]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
opencl: add fastdiv and use it in set_rows, ported from cuda (#17090)
authorlhez <redacted>
Mon, 10 Nov 2025 23:00:13 +0000 (15:00 -0800)
committerGitHub <redacted>
Mon, 10 Nov 2025 23:00:13 +0000 (15:00 -0800)
commitece0f5c1771f1835e66900d4168233f0430d819d
treeba891dd6a4a1698192d8ae24717fea54d9a0038f
parent7bef684118cc44f9ab8b82df102d68db94a6d9f4
opencl: add fastdiv and use it in set_rows, ported from cuda (#17090)

* opencl: add fastdiv for mm q8_0

* opencl: use uint4 for fastdiv vals

* opencl: use fastdiv for set_rows

* opencl: do not use fastdiv for q8_0 mm
ggml/src/ggml-opencl/ggml-opencl.cpp
ggml/src/ggml-opencl/kernels/set_rows.cl