]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 83deda3)
opencl: add fastdiv and use it in set_rows, ported from cuda (llama/17090)
authorlhez <redacted>
Mon, 10 Nov 2025 23:00:13 +0000 (15:00 -0800)
committerGeorgi Gerganov <redacted>
Mon, 17 Nov 2025 13:34:43 +0000 (15:34 +0200)
commit68559d6deb00e2fc419ec8dbdc32dd647494911d
treec2236f21f33a6add74a7da41becb4da0d5e12955tree
parent83deda3f617459f6f230d8af6a77d2773e58fc36commit | diff
opencl: add fastdiv and use it in set_rows, ported from cuda (llama/17090)

* opencl: add fastdiv for mm q8_0

* opencl: use uint4 for fastdiv vals

* opencl: use fastdiv for set_rows

* opencl: do not use fastdiv for q8_0 mm
src/ggml-opencl/ggml-opencl.cpp diff | blob | history
src/ggml-opencl/kernels/set_rows.cl diff | blob | history
Packaging of ggml-org/ggml