]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
opencl: add fastdiv and use it in set_rows, ported from cuda (llama/17090)
authorlhez <redacted>
Mon, 10 Nov 2025 23:00:13 +0000 (15:00 -0800)
committerGeorgi Gerganov <redacted>
Mon, 17 Nov 2025 19:05:46 +0000 (21:05 +0200)
commit46615d74d34ddde3b312072af7f1e20d84ed50e9
tree13237d54f4a03fff5a59d0258fd2ef1d32ec79e2
parentccf525baf022ffa5bf0e53caaa5a833d8c8093d9
opencl: add fastdiv and use it in set_rows, ported from cuda (llama/17090)

* opencl: add fastdiv for mm q8_0

* opencl: use uint4 for fastdiv vals

* opencl: use fastdiv for set_rows

* opencl: do not use fastdiv for q8_0 mm
ggml/src/ggml-opencl/ggml-opencl.cpp
ggml/src/ggml-opencl/kernels/set_rows.cl