]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
opencl: Fix rope and softmax (#11833)
authorlhez <redacted>
Fri, 14 Feb 2025 19:12:23 +0000 (11:12 -0800)
committerGitHub <redacted>
Fri, 14 Feb 2025 19:12:23 +0000 (12:12 -0700)
commit300907b2110cc17b4337334dc397e05de2d8f5e0
treedba593da25ec0fbb4b06b03e5288071d40855eca
parent94b87f87b502d2ab6c8b28d2b5935cf008ca1505
opencl: Fix rope and softmax (#11833)

* opencl: fix `ROPE`

* opencl: fix `SOFT_MAX`

* Add fp16 variant

* opencl: enforce subgroup size for `soft_max`
ggml/src/ggml-opencl/ggml-opencl.cpp
ggml/src/ggml-opencl/kernels/ggml-opencl.cl