]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
opencl: Fix rope and softmax (llama/11833)
authorlhez <redacted>
Fri, 14 Feb 2025 19:12:23 +0000 (11:12 -0800)
committerGeorgi Gerganov <redacted>
Thu, 27 Feb 2025 06:55:36 +0000 (08:55 +0200)
commit4b48fe449ad02f543ed39bd9b1be70c985f3bf62
treee285aa8ae976cb3ea038e561d025dfbd81d7816f
parent47cc043e69e0493a74336b2383603479dcbf2ea5
opencl: Fix rope and softmax (llama/11833)

* opencl: fix `ROPE`

* opencl: fix `SOFT_MAX`

* Add fp16 variant

* opencl: enforce subgroup size for `soft_max`
ggml/src/ggml-opencl/ggml-opencl.cpp
ggml/src/ggml-opencl/kernels/ggml-opencl.cl