]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
opencl: Fix rope and softmax (llama/11833)
authorlhez <redacted>
Fri, 14 Feb 2025 19:12:23 +0000 (11:12 -0800)
committerGeorgi Gerganov <redacted>
Tue, 25 Feb 2025 11:33:09 +0000 (13:33 +0200)
commit4adf33705cd657bb4976dc01726ca69b62d281f7
tree999673571147873d8fc5cbb1a4ca92d8c5dcaa94
parent7e3b016311d8358782910bd100c8079303495c14
opencl: Fix rope and softmax (llama/11833)

* opencl: fix `ROPE`

* opencl: fix `SOFT_MAX`

* Add fp16 variant

* opencl: enforce subgroup size for `soft_max`
src/ggml-opencl/ggml-opencl.cpp
src/ggml-opencl/kernels/ggml-opencl.cl