]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
opencl: add fused `rms_norm_mul` (llama/14841)
authorlhez <redacted>
Fri, 25 Jul 2025 15:12:13 +0000 (08:12 -0700)
committerGeorgi Gerganov <redacted>
Mon, 28 Jul 2025 10:02:32 +0000 (13:02 +0300)
commitd414c3f6acec1a72074228088501b3953a76a1a0
treef8264ea39c1e9a490048bb4ea9205ee52be011cf
parentbbf2389919a950988cc2b7a084a9e0009852483a
opencl: add fused `rms_norm_mul` (llama/14841)

* opencl: add fused `rms_norm` + `mul`

* opencl: improve workgroup size for `rms_norm_mul`
ggml/src/ggml-opencl/ggml-opencl.cpp
ggml/src/ggml-opencl/kernels/rms_norm.cl