]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
opencl: add fused `rms_norm_mul` (llama/14841)
authorlhez <redacted>
Fri, 25 Jul 2025 15:12:13 +0000 (08:12 -0700)
committerGeorgi Gerganov <redacted>
Mon, 28 Jul 2025 05:43:21 +0000 (08:43 +0300)
commit12b8cfef181de3e5eeb34105f173e4767117850f
treea0d94c6781286a6012d0364f46eb84777fcfe662
parentcea24e0ea12f8695b50507cb991373b583b02d06
opencl: add fused `rms_norm_mul` (llama/14841)

* opencl: add fused `rms_norm` + `mul`

* opencl: improve workgroup size for `rms_norm_mul`
src/ggml-opencl/ggml-opencl.cpp
src/ggml-opencl/kernels/rms_norm.cl