]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
opencl: Noncontiguous `norm`, `rms_norm`, disable `fp16` for some ops (llama/12217)
authorlhez <redacted>
Fri, 7 Mar 2025 00:20:35 +0000 (16:20 -0800)
committerGeorgi Gerganov <redacted>
Sat, 8 Mar 2025 13:13:01 +0000 (15:13 +0200)
commita34cb73dc28068d6c5b58c5e209dd26c8eac1e0a
treeb754148b2e2f0f6b397ab678556b4ee2fb470f06
parent82f949665706d7ac8c92f16aeb85890059927c8e
opencl: Noncontiguous `norm`, `rms_norm`, disable `fp16` for some ops (llama/12217)

* opencl: support noncontiguous `norm`

* opencl: support noncontiguous `rms_norm`

* opencl: disable fp16 for `ADD`, `MUL`, `SCALE`, `RELU`, `GELU`, `SILU`, `CLAMP`
ggml/src/ggml-opencl/ggml-opencl.cpp
ggml/src/ggml-opencl/kernels/ggml-opencl.cl