]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
opencl: Noncontiguous `norm`, `rms_norm`, disable `fp16` for some ops (#12217)
authorlhez <redacted>
Fri, 7 Mar 2025 00:20:35 +0000 (16:20 -0800)
committerGitHub <redacted>
Fri, 7 Mar 2025 00:20:35 +0000 (00:20 +0000)
commitd76a86d967ef491d530400b08bc8ef8a14807936
tree4fae18fbd90ba6353e6e2955d550f0c852881bbe
parent776f9e59cc8a85e840d1d4af8540d199c77190ac
opencl: Noncontiguous `norm`, `rms_norm`, disable `fp16` for some ops (#12217)

* opencl: support noncontiguous `norm`

* opencl: support noncontiguous `rms_norm`

* opencl: disable fp16 for `ADD`, `MUL`, `SCALE`, `RELU`, `GELU`, `SILU`, `CLAMP`
ggml/src/ggml-opencl/ggml-opencl.cpp
ggml/src/ggml-opencl/kernels/ggml-opencl.cl