]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
ggml webgpu: add support for soft_max, optimize rms_norm (llama/16357)
authorReese Levine <redacted>
Thu, 2 Oct 2025 18:00:31 +0000 (11:00 -0700)
committerGeorgi Gerganov <redacted>
Sun, 12 Oct 2025 08:16:23 +0000 (11:16 +0300)
commit27ebde6afdf596768b12756a02a4e9d35f9c5cb0
treea03754d76b9e5e15c2a86690a615e876955eb65c
parent33ca8355c43b3f4f46d207f32908588a33e54724
ggml webgpu: add support for soft_max, optimize rms_norm (llama/16357)

* Add inplace softmax

* Move rms_norm to split row approach

* Update debug for supports_op

* clean up debug statements

* Update tests/test-backend-ops.cpp

Co-authored-by: Georgi Gerganov <redacted>
---------

Co-authored-by: Georgi Gerganov <redacted>
ggml/include/ggml.h
ggml/src/ggml-webgpu/ggml-webgpu.cpp
ggml/src/ggml-webgpu/wgsl-shaders/rms_norm.wgsl
ggml/src/ggml-webgpu/wgsl-shaders/soft_max.tmpl.wgsl [new file with mode: 0644]
ggml/src/ggml.c