]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
ggml webgpu: support for rope,div,sub,glu,scale,cont operators (llama/16187)
authorReese Levine <redacted>
Tue, 30 Sep 2025 16:57:51 +0000 (09:57 -0700)
committerGeorgi Gerganov <redacted>
Sun, 12 Oct 2025 04:57:25 +0000 (07:57 +0300)
commitd31cca00f4c352475f0e85d735fd909595494aed
tree67e6b2b1d158e0df5d8608c4d40b376c40b9aa56
parent53a894caf2fbacfabc2abd0b14f00ca35eaf5cb9
ggml webgpu: support for rope,div,sub,glu,scale,cont operators (llama/16187)

* Work on rope

* Simplify inplace operation generation and combine mul/add generation

* Work on rope variants

* implement neox rope

* rope complete

* Add sub,div,glu operators

* implement scale op

* Update cpy shader to handle cont/more types

* formatting

* Update test vars printing for rope,rms_norm

* Avoid ROPE hardcoded constants

* Add TODO to change ROPE constants to enum

Co-authored-by: Georgi Gerganov <redacted>
* fix TODO comment

---------

Co-authored-by: Georgi Gerganov <redacted>
17 files changed:
include/ggml.h
src/ggml-webgpu/ggml-webgpu.cpp
src/ggml-webgpu/wgsl-shaders/add.tmpl.wgsl [deleted file]
src/ggml-webgpu/wgsl-shaders/add_in_place.tmpl.wgsl [deleted file]
src/ggml-webgpu/wgsl-shaders/bin_op.tmpl.wgsl [new file with mode: 0644]
src/ggml-webgpu/wgsl-shaders/cpy.tmpl.wgsl [new file with mode: 0644]
src/ggml-webgpu/wgsl-shaders/cpy.wgsl [deleted file]
src/ggml-webgpu/wgsl-shaders/embed_wgsl.py
src/ggml-webgpu/wgsl-shaders/get_rows.tmpl.wgsl
src/ggml-webgpu/wgsl-shaders/glu.tmpl.wgsl [new file with mode: 0644]
src/ggml-webgpu/wgsl-shaders/mul.tmpl.wgsl [deleted file]
src/ggml-webgpu/wgsl-shaders/mul_in_place.tmpl.wgsl [deleted file]
src/ggml-webgpu/wgsl-shaders/rms_norm.wgsl
src/ggml-webgpu/wgsl-shaders/rms_norm_in_place.wgsl [deleted file]
src/ggml-webgpu/wgsl-shaders/rope.tmpl.wgsl [new file with mode: 0644]
src/ggml-webgpu/wgsl-shaders/scale.tmpl.wgsl [new file with mode: 0644]
tests/test-backend-ops.cpp