]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
ggml webgpu: minor set rows optimization (llama/16810)
authorReese Levine <redacted>
Sun, 9 Nov 2025 12:44:39 +0000 (14:44 +0200)
committerGeorgi Gerganov <redacted>
Sun, 9 Nov 2025 21:38:03 +0000 (23:38 +0200)
commite734b5d6ef6ff99f4cc48daab2e082d92ef25a24
tree3f1ca281ff573298d7355211b059a29fd870b4ad
parent44e77ccee6c98a61cbfcc6ca6ecb8b43ea45025c
ggml webgpu: minor set rows optimization (llama/16810)

* Add buffer label and enable dawn-specific toggles to turn off some checks

* Minor set_rows optimization (ggml/4)

* updated optimization, fixed errors

* non vectorized version now dispatches one thread per element

* Simplify

* Change logic for set_rows pipelines

---------

Co-authored-by: Neha Abbas <redacted>
Co-authored-by: Neha Abbas <redacted>
Co-authored-by: Reese Levine <redacted>
* Comment on dawn toggles

* Remove some comments

* Implement overlap binary operators

* Revert "Implement overlap binary operators"

This reverts commit ed710b36f51ab3f53fa13db15c1685dc8678a32a.

* Disable support for non-contiguous binary_op tensors and leave note for future support

---------

Co-authored-by: neha-ha <redacted>
Co-authored-by: Neha Abbas <redacted>
Co-authored-by: Neha Abbas <redacted>
ggml/src/ggml-webgpu/ggml-webgpu.cpp
ggml/src/ggml-webgpu/wgsl-shaders/set_rows.tmpl.wgsl [new file with mode: 0644]