]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
ggml webgpu: shader library organization (llama/19530)
authorReese Levine <redacted>
Wed, 25 Feb 2026 07:33:32 +0000 (09:33 +0200)
committerGeorgi Gerganov <redacted>
Fri, 27 Feb 2026 18:57:58 +0000 (20:57 +0200)
commitfc7a78f4d8662f8d970629622f8a4f15bd90719b
treed99d77d2a328b89b6994a4aa59df96ef0e260d5f
parentf1da0a26f5adefd33a5d5b88ebfc9350ec2afa67
ggml webgpu: shader library organization (llama/19530)

* Basic JIT compilation for mul_mat, get_rows, and scale (ggml/17)

* scale jit working

* preliminary working jit for getrows and mulmat, needs refining

* simplified mul_mat preprocessing switch statement

* get_rows fixes, mul_mat refinement

* formatted + last edits

* removed some extraneous prints

* fixed get_rows, fixed workgroup dispatch in mul_mat. no gibberish

* small fix

* some changes, working

* get_rows and mul_mat jit fixed and working

* Update formatting

* formatting

* Add header

---------

Co-authored-by: Neha Abbas <redacted>
Co-authored-by: Reese Levine <redacted>
* Start work on all-encompassing shader library

* refactor argmax, set_rows

* Refactor all but flashattention, mat mul

* flashattention and matrix multiplication moved to new format

* clean up preprocessing

* Formatting

* remove duplicate constants

* Split large shaders into multiple static strings

---------

Co-authored-by: neha-ha <redacted>
17 files changed:
ggml/src/ggml-webgpu/ggml-webgpu-shader-lib.hpp
ggml/src/ggml-webgpu/ggml-webgpu.cpp
ggml/src/ggml-webgpu/wgsl-shaders/common_decls.tmpl
ggml/src/ggml-webgpu/wgsl-shaders/embed_wgsl.py
ggml/src/ggml-webgpu/wgsl-shaders/get_rows.tmpl.wgsl [deleted file]
ggml/src/ggml-webgpu/wgsl-shaders/get_rows.wgsl [new file with mode: 0644]
ggml/src/ggml-webgpu/wgsl-shaders/mul_mat.tmpl.wgsl [deleted file]
ggml/src/ggml-webgpu/wgsl-shaders/mul_mat.wgsl [new file with mode: 0644]
ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_decls.tmpl
ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_reg_tile.tmpl.wgsl [deleted file]
ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_reg_tile.wgsl [new file with mode: 0644]
ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_subgroup_matrix.tmpl.wgsl [deleted file]
ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_subgroup_matrix.wgsl [new file with mode: 0644]
ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_vec.tmpl.wgsl [deleted file]
ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_vec.wgsl [new file with mode: 0644]
ggml/src/ggml-webgpu/wgsl-shaders/scale.tmpl.wgsl [deleted file]
ggml/src/ggml-webgpu/wgsl-shaders/scale.wgsl [new file with mode: 0644]