]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
ggml webgpu: shader library organization (llama/19530)
authorReese Levine <redacted>
Wed, 25 Feb 2026 07:33:32 +0000 (09:33 +0200)
committerGeorgi Gerganov <redacted>
Wed, 25 Feb 2026 10:32:13 +0000 (12:32 +0200)
commitb9475cc92e0839df768df5cf2b61ef3108b96c50
treeecc69f2b51ae5e8f4850a505283ca757d60c689d
parent0174bc1aff9ff4abb5fa0551497f94d966b88f77
ggml webgpu: shader library organization (llama/19530)

* Basic JIT compilation for mul_mat, get_rows, and scale (#17)

* scale jit working

* preliminary working jit for getrows and mulmat, needs refining

* simplified mul_mat preprocessing switch statement

* get_rows fixes, mul_mat refinement

* formatted + last edits

* removed some extraneous prints

* fixed get_rows, fixed workgroup dispatch in mul_mat. no gibberish

* small fix

* some changes, working

* get_rows and mul_mat jit fixed and working

* Update formatting

* formatting

* Add header

---------

Co-authored-by: Neha Abbas <redacted>
Co-authored-by: Reese Levine <redacted>
* Start work on all-encompassing shader library

* refactor argmax, set_rows

* Refactor all but flashattention, mat mul

* flashattention and matrix multiplication moved to new format

* clean up preprocessing

* Formatting

* remove duplicate constants

* Split large shaders into multiple static strings

---------

Co-authored-by: neha-ha <redacted>
17 files changed:
src/ggml-webgpu/ggml-webgpu-shader-lib.hpp
src/ggml-webgpu/ggml-webgpu.cpp
src/ggml-webgpu/wgsl-shaders/common_decls.tmpl
src/ggml-webgpu/wgsl-shaders/embed_wgsl.py
src/ggml-webgpu/wgsl-shaders/get_rows.tmpl.wgsl [deleted file]
src/ggml-webgpu/wgsl-shaders/get_rows.wgsl [new file with mode: 0644]
src/ggml-webgpu/wgsl-shaders/mul_mat.tmpl.wgsl [deleted file]
src/ggml-webgpu/wgsl-shaders/mul_mat.wgsl [new file with mode: 0644]
src/ggml-webgpu/wgsl-shaders/mul_mat_decls.tmpl
src/ggml-webgpu/wgsl-shaders/mul_mat_reg_tile.tmpl.wgsl [deleted file]
src/ggml-webgpu/wgsl-shaders/mul_mat_reg_tile.wgsl [new file with mode: 0644]
src/ggml-webgpu/wgsl-shaders/mul_mat_subgroup_matrix.tmpl.wgsl [deleted file]
src/ggml-webgpu/wgsl-shaders/mul_mat_subgroup_matrix.wgsl [new file with mode: 0644]
src/ggml-webgpu/wgsl-shaders/mul_mat_vec.tmpl.wgsl [deleted file]
src/ggml-webgpu/wgsl-shaders/mul_mat_vec.wgsl [new file with mode: 0644]
src/ggml-webgpu/wgsl-shaders/scale.tmpl.wgsl [deleted file]
src/ggml-webgpu/wgsl-shaders/scale.wgsl [new file with mode: 0644]