]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
ggml-webgpu: improve i-quants mul_mat performance and speed up prefill (llama/24530)
authorMasashi Yoshimura <redacted>
Mon, 15 Jun 2026 01:15:30 +0000 (10:15 +0900)
committerGeorgi Gerganov <redacted>
Fri, 19 Jun 2026 09:53:43 +0000 (12:53 +0300)
commit3e0b9175143bc9d1685742e24a565925ba87e63f
tree7f58956b67d124b455fa7fe4b603d67ae31f41af
parent1216e0957bc060bff1012b91acab590d7d2b37d9
ggml-webgpu: improve i-quants mul_mat performance and speed up prefill (llama/24530)

* Improve prefill speeds for i-quants

* Fix #if defined() usage in preprocessor guards.
ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_decls.tmpl