git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit

overview / pkg / ggml / sources / whisper.cpp / commit

author	Ruben Ortlam <redacted>
	Wed, 29 Oct 2025 13:39:03 +0000 (14:39 +0100)
committer	Georgi Gerganov <redacted>
	Sun, 9 Nov 2025 21:38:03 +0000 (23:38 +0200)
commit	bc944bddc81ce3a262f531192c8e604fdd97fe61
tree	012bdbfc048a56d109d7799e958b6ad08cdbe8aa	tree
parent	4d74160c9a4da02d8eca45f922797b8032fb150d	commit \| diff

Vulkan MMQ Integer Dot Refactor and K-Quant support (llama/16536)

* vulkan: add mmq q2_k integer dot support

* Refactor mmq caching

* Reduce mmq register use

* Load 4 quant blocks into shared memory in one step

* Pack q2_k blocks into caches of 32

* Use 32-bit accumulators for integer dot matmul

* Add q4_k mmq

* Add q3_k mmq

* Add q5_k mmq

* Add q6_k mmq

* Add mxfp4 mmq, enable MMQ MUL_MAT_ID

* Fix mmv dm loads

18 files changed:

ggml/src/ggml-vulkan/ggml-vulkan.cpp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/dequant_funcs.glsl		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/dequant_funcs_cm2.glsl		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/dequant_mxfp4.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/dequant_q2_k.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/dequant_q4_k.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/dequant_q5_k.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_q2_k.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_q4_k.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_q5_k.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm_funcs.glsl		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm_id_funcs.glsl	[new file with mode: 0644]	blob
ggml/src/ggml-vulkan/vulkan-shaders/mul_mmq.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mmq_funcs.glsl		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mmq_shmem_types.glsl	[new file with mode: 0644]	blob
ggml/src/ggml-vulkan/vulkan-shaders/types.glsl		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp		diff \| blob \| history

Packaging of ggerganov/whisper.cpp

RSS Atom