git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit

overview / pkg / ggml / sources / whisper.cpp / commit

author	Jeff Bolz <redacted>
	Fri, 26 Dec 2025 22:12:58 +0000 (16:12 -0600)
committer	Georgi Gerganov <redacted>
	Wed, 31 Dec 2025 15:52:09 +0000 (17:52 +0200)
commit	015b618d966a862e217a46b939d794e9fd8bc549
tree	a6994de0d1b97f8b8e78b91db44da1989a0cb799	tree
parent	e37c8ed94ed0ef583de68c41e8d7cca764867093	commit \| diff

vulkan: preprocess mul_mat_id experts and discard workgroups more quickly (llama/18352)

Run a preprocess to count how many times each expert is used, and use this to
quickly discard workgroups that aren't needed.

Packaging of ggerganov/whisper.cpp

RSS Atom

ggml/src/ggml-vulkan/ggml-vulkan.cpp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/count_experts.comp	[new file with mode: 0644]	blob
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm_cm2.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm_id_funcs.glsl		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mmq.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp		diff \| blob \| history