git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

overview / pkg / ggml / sources / llama.cpp / commit

author	Jeff Bolz <redacted>
	Fri, 26 Dec 2025 22:12:58 +0000 (16:12 -0600)
committer	GitHub <redacted>
	Fri, 26 Dec 2025 22:12:58 +0000 (16:12 -0600)
commit	c9ced4910ba0c8d95565950ac11bcc54fee309cd
tree	c9a3958eb8a293413152d1f59f09f3fe43aadc0f	tree
parent	7ac8902133da6eb390c4d8368a7d252279123942	commit \| diff

vulkan: preprocess mul_mat_id experts and discard workgroups more quickly (#18352)

Run a preprocess to count how many times each expert is used, and use this to
quickly discard workgroups that aren't needed.

Packaging of ggml-org/llama.cpp

RSS Atom

ggml/src/ggml-vulkan/ggml-vulkan.cpp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/count_experts.comp	[new file with mode: 0644]	blob
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm_cm2.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm_id_funcs.glsl		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mmq.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp		diff \| blob \| history