]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
vulkan: fix noncontig check for mat_mul_id splitting (#14683)
authorJeff Bolz <redacted>
Tue, 15 Jul 2025 19:51:09 +0000 (14:51 -0500)
committerGitHub <redacted>
Tue, 15 Jul 2025 19:51:09 +0000 (21:51 +0200)
commitba1ceb34566c889a1fc500efa79799ffed25d9b0
treee00ebe7f04595a2dab52fbb05a5058db7c421051
parent10a0351a97c25471aea0bbde9cca54d32d163eec
vulkan: fix noncontig check for mat_mul_id splitting (#14683)

* vulkan: fix noncontig check for mat_mul_id splitting

Remove supports_op check for > 4096 (splitting fixes this)

* vulkan: fix batched matmul dequant for Q*_K
ggml/src/ggml-vulkan/ggml-vulkan.cpp
ggml/src/ggml-vulkan/vulkan-shaders/dequant_q2_k.comp
ggml/src/ggml-vulkan/vulkan-shaders/dequant_q3_k.comp
ggml/src/ggml-vulkan/vulkan-shaders/dequant_q4_k.comp
ggml/src/ggml-vulkan/vulkan-shaders/dequant_q5_k.comp
ggml/src/ggml-vulkan/vulkan-shaders/dequant_q6_k.comp