]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
vulkan: fix noncontig check for mat_mul_id splitting (llama/14683)
authorJeff Bolz <redacted>
Tue, 15 Jul 2025 19:51:09 +0000 (14:51 -0500)
committerGeorgi Gerganov <redacted>
Sat, 19 Jul 2025 14:47:23 +0000 (17:47 +0300)
commit43268088fe354eb63498ec6c946deb471c6e55c2
tree383aa634fe598359d93414f34adefbe9fc646070
parent84c18d5389ed919bbc68158bc4521d0051df1448
vulkan: fix noncontig check for mat_mul_id splitting (llama/14683)

* vulkan: fix noncontig check for mat_mul_id splitting

Remove supports_op check for > 4096 (splitting fixes this)

* vulkan: fix batched matmul dequant for Q*_K
src/ggml-vulkan/ggml-vulkan.cpp
src/ggml-vulkan/vulkan-shaders/dequant_q2_k.comp
src/ggml-vulkan/vulkan-shaders/dequant_q3_k.comp
src/ggml-vulkan/vulkan-shaders/dequant_q4_k.comp
src/ggml-vulkan/vulkan-shaders/dequant_q5_k.comp
src/ggml-vulkan/vulkan-shaders/dequant_q6_k.comp