]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
vulkan: fix noncontig check for mat_mul_id splitting (llama/14683)
authorJeff Bolz <redacted>
Tue, 15 Jul 2025 19:51:09 +0000 (14:51 -0500)
committerGeorgi Gerganov <redacted>
Sat, 19 Jul 2025 21:23:50 +0000 (00:23 +0300)
commit8d1a0485f1a31ec1530700963053387c8c9569e1
tree66cc7a327b0d93f981ba5570eaa354506260eb6a
parentb33841c453f3c7b14db36d4831ce0682328c140c
vulkan: fix noncontig check for mat_mul_id splitting (llama/14683)

* vulkan: fix noncontig check for mat_mul_id splitting

Remove supports_op check for > 4096 (splitting fixes this)

* vulkan: fix batched matmul dequant for Q*_K
ggml/src/ggml-vulkan/ggml-vulkan.cpp
ggml/src/ggml-vulkan/vulkan-shaders/dequant_q2_k.comp
ggml/src/ggml-vulkan/vulkan-shaders/dequant_q3_k.comp
ggml/src/ggml-vulkan/vulkan-shaders/dequant_q4_k.comp
ggml/src/ggml-vulkan/vulkan-shaders/dequant_q5_k.comp
ggml/src/ggml-vulkan/vulkan-shaders/dequant_q6_k.comp