]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
overview / pkg / ggml / sources / whisper.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: eb982dd)
vulkan: handle mat_mul with A matrix > 4GB (llama/16176)
authorJeff Bolz <redacted>
Sun, 28 Sep 2025 01:36:34 +0000 (20:36 -0500)
committerGeorgi Gerganov <redacted>
Mon, 29 Sep 2025 12:18:12 +0000 (15:18 +0300)
commit91ab93b75645e693716447dda4ba3c83c3e82bf6
treec365cd66ddec8d386427bc81cc85dafe00566194tree
parenteb982dd786f5be809dbde762eb54f74d52f070d0commit | diff
vulkan: handle mat_mul with A matrix > 4GB (llama/16176)

* vulkan: handle mat_mul with A matrix > 4GB

This change splits mat_mul operations with huge A matrix into chunks in the M
dimension. This works well for stable-diffusion use cases where the im2col
matrix has very large M.

Fix the order of setting the stride in mul_mm_cm2 - setting the dimension
clobbers the stride, so stride should be set after.

* build fixes
ggml/src/ggml-vulkan/ggml-vulkan.cpp diff | blob | history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm_cm2.comp diff | blob | history
Packaging of ggerganov/whisper.cpp