]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: e6d65fb)
vulkan: handle mat_mul with A matrix > 4GB (#16176)
authorJeff Bolz <redacted>
Sun, 28 Sep 2025 01:36:34 +0000 (20:36 -0500)
committerGitHub <redacted>
Sun, 28 Sep 2025 01:36:34 +0000 (20:36 -0500)
commit1384abf8b8d5894d32fada453ccf4d196ffba7de
tree27a41d88e57cc5b575264e07728af3425bc1b541tree
parente6d65fb02d553bd79cad94e517cdca18b687788dcommit | diff
vulkan: handle mat_mul with A matrix > 4GB (#16176)

* vulkan: handle mat_mul with A matrix > 4GB

This change splits mat_mul operations with huge A matrix into chunks in the M
dimension. This works well for stable-diffusion use cases where the im2col
matrix has very large M.

Fix the order of setting the stride in mul_mm_cm2 - setting the dimension
clobbers the stride, so stride should be set after.

* build fixes
ggml/src/ggml-vulkan/ggml-vulkan.cpp diff | blob | history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm_cm2.comp diff | blob | history
tests/test-backend-ops.cpp diff | blob | history
Packaging of ggml-org/llama.cpp