]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: e92734d)
vulkan: optimize mul_mat_id loading row ids into shared memory (#15427)
authorJeff Bolz <redacted>
Sat, 23 Aug 2025 06:31:54 +0000 (01:31 -0500)
committerGitHub <redacted>
Sat, 23 Aug 2025 06:31:54 +0000 (08:31 +0200)
commit330c3d2d21b55bca5517db7d2eea2ea8f131df4a
tree34cc77dc952a0484d5fec383044836801557d4abtree
parente92734d51bcb82cc35f0a6b5a14928f0036b2c90commit | diff
vulkan: optimize mul_mat_id loading row ids into shared memory (#15427)

- Spread the work across the whole workgroup. Using more threads seems to
far outweigh the synchronization overhead.
- Specialize the code for when the division is by a power of two.
ggml/src/ggml-vulkan/ggml-vulkan.cpp diff | blob | history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm.comp diff | blob | history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm_cm2.comp diff | blob | history
Packaging of ggml-org/llama.cpp