]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
vulkan: only use M-sized matmul on Apple GPUs (#5412)
authorSergio López <redacted>
Sun, 11 Feb 2024 14:12:00 +0000 (15:12 +0100)
committerGitHub <redacted>
Sun, 11 Feb 2024 14:12:00 +0000 (15:12 +0100)
commitc88c74f967028ae3d5ebade40ae586d20a961abc
treeafe4a9a029be0a71dbe73222270081430ea33055
parenta803333a4e6fc534c93afe90d741bc2388bdec87
vulkan: only use M-sized matmul on Apple GPUs (#5412)

* vulkan: refactor guess_matmul_pipeline for vendor

Refactor ggml_vk_guess_matmul_pipeline to simplify adding per-vendor
conditionals.

Signed-off-by: Sergio Lopez <redacted>
* vulkan: only use M-sized matmul on Apple GPUs

L-sized and S-sized matmuls are broken on Apple GPUs, force using
M-size with this vendor.

Signed-off-by: Sergio Lopez <redacted>
---------

Signed-off-by: Sergio Lopez <redacted>
ggml-vulkan.cpp