]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
vulkan: only use M-sized matmul on Apple GPUs (llama/5412)
authorSergio López <redacted>
Sun, 11 Feb 2024 14:12:00 +0000 (15:12 +0100)
committerGeorgi Gerganov <redacted>
Mon, 12 Feb 2024 07:25:26 +0000 (09:25 +0200)
commitadc3925de2d3f015c07e82d0f77097e3e3795489
tree7dc125c3c7089b157f286810b77624f8262899f5
parent1a781c5a53bc7dbdda3a787a984b4b3c4bc182b0
vulkan: only use M-sized matmul on Apple GPUs (llama/5412)

* vulkan: refactor guess_matmul_pipeline for vendor

Refactor ggml_vk_guess_matmul_pipeline to simplify adding per-vendor
conditionals.

Signed-off-by: Sergio Lopez <redacted>
* vulkan: only use M-sized matmul on Apple GPUs

L-sized and S-sized matmuls are broken on Apple GPUs, force using
M-size with this vendor.

Signed-off-by: Sergio Lopez <redacted>
---------

Signed-off-by: Sergio Lopez <redacted>
src/ggml-vulkan.cpp