]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
vulkan: only use M-sized matmul on Apple GPUs (llama/5412)
authorSergio López <redacted>
Sun, 11 Feb 2024 14:12:00 +0000 (15:12 +0100)
committerGeorgi Gerganov <redacted>
Mon, 12 Feb 2024 07:31:12 +0000 (09:31 +0200)
commit04839bae2296ef9138c37beda2f0a1647111e6e4
tree0e94fcca666c158e792403f50f289e7cf783c691
parent3cc6e04a5202753948b4ce4775cd250eb8e27314
vulkan: only use M-sized matmul on Apple GPUs (llama/5412)

* vulkan: refactor guess_matmul_pipeline for vendor

Refactor ggml_vk_guess_matmul_pipeline to simplify adding per-vendor
conditionals.

Signed-off-by: Sergio Lopez <redacted>
* vulkan: only use M-sized matmul on Apple GPUs

L-sized and S-sized matmuls are broken on Apple GPUs, force using
M-size with this vendor.

Signed-off-by: Sergio Lopez <redacted>
---------

Signed-off-by: Sergio Lopez <redacted>
ggml-vulkan.cpp