]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
vulkan: fix mul_mat_vec failure in backend tests (llama/12529)
authorJeff Bolz <redacted>
Mon, 24 Mar 2025 06:56:17 +0000 (01:56 -0500)
committerGeorgi Gerganov <redacted>
Thu, 27 Mar 2025 09:06:03 +0000 (11:06 +0200)
commita2cc8c2666e34022517c67bd3baaa0c9d8ed68dc
treeed42783ae8b67eba500f1adeafad6d86b41c0163
parent388ed98220d68faaacdc102d4eeb97e540825a3c
vulkan: fix mul_mat_vec failure in backend tests (llama/12529)

The OOB calculation could be wrong if the last iteration was during one of
the unrolled loops. Adjust the unrolling counts to avoid this. Add a couple
new backend tests that hit this failure on NVIDIA GPUs.
ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec.comp