]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 028e983)
vulkan: fix mul_mat_vec failure in backend tests (llama/12529)
authorJeff Bolz <redacted>
Mon, 24 Mar 2025 06:56:17 +0000 (01:56 -0500)
committerGeorgi Gerganov <redacted>
Thu, 27 Mar 2025 07:35:24 +0000 (09:35 +0200)
commitdf3540e555edd471d3280974b5532771811f92a2
tree86aefc0f1a708e1e26690d4d18ce812e36d709d6tree
parent028e983bf432ad5e58dd24621cb9d5669f8cf6fbcommit | diff
vulkan: fix mul_mat_vec failure in backend tests (llama/12529)

The OOB calculation could be wrong if the last iteration was during one of
the unrolled loops. Adjust the unrolling counts to avoid this. Add a couple
new backend tests that hit this failure on NVIDIA GPUs.
src/ggml-vulkan/vulkan-shaders/mul_mat_vec.comp diff | blob | history
tests/test-backend-ops.cpp diff | blob | history
Packaging of ggml-org/ggml