]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
CUDA: Various fixes to `cpy.cu` (#25000)
authorOliver Simons <redacted>
Thu, 25 Jun 2026 15:29:23 +0000 (17:29 +0200)
committerGitHub <redacted>
Thu, 25 Jun 2026 15:29:23 +0000 (17:29 +0200)
commit1ec44d178dcfc0ce6a61f357ccbde914821e1ae0
treec4fa8f2f1e0b49120746ece624bd7e0f068b570e
parentc7cddefcbde2ccf1829c55ea57bbee92316c294a
CUDA: Various fixes to `cpy.cu` (#25000)

* Add failing test-case to test-backend-ops

Extracted from https://github.com/ggml-org/llama.cpp/issues/24072

* Minimize repro with help of AI

N = 8 * (65535 - 1) + 1 = 524273

* Port and adjust workaround from https://github.com/LostRuins/koboldcpp/commit/0ba798341e0c70517cb226cb63c966b086a3b5b3

Fall-back should share code, also relax y-z constraint to be inclusive

* Add test-case + fallback also for y dim

* Fix x-guards which is 2^{31}-1, so inlusive of INT_MAX

* Fix overflow problems for transposed copy kernel
ggml/src/ggml-cuda/cpy.cu
tests/test-backend-ops.cpp