]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
CUDA: Various fixes to `cpy.cu` (llama/25000)
authorOliver Simons <redacted>
Thu, 25 Jun 2026 15:29:23 +0000 (17:29 +0200)
committerGeorgi Gerganov <redacted>
Fri, 26 Jun 2026 13:03:57 +0000 (16:03 +0300)
commit9cad7959184f9bbc4ec4de7aece7d2ac6488fd68
tree8d6d4a38908ec9754be425d2bbea85ab48c65750
parent82686b518fd829c321f9207a52c5d40ac2c17a09
CUDA: Various fixes to `cpy.cu` (llama/25000)

* Add failing test-case to test-backend-ops

Extracted from https://github.com/ggml-org/llama.cpp/issues/24072

* Minimize repro with help of AI

N = 8 * (65535 - 1) + 1 = 524273

* Port and adjust workaround from https://github.com/LostRuins/koboldcpp/commit/0ba798341e0c70517cb226cb63c966b086a3b5b3

Fall-back should share code, also relax y-z constraint to be inclusive

* Add test-case + fallback also for y dim

* Fix x-guards which is 2^{31}-1, so inlusive of INT_MAX

* Fix overflow problems for transposed copy kernel
ggml/src/ggml-cuda/cpy.cu