]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
CUDA: Replace init_offsets kernel with iterators in cub-based argsort (llama/18930)
authorOliver Simons <redacted>
Tue, 20 Jan 2026 12:11:01 +0000 (13:11 +0100)
committerGeorgi Gerganov <redacted>
Fri, 30 Jan 2026 13:56:40 +0000 (15:56 +0200)
commitfdc83ee3c0367e26ffc7b00edbed75d5189df8ce
tree643a833636ef0ec5b69575ef7857ab5562ccfc37
parentbf71ffa6b34a04d18b5f0b5489206171f16e9790
CUDA: Replace init_offsets kernel with iterators in cub-based argsort (llama/18930)

* CUDA: Replace `init_offsets` with iterators in argsort

This is a QOL improvement, saving us the cost of materializing the
iterator

* Remove unnecessary include from top-k.cu
ggml/src/ggml-cuda/argsort.cu
ggml/src/ggml-cuda/top-k.cu