]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 3f0de98)
CUDA: Replace init_offsets kernel with iterators in cub-based argsort (llama/18930)
authorOliver Simons <redacted>
Tue, 20 Jan 2026 12:11:01 +0000 (13:11 +0100)
committerGeorgi Gerganov <redacted>
Fri, 30 Jan 2026 11:49:29 +0000 (13:49 +0200)
commit831fdb7f95f38d4cac5529c2a3c138bec00e8058
tree7a0679b861421209c604f33107e2c12b84446dcdtree
parent3f0de985a620c7473f45edd5aa87977039df7053commit | diff
CUDA: Replace init_offsets kernel with iterators in cub-based argsort (llama/18930)

* CUDA: Replace `init_offsets` with iterators in argsort

This is a QOL improvement, saving us the cost of materializing the
iterator

* Remove unnecessary include from top-k.cu
src/ggml-cuda/argsort.cu diff | blob | history
src/ggml-cuda/top-k.cu diff | blob | history
Packaging of ggml-org/ggml