]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
ggml-cuda: add mem check for fusion (llama/19916)
authorAman Gupta <redacted>
Fri, 6 Mar 2026 16:05:43 +0000 (00:05 +0800)
committerGeorgi Gerganov <redacted>
Mon, 16 Mar 2026 11:10:15 +0000 (13:10 +0200)
commitd658720fa5221182009a79f8a29eb73fb8b814e4
tree1a8061ea4274d7c20cc33da9dbd306e7196cdf7e
parent5d9b73dc066bfaa2987bc62e0f1faf7b24cfe6e9
ggml-cuda: add mem check for fusion (llama/19916)

* ggml-cuda: add mem check for fusion

* Replace NaNs with -FLT_MAX

* fix typo

Co-authored-by: Johannes Gäßler <redacted>
---------

Co-authored-by: Johannes Gäßler <redacted>
ggml/src/ggml-cuda/ggml-cuda.cu
ggml/src/ggml-cuda/topk-moe.cu