]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
ggml-cuda: add mem check for fusion (#19916)
authorAman Gupta <redacted>
Fri, 6 Mar 2026 16:05:43 +0000 (00:05 +0800)
committerGitHub <redacted>
Fri, 6 Mar 2026 16:05:43 +0000 (00:05 +0800)
commitd48e876467734ab9c4292340a32b52c92660111c
treeecb8b0145dfce8f764593a4bd742f3880a7de862
parentba2ff79e43bad81fd19ecc8324431c93499e459e
ggml-cuda: add mem check for fusion (#19916)

* ggml-cuda: add mem check for fusion

* Replace NaNs with -FLT_MAX

* fix typo

Co-authored-by: Johannes Gäßler <redacted>
---------

Co-authored-by: Johannes Gäßler <redacted>
ggml/src/ggml-cuda/ggml-cuda.cu
ggml/src/ggml-cuda/topk-moe.cu