]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
cuda: reserve space for quantize kv-cache at startup (llama/23907)
authorAman Gupta <redacted>
Wed, 3 Jun 2026 10:39:59 +0000 (18:39 +0800)
committerGeorgi Gerganov <redacted>
Mon, 8 Jun 2026 11:36:36 +0000 (14:36 +0300)
commitd5a49ebec8445172aa73d36c3cefb0586e7ce1ab
treef64e7224705472c4a2814d6a3fdee480a012cecc
parentf110ff540c06ba74a9f26c9964eb21c1edf846b1
cuda: reserve space for quantize kv-cache at startup (llama/23907)

* cuda: reserve space for quantize kv-cache at startup

* address review comments

* remove forward decl

Co-authored-by: Johannes Gäßler <redacted>
* remove assert in ggml-cuda.cu

Co-authored-by: Johannes Gäßler <redacted>
---------

Co-authored-by: Johannes Gäßler <redacted>
ggml/src/ggml-cuda/fattn-common.cuh
ggml/src/ggml-cuda/fattn.cu
ggml/src/ggml-cuda/fattn.cuh
ggml/src/ggml-cuda/ggml-cuda.cu