]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
overview / pkg / ggml / sources / whisper.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 54e5095)
Update CUDA graph on scale change plus clear nodes/params (llama/9550)
authoragray3 <redacted>
Sat, 21 Sep 2024 00:41:07 +0000 (01:41 +0100)
committerGeorgi Gerganov <redacted>
Tue, 24 Sep 2024 16:45:08 +0000 (19:45 +0300)
commitf0a7d65b3d7bcbd7868823ab45fb7d7de7109e3a
tree199fb95a0b70cc4fc7be1c70cbc47c7e20f1e947tree
parent54e50957658fd9f26408a237dea0bc828b91fe0ccommit | diff
Update CUDA graph on scale change plus clear nodes/params (llama/9550)

* Avoid using saved CUDA graph if scale changes and reset nodes/params on update

Fixes https://github.com/ggerganov/llama.cpp/issues/9451

* clear before resize
ggml/src/ggml-cuda.cu diff | blob | history
ggml/src/ggml-cuda/common.cuh diff | blob | history
Packaging of ggerganov/whisper.cpp