]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
Allow number of nodes in CUDA graph to change (llama/7738)
authoragray3 <redacted>
Tue, 4 Jun 2024 20:06:49 +0000 (21:06 +0100)
committerGeorgi Gerganov <redacted>
Sat, 15 Jun 2024 19:05:47 +0000 (22:05 +0300)
commita524d3f0ca02c83f40a36b514e902260190d53b0
tree2f9689cc6071de7b6798d0f422b603021135980b
parent9b053468ebc0f64705ca66224b7e6c67b5dfd0df
Allow number of nodes in CUDA graph to change (llama/7738)

Previously the code would have failed to cope in the case that the
number of nodes changes in an existing CUDA graph. This fixes the
issue by removing an unnecessary conditional.
src/ggml-cuda.cu