]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
llama : optimize defrag moves + fix fragmentation calculation (#6037)
authorMichael Podvitskiy <redacted>
Thu, 14 Mar 2024 10:56:48 +0000 (11:56 +0100)
committerGitHub <redacted>
Thu, 14 Mar 2024 10:56:48 +0000 (12:56 +0200)
commit2c4fb69246834503db7b78bcbedcef506bbc60c4
tree289f7fbc82f62fd71225efb0a92bceb0b904cf3a
parent3ca23481dd309bd51cc31c73a4cc34f922cc372f
llama : optimize defrag moves + fix fragmentation calculation (#6037)

* attempt to reduce the impact of a worst-case scenario

* fragmentation calculation fix

* Update llama.cpp

---------

Co-authored-by: Georgi Gerganov <redacted>
llama.cpp