]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
llama : add abort_callback to interrupt computation (#5409)
authorMichael Podvitskiy <redacted>
Sat, 2 Mar 2024 19:52:25 +0000 (20:52 +0100)
committerGitHub <redacted>
Sat, 2 Mar 2024 19:52:25 +0000 (21:52 +0200)
commit4a6e2d6142ab815c964924896891e9ab3e050632
treef131e13286a84b912001d8e56d5b3ce316cf3283
parent494c87032613e31c0be99b2735e732871f2c4e4d
llama : add abort_callback to interrupt computation (#5409)

* using abort_callback from ggml to stop llama computation

* format fix

* a brief explaining comment

---------

Co-authored-by: Georgi Gerganov <redacted>
llama.cpp
llama.h