]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
llama : make model stateless and context stateful (llama_state) (#1797)
authorDidzis Gosko <redacted>
Sat, 24 Jun 2023 08:47:58 +0000 (11:47 +0300)
committerGitHub <redacted>
Sat, 24 Jun 2023 08:47:58 +0000 (11:47 +0300)
commit527b6fba1d237befb324fd846bda7418c0fa394d
tree360b44abac0c9a53739444b8ba9e4ccf903938cd
parentd7b7484f74d486f77feb4c0b7af7e1718ed91651
llama : make model stateless and context stateful (llama_state) (#1797)

* llama : make model stateless and context stateful

* llama : minor cleanup

* llama : update internal API declaration

* Apply suggestions from code review

fix style

Co-authored-by: Georgi Gerganov <redacted>
* Missing model memory release

* Fix style

* Add deprecated warning for public API function llama_init_from_file

* Update public API use cases: move away from deprecated llama_init_from_file

* Deprecate public API function llama_apply_lora_from_file

---------

Co-authored-by: Georgi Gerganov <redacted>
13 files changed:
examples/common.cpp
examples/common.h
examples/embedding/embedding.cpp
examples/main/main.cpp
examples/perplexity/perplexity.cpp
examples/quantize-stats/quantize-stats.cpp
examples/save-load-state/save-load-state.cpp
examples/server/server.cpp
examples/simple/simple.cpp
examples/train-text-from-scratch/train-text-from-scratch.cpp
llama.cpp
llama.h
tests/test-tokenizer-0.cpp