]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
main : add self-extend support (#4815)
authorGeorgi Gerganov <redacted>
Mon, 8 Jan 2024 09:18:32 +0000 (11:18 +0200)
committerGitHub <redacted>
Mon, 8 Jan 2024 09:18:32 +0000 (11:18 +0200)
commit52531fdff88764282c1b233174721aab8347252d
treed4aeec20b4b634f5de3bd9839df507dee85c9e1f
parentb0034d93ce2949ce7d9c098ca02e56f66cd484e2
main : add self-extend support (#4815)

* examples : add passkey test

* passkey : better prints

* passkey : select pass key pos from CLI

* passkey : simplify n_past logic

* llama : "self-extend"-like context extension

* passkey : add comment

* main : add Self-Extend support

* llama : add comment about llama_kv_cache_seq_div
common/common.cpp
common/common.h
examples/main/main.cpp
llama.h