]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server: support inp embd to generate next token (#26313)
authorXuan-Son Nguyen <redacted>
Thu, 30 Jul 2026 19:40:38 +0000 (21:40 +0200)
committerGitHub <redacted>
Thu, 30 Jul 2026 19:40:38 +0000 (21:40 +0200)
commitb4ca032ae3729516943884786de4ae39fba0bbca
tree583adfad23918bbd44464116efea85d6ed2d1d59
parentea63b4d32ea1b66bdbe369be7f9443f6c00f8b31
server: support inp embd to generate next token (#26313)

* server: support embd for sampled token

* fix ~server_batch()
tools/server/server-context.cpp