git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

overview / pkg / ggml / sources / llama.cpp / commit

author	Xuan-Son Nguyen <redacted>
	Sat, 6 Dec 2025 14:54:38 +0000 (15:54 +0100)
committer	GitHub <redacted>
	Sat, 6 Dec 2025 14:54:38 +0000 (15:54 +0100)
commit	c42712b056fb2cf03902ef57fd314c531e356965
tree	d17e51b77cef0768cefd17bbf7bdf8f956ec8e92	tree
parent	09c7c50e64c98adac452d090406b6e5f6c320a41	commit \| diff

server: support multiple generations from one prompt (OAI "n" option) (#17775)

* backend support

* server: support multiple generations from one prompt (OAI "n" option)

* fix invalid batch

* format oai

* clean up

* disable ctx shift

* add test

* update comments

* fix style

* add n_cmpl to docs [no ci]

* allowing using both n_cmpl and n

Packaging of ggml-org/llama.cpp

RSS Atom

tools/server/README.md		diff \| blob \| history
tools/server/server-common.cpp		diff \| blob \| history
tools/server/server-common.h		diff \| blob \| history
tools/server/server-context.cpp		diff \| blob \| history
tools/server/server-task.cpp		diff \| blob \| history
tools/server/server-task.h		diff \| blob \| history
tools/server/tests/unit/test_chat_completion.py		diff \| blob \| history