]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server : Prefilling assistant message in openai compatible API (#13174)
authormatteo <redacted>
Tue, 29 Apr 2025 18:33:10 +0000 (20:33 +0200)
committerGitHub <redacted>
Tue, 29 Apr 2025 18:33:10 +0000 (20:33 +0200)
commite2e1ddb93a01ce282e304431b37e60b3cddb6114
treec8a5522de198ead6cea0c369de4aa5bcb17104e0
parentd9d398f84f96d16c308d4976f5e90222ecc2a492
server : Prefilling assistant message in openai compatible API (#13174)

* Prefilling assistant message in openai compatible API

* fixed indentation

* fixed code convention

* simplify method usage

* no more than one assistant message at end of messages

* merge checks into prefill code

* Update examples/server/utils.hpp

---------

Co-authored-by: matteo <redacted>
Co-authored-by: Xuan-Son Nguyen <redacted>
examples/server/utils.hpp