]>
git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server : add single-client multi-prompt support (#4232)
* * add multiprompt support
* * cleanup
* * more cleanup
* * remove atomicity of id_gen, and change lock_guard to unique_lock on completion requests
* * remove all references to mutex_multitasks
* Update examples/server/server.cpp
Co-authored-by: Jared Van Bortel <redacted>
* Update examples/server/server.cpp
Co-authored-by: Jared Van Bortel <redacted>
* Update examples/server/server.cpp
Co-authored-by: Jared Van Bortel <redacted>
* Update examples/server/server.cpp
Co-authored-by: Jared Van Bortel <redacted>
* * change to set
---------
Co-authored-by: Jared Van Bortel <redacted>