]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 7ee76e4)
Add an API example using server.cpp similar to OAI. (#2009)
authorjwj7140 <redacted>
Tue, 4 Jul 2023 18:06:12 +0000 (03:06 +0900)
committerGitHub <redacted>
Tue, 4 Jul 2023 18:06:12 +0000 (21:06 +0300)
commitf257fd255044decffad93dee2502875ce66ad80c
tree721030366e4a3ca93088493581ad19750b6bff95tree
parent7ee76e45afae7f9a7a53e93393accfb5b36684e1commit | diff
Add an API example using server.cpp similar to OAI. (#2009)

* add api_like_OAI.py
* add evaluated token count to server
* add /v1/ endpoints binding
examples/server/README.md diff | blob | history
examples/server/api_like_OAI.py [new file with mode: 0755] blob
examples/server/server.cpp diff | blob | history
Packaging of ggml-org/llama.cpp