]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server : update `/props` with "total_slots" value (#5373)
authorJustin Parker <redacted>
Wed, 7 Feb 2024 06:15:19 +0000 (01:15 -0500)
committerGitHub <redacted>
Wed, 7 Feb 2024 06:15:19 +0000 (08:15 +0200)
commitf3e2b4fa3f81a410ecb7dec929c259ef8d8dbb7d
tree77bda53ac299ccac3ee35e91e5571d57485b63a4
parentf68664ac241a6b5c233d8f1051eef20929b06008
server : update `/props` with "total_slots" value (#5373)

* include total "num_slots" in default_generation_settings_for_props

* cleanup total_slots return value in /props endpoint

* update /props endpoint docs with total_slots

* remove num_slots from default_generation_settings_for_props

* update /props endpoint section
examples/server/README.md
examples/server/server.cpp