git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

overview / pkg / ggml / sources / llama.cpp / commit

author	Tobias Lütke <redacted>
	Wed, 5 Jul 2023 20:51:13 +0000 (16:51 -0400)
committer	GitHub <redacted>
	Wed, 5 Jul 2023 20:51:13 +0000 (16:51 -0400)
commit	31cfbb1013a482e89c72146e2063ac4362becae7
tree	b6479860979f90d185a132efe883ae7fb62b07f5	tree
parent	983b555e9ddb36703cee4d22642afe958de093b7	commit \| diff

Expose generation timings from server & update completions.js (#2116)

* use javascript generators as much cleaner API

Also add ways to access completion as promise and EventSource

* export llama_timings as struct and expose them in server

* update readme, update baked includes

* llama : uniform variable names + struct init

---------

Co-authored-by: Georgi Gerganov <redacted>

Packaging of ggml-org/llama.cpp

RSS Atom

examples/server/README.md		diff \| blob \| history
examples/server/completion.js.hpp		diff \| blob \| history
examples/server/deps.sh		diff \| blob \| history
examples/server/index.html.hpp		diff \| blob \| history
examples/server/public/completion.js		diff \| blob \| history
examples/server/public/index.html		diff \| blob \| history
examples/server/server.cpp		diff \| blob \| history
llama.cpp		diff \| blob \| history
llama.h		diff \| blob \| history