git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

overview / pkg / ggml / sources / llama.cpp / commit

author	Xuan-Son Nguyen <redacted>
	Mon, 22 Jun 2026 16:24:04 +0000 (18:24 +0200)
committer	GitHub <redacted>
	Mon, 22 Jun 2026 16:24:04 +0000 (18:24 +0200)
commit	721354fbdfb7743e2be2183d918a3cdb9276c70f
tree	2df8d54efd807c6794130a6090eb82998a8c9d4f	tree
parent	6ee0f65793da4bca2301826f70383aef2da60345	commit \| diff

server: (router) move model downloading to dedicated process (#24834)

* server: real-time model load progress tracking via /models/sse

* update docs

* server: move model download to child process

* rm unused

* fix most problems

* clean up

* nit fixes

* fix test case

* do not detact() thread

* shorter MODEL_DOWNLOAD_TIMEOUT in test

* throttle

Packaging of ggml-org/llama.cpp

RSS Atom

common/arg.cpp		diff \| blob \| history
common/arg.h		diff \| blob \| history
tools/server/README-dev.md		diff \| blob \| history
tools/server/server-context.cpp		diff \| blob \| history
tools/server/server-context.h		diff \| blob \| history
tools/server/server-models.cpp		diff \| blob \| history
tools/server/server-models.h		diff \| blob \| history
tools/server/server.cpp		diff \| blob \| history
tools/server/tests/unit/test_router.py		diff \| blob \| history