]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server : add lora hotswap endpoint (WIP) (#8857)
authorXuan Son Nguyen <redacted>
Tue, 6 Aug 2024 15:33:39 +0000 (17:33 +0200)
committerGitHub <redacted>
Tue, 6 Aug 2024 15:33:39 +0000 (17:33 +0200)
commit1e6f6554aa11fa10160a5fda689e736c3c34169f
treed49931b6077c9ec4ce66c3636f345631b41aa6f7
parent641f5dd2a6422941faa9f32ab5cb50fc1b24c1f5
server : add lora hotswap endpoint (WIP) (#8857)

* server : add lora hotswap endpoint

* handle lora_no_apply

* fix build

* updae docs

* clean up struct def

* fix build

* add LoRA test

* fix style
common/common.cpp
common/common.h
examples/export-lora/export-lora.cpp
examples/server/README.md
examples/server/server.cpp
examples/server/tests/features/lora.feature [new file with mode: 0644]
examples/server/tests/features/steps/steps.py
examples/server/tests/requirements.txt
gguf-py/gguf/metadata.py