From: Zagaj Date: Mon, 11 Aug 2025 12:27:54 +0000 (+0200) Subject: readme : update infra list (#15234) X-Git-Tag: upstream/0.0.6164~34 X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=27093afe78912494073eb043fec93a007e49653c;p=pkg%2Fggml%2Fsources%2Fllama.cpp readme : update infra list (#15234) --- diff --git a/README.md b/README.md index 954fff83..96e30050 100644 --- a/README.md +++ b/README.md @@ -240,7 +240,7 @@ Instructions for adding support for new models: [HOWTO-add-model.md](docs/develo
Infrastructure -- [Paddler](https://github.com/distantmagic/paddler) - Stateful load balancer custom-tailored for llama.cpp +- [Paddler](https://github.com/intentee/paddler) - Open-source LLMOps platform for hosting and scaling AI in your own infrastructure - [GPUStack](https://github.com/gpustack/gpustack) - Manage GPU clusters for running LLMs - [llama_cpp_canister](https://github.com/onicai/llama_cpp_canister) - llama.cpp as a smart contract on the Internet Computer, using WebAssembly - [llama-swap](https://github.com/mostlygeek/llama-swap) - transparent proxy that adds automatic model switching with llama-server