]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
llama : accept a list of devices to use to offload a model (llama/10497)
authorDiego Devesa <redacted>
Mon, 25 Nov 2024 18:30:06 +0000 (19:30 +0100)
committerGeorgi Gerganov <redacted>
Tue, 3 Dec 2024 19:05:37 +0000 (21:05 +0200)
commit14533ad5967d7d95a63cca13dff7a3e6a6033f94
treef20b23b44916d23d5653776e573d14622685e449
parent808c4affa6cd7caabfc63cc9e3b179ca28849cef
llama : accept a list of devices to use to offload a model (llama/10497)

* llama : accept a list of devices to use to offload a model

* accept `--dev none` to completely disable offloading

* fix dev list with dl backends

* rename env parameter to LLAMA_ARG_DEVICE for consistency
src/ggml-backend-reg.cpp