From: Radoslav Gerganov <redacted>
Date: Fri, 17 Jan 2025 08:57:09 +0000 (+0200)
Subject: rpc : early register backend devices (llama/11262)
X-Git-Tag: upstream/0.0.1689~44
X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=ab207130b62274c0f04ad5ad3f2b056f247b7fb2;p=pkg%2Fggml%2Fsources%2Fggml

rpc : early register backend devices (llama/11262)

Early register RPC devices and do not propagate RPC specifics in the
llama model structures.

ref: #10609
---

diff --git a/include/ggml-backend.h b/include/ggml-backend.h
index 7221a083..fc9571c8 100644
--- a/include/ggml-backend.h
+++ b/include/ggml-backend.h
@@ -203,6 +203,8 @@ extern "C" {
     // Backend registry
     //
 
+    GGML_API void ggml_backend_device_register(ggml_backend_dev_t device);
+
     // Backend (reg) enumeration
     GGML_API size_t             ggml_backend_reg_count(void);
     GGML_API ggml_backend_reg_t ggml_backend_reg_get(size_t index);
diff --git a/src/ggml-backend-impl.h b/src/ggml-backend-impl.h
index 36d72e95..d1c2d76d 100644
--- a/src/ggml-backend-impl.h
+++ b/src/ggml-backend-impl.h
@@ -208,7 +208,6 @@ extern "C" {
 
     // Internal backend registry API
     GGML_API void ggml_backend_register(ggml_backend_reg_t reg);
-    GGML_API void ggml_backend_device_register(ggml_backend_dev_t device);
 
     // Add backend dynamic loading support to the backend