]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
ggml-virtgpu: make the code thread safe (llama/19204)
authorKevin Pouget <redacted>
Wed, 4 Feb 2026 02:46:18 +0000 (03:46 +0100)
committerGeorgi Gerganov <redacted>
Sat, 7 Feb 2026 08:37:38 +0000 (10:37 +0200)
commitb0e0d352f78b5d2401fbac668f1c995a0269b53e
treee1a6252f59e72d5164999073806c39283ceae304
parent545b7a9a98d181362eb74b94a4f37fa6fa778840
ggml-virtgpu: make the code thread safe (llama/19204)

* ggml-virtgpu: regenerate_remoting.py: add the ability to deprecate a function

* ggml-virtgpu: deprecate buffer_type is_host remoting

not necessary

* ggml-virtgpu: stop using static vars as cache

The static init isn't thread safe.

* ggml-virtgpu: protect the use of the shared memory to transfer data

* ggml-virtgpu: make the remote calls thread-safe

* ggml-virtgpu: backend: don't continue if couldn't allocate the tensor memory

* ggml-virtgpu: add a cleanup function for consistency

* ggml-virtgpu: backend: don't crash if buft->iface.get_max_size is missing

* fix style and ordering

* Remove the static variable in apir_device_get_count

* ggml-virtgpu: improve the logging

* fix review minor formatting changes
27 files changed:
include/ggml-virtgpu.h
src/ggml-virtgpu/apir_cs_ggml-rpc-front.cpp
src/ggml-virtgpu/backend/backend-dispatched-backend.cpp
src/ggml-virtgpu/backend/backend-dispatched-buffer-type.cpp
src/ggml-virtgpu/backend/backend-dispatched-buffer.cpp
src/ggml-virtgpu/backend/backend-dispatched-device.cpp
src/ggml-virtgpu/backend/backend-dispatched.cpp
src/ggml-virtgpu/backend/backend-dispatched.gen.h
src/ggml-virtgpu/backend/backend-dispatched.h
src/ggml-virtgpu/backend/backend.cpp
src/ggml-virtgpu/backend/shared/apir_cs.h
src/ggml-virtgpu/backend/shared/apir_cs_ggml.h
src/ggml-virtgpu/ggml-backend-buffer-type.cpp
src/ggml-virtgpu/ggml-backend-device.cpp
src/ggml-virtgpu/ggml-backend-reg.cpp
src/ggml-virtgpu/ggml-remoting.h
src/ggml-virtgpu/ggmlremoting_functions.yaml
src/ggml-virtgpu/regenerate_remoting.py
src/ggml-virtgpu/virtgpu-forward-backend.cpp
src/ggml-virtgpu/virtgpu-forward-buffer-type.cpp
src/ggml-virtgpu/virtgpu-forward-buffer.cpp
src/ggml-virtgpu/virtgpu-forward-device.cpp
src/ggml-virtgpu/virtgpu-forward-impl.h
src/ggml-virtgpu/virtgpu-forward.gen.h
src/ggml-virtgpu/virtgpu-shm.cpp
src/ggml-virtgpu/virtgpu.cpp
src/ggml-virtgpu/virtgpu.h