]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
ggml-virtgpu: make the code thread safe (llama/19204)
authorKevin Pouget <redacted>
Wed, 4 Feb 2026 02:46:18 +0000 (03:46 +0100)
committerGeorgi Gerganov <redacted>
Sun, 8 Feb 2026 07:29:10 +0000 (09:29 +0200)
commit2763054f99b3609ee438bfec70a1ecbe9a563829
tree2e788b42c2a10901576608b39994eb6aeb217e93
parent4685ec95557ecd53225c5a1abac2392454a4e20d
ggml-virtgpu: make the code thread safe (llama/19204)

* ggml-virtgpu: regenerate_remoting.py: add the ability to deprecate a function

* ggml-virtgpu: deprecate buffer_type is_host remoting

not necessary

* ggml-virtgpu: stop using static vars as cache

The static init isn't thread safe.

* ggml-virtgpu: protect the use of the shared memory to transfer data

* ggml-virtgpu: make the remote calls thread-safe

* ggml-virtgpu: backend: don't continue if couldn't allocate the tensor memory

* ggml-virtgpu: add a cleanup function for consistency

* ggml-virtgpu: backend: don't crash if buft->iface.get_max_size is missing

* fix style and ordering

* Remove the static variable in apir_device_get_count

* ggml-virtgpu: improve the logging

* fix review minor formatting changes
27 files changed:
ggml/include/ggml-virtgpu.h
ggml/src/ggml-virtgpu/apir_cs_ggml-rpc-front.cpp
ggml/src/ggml-virtgpu/backend/backend-dispatched-backend.cpp
ggml/src/ggml-virtgpu/backend/backend-dispatched-buffer-type.cpp
ggml/src/ggml-virtgpu/backend/backend-dispatched-buffer.cpp
ggml/src/ggml-virtgpu/backend/backend-dispatched-device.cpp
ggml/src/ggml-virtgpu/backend/backend-dispatched.cpp
ggml/src/ggml-virtgpu/backend/backend-dispatched.gen.h
ggml/src/ggml-virtgpu/backend/backend-dispatched.h
ggml/src/ggml-virtgpu/backend/backend.cpp
ggml/src/ggml-virtgpu/backend/shared/apir_cs.h
ggml/src/ggml-virtgpu/backend/shared/apir_cs_ggml.h
ggml/src/ggml-virtgpu/ggml-backend-buffer-type.cpp
ggml/src/ggml-virtgpu/ggml-backend-device.cpp
ggml/src/ggml-virtgpu/ggml-backend-reg.cpp
ggml/src/ggml-virtgpu/ggml-remoting.h
ggml/src/ggml-virtgpu/ggmlremoting_functions.yaml
ggml/src/ggml-virtgpu/regenerate_remoting.py
ggml/src/ggml-virtgpu/virtgpu-forward-backend.cpp
ggml/src/ggml-virtgpu/virtgpu-forward-buffer-type.cpp
ggml/src/ggml-virtgpu/virtgpu-forward-buffer.cpp
ggml/src/ggml-virtgpu/virtgpu-forward-device.cpp
ggml/src/ggml-virtgpu/virtgpu-forward-impl.h
ggml/src/ggml-virtgpu/virtgpu-forward.gen.h
ggml/src/ggml-virtgpu/virtgpu-shm.cpp
ggml/src/ggml-virtgpu/virtgpu.cpp
ggml/src/ggml-virtgpu/virtgpu.h