]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
opencl: Add support for multiple devices (llama/12622)
authorHenry Linjamäki <redacted>
Wed, 21 May 2025 23:21:45 +0000 (02:21 +0300)
committerGeorgi Gerganov <redacted>
Tue, 27 May 2025 15:03:00 +0000 (18:03 +0300)
commit316600e8eed30c2da6d124f18311039562b56f22
tree406b4d752f8fb825913a7e904732d6086250bc79
parent42f2b3bb6599659a5cb0a69ca2cbd67968ba6d48
opencl: Add support for multiple devices (llama/12622)

* opencl: Add support for multiple devices

... but limited to one platform. A platform with a GPU will be preferred.

Additionally:

* Filter out devices that lack capabilities needed by the backend
  implementation (half support, OpenCL 2.0+, etc).

* Make ggml_backend_opencl_reg() thread-safe.

* fixup: fix an error in sync_with_other_backends

... when there is only one OpenCL device available.
ggml/src/ggml-opencl/ggml-opencl.cpp