]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
cuda : synchronize graph capture and cublas handle destruction (llama/14288)
authorDiego Devesa <redacted>
Fri, 20 Jun 2025 11:57:36 +0000 (04:57 -0700)
committerGeorgi Gerganov <redacted>
Fri, 20 Jun 2025 18:14:52 +0000 (21:14 +0300)
commitbeb672ed6a3271a0d1202f7551a43ba8e8c60b64
tree5345de86f478d1974be4ad543252ca8fc526657e
parent7c5b8d2b7525b18d7be45276c1c138bf09a13f50
cuda : synchronize graph capture and cublas handle destruction (llama/14288)

Workarounds an issue that may cause CUDA graph capture to fail when a cuBLAS handle is destroyed in a different thread
src/ggml-cuda/common.cuh
src/ggml-cuda/ggml-cuda.cu