]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
HIP: Only call rocblas_initialize on rocblas versions with the multiple instantation...
authorNikita Sarychev <redacted>
Tue, 28 Jan 2025 15:42:20 +0000 (07:42 -0800)
committerGeorgi Gerganov <redacted>
Wed, 29 Jan 2025 10:57:00 +0000 (12:57 +0200)
commitbf2037f72cc3757ede5485626ed8c307f1531ce6
treee7ff25a8f548e1e5ddae33c3a599ad600e4d60f1
parentb9faf73698374d2a059f2f006b7c9f81e9977392
HIP: Only call rocblas_initialize on rocblas versions with the multiple instantation bug (llama/11080)

This disables the workaround on rocblas fixed versions (>=4.0.0) to eliminate the runtime cost and unnecessary VRAM allocation of loading all tensile objects.
src/ggml-cuda/ggml-cuda.cu