]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
llama : add thread safety test (llama/14035)
authorDiego Devesa <redacted>
Mon, 16 Jun 2025 15:11:43 +0000 (08:11 -0700)
committerGeorgi Gerganov <redacted>
Wed, 18 Jun 2025 09:40:34 +0000 (12:40 +0300)
commit44871c8a3e95c288de6c07553e2e5ac415433bb2
tree5aa4793562f28dbec2986f48ac1eb430dbd57990
parentad6cd94a3a047f1431ca8905fa0c5be0b9fa1969
llama : add thread safety test (llama/14035)

* llama : add thread safety test

* llamafile : remove global state

* llama : better LLAMA_SPLIT_MODE_NONE logic

when main_gpu < 0 GPU devices are not used

---------

Co-authored-by: Georgi Gerganov <redacted>
ggml/src/ggml-cpu/ggml-cpu-impl.h
ggml/src/ggml-cpu/ggml-cpu.c
ggml/src/ggml-cpu/llamafile/sgemm.cpp