]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
ggml : use OpenMP as a thread pool (llama/7606)
authorMasaya, Kato <redacted>
Mon, 3 Jun 2024 15:14:15 +0000 (00:14 +0900)
committerGeorgi Gerganov <redacted>
Sat, 15 Jun 2024 19:05:47 +0000 (22:05 +0300)
commit703d5e6ad6e109bbfe5f59002c11b2fc4de4dfbb
treefe58d7ed0d37788cc6568cfa8d50c7b00509616e
parent1981d5bbc4526df030be0d5cbeeb1f28f7aba692
ggml : use OpenMP as a thread pool (llama/7606)

* ggml: Added OpenMP for multi-threads processing

* ggml : Limit the number of threads used to avoid deadlock

* update shared state n_threads in parallel region

* clear numa affinity for main thread even with openmp

* enable openmp by default

* fix msvc build

* disable openmp on macos

* ci : disable openmp with thread sanitizer

* Update ggml.c

Co-authored-by: Georgi Gerganov <redacted>
---------

Co-authored-by: slaren <redacted>
Co-authored-by: Georgi Gerganov <redacted>
src/ggml.c