]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
ggml : use OpenMP as a thread pool (llama/7606)
authorMasaya, Kato <redacted>
Mon, 3 Jun 2024 15:14:15 +0000 (00:14 +0900)
committerGeorgi Gerganov <redacted>
Sun, 16 Jun 2024 15:19:48 +0000 (18:19 +0300)
commite5e38d4920a6843944b62bac4e239ba7ee314da3
treee29baaf56874d56af0745773229b29a3e7e41b86
parent2a6bab5655f831a48cb418cfee9d9933f5152314
ggml : use OpenMP as a thread pool (llama/7606)

* ggml: Added OpenMP for multi-threads processing

* ggml : Limit the number of threads used to avoid deadlock

* update shared state n_threads in parallel region

* clear numa affinity for main thread even with openmp

* enable openmp by default

* fix msvc build

* disable openmp on macos

* ci : disable openmp with thread sanitizer

* Update ggml.c

Co-authored-by: Georgi Gerganov <redacted>
---------

Co-authored-by: slaren <redacted>
Co-authored-by: Georgi Gerganov <redacted>
ggml.c