]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
ggml : use OpenMP as a thread pool (#7606)
authorMasaya, Kato <redacted>
Mon, 3 Jun 2024 15:14:15 +0000 (00:14 +0900)
committerGitHub <redacted>
Mon, 3 Jun 2024 15:14:15 +0000 (17:14 +0200)
commita5735e4426b19a3ebd0c653ad8ac01420458ee95
tree992da9d6e702e105956d9c4e8d1bc3b93449da8d
parent0b832d53ba0ffcc759c8d62ede3772dd62321f8e
ggml : use OpenMP as a thread pool (#7606)

* ggml: Added OpenMP for multi-threads processing

* ggml : Limit the number of threads used to avoid deadlock

* update shared state n_threads in parallel region

* clear numa affinity for main thread even with openmp

* enable openmp by default

* fix msvc build

* disable openmp on macos

* ci : disable openmp with thread sanitizer

* Update ggml.c

Co-authored-by: Georgi Gerganov <redacted>
---------

Co-authored-by: slaren <redacted>
Co-authored-by: Georgi Gerganov <redacted>
.github/workflows/build.yml
CMakeLists.txt
Makefile
ggml.c