From: automaticcat <redacted>
Date: Sat, 30 Dec 2023 08:07:48 +0000 (+0700)
Subject: ggml : add ggml_cpu_has_avx_vnni() (llama/4589)
X-Git-Tag: upstream/1.7.4~1182
X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=dbe29d4e33f3223411f64ce515c775ee8d8e2cab;p=pkg%2Fggml%2Fsources%2Fwhisper.cpp

ggml : add ggml_cpu_has_avx_vnni() (llama/4589)

* feat: add avx_vnni based on intel documents

* ggml: add avx vnni based on intel document

* llama: add avx vnni information display

* docs: add more details about using oneMKL and oneAPI for intel processors

* docs: add more details about using oneMKL and oneAPI for intel processors

* docs: add more details about using oneMKL and oneAPI for intel processors

* docs: add more details about using oneMKL and oneAPI for intel processors

* docs: add more details about using oneMKL and oneAPI for intel processors

* Update ggml.c

Fix indentation upgate

Co-authored-by: Georgi Gerganov <redacted>

---------

Co-authored-by: Georgi Gerganov <redacted>
---

diff --git a/ggml.c b/ggml.c
index 4d8891c3..b124f14c 100644
--- a/ggml.c
+++ b/ggml.c
@@ -19796,6 +19796,14 @@ int ggml_cpu_has_avx(void) {
 #endif
 }
 
+int ggml_cpu_has_avx_vnni(void) {
+#if defined(__AVXVNNI__)
+    return 1;
+#else
+    return 0;
+#endif
+}
+
 int ggml_cpu_has_avx2(void) {
 #if defined(__AVX2__)
     return 1;
diff --git a/ggml.h b/ggml.h
index 67d6bc4f..64f4e45e 100644
--- a/ggml.h
+++ b/ggml.h
@@ -2198,6 +2198,7 @@ extern "C" {
     //
 
     GGML_API int ggml_cpu_has_avx        (void);
+    GGML_API int ggml_cpu_has_avx_vnni   (void);
     GGML_API int ggml_cpu_has_avx2       (void);
     GGML_API int ggml_cpu_has_avx512     (void);
     GGML_API int ggml_cpu_has_avx512_vbmi(void);