]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
openvino: driver setup, CI split, thread safety, and NPU optimizations (llama/21944)
authorZijun Yu <redacted>
Tue, 21 Apr 2026 15:58:34 +0000 (23:58 +0800)
committerGeorgi Gerganov <redacted>
Thu, 30 Apr 2026 08:29:15 +0000 (11:29 +0300)
commit3a73f9cf0b3dc2a221000fd865545c783d3e978d
treed36846a17d2cebb6d21c68075e1a0a9812915d2c
parent150cef5a5f5c5272444eafbf090083476c8b1ccf
openvino: driver setup, CI split, thread safety, and NPU optimizations (llama/21944)

* Thread safety per request only

* Fix ROPE yarn case

* Fix sticky stateful config

* Use i4/i8 directly for symmetric quant

* Use weightless caching

* Add WeightlessCacheAttribute to reduce NPU memory usage

* Gelu tanh support (llama/125)

* Imrope support (llama/126)

* fix(openvino): explicit ov::Tensor frees in ggml_backend_openvino_free

* add GPU,NPU support in OV Dockerfile

* add build-openvino.yml ci

* Fix sticky stateful config

* add concurrency to ov-gpu ci runs. Move OV CI to build-openvino.yml

* fix thread-safety of shared runtime context

* rope type abstraction for frontend translations

* fix editorconfig

---------

Co-authored-by: Mustafa Cavus <redacted>
Co-authored-by: Dan Hoffman <redacted>
Co-authored-by: Ravi Panchumarthy <redacted>
16 files changed:
ggml/src/ggml-openvino/ggml-decoder.cpp
ggml/src/ggml-openvino/ggml-openvino-extra.cpp
ggml/src/ggml-openvino/ggml-openvino.cpp
ggml/src/ggml-openvino/ggml-quants.cpp
ggml/src/ggml-openvino/openvino/op/rope.cpp
ggml/src/ggml-openvino/openvino/op/unary_gelu.cpp [new file with mode: 0644]
ggml/src/ggml-openvino/openvino/op_table.cpp
ggml/src/ggml-openvino/openvino/op_table.h
ggml/src/ggml-openvino/openvino/pass/eliminate_zp.cpp [deleted file]
ggml/src/ggml-openvino/openvino/pass/eliminate_zp.h [deleted file]
ggml/src/ggml-openvino/openvino/rt_info/weightless_caching_attributes.hpp [new file with mode: 0644]
ggml/src/ggml-openvino/openvino/translate_session.cpp
ggml/src/ggml-openvino/openvino/utils.cpp
ggml/src/ggml-openvino/openvino/utils.h
ggml/src/ggml-openvino/utils.cpp
ggml/src/ggml-openvino/utils.h