]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
openvino: driver setup, CI split, thread safety, and NPU optimizations (#21944)
authorZijun Yu <redacted>
Tue, 21 Apr 2026 15:58:34 +0000 (23:58 +0800)
committerGitHub <redacted>
Tue, 21 Apr 2026 15:58:34 +0000 (18:58 +0300)
commit52f1096f21b0e12e4532f34224991e06cf21a69a
treee1aa6187a94444f3c8668b95faf1523308242841
parent606fa42f5de58ef74e0eb9a0a55bb6c0a689e2eb
openvino: driver setup, CI split, thread safety, and NPU optimizations (#21944)

* Thread safety per request only

* Fix ROPE yarn case

* Fix sticky stateful config

* Use i4/i8 directly for symmetric quant

* Use weightless caching

* Add WeightlessCacheAttribute to reduce NPU memory usage

* Gelu tanh support (#125)

* Imrope support (#126)

* fix(openvino): explicit ov::Tensor frees in ggml_backend_openvino_free

* add GPU,NPU support in OV Dockerfile

* add build-openvino.yml ci

* Fix sticky stateful config

* add concurrency to ov-gpu ci runs. Move OV CI to build-openvino.yml

* fix thread-safety of shared runtime context

* rope type abstraction for frontend translations

* fix editorconfig

---------

Co-authored-by: Mustafa Cavus <redacted>
Co-authored-by: Dan Hoffman <redacted>
Co-authored-by: Ravi Panchumarthy <redacted>
21 files changed:
.devops/openvino.Dockerfile
.github/workflows/build-openvino.yml [new file with mode: 0644]
.github/workflows/build-self-hosted.yml
.github/workflows/build.yml
docs/backend/OPENVINO.md
ggml/src/ggml-openvino/ggml-decoder.cpp
ggml/src/ggml-openvino/ggml-openvino-extra.cpp
ggml/src/ggml-openvino/ggml-openvino.cpp
ggml/src/ggml-openvino/ggml-quants.cpp
ggml/src/ggml-openvino/openvino/op/rope.cpp
ggml/src/ggml-openvino/openvino/op/unary_gelu.cpp [new file with mode: 0644]
ggml/src/ggml-openvino/openvino/op_table.cpp
ggml/src/ggml-openvino/openvino/op_table.h
ggml/src/ggml-openvino/openvino/pass/eliminate_zp.cpp [deleted file]
ggml/src/ggml-openvino/openvino/pass/eliminate_zp.h [deleted file]
ggml/src/ggml-openvino/openvino/rt_info/weightless_caching_attributes.hpp [new file with mode: 0644]
ggml/src/ggml-openvino/openvino/translate_session.cpp
ggml/src/ggml-openvino/openvino/utils.cpp
ggml/src/ggml-openvino/openvino/utils.h
ggml/src/ggml-openvino/utils.cpp
ggml/src/ggml-openvino/utils.h