]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
common : add standard Hugging Face cache support (#20775)
authorAdrien Gallouët <redacted>
Tue, 24 Mar 2026 06:30:33 +0000 (07:30 +0100)
committerGitHub <redacted>
Tue, 24 Mar 2026 06:30:33 +0000 (07:30 +0100)
commit8c7957ca33a40cd928146fd3f33a98180e486004
treea117c682e29883e1d29c6e8d6b02c9cd637927d0
parente852eb490136dfa335586b9dd6efb94b02c8fdd3
common : add standard Hugging Face cache support (#20775)

* common : add standard Hugging Face cache support

- Use HF API to find all files
- Migrate all manifests to hugging face cache at startup

Signed-off-by: Adrien Gallouët <redacted>
* Check with the quant tag

Signed-off-by: Adrien Gallouët <redacted>
* Cleanup

Signed-off-by: Adrien Gallouët <redacted>
* Improve error handling and report API errors

Signed-off-by: Adrien Gallouët <redacted>
* Restore common_cached_model_info and align mmproj filtering

Signed-off-by: Adrien Gallouët <redacted>
* Prefer main when getting cached ref

Signed-off-by: Adrien Gallouët <redacted>
* Use cached files when HF API fails

Signed-off-by: Adrien Gallouët <redacted>
* Use final_path..

Signed-off-by: Adrien Gallouët <redacted>
* Check all inputs

Signed-off-by: Adrien Gallouët <redacted>
---------

Signed-off-by: Adrien Gallouët <redacted>
common/CMakeLists.txt
common/arg.cpp
common/download.cpp
common/download.h
common/hf-cache.cpp [new file with mode: 0644]
common/hf-cache.h [new file with mode: 0644]
tools/llama-bench/llama-bench.cpp
tools/server/tests/unit/test_router.py