]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
[Model] Add support for xverse (#6301)
authorhxer7963 <redacted>
Fri, 29 Mar 2024 13:37:03 +0000 (21:37 +0800)
committerGitHub <redacted>
Fri, 29 Mar 2024 13:37:03 +0000 (14:37 +0100)
commit069574775cea67d8a977904e4d534aff47a671f4
tree0a599af29292d6ec5826533fa4bfc60e0e33f573
parentcfde806eb95de06d84162bdee593dad33a1d2693
[Model] Add support for xverse (#6301)

* Support xverse model convert to gguf format.

* 1. Convert xverse models to gguf;
2. Add LLM_ARCH_XVERSE inference in llama.cpp;
3. Add xverse item in Supported models in README.md;

* * gguf-py: remove redundant logs
* llama: remove the init_mapping_prefetch custom parameter

* llama.cpp: Include the changes from #6122 to exclude the unused outputs of the last layers.

* - Fix format issues
- Remove duplicate set kqv_out to llm_build_kv

* Update llama.cpp

---------

Co-authored-by: willhe <redacted>
Co-authored-by: willhe <redacted>
README.md
convert-hf-to-gguf.py
gguf-py/gguf/constants.py
llama.cpp