]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
model : support for DeepseekV32ForCausalLM with generic DeepSeek Sparse Attention...
authorfairydreaming <redacted>
Fri, 29 May 2026 08:15:17 +0000 (10:15 +0200)
committerGitHub <redacted>
Fri, 29 May 2026 08:15:17 +0000 (10:15 +0200)
commit1f0aa2a6964091c33827b1daae1e2b74118c6fa7
treebc2ed4cf8f172e4bb0a5a722b7fc2d1c1f070e23
parent031ddb2e08962837c899374297da75f91cc0157d
model : support for DeepseekV32ForCausalLM with generic DeepSeek Sparse Attention (DSA) implementation (#23346)

* llama : support DeepSeek V3.2 model family (with DSA lightning indexer)

* convert : handle DeepseekV32ForCausalLM architecture

* ggml : support for f16 GGML_OP_FILL

* memory : separate hparams argument in llama_kv_cache constructor

* memory : add llama_kv_cache_dsa memory (KV cache + lightning indexer cache)

* llama : support for LLM_ARCH_DEEPSEEK32

* model : llama_model_deepseek32 implementation

* model : merge two scale operations into one in DSA lightning indexer implementation

* chore : remove unused code

* model : support NVFP4 in DeepSeek V3.2

Co-authored-by: Sigbjørn Skjæret <redacted>
* memory : refactoring TODO

Co-authored-by: ggerganov <redacted>
---------

Co-authored-by: Stanisław Szymczyk <redacted>
Co-authored-by: Sigbjørn Skjæret <redacted>
Co-authored-by: ggerganov <redacted>
22 files changed:
conversion/__init__.py
conversion/base.py
conversion/deepseek.py
ggml/src/ggml-cpu/ops.cpp
ggml/src/ggml.c
gguf-py/gguf/constants.py
src/CMakeLists.txt
src/llama-arch.cpp
src/llama-arch.h
src/llama-graph.cpp
src/llama-graph.h
src/llama-kv-cache-dsa.cpp [new file with mode: 0644]
src/llama-kv-cache-dsa.h [new file with mode: 0644]
src/llama-kv-cache-iswa.cpp
src/llama-kv-cache.cpp
src/llama-kv-cache.h
src/llama-memory-hybrid.cpp
src/llama-model.cpp
src/llama-model.h
src/models/deepseek32.cpp [new file with mode: 0644]
src/models/models.h
tests/test-llama-archs.cpp