]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
model : support for DeepseekV32ForCausalLM with generic DeepSeek Sparse Attention...
authorfairydreaming <redacted>
Fri, 29 May 2026 08:15:17 +0000 (10:15 +0200)
committerGeorgi Gerganov <redacted>
Mon, 8 Jun 2026 11:36:36 +0000 (14:36 +0300)
commitc50e951afdf0b1bd4d63adddbd48dc90ff92893c
treea785a29e1be7abdb18cfade6ca36b511040441a2
parente1da83d7736f4a170a4c8057c205df35c39fe230
model : support for DeepseekV32ForCausalLM with generic DeepSeek Sparse Attention (DSA) implementation (llama/23346)

* llama : support DeepSeek V3.2 model family (with DSA lightning indexer)

* convert : handle DeepseekV32ForCausalLM architecture

* ggml : support for f16 GGML_OP_FILL

* memory : separate hparams argument in llama_kv_cache constructor

* memory : add llama_kv_cache_dsa memory (KV cache + lightning indexer cache)

* llama : support for LLM_ARCH_DEEPSEEK32

* model : llama_model_deepseek32 implementation

* model : merge two scale operations into one in DSA lightning indexer implementation

* chore : remove unused code

* model : support NVFP4 in DeepSeek V3.2

Co-authored-by: Sigbjørn Skjæret <redacted>
* memory : refactoring TODO

Co-authored-by: ggerganov <redacted>
---------

Co-authored-by: Stanisław Szymczyk <redacted>
Co-authored-by: Sigbjørn Skjæret <redacted>
Co-authored-by: ggerganov <redacted>
ggml/src/ggml-cpu/ops.cpp
ggml/src/ggml.c