git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

overview / pkg / ggml / sources / llama.cpp / commit

author	ynankani <redacted>
	Sat, 16 May 2026 09:09:27 +0000 (09:09 +0000)
committer	GitHub <redacted>
	Sat, 16 May 2026 09:09:27 +0000 (11:09 +0200)
commit	42928bc14d33bde7b8fe8ea436ca44b40357737e
tree	50aa23949b519f164ae9f7332b3a1b9b018bb931	tree
parent	59778f0196a82db32580bb649d5d839355d6d7bf	commit \| diff

model : NvFP4 quantized LM head support (#23046)

* NvFP4 quantized LM head support

Signed-off-by: ynankani <redacted>
* Address review commnets

Signed-off-by: ynankani <redacted>
* Add assert for NvFp4 lm head and tied embeddings

Signed-off-by: ynankani <redacted>
* Address review commnets

Signed-off-by: ynankani <redacted>
* Create output_s tensor only when LM head NvFp4

Signed-off-by: ynankani <redacted>
---------

Signed-off-by: ynankani <redacted>

103 files changed:

src/llama-model-saver.cpp		diff \| blob \| history
src/llama-model.cpp		diff \| blob \| history
src/llama-model.h		diff \| blob \| history
src/models/afmoe.cpp		diff \| blob \| history
src/models/apertus.cpp		diff \| blob \| history
src/models/arcee.cpp		diff \| blob \| history
src/models/arctic.cpp		diff \| blob \| history
src/models/arwkv7.cpp		diff \| blob \| history
src/models/baichuan.cpp		diff \| blob \| history
src/models/bailingmoe.cpp		diff \| blob \| history
src/models/bailingmoe2.cpp		diff \| blob \| history
src/models/bloom.cpp		diff \| blob \| history
src/models/chameleon.cpp		diff \| blob \| history
src/models/chatglm.cpp		diff \| blob \| history
src/models/codeshell.cpp		diff \| blob \| history
src/models/cogvlm.cpp		diff \| blob \| history
src/models/cohere2.cpp		diff \| blob \| history
src/models/command-r.cpp		diff \| blob \| history
src/models/dbrx.cpp		diff \| blob \| history
src/models/deci.cpp		diff \| blob \| history
src/models/deepseek.cpp		diff \| blob \| history
src/models/dots1.cpp		diff \| blob \| history
src/models/dream.cpp		diff \| blob \| history
src/models/ernie4-5-moe.cpp		diff \| blob \| history
src/models/ernie4-5.cpp		diff \| blob \| history
src/models/exaone-moe.cpp		diff \| blob \| history
src/models/exaone.cpp		diff \| blob \| history
src/models/exaone4.cpp		diff \| blob \| history
src/models/falcon-h1.cpp		diff \| blob \| history
src/models/falcon.cpp		diff \| blob \| history
src/models/gemma.cpp		diff \| blob \| history
src/models/gemma2.cpp		diff \| blob \| history
src/models/gemma3.cpp		diff \| blob \| history
src/models/gemma3n.cpp		diff \| blob \| history
src/models/gemma4.cpp		diff \| blob \| history
src/models/glm4-moe.cpp		diff \| blob \| history
src/models/glm4.cpp		diff \| blob \| history
src/models/gpt2.cpp		diff \| blob \| history
src/models/gptneox.cpp		diff \| blob \| history
src/models/granite-hybrid.cpp		diff \| blob \| history
src/models/granite.cpp		diff \| blob \| history
src/models/grok.cpp		diff \| blob \| history
src/models/grovemoe.cpp		diff \| blob \| history
src/models/hunyuan-moe.cpp		diff \| blob \| history
src/models/hunyuan-vl.cpp		diff \| blob \| history
src/models/internlm2.cpp		diff \| blob \| history
src/models/jais.cpp		diff \| blob \| history
src/models/jais2.cpp		diff \| blob \| history
src/models/jamba.cpp		diff \| blob \| history
src/models/lfm2.cpp		diff \| blob \| history
src/models/llada-moe.cpp		diff \| blob \| history
src/models/llada.cpp		diff \| blob \| history
src/models/llama.cpp		diff \| blob \| history
src/models/llama4.cpp		diff \| blob \| history
src/models/maincoder.cpp		diff \| blob \| history
src/models/mamba.cpp		diff \| blob \| history
src/models/mimo2.cpp		diff \| blob \| history
src/models/minicpm3.cpp		diff \| blob \| history
src/models/minimax-m2.cpp		diff \| blob \| history
src/models/mistral3.cpp		diff \| blob \| history
src/models/mpt.cpp		diff \| blob \| history
src/models/nemotron-h.cpp		diff \| blob \| history
src/models/nemotron.cpp		diff \| blob \| history
src/models/olmo.cpp		diff \| blob \| history
src/models/olmo2.cpp		diff \| blob \| history
src/models/olmoe.cpp		diff \| blob \| history
src/models/openai-moe.cpp		diff \| blob \| history
src/models/openelm.cpp		diff \| blob \| history
src/models/orion.cpp		diff \| blob \| history
src/models/paddleocr.cpp		diff \| blob \| history
src/models/pangu-embed.cpp		diff \| blob \| history
src/models/phi2.cpp		diff \| blob \| history
src/models/phi3.cpp		diff \| blob \| history
src/models/plamo.cpp		diff \| blob \| history
src/models/plamo2.cpp		diff \| blob \| history
src/models/plamo3.cpp		diff \| blob \| history
src/models/plm.cpp		diff \| blob \| history
src/models/qwen.cpp		diff \| blob \| history
src/models/qwen2.cpp		diff \| blob \| history
src/models/qwen2moe.cpp		diff \| blob \| history
src/models/qwen2vl.cpp		diff \| blob \| history
src/models/qwen3.cpp		diff \| blob \| history
src/models/qwen35.cpp		diff \| blob \| history
src/models/qwen35moe.cpp		diff \| blob \| history
src/models/qwen3moe.cpp		diff \| blob \| history
src/models/qwen3next.cpp		diff \| blob \| history
src/models/qwen3vl.cpp		diff \| blob \| history
src/models/qwen3vlmoe.cpp		diff \| blob \| history
src/models/refact.cpp		diff \| blob \| history
src/models/rnd1.cpp		diff \| blob \| history
src/models/rwkv6.cpp		diff \| blob \| history
src/models/rwkv6qwen2.cpp		diff \| blob \| history
src/models/rwkv7.cpp		diff \| blob \| history
src/models/seed-oss.cpp		diff \| blob \| history
src/models/smallthinker.cpp		diff \| blob \| history
src/models/smollm3.cpp		diff \| blob \| history
src/models/stablelm.cpp		diff \| blob \| history
src/models/starcoder.cpp		diff \| blob \| history
src/models/starcoder2.cpp		diff \| blob \| history
src/models/step35.cpp		diff \| blob \| history
src/models/t5.cpp		diff \| blob \| history
src/models/wavtokenizer-dec.cpp		diff \| blob \| history
src/models/xverse.cpp		diff \| blob \| history

Packaging of ggml-org/llama.cpp

RSS Atom