git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

overview / pkg / ggml / sources / llama.cpp / commit

author	Georgi Gerganov <redacted>
	Thu, 13 Aug 2026 11:33:53 +0000 (14:33 +0300)
committer	GitHub <redacted>
	Thu, 13 Aug 2026 11:33:53 +0000 (14:33 +0300)
commit	4a84b0ad108204f17f3232e26e5c802fb172b492
tree	aa30840e3244c6c58b52bd4a86bce7a7fc48dc00	tree
parent	f65e568fd83712c92babbb096b57e572af0ec357	commit \| diff

metal : add TQ2_0 support (#26980)

* metal: add TQ2_0 support

Add support for the GGML_TYPE_TQ2_0 (ternary, 2 bits per element) type in
the Metal backend.

Assisted-by: llama.cpp:DeepSeek-v4-Flash-0731
* cont : optimize mul_mv kernel

- float ops over integer ops
- precalculate sums
- hoist coef out of the inner loop
- contiguous y loads

llama.cpp:DeepSeek-v4-Flash-0731

Packaging of ggml-org/llama.cpp

RSS Atom

ggml/src/ggml-metal/ggml-metal-device.cpp		diff \| blob \| history
ggml/src/ggml-metal/ggml-metal-device.m		diff \| blob \| history
ggml/src/ggml-metal/ggml-metal-impl.h		diff \| blob \| history
ggml/src/ggml-metal/ggml-metal.metal		diff \| blob \| history
tests/test-backend-ops.cpp		diff \| blob \| history