git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

overview / pkg / ggml / sources / llama.cpp / commit

author	Ruben Ortlam <redacted>
	Sat, 29 Nov 2025 08:37:22 +0000 (09:37 +0100)
committer	GitHub <redacted>
	Sat, 29 Nov 2025 08:37:22 +0000 (09:37 +0100)
commit	47a268ea5000fc0f05fc1c5cd0062efebfe84b92
tree	4e5ee5b1bafb75e28024835b245ec7c9e8e7865e	tree
parent	59d8d4e96341eb54f362ac3d583ef522566e2a39	commit \| diff

Vulkan: MMVQ Integer Dot K-Quant and MUL_MAT_ID support (#16900)

* vulkan: split mul_mmq_funcs for mul_mat_vecq use

* add mxfp4 mmvq

* add q2_k mmvq

* add q3_k mmvq

* add q4_k and q5_k mmvq

* add q6_k mmvq

* handle 4x4 quants per mmvq thread

* enable MUL_MAT_ID mmvq support

* enable subgroup optimizations for mul_mat_vec_id shaders

* device tuning

* request prealloc_y sync after quantization

* fix indentation

* fix llvmpipe test failures

* fix mul_mat_id mmvq condition

* fix unused variable warning

12 files changed:

ggml/src/ggml-vulkan/ggml-vulkan.cpp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/dequant_funcs.glsl		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/generic_binary_head.glsl		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/generic_unary_head.glsl		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_base.glsl		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_iface.glsl		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vecq.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vecq_funcs.glsl	[new file with mode: 0644]	blob
ggml/src/ggml-vulkan/vulkan-shaders/mul_mmq.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mmq_funcs.glsl		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp		diff \| blob \| history

Packaging of ggml-org/llama.cpp

RSS Atom