]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
vulkan: optimize coopmat2 q4_k/q5_k dequant functions. (#11206)
authorJeff Bolz <redacted>
Thu, 16 Jan 2025 21:23:49 +0000 (15:23 -0600)
committerGitHub <redacted>
Thu, 16 Jan 2025 21:23:49 +0000 (22:23 +0100)
commit466300fe1416de2802b710215817db28d4496f41
tree934d93f3ca29540568cc13c918d2249fe9d3d1de
parent206bc53422521a67de5e2caba661e21d590d2bae
vulkan: optimize coopmat2 q4_k/q5_k dequant functions. (#11206)

Do masking on whole dwords, fetch all scales at once.
ggml/src/ggml-vulkan/vulkan-shaders/dequant_funcs_cm2.comp
ggml/src/ggml-vulkan/vulkan-shaders/types.comp