]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
vulkan: optimize coopmat2 q4_k/q5_k dequant functions. (llama/11206)
authorJeff Bolz <redacted>
Thu, 16 Jan 2025 21:23:49 +0000 (15:23 -0600)
committerGeorgi Gerganov <redacted>
Mon, 3 Feb 2025 20:00:57 +0000 (22:00 +0200)
commit09f3c6664870dad525448e8da43e92d8c8f6fd20
tree1b509a60f4e5004901091cae16934184b89c9c6d
parent62e24146200c8d0ae2473389f8d9bbd4efbfafb7
vulkan: optimize coopmat2 q4_k/q5_k dequant functions. (llama/11206)

Do masking on whole dwords, fetch all scales at once.
ggml/src/ggml-vulkan/vulkan-shaders/dequant_funcs_cm2.comp
ggml/src/ggml-vulkan/vulkan-shaders/types.comp