]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
vulkan: optimize coopmat2 q4_k/q5_k dequant functions. (llama/11206)
authorJeff Bolz <redacted>
Thu, 16 Jan 2025 21:23:49 +0000 (15:23 -0600)
committerGeorgi Gerganov <redacted>
Wed, 29 Jan 2025 10:57:00 +0000 (12:57 +0200)
commit5b62c4013e7db24de63acc6159fb10ff7ba147e0
tree014c40f30feda0bfcaadea872d632981ad8f18f3
parent8bc94476d06b9b1ce6ef5c39b536d17299506171
vulkan: optimize coopmat2 q4_k/q5_k dequant functions. (llama/11206)

Do masking on whole dwords, fetch all scales at once.
src/ggml-vulkan/vulkan-shaders/dequant_funcs_cm2.comp
src/ggml-vulkan/vulkan-shaders/types.comp