]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
vulkan: Add VK_NV_cooperative_matrix2 support for mul_mat and flash attention (llama...
authorJeff Bolz <redacted>
Thu, 5 Dec 2024 19:15:05 +0000 (13:15 -0600)
committerGeorgi Gerganov <redacted>
Wed, 18 Dec 2024 10:52:16 +0000 (12:52 +0200)
commitb74b68212a657348c97fd9fdbfa7a072996fe35f
tree5e3cae8ca9ada51b411e400c83c53da6f6d651d1
parent3a27b2b91b6cda56d31590da9c1093e5dc96c818
vulkan: Add VK_NV_cooperative_matrix2 support for mul_mat and flash attention (llama/10206)
ggml/src/ggml-vulkan/ggml-vulkan.cpp
ggml/src/ggml-vulkan/vulkan-shaders/CMakeLists.txt
ggml/src/ggml-vulkan/vulkan-shaders/dequant_funcs_cm2.comp [new file with mode: 0644]
ggml/src/ggml-vulkan/vulkan-shaders/flash_attn_cm2.comp [new file with mode: 0644]
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm_cm2.comp [new file with mode: 0644]
ggml/src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp