]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
vulkan: Add VK_NV_cooperative_matrix2 support for mul_mat and flash attention (llama...
authorJeff Bolz <redacted>
Thu, 5 Dec 2024 19:15:05 +0000 (13:15 -0600)
committerGeorgi Gerganov <redacted>
Tue, 10 Dec 2024 16:33:03 +0000 (18:33 +0200)
commite702374aa155790039261da2e8603b880bf96155
tree81b6bcb2889b9a58db73af36c105c1adab0b45f3
parent620bee8c8f9f7ef7337f54907ac058c27d26c480
vulkan: Add VK_NV_cooperative_matrix2 support for mul_mat and flash attention (llama/10206)
src/ggml-vulkan/ggml-vulkan.cpp
src/ggml-vulkan/vulkan-shaders/CMakeLists.txt
src/ggml-vulkan/vulkan-shaders/dequant_funcs_cm2.comp [new file with mode: 0644]
src/ggml-vulkan/vulkan-shaders/flash_attn_cm2.comp [new file with mode: 0644]
src/ggml-vulkan/vulkan-shaders/mul_mm_cm2.comp [new file with mode: 0644]
src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp