]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
Vulkan IQ4_NL Support (#8613)
author0cc4m <redacted>
Tue, 23 Jul 2024 08:56:49 +0000 (10:56 +0200)
committerGitHub <redacted>
Tue, 23 Jul 2024 08:56:49 +0000 (10:56 +0200)
commit751fcfc6c33ea5f43cadd4d976f8fb176871df5e
tree22f21dceaa5df1d7aa2e731b2e2a6c0bd764332a
parent46e47417aa4f18c08738afd4d9a3e838e97ca03f
Vulkan IQ4_NL Support (#8613)

* Fix Vulkan matmul tests compile errors

* Add Vulkan IQ4_NL support

* Fix Vulkan DeepSeek-Coder-V2-Lite MoE support
ggml/src/ggml-vulkan.cpp
ggml/src/vulkan-shaders/dequant_funcs.comp
ggml/src/vulkan-shaders/dequant_iq4_nl.comp [new file with mode: 0644]
ggml/src/vulkan-shaders/dequant_q4_0.comp
ggml/src/vulkan-shaders/mul_mm.comp
ggml/src/vulkan-shaders/types.comp
ggml/src/vulkan-shaders/vulkan-shaders-gen.cpp