git.djapps.eu Git - pkg/ggml/sources/ggml/commit

]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit

vulkan: matmul dequantization improvements (llama/12015)

* faster dequant for old quants

* dont use unpack for iq4_nl

* vec2 unpack for q8

Packaging of ggml-org/ggml

src/ggml-vulkan/vulkan-shaders/dequant_funcs.comp		diff \| blob \| history
src/ggml-vulkan/vulkan-shaders/dequant_funcs_cm2.comp		diff \| blob \| history
src/ggml-vulkan/vulkan-shaders/mul_mm.comp		diff \| blob \| history
src/ggml-vulkan/vulkan-shaders/types.comp		diff \| blob \| history
src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp		diff \| blob \| history