git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit

overview / pkg / ggml / sources / whisper.cpp / commit

author	Rémy Oudompheng <redacted>
	Wed, 29 Jan 2025 17:29:39 +0000 (18:29 +0100)
committer	Georgi Gerganov <redacted>
	Mon, 3 Feb 2025 20:00:57 +0000 (22:00 +0200)
commit	80fa576254aa136231457236bb00ec085249ee80
tree	0f7ed1b5e8c69a76e61a1ae5046cf492cdfd68b8	tree
parent	75e7d0585e863e20e9e06feb6a7390d6507436ff	commit \| diff

vulkan: implement initial support for IQ2 and IQ3 quantizations (llama/11360)

* vulkan: initial support for IQ3_S

* vulkan: initial support for IQ3_XXS

* vulkan: initial support for IQ2_XXS

* vulkan: initial support for IQ2_XS

* vulkan: optimize Q3_K by removing branches

* vulkan: implement dequantize variants for coopmat2

* vulkan: initial support for IQ2_S

* vulkan: vertically realign code

* port failing dequant callbacks from mul_mm

* Fix array length mismatches

* vulkan: avoid using workgroup size before it is referenced

* tests: increase timeout for Vulkan llvmpipe backend

---------

Co-authored-by: Jeff Bolz <redacted>

18 files changed:

ggml/src/ggml-vulkan/ggml-vulkan.cpp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/copy_from_quant.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/copy_to_quant.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/dequant_funcs.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/dequant_funcs_cm2.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/dequant_iq2_s.comp	[new file with mode: 0644]	blob
ggml/src/ggml-vulkan/vulkan-shaders/dequant_iq2_xs.comp	[new file with mode: 0644]	blob
ggml/src/ggml-vulkan/vulkan-shaders/dequant_iq2_xxs.comp	[new file with mode: 0644]	blob
ggml/src/ggml-vulkan/vulkan-shaders/dequant_iq3_s.comp	[new file with mode: 0644]	blob
ggml/src/ggml-vulkan/vulkan-shaders/dequant_iq3_xxs.comp	[new file with mode: 0644]	blob
ggml/src/ggml-vulkan/vulkan-shaders/dequant_iq4_nl.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/flash_attn_cm2.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/get_rows_quant.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm_cm2.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/types.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp		diff \| blob \| history

Packaging of ggerganov/whisper.cpp

RSS Atom