git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit

overview / pkg / ggml / sources / whisper.cpp / commit

author	Jeff Bolz <redacted>
	Thu, 5 Feb 2026 15:26:38 +0000 (09:26 -0600)
committer	Georgi Gerganov <redacted>
	Sun, 8 Feb 2026 07:29:10 +0000 (09:29 +0200)
commit	a567c140a3d8a043f9bf78d48a79066f30d8d7a7
tree	4ce12098e7c3fcdeeddefe62edacd62afe0d6a7d	tree
parent	0781df25183fc674d84db01a0da94289c83b3a03	commit \| diff

vulkan: Preprocess FA mask to detect all-neg-inf and all-zero. (llama/19281)

Write out a 2-bit code per block and avoid loading the mask when it
matches these two common cases.

Apply this optimization when the mask is relatively large (i.e. prompt
processing).

Packaging of ggerganov/whisper.cpp

RSS Atom

ggml/src/ggml-vulkan/ggml-vulkan.cpp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/flash_attn.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/flash_attn_base.glsl		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/flash_attn_cm1.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/flash_attn_cm2.comp		diff \| blob \| history
ggml/src/ggml-vulkan/vulkan-shaders/flash_attn_mask_opt.comp	[new file with mode: 0644]	blob
ggml/src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp		diff \| blob \| history