]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
vulkan: im2col and matmul optimizations for stable diffusion (llama/10942)
authorJeff Bolz <redacted>
Sun, 29 Dec 2024 09:16:34 +0000 (03:16 -0600)
committerGeorgi Gerganov <redacted>
Sat, 4 Jan 2025 08:45:01 +0000 (10:45 +0200)
commit2112462db407d02c82b36d887fb8721923f426e8
tree97b8863970be6c8033316bbacbc170be8ef3355c
parentfc84ecd44544b3db93612e2536274a9f163db951
vulkan: im2col and matmul optimizations for stable diffusion (llama/10942)

* tests: Add im2col perf tests

* vulkan: optimize im2col, more elements per thread

* vulkan: increase small tile size for NV_coopmat2

* vulkan: change im2col to 512 elements per workgroup
ggml/src/ggml-vulkan/ggml-vulkan.cpp
ggml/src/ggml-vulkan/vulkan-shaders/im2col.comp