]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 87837d3)
vulkan: im2col and matmul optimizations for stable diffusion (llama/10942)
authorJeff Bolz <redacted>
Sun, 29 Dec 2024 09:16:34 +0000 (03:16 -0600)
committerGeorgi Gerganov <redacted>
Fri, 3 Jan 2025 12:00:38 +0000 (14:00 +0200)
commit74c83c417838b18fe9e19992b33274c9a04b5a8d
tree4c3ff1e44f3a2d92bfacfcbffdd1eebd84e83c8btree
parent87837d3e97f3f6a4e402ffa3d2cd15d917cdfae2commit | diff
vulkan: im2col and matmul optimizations for stable diffusion (llama/10942)

* tests: Add im2col perf tests

* vulkan: optimize im2col, more elements per thread

* vulkan: increase small tile size for NV_coopmat2

* vulkan: change im2col to 512 elements per workgroup
src/ggml-vulkan/ggml-vulkan.cpp diff | blob | history
src/ggml-vulkan/vulkan-shaders/im2col.comp diff | blob | history
tests/test-backend-ops.cpp diff | blob | history
Packaging of ggml-org/ggml