]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: fdd2188)
vulkan: im2col and matmul optimizations for stable diffusion (#10942)
authorJeff Bolz <redacted>
Sun, 29 Dec 2024 09:16:34 +0000 (03:16 -0600)
committerGitHub <redacted>
Sun, 29 Dec 2024 09:16:34 +0000 (10:16 +0100)
commita813badbbdf0d38705f249df7a0c99af5cdee678
treef49a5d4eb2c2dae27db09087ced0fac29adbb768tree
parentfdd21889123bec62b1db3b2fc22b5a4abab32174commit | diff
vulkan: im2col and matmul optimizations for stable diffusion (#10942)

* tests: Add im2col perf tests

* vulkan: optimize im2col, more elements per thread

* vulkan: increase small tile size for NV_coopmat2

* vulkan: change im2col to 512 elements per workgroup
ggml/src/ggml-vulkan/ggml-vulkan.cpp diff | blob | history
ggml/src/ggml-vulkan/vulkan-shaders/im2col.comp diff | blob | history
tests/test-backend-ops.cpp diff | blob | history
Packaging of ggml-org/llama.cpp