]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
vulkan : implement Stable Diffusion operators (#904)
author0cc4m <redacted>
Sun, 4 Aug 2024 15:28:08 +0000 (17:28 +0200)
committerGitHub <redacted>
Sun, 4 Aug 2024 15:28:08 +0000 (18:28 +0300)
commit18703ad600cc68dbdb04d57434c876989a841d12
tree5f263119e8ad971a3a61ff6d6612f1994c6dc75b
parent29d87fc6676e7ed0cdfdec0804b06001d9c2bb44
vulkan : implement Stable Diffusion operators (#904)

* Fix Vulkan repeat op

* Implement Vulkan concat op

* Delete old Vulkan shader generator

* Implement Vulkan im2col op

* Implement Vulkan unary gelu_quick op

* Implement Vulkan group_norm op

* Implement Vulkan timestep_embedding op

* Implement Vulkan upscale op

* Fix Vulkan vk_context tensor extra index issue

* Fix Vulkan matmul shader parameter bug

* Properly fix Vulkan matmul shader parameter bug

* Add Vulkan ADD f16 + f32 -> f16 operator support

* Implement Vulkan tanh op

* Fix Vulkan group count too large Validation error on non-Nvidia GPUs

* Throw error when too much memory is requested

* Fix another Vulkan group count too large Validation error on non-Nvidia GPUs

* Fix matmul MMQ condition

* Implement Vulkan pad op

* Fix Vulkan crash when tensor is used multiple times in a compute graph

* Add Vulkan CONCAT f16 + f16 -> f16 op

* Add Vulkan LEAKY_RELU op
29 files changed:
src/ggml-vulkan.cpp
src/ggml_vk_generate_shaders.py [deleted file]
src/vulkan-shaders/add.comp
src/vulkan-shaders/clamp.comp
src/vulkan-shaders/concat.comp [new file with mode: 0644]
src/vulkan-shaders/copy.comp
src/vulkan-shaders/div.comp
src/vulkan-shaders/gelu.comp
src/vulkan-shaders/gelu_quick.comp [new file with mode: 0644]
src/vulkan-shaders/generic_binary_head.comp
src/vulkan-shaders/generic_unary_head.comp
src/vulkan-shaders/group_norm.comp [new file with mode: 0644]
src/vulkan-shaders/im2col.comp [new file with mode: 0644]
src/vulkan-shaders/leaky_relu.comp [new file with mode: 0644]
src/vulkan-shaders/mul.comp
src/vulkan-shaders/norm.comp
src/vulkan-shaders/pad.comp [new file with mode: 0644]
src/vulkan-shaders/relu.comp
src/vulkan-shaders/rms_norm.comp
src/vulkan-shaders/scale.comp
src/vulkan-shaders/silu.comp
src/vulkan-shaders/soft_max.comp
src/vulkan-shaders/square.comp
src/vulkan-shaders/sum_rows.comp
src/vulkan-shaders/tanh.comp [new file with mode: 0644]
src/vulkan-shaders/timestep_embedding.comp [new file with mode: 0644]
src/vulkan-shaders/types.comp
src/vulkan-shaders/upscale.comp [new file with mode: 0644]
src/vulkan-shaders/vulkan-shaders-gen.cpp