]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
vulkan : implement Stable Diffusion operators (ggml/904)
author0cc4m <redacted>
Sun, 4 Aug 2024 15:28:08 +0000 (17:28 +0200)
committerGeorgi Gerganov <redacted>
Mon, 5 Aug 2024 05:50:57 +0000 (08:50 +0300)
commita3738b2fa7c60ef2c4592435d1aa7fb8f1f69c3e
tree3571fc14ef6d2e36265cc45a2bc0f85913925453
parent655858ace0cf2720e56eb01f84ad05e0c94ada3c
vulkan : implement Stable Diffusion operators (ggml/904)

* Fix Vulkan repeat op

* Implement Vulkan concat op

* Delete old Vulkan shader generator

* Implement Vulkan im2col op

* Implement Vulkan unary gelu_quick op

* Implement Vulkan group_norm op

* Implement Vulkan timestep_embedding op

* Implement Vulkan upscale op

* Fix Vulkan vk_context tensor extra index issue

* Fix Vulkan matmul shader parameter bug

* Properly fix Vulkan matmul shader parameter bug

* Add Vulkan ADD f16 + f32 -> f16 operator support

* Implement Vulkan tanh op

* Fix Vulkan group count too large Validation error on non-Nvidia GPUs

* Throw error when too much memory is requested

* Fix another Vulkan group count too large Validation error on non-Nvidia GPUs

* Fix matmul MMQ condition

* Implement Vulkan pad op

* Fix Vulkan crash when tensor is used multiple times in a compute graph

* Add Vulkan CONCAT f16 + f16 -> f16 op

* Add Vulkan LEAKY_RELU op
28 files changed:
ggml/src/ggml-vulkan.cpp
ggml/src/vulkan-shaders/add.comp
ggml/src/vulkan-shaders/clamp.comp
ggml/src/vulkan-shaders/concat.comp [new file with mode: 0644]
ggml/src/vulkan-shaders/copy.comp
ggml/src/vulkan-shaders/div.comp
ggml/src/vulkan-shaders/gelu.comp
ggml/src/vulkan-shaders/gelu_quick.comp [new file with mode: 0644]
ggml/src/vulkan-shaders/generic_binary_head.comp
ggml/src/vulkan-shaders/generic_unary_head.comp
ggml/src/vulkan-shaders/group_norm.comp [new file with mode: 0644]
ggml/src/vulkan-shaders/im2col.comp [new file with mode: 0644]
ggml/src/vulkan-shaders/leaky_relu.comp [new file with mode: 0644]
ggml/src/vulkan-shaders/mul.comp
ggml/src/vulkan-shaders/norm.comp
ggml/src/vulkan-shaders/pad.comp [new file with mode: 0644]
ggml/src/vulkan-shaders/relu.comp
ggml/src/vulkan-shaders/rms_norm.comp
ggml/src/vulkan-shaders/scale.comp
ggml/src/vulkan-shaders/silu.comp
ggml/src/vulkan-shaders/soft_max.comp
ggml/src/vulkan-shaders/square.comp
ggml/src/vulkan-shaders/sum_rows.comp
ggml/src/vulkan-shaders/tanh.comp [new file with mode: 0644]
ggml/src/vulkan-shaders/timestep_embedding.comp [new file with mode: 0644]
ggml/src/vulkan-shaders/types.comp
ggml/src/vulkan-shaders/upscale.comp [new file with mode: 0644]
ggml/src/vulkan-shaders/vulkan-shaders-gen.cpp