]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
Refactor Vulkan backend to allow multiple contexts (#7961)
author0cc4m <redacted>
Sun, 23 Jun 2024 08:21:25 +0000 (10:21 +0200)
committerGitHub <redacted>
Sun, 23 Jun 2024 08:21:25 +0000 (10:21 +0200)
commit45c0e2e4c1268c2d7c8c45536f15e3c9a731ecdc
tree5909b966247d253fd983cecb041bdca1c1394534
parentb5a5f34efadec8d8f0057b35cb04742abfeb2ef5
Refactor Vulkan backend to allow multiple contexts (#7961)

* Refactor Vulkan backend to allow multiple contexts

* Fix too many shader groups called validation error in llama3 on AMD and Intel GPUs

* Fix Vulkan debug build error
ggml-vulkan-shaders.hpp
ggml-vulkan.cpp
vulkan-shaders/mul_mat_vec.comp
vulkan-shaders/mul_mat_vec_q2_k.comp
vulkan-shaders/mul_mat_vec_q3_k.comp
vulkan-shaders/mul_mat_vec_q4_k.comp
vulkan-shaders/mul_mat_vec_q5_k.comp
vulkan-shaders/mul_mat_vec_q6_k.comp