]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 0c7b359)
Vulkan Shader Refactor, Memory Debugging Option (#7947)
author0cc4m <redacted>
Sun, 16 Jun 2024 05:17:31 +0000 (07:17 +0200)
committerGitHub <redacted>
Sun, 16 Jun 2024 05:17:31 +0000 (07:17 +0200)
commit7c7836d9d4062d6858e3fb337b135c417ccee6ce
treec896967a106e2985763bf1c7bfd7bfb8cbe4f0fdtree
parent0c7b3595b9e5ad2355818e259f06b0dc3f0065b3commit | diff
Vulkan Shader Refactor, Memory Debugging Option (#7947)

* Refactor shaders, extract GLSL code from ggml_vk_generate_shaders.py into vulkan-shaders directory

* Improve debug log code

* Add memory debug output option

* Fix flake8

* Fix unnecessary high llama-3 VRAM use
54 files changed:
CMakeLists.txt diff | blob | history
Makefile diff | blob | history
ggml-vulkan-shaders.hpp diff | blob | history
ggml-vulkan.cpp diff | blob | history
ggml_vk_generate_shaders.py diff | blob | history
vulkan-shaders/add.comp [new file with mode: 0644] blob
vulkan-shaders/argsort.comp [new file with mode: 0644] blob
vulkan-shaders/clamp.comp [new file with mode: 0644] blob
vulkan-shaders/copy.comp [new file with mode: 0644] blob
vulkan-shaders/dequant_f32.comp [new file with mode: 0644] blob
vulkan-shaders/dequant_funcs.comp [new file with mode: 0644] blob
vulkan-shaders/dequant_head.comp [new file with mode: 0644] blob
vulkan-shaders/dequant_q2_k.comp [new file with mode: 0644] blob
vulkan-shaders/dequant_q3_k.comp [new file with mode: 0644] blob
vulkan-shaders/dequant_q4_0.comp [new file with mode: 0644] blob
vulkan-shaders/dequant_q4_1.comp [new file with mode: 0644] blob
vulkan-shaders/dequant_q4_k.comp [new file with mode: 0644] blob
vulkan-shaders/dequant_q5_0.comp [new file with mode: 0644] blob
vulkan-shaders/dequant_q5_1.comp [new file with mode: 0644] blob
vulkan-shaders/dequant_q5_k.comp [new file with mode: 0644] blob
vulkan-shaders/dequant_q6_k.comp [new file with mode: 0644] blob
vulkan-shaders/dequant_q8_0.comp [new file with mode: 0644] blob
vulkan-shaders/diag_mask_inf.comp [new file with mode: 0644] blob
vulkan-shaders/div.comp [new file with mode: 0644] blob
vulkan-shaders/gelu.comp [new file with mode: 0644] blob
vulkan-shaders/generic_binary_head.comp [new file with mode: 0644] blob
vulkan-shaders/generic_head.comp [new file with mode: 0644] blob
vulkan-shaders/generic_unary_head.comp [new file with mode: 0644] blob
vulkan-shaders/get_rows.comp [new file with mode: 0644] blob
vulkan-shaders/get_rows_quant.comp [new file with mode: 0644] blob
vulkan-shaders/mul.comp [new file with mode: 0644] blob
vulkan-shaders/mul_mat_split_k_reduce.comp [new file with mode: 0644] blob
vulkan-shaders/mul_mat_vec.comp [new file with mode: 0644] blob
vulkan-shaders/mul_mat_vec_base.comp [new file with mode: 0644] blob
vulkan-shaders/mul_mat_vec_nc.comp [new file with mode: 0644] blob
vulkan-shaders/mul_mat_vec_p021.comp [new file with mode: 0644] blob
vulkan-shaders/mul_mat_vec_q2_k.comp [new file with mode: 0644] blob
vulkan-shaders/mul_mat_vec_q3_k.comp [new file with mode: 0644] blob
vulkan-shaders/mul_mat_vec_q4_k.comp [new file with mode: 0644] blob
vulkan-shaders/mul_mat_vec_q5_k.comp [new file with mode: 0644] blob
vulkan-shaders/mul_mat_vec_q6_k.comp [new file with mode: 0644] blob
vulkan-shaders/mul_mm.comp [new file with mode: 0644] blob
vulkan-shaders/norm.comp [new file with mode: 0644] blob
vulkan-shaders/relu.comp [new file with mode: 0644] blob
vulkan-shaders/rms_norm.comp [new file with mode: 0644] blob
vulkan-shaders/rope_head.comp [new file with mode: 0644] blob
vulkan-shaders/rope_neox.comp [new file with mode: 0644] blob
vulkan-shaders/rope_norm.comp [new file with mode: 0644] blob
vulkan-shaders/scale.comp [new file with mode: 0644] blob
vulkan-shaders/silu.comp [new file with mode: 0644] blob
vulkan-shaders/soft_max.comp [new file with mode: 0644] blob
vulkan-shaders/square.comp [new file with mode: 0644] blob
vulkan-shaders/sum_rows.comp [new file with mode: 0644] blob
vulkan-shaders/types.comp [new file with mode: 0644] blob
Packaging of ggml-org/llama.cpp