]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
opencl: add basic support for q4_1 (#19534)
authorlhez <redacted>
Thu, 12 Feb 2026 22:52:37 +0000 (14:52 -0800)
committerGitHub <redacted>
Thu, 12 Feb 2026 22:52:37 +0000 (14:52 -0800)
commit79cc0f2dafbc7cbbfc37a8d99b399b816e141b90
tree992416605f180013682b47ea7cee9e570a997d28
parent338085c69e486b7155e5b03d7b5087e02c0e2528
opencl: add basic support for q4_1 (#19534)

* opencl: add q4_1 mv

* opencl: clean up

* opencl: add flattened q4_1 mv

* opencl: clean up

* opencl: add basic q4_1 mm

* opencl: fix whitespace

* opencl: add general q4_0 mm
ggml/src/ggml-opencl/CMakeLists.txt
ggml/src/ggml-opencl/ggml-opencl.cpp
ggml/src/ggml-opencl/kernels/cvt.cl
ggml/src/ggml-opencl/kernels/mul_mm_q4_0_f32_l4_lm.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/mul_mm_q4_1_f32_l4_lm.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/mul_mv_q4_1_f32.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/mul_mv_q4_1_f32_flat.cl [new file with mode: 0644]