]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
opencl: add basic support for q4_1 (llama/19534)
authorlhez <redacted>
Thu, 12 Feb 2026 22:52:37 +0000 (14:52 -0800)
committerGeorgi Gerganov <redacted>
Sat, 14 Feb 2026 22:20:18 +0000 (00:20 +0200)
commit20fe3a8ad8fa16826238b7b5eb057e69b1605c24
treebfc5ac63564f316213ee562b529cd7708e177457
parent9c80bbfba8dd14056ca73a6c5bc8d9647a1c27f4
opencl: add basic support for q4_1 (llama/19534)

* opencl: add q4_1 mv

* opencl: clean up

* opencl: add flattened q4_1 mv

* opencl: clean up

* opencl: add basic q4_1 mm

* opencl: fix whitespace

* opencl: add general q4_0 mm
src/ggml-opencl/CMakeLists.txt
src/ggml-opencl/ggml-opencl.cpp
src/ggml-opencl/kernels/cvt.cl
src/ggml-opencl/kernels/mul_mm_q4_0_f32_l4_lm.cl [new file with mode: 0644]
src/ggml-opencl/kernels/mul_mm_q4_1_f32_l4_lm.cl [new file with mode: 0644]
src/ggml-opencl/kernels/mul_mv_q4_1_f32.cl [new file with mode: 0644]
src/ggml-opencl/kernels/mul_mv_q4_1_f32_flat.cl [new file with mode: 0644]