]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
opencl: add basic support for q4_1 (llama/19534)
authorlhez <redacted>
Thu, 12 Feb 2026 22:52:37 +0000 (14:52 -0800)
committerGeorgi Gerganov <redacted>
Sun, 15 Feb 2026 19:44:37 +0000 (21:44 +0200)
commit9f87eeccdf982faf6aeeb1cef53c6f2681c792ff
treea691c87ade979451deb5c25c3d159bf6205c0266
parentd8e3e2ef0891ff858aeacc62b5b44ccaae62ba6f
opencl: add basic support for q4_1 (llama/19534)

* opencl: add q4_1 mv

* opencl: clean up

* opencl: add flattened q4_1 mv

* opencl: clean up

* opencl: add basic q4_1 mm

* opencl: fix whitespace

* opencl: add general q4_0 mm
ggml/src/ggml-opencl/CMakeLists.txt
ggml/src/ggml-opencl/ggml-opencl.cpp
ggml/src/ggml-opencl/kernels/cvt.cl
ggml/src/ggml-opencl/kernels/mul_mm_q4_0_f32_l4_lm.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/mul_mm_q4_1_f32_l4_lm.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/mul_mv_q4_1_f32.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/mul_mv_q4_1_f32_flat.cl [new file with mode: 0644]