]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
opencl: add iq4_nl support (llama/22272)
authorlhez <redacted>
Sun, 26 Apr 2026 04:21:58 +0000 (21:21 -0700)
committerGeorgi Gerganov <redacted>
Thu, 30 Apr 2026 08:29:19 +0000 (11:29 +0300)
commit93a3f376421cd1439e2f25e2b8687bb5685e4e15
treee688efb44173a7c3c32fca1fad37f4d4f576e973
parent1be2adf7b3df28f450a60822ad3952316aaa6644
opencl: add iq4_nl support (llama/22272)

* opencl: add general support for iq4_nl

* opencl: add iq4_nl gemm/gemv for adreno

* opencl: pack 2 lut entries into a uint
ggml/src/ggml-opencl/CMakeLists.txt
ggml/src/ggml-opencl/ggml-opencl.cpp
ggml/src/ggml-opencl/kernels/cvt.cl
ggml/src/ggml-opencl/kernels/gemm_noshuffle_iq4_nl_f32.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/gemv_noshuffle_iq4_nl_f32.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/mul_mm_iq4_nl_f32_l4_lm.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/mul_mv_iq4_nl_f32.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/mul_mv_iq4_nl_f32_flat.cl [new file with mode: 0644]