]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: b760272)
opencl: add iq4_nl support (#22272)
authorlhez <redacted>
Sun, 26 Apr 2026 04:21:58 +0000 (21:21 -0700)
committerGitHub <redacted>
Sun, 26 Apr 2026 04:21:58 +0000 (21:21 -0700)
commitf454bd7eb8944629aabca163ea1c6e67e53fd77e
treed084f0e8146888390cae0397b16ae62cfd9c3a25tree
parentb760272f1a25fcae065d827ce2cbcaa035597b02commit | diff
opencl: add iq4_nl support (#22272)

* opencl: add general support for iq4_nl

* opencl: add iq4_nl gemm/gemv for adreno

* opencl: pack 2 lut entries into a uint
ggml/src/ggml-opencl/CMakeLists.txt diff | blob | history
ggml/src/ggml-opencl/ggml-opencl.cpp diff | blob | history
ggml/src/ggml-opencl/kernels/cvt.cl diff | blob | history
ggml/src/ggml-opencl/kernels/gemm_noshuffle_iq4_nl_f32.cl [new file with mode: 0644] blob
ggml/src/ggml-opencl/kernels/gemv_noshuffle_iq4_nl_f32.cl [new file with mode: 0644] blob
ggml/src/ggml-opencl/kernels/mul_mm_iq4_nl_f32_l4_lm.cl [new file with mode: 0644] blob
ggml/src/ggml-opencl/kernels/mul_mv_iq4_nl_f32.cl [new file with mode: 0644] blob
ggml/src/ggml-opencl/kernels/mul_mv_iq4_nl_f32_flat.cl [new file with mode: 0644] blob
Packaging of ggml-org/llama.cpp