]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 6bc4400)
ggml : add CLBlast q5_0, q5_1, q8_0 dequant kernels (#1225)
author0cc4m <redacted>
Sun, 30 Apr 2023 18:34:52 +0000 (20:34 +0200)
committerGitHub <redacted>
Sun, 30 Apr 2023 18:34:52 +0000 (21:34 +0300)
commit76a884920aa1d2fc0dc7a7ac12dfc5ec5816377c
tree759c2a1d93d9f2c2c83dd898f3fe89c511147e43tree
parent6bc4400e67e6bc4faad3ad3d5e9d8a6576a9752dcommit | diff
ggml : add CLBlast q5_0, q5_1, q8_0 dequant kernels (#1225)

* Implement q5_0, q5_1 and q8_0

* Work around q5_0 OpenCL issue

* Fix q8_0 dequant kernel

* Move cl kernels into ggml-opencl.c

* Use two memcpy calls for q5_0 buffer transfer
ggml-opencl-dequant.cl [deleted file] blob | history
ggml-opencl.c diff | blob | history
Packaging of ggml-org/llama.cpp