]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 29a404a)
CLBlast: Add broadcast support for matrix multiplication (#3402)
authorshibe2 <redacted>
Mon, 2 Oct 2023 19:26:15 +0000 (23:26 +0400)
committerGitHub <redacted>
Mon, 2 Oct 2023 19:26:15 +0000 (21:26 +0200)
commit665018c749101e81c816675198e731e47d6b1dbe
tree4486f9b1484367d04d2609b57453af30cf0c8453tree
parent29a404a951fb0b3f9c3b6ab8c4c9c76ac50d2bb3commit | diff
CLBlast: Add broadcast support for matrix multiplication (#3402)

Broadcast src0 into src1 across dimensions 2 and 3 when needed.
This is required for models that use GQA.
ggml-opencl.cpp diff | blob | history
ggml.c diff | blob | history
Packaging of ggml-org/llama.cpp