]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 63d3b06)
metal : support MTLGPUFamily < Apple7, formatting, style (#3524)
authorGeorgi Gerganov <redacted>
Sun, 8 Oct 2023 07:01:53 +0000 (10:01 +0300)
committerGitHub <redacted>
Sun, 8 Oct 2023 07:01:53 +0000 (10:01 +0300)
commitb0ec5218c3d24755786b80ecce9cf4ffc07583f8
treebefa0fb2b9f9f44c2cd31e6c58d1097a0977d0fdtree
parent63d3b06a4318329f92b078e8aa0be7ab6e9f871fcommit | diff
metal : support MTLGPUFamily < Apple7, formatting, style (#3524)

* metal : improve decoding speed for batches of 2-16

* metal : rename kernels mul_mat_ to mul_mv_

* metal : indentations

* minor

* metal : print more GPU info + disable mul_mm for MTLGPUFamiliy < Apple7
ggml-metal.m diff | blob | history
ggml-metal.metal diff | blob | history
Packaging of ggml-org/llama.cpp