]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 9a08eaf)
metal : concurrently dispatch commands (#2358)
authorShouzheng Liu <redacted>
Tue, 25 Jul 2023 12:00:19 +0000 (08:00 -0400)
committerGitHub <redacted>
Tue, 25 Jul 2023 12:00:19 +0000 (15:00 +0300)
commit1aa18ef994a6a2b531434eb13251ef48e56d345b
tree7ce76e5926ae0a6a48db56590f69873aca8dd917tree
parent9a08eaf3c4010962d0126e9e5bfbe9af64b2ac90commit | diff
metal : concurrently dispatch commands (#2358)

* metal: concurrently dispatch commands

Function `ggml_metal_graph_find_concurrency` will run and write
commands that can be issued concurrently to metal context `concur_list`
array, when `ggml_metal_graph_compute` is called for the first time.

* metal: don't call find_concurrency automatically.

* metal : code style changes

---------

Co-authored-by: Georgi Gerganov <redacted>
ggml-metal.h diff | blob | history
ggml-metal.m diff | blob | history
llama.cpp diff | blob | history
Packaging of ggml-org/llama.cpp