git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

overview / pkg / ggml / sources / llama.cpp / commit

summary | shortlog | log | commit | commitdiff | tree
(parent: 5a7d312)

author	Georgi Gerganov <redacted>
	Sun, 3 Dec 2023 08:58:16 +0000 (10:58 +0200)
committer	GitHub <redacted>
	Sun, 3 Dec 2023 08:58:16 +0000 (10:58 +0200)
commit	d7b800b8bc490a221acbd83c575206a907f2f6e2
tree	c41c5d8ead5fb3cb23ea0b5bca51f92a58e0d7cf	tree
parent	5a7d3125e7c24f223659b7f0b7aa7736986e92c0	commit \| diff

llama : pad KV cache size (#4280)

* llama : pad KV cache size to 32

* metal : try to improve batched decoding

ggml-metal.m		diff \| blob \| history
llama.cpp		diff \| blob \| history

Packaging of ggml-org/llama.cpp