git.djapps.eu Git - pkg/ggml/sources/ggml/commit

]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit

overview / pkg / ggml / sources / ggml / commit

author	snadampal <redacted>
	Fri, 26 Jan 2024 17:17:59 +0000 (11:17 -0600)
committer	Georgi Gerganov <redacted>
	Sat, 27 Jan 2024 15:00:48 +0000 (17:00 +0200)
commit	f677ef577168263cb24230b95441de3a356f0b70
tree	90bc5eb4c34f5495ca50e3ff7575b8cc0ac5b34e	tree
parent	c428151657884946d263cf18f76fec60385f801b	commit \| diff

ggml : update softmax n_task calculation (llama/5126)

updated the n_task calculation to use max number of
threads possible. This has improved the prompt eval
performance by around 5% for DOT kernels and by
around 10% for MMLA kernels on AWS Graviton3.

src/ggml.c

diff | blob | history

Packaging of ggml-org/ggml

RSS Atom