git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

overview / pkg / ggml / sources / llama.cpp / commit

author	Kawrakow <redacted>
	Thu, 18 Jan 2024 17:18:21 +0000 (19:18 +0200)
committer	GitHub <redacted>
	Thu, 18 Jan 2024 17:18:21 +0000 (19:18 +0200)
commit	3e945cc1e9c06d2001031360e4e303e9548fb02c
tree	6e7468da2718a28a07026fd3d5d4c18edaa63bd6	tree
parent	ad19812cda4062c9f154ef16315df41fbe6a770a	commit \| diff

HellaSwag: speed up by parallelizing log-prob evaluation (#5020)

For Mistral-7B and fp16, time on my system goes down from 536 seconds
to 423 seconds for the full evaluation dataset (10042 tasks).

Co-authored-by: Iwan Kawrakow <redacted>

examples/perplexity/perplexity.cpp

diff | blob | history

Packaging of ggml-org/llama.cpp

RSS Atom