]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
llama-eval : add AIME 2026 dataset support (#23058)
authorGeorgi Gerganov <redacted>
Fri, 15 May 2026 10:58:30 +0000 (13:58 +0300)
committerGitHub <redacted>
Fri, 15 May 2026 10:58:30 +0000 (13:58 +0300)
commitd5dc2e0a0275bf51a43074920f03b08c0fa906de
tree82cfec15c62b0d93ccd19dfc3869175d351d72af
parentac33f032ac41748ffa9aaefca07cfc16e732f73f
llama-eval : add AIME 2026 dataset support (#23058)

Add Aime2026Dataset class loading from MathArena/aime_2026 on
HuggingFace. 30 problems (two sets of 15), single config/split.

Usage: --dataset aime2026

Assisted-by: llama.cpp:local pi
examples/llama-eval/llama-eval.py