Skip to content

Benchmarks: what is being measured

85 AI benchmarks in 15 domains, each with its task, dataset, method, metric, versions and paper. 28 have scores captured here every day.

5 of 85 benchmarks in Math

BenchmarkScores
GSM8KMath · 2021OpenAI·
MATH (and MATH-500)Math · 2021UC Berkeley·
AIMEMathMathematical Association of America·
FrontierMathMath · 2024Epoch AI·
MGSMMath · 2022Google·

Scores counts the models with a captured score on the boards that publish this benchmark. A dot means we capture no board for it yet.

Sources: each benchmark's paper (arXiv) and its official site or leaderboard. Scores are the boards captured here every day, exactly as published.

New #1s by email

Saturdays, only in weeks when a leaderboard has a new #1.

Double opt-in. Unsubscribe any time.