Skip to content

Benchmarks: what is being measured

85 AI benchmarks in 15 domains, each with its task, dataset, method, metric, versions and paper. 28 have scores captured here every day.

2 of 85 benchmarks in Chat and instructions

BenchmarkScores
IFEvalChat and instructions · 2023Google·
MultiChallengeChat and instructions · 2025Scale AI29

Scores counts the models with a captured score on the boards that publish this benchmark. A dot means we capture no board for it yet.

Sources: each benchmark's paper (arXiv) and its official site or leaderboard. Scores are the boards captured here every day, exactly as published.

New #1s by email

Saturdays, only in weeks when a leaderboard has a new #1.

Double opt-in. Unsubscribe any time.