Every AI leaderboard

28 leaderboards · 992 models ranked

AI benchmarks: what is being measured

12 of 85 benchmarks

BenchmarkScores
HumanEvalWrite a Python function from its signature and docstring.Coding · 2021OpenAI·
MBPPWrite short Python programs from a one-sentence description.Coding · 2021Google·
SWE-benchResolve a real GitHub issue by editing the repository so the hidden tests pass.Coding · 2023Princeton University·
SWE-bench VerifiedResolve real GitHub issues; the subset people confirmed is well specified and fairly tested.Coding · 2024SWE-bench team and OpenAI39
SWE-Bench ProSolve long-horizon, enterprise-style software engineering tasks in real repositories.Coding · 2025Scale AI18
LiveCodeBenchSolve competitive programming problems published after a model was trained; also self-repair and test-output prediction.Coding · 2024UC Berkeley, MIT and Cornell·
Aider PolyglotEdit code to solve hard programming exercises in six languages, through the Aider coding assistant.Coding · 2024Aider50
Terminal-BenchComplete hard, realistic tasks in a computer terminal: build, debug, configure, analyse.Coding · 2025Stanford University and Laude Institute·
SciCodeWrite code for research problems from 16 natural-science subfields.Coding · 2024University of Illinois and collaborators·
BigCodeBenchWrite Python that calls many library functions to complete practical tasks.Coding · 2024BigCode·
MLE-benchAct as a machine-learning engineer on Kaggle competitions: prepare data, train, submit.Coding · 2024OpenAI·
SWE-LancerComplete real freelance software jobs from Upwork, both implementation and choosing between proposals.Coding · 2025OpenAI·

Scores counts the models with a captured score on the boards that publish this benchmark. A dot means we capture no board for it yet.

Sources: each benchmark's paper (arXiv) and its official site or leaderboard. Scores are the boards captured here every day, exactly as published.