Benchmarks: what is being measured
85 AI benchmarks in 15 domains, each with its task, dataset, method, metric, versions and paper. 28 have scores captured here every day.
12 of 85 benchmarks in Coding
| Benchmark | Scores | |||
|---|---|---|---|---|
| Coding | Jul 7, 20215 years ago | 2107.03374 | · | |
| Coding | Aug 16, 20215 years ago | 2108.07732 | · | |
| Coding | Oct 10, 20232 years ago | 2310.06770 | · | |
| Coding | Aug 20242 years ago | 2310.06770 | 39 | |
| Coding | Sep 21, 20251 year ago | 2509.16941 | 11 | |
| Coding | Mar 12, 20242 years ago | 2403.07974 | · | |
| Coding | Dec 20241 year ago | · | 50 | |
| Coding | May 19, 20251 year ago | 2601.11868 | · | |
| Coding | Jul 18, 20242 years ago | 2407.13168 | · | |
| Coding | Jun 22, 20242 years ago | 2406.15877 | · | |
| Coding | Oct 9, 20241 year ago | 2410.07095 | · | |
| Coding | Feb 17, 20251 year ago | 2502.12115 | · |
Scores counts the models with a captured score on the boards that publish this benchmark. A dot means we capture no board for it yet.
Sources: each benchmark's paper (arXiv) and its official site or leaderboard. Scores are the boards captured here every day, exactly as published.