Benchmarks: what is being measured
85 AI benchmarks in 15 domains, each with its task, dataset, method, metric, versions and paper. 28 have scores captured here every day.
9 of 85 benchmarks in Agents and tools
| Benchmark | Scores | |||
|---|---|---|---|---|
| Agents and tools | Jun 17, 20242 years ago | 2406.12045 | · | |
| Agents and tools | Feb 26, 20242 years ago | · | 81 | |
| Agents and tools | · | 34 | ||
| Agents and tools | Nov 21, 20232 years ago | 2311.12983 | · | |
| Agents and tools | Jul 25, 20233 years ago | 2307.13854 | · | |
| Agents and tools | Apr 11, 20242 years ago | 2404.07972 | · | |
| Agents and tools | Apr 16, 20251 year ago | 2504.12516 | · | |
| Agents and tools | Oct 5, 202511 months ago | 2510.04374 | · | |
| Agents and tools | Feb 20, 20251 year ago | 2502.15840 | · |
Scores counts the models with a captured score on the boards that publish this benchmark. A dot means we capture no board for it yet.
Sources: each benchmark's paper (arXiv) and its official site or leaderboard. Scores are the boards captured here every day, exactly as published.