10 of 85 benchmarks in Reasoning
| Benchmark | Domain | Introduced | Paper | Scores |
|---|
 ARC-AGI-1Reasoning · 2019ARC Prize Foundation (created by François Chollet) | Reasoning | Nov 5, 20196y6 years ago | 1911.01547 | · |
| ARC-AGI-2Reasoning · 2025ARC Prize Foundation | Reasoning | Mar 24, 20251y1 year ago | 2505.11831 | 79 |
| ARC-AGI-3Reasoning · 2026ARC Prize Foundation | Reasoning | Mar 25, 20266mo6 months ago | · | · |
 BIG-Bench HardReasoning · 2022Google | Reasoning | Oct 17, 20223y3 years ago | 2210.09261 | · |
| BIG-benchReasoning · 2022Google and 450+ collaborators | Reasoning | Jun 9, 20224y4 years ago | 2206.04615 | · |
 HellaSwagReasoning · 2019University of Washington and Allen Institute for AI | Reasoning | May 19, 20197y7 years ago | 1905.07830 | · |
 AI2 Reasoning Challenge (ARC)Reasoning · 2018Allen Institute for AI | Reasoning | Mar 14, 20188y8 years ago | 1803.05457 | · |
| WinoGrandeReasoning · 2019Allen Institute for AI and University of Washington | Reasoning | Jul 24, 20197y7 years ago | 1907.10641 | · |
 MuSRReasoning · 2023University of Texas at Austin | Reasoning | Oct 24, 20232y2 years ago | 2310.16049 | · |
 LiveBenchReasoning · 2024LiveBench (Abacus.AI, NYU, NVIDIA and others) | Reasoning | Jun 27, 20242y2 years ago | 2406.19314 | 59 |
Scores counts the models with a captured score on the boards that publish this benchmark. A dot means we capture no board for it yet.
Sources: each benchmark's paper (arXiv) and its official site or leaderboard. Scores are the boards captured here every day, exactly as published.