Benchmarks: what is being measured
85 AI benchmarks in 15 domains, each with its task, dataset, method, metric, versions and paper. 28 have scores captured here every day.
7 of 85 benchmarks in Multimodal
| Benchmark | Scores | |||
|---|---|---|---|---|
| MMMUMultimodal · 2023MMMU team | Multimodal | Nov 27, 20232 years ago | 2311.16502 | · |
| Multimodal | Oct 3, 20232 years ago | 2310.02255 | · | |
| Multimodal | Mar 19, 20224 years ago | 2203.10244 | · | |
| Multimodal | Jul 1, 20206 years ago | 2007.00398 | · | |
| Video-MMEMultimodal · 2024Video-MME team | Multimodal | May 31, 20242 years ago | 2405.21075 | · |
| Multimodal | Jul 12, 20233 years ago | 2307.06281 | · | |
| Multimodal | Mar 24, 201610 years ago | 1603.07396 | · |
Scores counts the models with a captured score on the boards that publish this benchmark. A dot means we capture no board for it yet.
Sources: each benchmark's paper (arXiv) and its official site or leaderboard. Scores are the boards captured here every day, exactly as published.