AI benchmarks: what each one measures

2 of 85 benchmarks

Benchmark	Domain	Introduced	Paper	Scores
GenEvalGenerate images that get objects, counts, colours and positions right.Image and video generation · 2023University of Washington	Image and video generation	Oct 17, 20233 years ago	2310.11513	·
VBenchGenerate videos that score well on 16 separate quality and consistency dimensions.Image and video generation · 2023Nanyang Technological University and Shanghai AI Laboratory	Image and video generation	Nov 29, 20232 years ago	2311.17982	·

Scores counts the models with a captured score on the boards that publish this benchmark. A dot means we capture no board for it yet.

Sources: each benchmark's paper (arXiv) and its official site or leaderboard. Scores are the boards captured here every day, exactly as published.

AI benchmarks: what is being measured