VBench what it measures, how it is scored and who leads it
Image and video generation · Nanyang Technological University and Shanghai AI Laboratory · introduced Nov 29, 2023 · Dimension scores
About this benchmark
- Task
- Generate videos that score well on 16 separate quality and consistency dimensions.
- Dataset
- Prompt suites per dimension.
- Method
- Automatic metrics per dimension, validated against human preference.
- Metric
- Dimension scores
- Organization
- Nanyang Technological University and Shanghai AI Laboratory
- Introduced
- Nov 29, 2023
- Official leaderboard
- huggingface.co/spaces/Vchitect/VBench_Leaderboard
Versions
Newest first. New versions are added, never rewritten.
| Version | Date | |
|---|---|---|
| 1Released with the paper. | Nov 29, 20232 years ago | Released with the paper. |
Sources: each benchmark's paper (arXiv) and its official site or leaderboard. Scores are the boards captured here every day, exactly as published.