VBench: Comprehensive Benchmark Suite for Video Generative Models
Nanyang Technological University · Beijing Academy of Artificial Intelligence · +2 more institutions
Abstract
Video generation has witnessed significant advance-ments, yet evaluating these models remains a challenge. A comprehensive evaluation benchmark for video generation is indispensable for two reasons: 1) Existing metrics do not fully align with human perceptions; 2) An ideal eval-uation system should provide insights to inform future de-velopments of video generation. To this end, we present VBench, a comprehensive benchmark suite that dissects “video generation quality” into specific, hierarchical, and disentangled dimensions, each with tailored prompts and evaluation methods. VBench has three appealing proper-ties: 1) Comprehensive Dimensions: VBench comprises 16 dimensions in video generation (e.g., subject…
Citation impact
- FWCI
- 47.97
- Percentile
- 100%
- References
- 135
Authors
16- ZHZiqi HuangCorresponding
Nanyang Technological University
- YHYinan He
Beijing Academy of Artificial Intelligence, Shanghai Artificial Intelligence Laboratory
- JYJiashuo Yu
Nanyang Technological University
- FZFan Zhang
Beijing Academy of Artificial Intelligence, Shanghai Artificial Intelligence Laboratory
- CSChenyang Si
Nanyang Technological University
Topics & keywords
- Suite
- Benchmark (surveying)
- Computer science
- Generative grammar
- Artificial intelligence
- Cartography
- Geography