A Novel Performance Evaluation Methodology for Single-Target Trackers
University of Ljubljana · Czech Technical University in Prague · +4 more institutions
Abstract
This paper addresses the problem of single-target tracker performance evaluation. We consider the performance measures, the dataset and the evaluation system to be the most important components of tracker evaluation and propose requirements for each of them. The requirements are the basis of a new evaluation methodology that aims at a simple and easily interpretable tracker comparison. The ranking-based methodology addresses tracker equivalence in terms of statistical significance and practical differences. A fully-annotated dataset with per-frame annotations with several visual attributes is introduced. The diversity of its visual properties is maximized in a novel way by clustering a large number of videos…
Citation impact
- FWCI
- 40.54
- Percentile
- 100%
- References
- 89
Authors
9- MKMatej KristanCorresponding
University of Ljubljana
- JMJiřı́ Matas
Czech Technical University in Prague
- ALAleš Leonardis
University of Birmingham
- TVTomas Vojir
Czech Technical University in Prague
- RPRoman Pflugfelder
Austrian Institute of Technology
Topics & keywords
- Computer science
- BitTorrent tracker
- Benchmark (surveying)
- Ranking (information retrieval)
- Visualization
- Cluster analysis
- Data mining
- Artificial intelligence