DeepPoseKit, a software toolkit for fast and robust animal pose estimation using deep learning
University of Konstanz · Max Planck Institute of Animal Behavior · +2 more institutions
Abstract
Quantitative behavioral measurements are important for answering questions across scientific disciplines—from neuroscience to ecology. State-of-the-art deep-learning methods offer major advances in data quality and detail by allowing researchers to automatically estimate locations of an animal’s body parts directly from images or videos. However, currently available animal pose estimation methods have limitations in speed and robustness. Here, we introduce a new easy-to-use software toolkit, DeepPoseKit, that addresses these problems using an efficient multi-scale deep-learning model, called Stacked DenseNet, and a fast GPU-based peak-detection algorithm for estimating keypoint locations with subpixel…
Citation impact
- FWCI
- 72.30
- Percentile
- 100%
- References
- 145
Authors
7- JMJacob M. GravingCorresponding
University of Konstanz, Max Planck Institute of Animal Behavior
- DHDaniel H. Chae
Princeton University
- HNHemal Naik
University of Konstanz, Max Planck Institute of Animal Behavior, Technical University of Munich
- LLLiang Li
University of Konstanz, Max Planck Institute of Animal Behavior
- BKBenjamin Koger
University of Konstanz, Max Planck Institute of Animal Behavior
Topics & keywords
- Subpixel rendering
- Computer science
- Robustness (evolution)
- Artificial intelligence
- Deep learning
- Machine learning
- Software
- Pose
Funding
- NSNational Science FoundationAwards: N00014-14-1-0635, 1355061, IOS-1355061, N00014-09-1-1074
- NNvidia
- ECEuropean CommissionAward: 748549
- DFDeutsche Forschungsgemeinschaft
- MFMinisterium für Wissenschaft, Forschung und Kunst Baden-Württemberg
- MMax-Planck-GesellschaftAwards: W911NG-11-1-0385, N00014-09-1-1074, IOS-1355061, N00014-14-1-0635
- UKUniversität Konstanz
- H2Horizon 2020 Framework ProgrammeAward: 748549
- OOOffice of Naval ResearchAwards: N00014-09-1-1074, N00014-14-1-0635, IOS-1355061, W911NG-11-1-0385, N00014
- ARArmy Research OfficeAwards: N00014-14-1-0635, W911NF14-1-0431, IOS-1355061, W911NG-11-1-0385, N00014-09-1-1074