book chapterLecture notes in computer scienceJan 1, 2022Closed access

TinyViT: Fast Pretraining Distillation for Small Vision Transformers

KWKan WuJZJinnian ZhangHPHouwen PengMLMengchen LiuBXBin Xiao

Microsoft Research Asia (China) · Sun Yat-sen University · +2 more institutions

Indexed incrossref

Abstract

No abstract available for this paper.

Citation impact

328
total citations
FWCI
38.54
Percentile
100%
References
51
Citations per year

Authors

7

Topics & keywords

Topics
Keywords
  • Computer science
  • Transformer
  • Computation
  • Distillation
  • Artificial intelligence
  • Machine learning
  • Source code
  • Algorithm
UN Sustainable Development Goals
  • Quality Education
No related works found for this paper.