Attention mechanisms in computer vision: A survey
Tsinghua University · Nankai University · +1 more institution
Abstract
Humans can naturally and effectively find salient regions in complex scenes. Motivated by this observation, attention mechanisms were introduced into computer vision with the aim of imitating this aspect of the human visual system. Such an attention mechanism can be regarded as a dynamic weight adjustment process based on features of the input image. Attention mechanisms have achieved great success in many visual tasks, including image classification, object detection, semantic segmentation, video understanding, image generation, 3D vision, multimodal tasks, and self-supervised learning. In this survey, we provide a comprehensive review of various attention mechanisms in computer vision and categorize them…
Citation impact
- FWCI
- 217.58
- Percentile
- 100%
- References
- 238
Authors
10Topics & keywords
- Computer science
- Categorization
- Artificial intelligence
- Computer graphics
- Process (computing)
- Salient
- Mechanism (biology)
- Computer vision