The Devil Is in the Details: Window-based Attention for Image Compression
University of Chinese Academy of Sciences · Centre for Artificial Intelligence and Robotics
Abstract
Learned image compression methods have exhibited superior rate-distortion performance than classical image compression standards. Most existing learned image compression models are based on Convolutional Neural Networks (CNNs). Despite great contributions, a main drawback of CNN based model is that its structure is not designed for capturing local redundancy, especially the nonrepetitive textures, which severely affects the reconstruction quality. Therefore, how to make full use of both global structure and local texture becomes the core problem for learning-based image compression. Inspired by recent progresses of Vision Transformer (ViT) and Swin Transformer, we found that combining the local-aware attention…
Citation impact
- FWCI
- 14.40
- Percentile
- 100%
- References
- 58
Authors
3Topics & keywords
- Computer science
- Encoder
- Artificial intelligence
- Image compression
- Transformer
- Convolutional neural network
- Redundancy (engineering)
- Computer vision