DS-TransUNet: Dual Swin Transformer U-Net for Medical Image Segmentation
Shenzhen Institute of Information Technology · Harbin Institute of Technology · +1 more institution
Abstract
Automatic medical image segmentation has made great progress owing to the powerful deep representation learning. Inspired by the success of self-attention mechanism in Transformer, considerable efforts are devoted to designing the robust variants of encoder-decoder architecture with Transformer. However, the patch division used in the existing Transformer-based models usually ignores the pixel-level intrinsic structural features inside each patch. In this paper, we propose a novel deep medical image segmentation framework called Dual Swin Transformer U-Net (DS-TransUNet), which aims to incorporate the hierarchical Swin Transformer into both encoder and decoder of the standard U-shaped architecture. Our…
Citation impact
- FWCI
- 79.90
- Percentile
- 100%
- References
- 77
Authors
6- ALAiliang LinCorresponding
Shenzhen Institute of Information Technology, Harbin Institute of Technology
- BCBingzhi Chen
Shenzhen Institute of Information Technology, Harbin Institute of Technology
- JXJiayu Xu
Shenzhen Institute of Information Technology, Harbin Institute of Technology
- ZZZheng Zhang
Shenzhen Institute of Information Technology, Harbin Institute of Technology
- GLGuangming Lu
Shenzhen Institute of Information Technology, Harbin Institute of Technology
Topics & keywords
- Encoder
- Computer science
- Transformer
- Artificial intelligence
- Segmentation
- Image segmentation
- Computer vision
- Pattern recognition (psychology)
Funding
- NNNational Natural Science Foundation of ChinaAwards: 61906162, 62176077
- HIHarbin Institute of Technology
- STShenzhen Technical ProjectAward: 2020N046
- SFShenzhen Fundamental Research and Discipline Layout projectAwards: JCYJ20210324132212030, JCYJ20210324132210025
- SSShenzhen Science and Technology Innovation ProgramAward: RCBS20200714114910193
- BABasic and Applied Basic Research Foundation of Guangdong ProvinceAward: 2019Bl515120055