More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification
Institut polytechnique de Grenoble · Centre National de la Recherche Scientifique · +9 more institutions
Abstract
Classification and identification of the materials lying over or beneath the earth's surface have long been a fundamental but challenging research topic in geoscience and remote sensing (RS), and have garnered a growing concern owing to the recent advancements of deep learning techniques. Although deep networks have been successfully applied in single-modality-dominated classification tasks, yet their performance inevitably meets the bottleneck in complex scenes that need to be finely classified, due to the limitation of information diversity. In this work, we provide a baseline solution to the aforementioned difficulty by developing a general multimodal deep learning (MDL) framework. In particular, we also…
Citation impact
- FWCI
- 157.20
- Percentile
- 100%
- References
- 70
Authors
7- DHDanfeng HongCorresponding
Institut polytechnique de Grenoble, Centre National de la Recherche Scientifique, GIPSA-Lab, Université Grenoble Alpes
- LGLianru Gao
Chinese Academy of Sciences, Aerospace Information Research Institute
- NYNaoto Yokoya
RIKEN Center for Advanced Intelligence Project, The University of Tokyo
- JYJing Yao
Xi'an Jiaotong University
- JCJocelyn Chanussot
Institut polytechnique de Grenoble, Centre National de la Recherche Scientifique, Chinese Academy of Sciences, GIPSA-Lab, Aerospace Information Research Institute, Université Grenoble Alpes
Topics & keywords
- Computer science
- Deep learning
- Modality (human–computer interaction)
- Artificial intelligence
- Convolutional neural network
- Bottleneck
- Machine learning
- Fuse (electrical)