Dif-Fusion: Toward High Color Fidelity in Infrared and Visible Image Fusion With Diffusion Models

Color plays an important role in human visual perception, reflecting the spectrum of objects. However, the existing infrared and visible image fusion methods rarely explore how to handle multi-spectral/channel data directly and achieve high color fidelity. This paper addresses the above issue by proposing a novel method with diffusion models, termed as Dif-Fusion, to generate the distribution of the multi-channel input data, which increases the ability of multi-source information aggregation and the fidelity of colors. In specific, instead of converting multi-channel images into single-channel data in existing fusion methods, we create the multi-channel data distribution with a denoising network in a latent…

• NN
  National Natural Science Foundation of China

  Awards: U22B2014, 62101072, 42201481
• NS
  Natural Science Foundation of Hunan Province

  Awards: 2021JJ40570, 2023JJ40024
• SA
  Science and Technology Program of Hunan Province

  Award: 2022RSC3064