DIRE for Diffusion-Generated Image Detection
University of Science and Technology of China · Microsoft Research Asia (China) · +2 more institutions
Abstract
Diffusion models have shown remarkable success in visual synthesis, but have also raised concerns about potential abuse for malicious purposes. In this paper, we seek to build a detector for telling apart real images from diffusion-generated images. We find that existing detectors struggle to detect images generated by diffusion models, even if we include generated images from a specific diffusion model in their training data. To address this issue, we propose a novel image representation called DIffusion Reconstruction Error (DIRE), which measures the error between an input image and its reconstruction counterpart by a pre-trained diffusion model. We observe that diffusion-generated images can be…
Citation impact
- FWCI
- 24.84
- Percentile
- 100%
- References
- 75
Authors
7- ZWZhendong WangCorresponding
University of Science and Technology of China
- JBJianmin Bao
Microsoft Research Asia (China)
- WZWengang Zhou
Institute of Art, National Science Center, University of Science and Technology of China
- WWWeilun Wang
University of Science and Technology of China
- HHHezhen Hu
University of Science and Technology of China
Topics & keywords
- Diffusion
- Computer science
- Benchmark (surveying)
- Artificial intelligence
- Computer vision
- Code (set theory)
- Image (mathematics)
- Representation (politics)
- Peace, Justice and strong institutions