A Size-Aware Graph Embedding Approach to Remote Sensing Image Captioning With Object Relative Size Information

Remote sensing image captioning is the task of automatically generating descriptive texts for remotely sensed scenes and objects. A common shortcoming of existing methods is the inadequate consideration of object size, which often leads to captions that either omit size information or provide imprecise size descriptions. To overcome this deficiency, we develop a novel framework composed of three modules: (a) an object confirmation and relative size estimation module, (b) a graph construction and graph convolution module, and (c) a caption generation module. Our framework comprehensively characterizes object size to generate more quantitatively informative captions. Furthermore, we introduce a new evaluation…

• NS
  Natural Science Foundation of Shandong Province

  Award: ZR2024MF061
• SP
  Shandong Provincial Postdoctoral Science Foundation

  Award: ZR2024MF061