Convolutional Neural Network Architecture for Geometric Matching
Institut national de recherche en sciences et technologies du numérique · Université Paris Sciences et Lettres · +5 more institutions
Abstract
We address the problem of determining correspondences between two images in agreement with a geometric model such as an affine or thin-plate spline transformation, and estimating its parameters. The contributions of this work are three-fold. First, we propose a convolutional neural network architecture for geometric matching. The architecture is based on three main components that mimic the standard steps of feature extraction, matching and simultaneous inlier detection and model parameter estimation, while being trainable end-to-end. Second, we demonstrate that the network parameters can be trained from synthetically generated imagery without the need for manual annotation and that our matching layer…
Citation impact
- FWCI
- 19.22
- Percentile
- 100%
- References
- 77
Authors
3- IRIgnacio RoccoCorresponding
Institut national de recherche en sciences et technologies du numérique, Université Paris Sciences et Lettres, École Normale Supérieure - PSL, Département d'Informatique
- RARelja Arandjelović
Institut national de recherche en sciences et technologies du numérique, Université Paris Sciences et Lettres, École Normale Supérieure - PSL, Google DeepMind (United Kingdom), Département d'Informatique
- JŠJosef Šivic
Institut national de recherche en sciences et technologies du numérique, China University of Labor Relations, Université Paris Sciences et Lettres, École Normale Supérieure - PSL, Département d'Informatique, Czech Technical University in Prague
Topics & keywords
- Affine transformation
- Computer science
- Convolutional neural network
- Artificial intelligence
- Matching (statistics)
- Generalization
- Pattern recognition (psychology)
- Transformation (genetics)
- Sustainable cities and communities