A Dual Decomposition Approach to Feature Correspondence

Lorenzo Torresani, Vladimir Kolmogorov and Carsten Rother.

In IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), February 2013, 35(2):259-271.
Preliminary version ("Feature Correspondence via Graph Matching: Models and Global Optimization") appeared in European Conference on Computer Vision (ECCV), October 2008.


In this paper we present a new approach for establishing correspondences between sparse image features related by an unknown non-rigid mapping and corrupted by clutter and occlusion, such as points extracted from images of different instances of the same object category. We formulate this matching task as an energy minimization problem by defining a complex objective function of the appearance and the spatial arrangement of the features. Optimization of this energy is an instance of graph matching, which is in general an NP-hard problem. We describe a novel graph matching optimization technique, which we refer to as dual decomposition (DD), and demonstrate on a variety of examples that this method outperforms existing graph matching algorithms. In the majority of our examples, DD is able to find the global minimum within a minute. The ability to globally optimize the objective allows us to accurately learn the parameters of our matching model from training examples. We show on several matching tasks that our learned model yields results superior to those of state-of-the-art methods.


doi ECCV version [implementation]