Abstract
Graph matching is an essential problem in computer vision that has been successfully applied to 2D and 3D feature matching and object recognition. Despite its importance, little has been published on learning the parameters that control graph matching, even though learning has been shown to be vital for improving the matching rate. In this paper we show how to perform parameter learning in an unsupervised fashion, that is when no correct correspondences between graphs are given during training. Our experiments reveal that unsupervised learning compares favorably to the supervised case, both in terms of efficiency and quality, while avoiding the tedious manual labeling of ground truth correspondences. We verify experimentally that our learning method can improve the performance of several state-of-the art graph matching algorithms. We also show that a similar method can be successfully applied to parameter learning for graphical models and demonstrate its effectiveness empirically.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Bach, F. R., & Jordan, M. I. (2003). Learning spectral clustering. In Neural Information Processing Systems.
Baratchart, L., Berthod, M., & Pottier, L. (1998). Optimization of positive generalized polynomials under l p constraints. Journal of Convex Analysis, 5(2), 353–379.
Belongie, S., Malik, J., & Puzicha, J. (2002). Shape matching and object recognition using shape context. Pattern Analysis and. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(4), 509–522.
Berg, A., Berg, T., & Malik, J. (2005). Shape matching and object recognition using low distortion correspondences. In International Conference on Computer Vision and Pattern Recognition.
Besag, J. (1986). On the statistical analysis of dirty pictures. Journal of the Royal Statistical Society, 48(5), 259–302.
Brendel, W., & Todorovic, S. (2010). Segmentation as maximum-weight independent set. In Neural Information Processing Systems.
Caetano, T., Cheng, L., Le, Q. V., & Smola, A. J. (2007). Learning graph matching. In International Conference on Computer Vision.
Caetano, T., McAuley, J. J., Cheng, L., Le, Q. V., & Smola, A. J. (2009). Learning graph matching. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(6), 1048–1058.
Carcassoni, M., & Hancock, E. R. (2002). Alignment using spectral clusters. In British Machine Vision Conference.
Chertok, M., & Keller, Y. (2010). Spectral symmetry analysis. Pattern Analysis and. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(7), 1227–1238.
Cour, T., & Shi, J. (2007). Solving Markov random fields with spectral relaxation. In International Conference on Artificial Intelligence and Statistics.
Cour, T., Shi, J., & Gogin, N. (2005). Learning spectral graph segmentation. In International Conference on Artificial Intelligence and Statistics.
Cour, T., Srinivasan, P., & Shi, J. (2006). Balanced graph matching. In Neural Information Processing Systems.
de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.-P., & Thrun, S. (2008). Performance capture from sparse multi-view video. In SIGGRAPH.
Duchenne, O., Bach, F., Kweon, I., & Ponce, J. (2009). A tensor-based algorithm for high-order graph matching. In International Conference on Computer Vision and Pattern Recognition.
Frank, M., & Wolfe, P. (1956). An algorithm for quadratic programming. Naval Research Logistics Quarterly, 3(1–2), 95–110.
Gold, S., & Rangarajan, A. (1996). A graduated assignment algorithm for graph matching. Pattern Analysis and. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(4), 377–388.
Hays, J., Leordeanu, M., Efros, A., & Liu, Y. (2006). Discovering texture regularity as a higher-order correspondence problem. In European Conference on Computer Vision.
Huhle, B., Jenke, P., & Straßer, W. (2008). On-the-fly scene acquisition with a handy multi-sensor system. International Journal of Intelligent Systems Technologies and Applications, 5(3–4), 255–263.
Kim, G., Faloutsos, C., & Hebert, M. (2008). Unsupervised modeling and recognition of object categories with combination of visual contents and geometric similarity links. In ACM International Conference on Multimedia Information Retrieval.
Kim, G., Faloutsos, C., & Hebert, M. (2008). Unsupervised modeling of object categories using link analysis techniques. In International Conference on Computer Vision and Pattern Recognition.
Kumar, S. Models for learning spatial interactions in natural images for context-based classification. PhD thesis, The Robotics Institute, Carnegie Mellon University, 2005.
Leordeanu, M., Collins, R., & Hebert, M. (2005). Unsupervised learning of object features from video sequences. In International Conference on Computer Vision and Pattern Recognition.
Leordeanu, M., & Hebert, M. (2005). A spectral technique for correspondence problems using pairwise constraints. In International Conference on Computer Vision.
Leordeanu, M., & Hebert, M. (2006). Efficient MAP approximation for dense energy functions. In International Conference on Machine Learning.
Leordeanu, M., & Hebert, M. (2008). Smoothing-based optimization. In International Conference on Computer Vision and Pattern Recognition.
Leordeanu, M., & Hebert, M. (2009). Unsupervised learning for graph matching. In International Conference on Computer Vision and Pattern Recognition.
Leordeanu, M., Hebert, M., & Sukthankar, R. (2007). Beyond local appearance: Category recognition from pairwise interactions of simple features. In International Conference on Computer Vision and Pattern Recognition.
Leordeanu, M., Hebert, M., & Sukthankar, R. (2009). An integer projected fixed point method for graph matching and MAP inference. In Neural Information Processing Systems.
Liu, J., Luo, J., & Shah, M. (2009). Recognizing realistic actions from videos “in the wild. In International Conference on Computer Vision and Pattern Recognition.
Magnus, J., & Neudecker, H. (1999). Matrix Differential Calculus with Applications in Statistics and Econometrics. New York: Wiley.
Parikh, D., & Chen, T. (2007). Unsupervised identification of multiple objects of interest from multiple images: dISCOVER. In Asian Conference on Computer Vision.
Parikh, D., & Chen, T. (2007). Unsupervised learning of hierarchical semantics of objects (hSOs). In International Conference on Computer Vision and Pattern Recognition.
Ravikumar, P., & Lafferty, J. (2006). Quadratic programming relaxations for metric labeling and Markov random field MAP estimation. In International Conference on Machine Learning.
Ren, X. (2007). Learning and matching line aspects for articulated objects. In International Conference on Computer Vision and Pattern Recognition.
Schellewald, C., & Schnorr, C. (2005). Probabilistic subgraph matching based on convex relaxation. In International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition.
Semenovich, D. (2010). Tensor power method for efficient MAP inference in higher-order MRFs. In International Conference on Pattern Recognition.
Szummer, M., Kohli, P., & Hoiem, D. (2008). Learning CRFs using graph cuts. In European Conference on Computer Vision.
Taskar, B., Guestrin, C., & Koller, D. (2004). Max-margin Markov networks. In Neural Information Processing Systems.
Umeyama, S. (1988). An eigen decomposition approach to weighted graph matching problems. In Pattern Analysis and Machine Intelligence.
Yan, P., Khan, S. M., & Shah, M. (2008). Learning 4D action feature models for arbitrary view action recognition. In International Conference on Computer Vision and Pattern Recognition.
Zaslavskiy, M. Graph matching and its application in computer vision and bioinformatics. PhD thesis, l’Ecole nationale superieure des mines de Paris, 2010.
Zaslavskiy, M., Bach, F., & Vert, J.-P. (2009). A path following algorithm for graph matching. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(12), 2227–2242.
Zass, R., & Shashua, A. (2008). Probabilistic graph and hypergraph matching. In International Conference on Computer Vision and Pattern Recognition.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Leordeanu, M., Sukthankar, R. & Hebert, M. Unsupervised Learning for Graph Matching. Int J Comput Vis 96, 28–45 (2012). https://doi.org/10.1007/s11263-011-0442-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11263-011-0442-2