Abstract
In this paper there are two innovations. First, the geometry of imaged curves is developed in two and three views. A set of results are given for both conics and non-algebraic curves. It is shown that the homography between the images induced by the plane of the curve can be computed from two views given only the epipolar geometry, and that the trifocal tensor can be used to transfer a conic or the curvature from two views to a third.
The second innovation is an algorithm for automatically matching individual curves between images. The algorithm uses both photometric information and the multiple view geometric results. For image pairs the homography facilitates the computation of a neighbourhood cross-correlation based matching score for putative curve correspondences. For image triplets cross-correlation matching scores are used in conjunction with curve transfer based on the trifocal geometry to disambiguate matches. Algorithms are developed for both short and wide baselines. The algorithms are robust to deficiencies in the curve segment extraction and partial occlusion.
Experimental results are given for image pairs and triplets, for varying motions between views, and for different scene types. The method is applicable to curve matching in stereo and trinocular rigs, and as a starting point for curve matching through monocular image sequences.
Chapter PDF
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
P. Beardsley, P. Torr, and A. Zisserman. 3D model acquisition from extended image sequences. In Proc. ECCV, pages 683–695, 1996.
A. Blake and R. Cipolla. Robust estimation of surface curvature from deformation of apparent contours. In Proc. ECCV, pages 465–474, 1990.
F.L. Bookstein. Fitting conic sections to scattered data. In Computer Graphics and Image Processing, 9:56–71, 1979.
A.T. Brint and M. Brady. Stereo matching of curves by least deformation. In International Workshop on Intelligent Robots and Systems, pages 163–170, 1989.
R. C. K. Chung and R. Nevatia. Use of monocular groupings and occlusion analysis in a hierarchical stereo system. In Proc. CVPR, pages 50–56, 1991.
G. Cross and A. Zisserman. Quadric surface reconstruction from dual-space geometry. In Proc. ICCV, pages 25–31, 1998.
O. Faugeras and L. Robert. What can two images tell us about a third one? International Journal of Computer Vision, 18:5–19, 1996.
R.I. Hartley. A linear method for reconstruction from lines and points. Proc. ICCV, pages 882–887, 1995.
R.I. Hartley. Lines and points in three views and the trifocal tensor. International Journal of Computer Vision, 22(2):125–140, 1997.
P. Havaldar and G. Medioni. Segmented shape-descriptions from 3-view stereo. Proc. ICCV, pages 102–108, 1995.
Q. Luong and T. Vieville. Canonic representations for the geometries of multiple projective views. Technical report, University of California, Berkeley, 1993.
S. Ma. Conics-based stereo, motion estimation, and pose determination. International Journal of Computer Vision, 10(1):7–25, 1993.
Maybank S. and Faugeras O. A theory of self-calibration of a moving camera. International Journal of Computer Vision, 8(2):123–151, 1992.
J.L. Mundy and A. Zisserman, editors. Geometric Invariance in Computer Vision. The MIT Press, Cambridge, MA, USA, 1992.
S.K. Nayar and R.M. Bolle, Reflectance Based Object Recognition. International Journal of Computer Vision, 17(3):219–240, 1996.
S.B. Pollard, J.E.W. Mayhew, and J.P. Frisby. PMF: A stereo correspondence algorithm using a disparity gradient constraint. Perception, 14:449–470, 1985.
L. Quan. Conic reconstruction and correspondence from two views, Ieee Transactions on Pattern Analysis and Machine Intelligence, 18(2):151–160, 1996.
L. Robert and O.D. Faugeras. Curve-based stereo: Figural continuity and curvature. In Proc. CVPR, pages 57–62, 1991.
R. Safaee-Rad, I. Tchoukanov, B. Benhabib, and K.C. Smith. 3D pose estimation from a quadratic curved feature in two perspective views. In Proc. ICPR, pages 341–344, 1992.
C. Schmid and A. Zisserman. Automatic line matching across views. In Proc. CVPR, pages 666–671, 1997.
C. Schmid and A. Zisserman. The geometry and matching of lines and curves over multiple views. Research Report, 1998.
A. Shashua. Trilinearity in visual recognition by alignment. In Proc. ECCV, pages 479–484, 1994.
M. Spetsakis and J. Aloimonos. Structure from motion using line correspondences. International Journal of Computer Vision, pages 171–183, 1990.
P. Torr and A. Zisserman. Robust parameterization and computation of the trifocal tensor. Image and Vision Computing, 15:591–605, 1997.
R. Vaillant. Using occluding contours for 3D object modeling. In Proc. ECCV, pages 454–464, 1990.
Z. Zhang, R. Deriche, O. Faugeras, and Q. Luong. A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry. Artificial Intelligence, 78:87–119, 1995.
Y. Zhang and J.J. Gerbrands. Method for matching general stereo planar curves. Image and Vision Computing, 13(8):645–655, 1995.
Zisserman A. and Maybank S. A case against epipolar geometry. In Applications of Invariance in Computer Vision LNCS 825. Springer-Verlag, 1994.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schmid, C., Zisserman, A. (1998). The geometry and matching of curves in multiple views. In: Burkhardt, H., Neumann, B. (eds) Computer Vision — ECCV'98. ECCV 1998. Lecture Notes in Computer Science, vol 1406. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0055680
Download citation
DOI: https://doi.org/10.1007/BFb0055680
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64569-6
Online ISBN: 978-3-540-69354-3
eBook Packages: Springer Book Archive