Abstract
The present article proposes a Structure from Motion (SfM) methodology to recover the liver surface from endoscopic video sequences. Features from an imaged liver are extracted and tracked for the complete sequence to generate a correspondences lookup table (C-LUT) between all frames. A keyframe selection code extracts two frames, from which the relative pose of the camera is reconstructed using a MSAC-based 5-Point algorithm. Techniques such as an optimal triangulation method and a PnP resection algorithm are also used to obtain an initial 3D surface of the liver. A global Bundle Adjustment step refines the initial reconstruction. Proper parametrization and conditioning of these techniques are compared and evaluated under typical laparoscopic uncertainties arising from patient, illumination, reflections, image quality and organs’ location among others. A robotic system and grid patterns are used to provide camera pose and surface ground truth data respectively.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Jones, D., Wu, J., Soper, N.: Laparoscopic surgery: principles and procedures. Marcel Dekker Inc., New York (2004)
Pollefeys, M., van Gool, L., Vergauwen, M.: Visual modeling with a hand-held camera. Int. J. Comput. Vision 59, 207–232 (2004)
Stoyanov, D., Mylonas, G.P., Deligianni, F., Darzi, A., Yang, G.-Z.: Soft-Tissue Motion Tracking and Structure Estimation for Robotic Assisted MIS Procedures. In: Duncan, J.S., Gerig, G. (eds.) MICCAI 2005. LNCS, vol. 3750, pp. 139–146. Springer, Heidelberg (2005)
Mountney, P., Stoyanov, D., Yang, G.Z.: Three-dimensional tissue deformation recovery and tracking. Signal Processing Magazine 27, 14–24 (2010)
Lowe, D.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60, 91–110 (2004)
Nistér, D.: An efficient solution to the five-point relative pose problem. IEEE Trans. Pattern Anal. Mach. Intell. 26, 756–777 (2004)
Lepetit, V., Moreno-Noguer, F., Fua, P.: EPnP: An accurate O(n) solution to the PnP problem. Int. J. Comput. Vision 81, 155–166 (2009)
Fischler, M., Bolles, R.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. J. Communications ACM 24, 381–395 (1981)
Hartley, R., Zisserman, A.: Multiple view geometry. Cambridge University Press, Cambridge (2004)
Rabaud, V.: Structure from motion toolbox, http://vision.ucsd.edu/~vrabaud/toolbox/
von Oehsen, U., Marcinczak, J.M., Mármol Vélez, A., Grigat, R.-R.: Key-frame selection for robust pose estimation in laparoscopic videos. In: Medical Imaging 2012: Image-Guided Procedures, Robotic Interventions, and Modeling, New York (2012)
Bern, M., Eppstein, D., Gilbert, J.: Provably Good Mesh Generation. J. Comput. Syst. Sci. 48, 231–241 (1990)
Camera calibration toolbox for Matlab, http://www.vision.caltech.edu/bouguetj/calib_doc/
Myronenko, A., Song, X.: Point-Set Registration: Coherent Point Drift. IEEE Trans. on Pattern Analysis and Machine Intelligence 32, 2262–2275 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Vélez, A.F.M., Marcinczak, J.M., Grigat, RR. (2012). Structure from Motion Based Approaches to 3D Reconstruction in Minimal Invasive Laparoscopy. In: Campilho, A., Kamel, M. (eds) Image Analysis and Recognition. ICIAR 2012. Lecture Notes in Computer Science, vol 7325. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31298-4_35
Download citation
DOI: https://doi.org/10.1007/978-3-642-31298-4_35
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-31297-7
Online ISBN: 978-3-642-31298-4
eBook Packages: Computer ScienceComputer Science (R0)