{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,6,22]],"date-time":"2024-06-22T06:38:14Z","timestamp":1719038294450},"reference-count":44,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2016,5,9]],"date-time":"2016-05-09T00:00:00Z","timestamp":1462752000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"In this paper, we propose a novel extrinsic calibration method for camera networks by analyzing tracks of pedestrians. First of all, we extract the center lines of walking persons by detecting their heads and feet in the camera images. We propose an easy and accurate method to estimate the 3D positions of the head and feet w.r.t. a local camera coordinate system from these center lines. We also propose a RANSAC-based orthogonal Procrustes approach to compute relative extrinsic parameters connecting the coordinate systems of cameras in a pairwise fashion. Finally, we refine the extrinsic calibration matrices using a method that minimizes the reprojection error. While existing state-of-the-art calibration methods explore epipolar geometry and use image positions directly, the proposed method first computes 3D positions per camera and then fuses the data. This results in simpler computations and a more flexible and accurate calibration method. Another advantage of our method is that it can also handle the case of persons walking along straight lines, which cannot be handled by most of the existing state-of-the-art calibration methods since all head and feet positions are co-planar. This situation often happens in real life.<\/jats:p>","DOI":"10.3390\/s16050654","type":"journal-article","created":{"date-parts":[[2016,5,9]],"date-time":"2016-05-09T14:05:24Z","timestamp":1462802724000},"page":"654","source":"Crossref","is-referenced-by-count":20,"title":["Extrinsic Calibration of Camera Networks Based on Pedestrians"],"prefix":"10.3390","volume":"16","author":[{"given":"Junzhi","family":"Guan","sequence":"first","affiliation":[{"name":"Image Processing and Interpretation, TELIN, Ghent University\/iMinds, Sint Pietersnieuwstraat 41, 9000 Gent, Belgium"}]},{"given":"Francis","family":"Deboeverie","sequence":"additional","affiliation":[{"name":"Image Processing and Interpretation, TELIN, Ghent University\/iMinds, Sint Pietersnieuwstraat 41, 9000 Gent, Belgium"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-1822-3881","authenticated-orcid":false,"given":"Maarten","family":"Slembrouck","sequence":"additional","affiliation":[{"name":"Image Processing and Interpretation, TELIN, Ghent University\/iMinds, Sint Pietersnieuwstraat 41, 9000 Gent, Belgium"}]},{"given":"Dirk","family":"Van Haerenborgh","sequence":"additional","affiliation":[{"name":"Image Processing and Interpretation, TELIN, Ghent University\/iMinds, Sint Pietersnieuwstraat 41, 9000 Gent, Belgium"}]},{"given":"Dimitri","family":"Van Cauwelaert","sequence":"additional","affiliation":[{"name":"Image Processing and Interpretation, TELIN, Ghent University\/iMinds, Sint Pietersnieuwstraat 41, 9000 Gent, Belgium"}]},{"given":"Peter","family":"Veelaert","sequence":"additional","affiliation":[{"name":"Image Processing and Interpretation, TELIN, Ghent University\/iMinds, Sint Pietersnieuwstraat 41, 9000 Gent, Belgium"}]},{"given":"Wilfried","family":"Philips","sequence":"additional","affiliation":[{"name":"Image Processing and Interpretation, TELIN, Ghent University\/iMinds, Sint Pietersnieuwstraat 41, 9000 Gent, Belgium"}]}],"member":"1968","published-online":{"date-parts":[[2016,5,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1109\/JRA.1987.1087109","article-title":"A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses","volume":"3","author":"Tsai","year":"1987","journal-title":"IEEE J. Robot. Autom."},{"key":"ref_2","unstructured":"Faugeras, O.D., and Toscani, G. (1986, January 22\u201326). The calibration problem for stereo. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/MC.1982.1653915","article-title":"Measuring Curved Surfaces for Robot Vision","volume":"15","author":"Hall","year":"1982","journal-title":"Computer"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1109\/34.159901","article-title":"Camera calibration with distortion models and accuracy evaluation","volume":"14","author":"Weng","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1162\/105474605774785325","article-title":"A Convenient Multi-Camera Self-Calibration for Virtual Environments","volume":"14","author":"Svoboda","year":"2005","journal-title":"PRESENCE Teleoper. Virtual Environ."},{"key":"ref_7","unstructured":"Chen, X., Davis, J., and Slusallek, P. (2000, January 13\u201315). Wide area camera calibration using virtual calibration objects. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Hilton Head Island, SC, USA."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kurillo, G., Li, Z., and Bajcsy, R. (2008, January 7\u201311). Wide-area external multi-camera calibration using vision graphs and virtual calibration object. Proceedings of the ACM\/IEEE International Conference on Distributed Smart Cameras, Stanford, CA, USA.","DOI":"10.1109\/ICDSC.2008.4635695"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sturm, P., and Triggs, B. (1996, January 14\u201318). A Factorization Based Algorithm for Multi-Image Projective Structure and Motion. Proceedings of the European Conference on Computer Vision, Cambridge, UK.","DOI":"10.1007\/3-540-61123-1_183"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press. [2nd ed.].","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_11","unstructured":"Pollefeys, M., Koch, R., and Van Gool, L. (1998, January 4\u20137). Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters. Proceedings of the International Conference on Computer Vision, Bombay, India."},{"key":"ref_12","first-page":"298","article-title":"Bundle Adjustment-A Modern Synthesis","volume":"Volume 1883","author":"Triggs","year":"2000","journal-title":"Vision Algorithms: Theory and Practice"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Shen, J., Xu, W., Luo, Y., Su, P.C., and Cheung, S. (2014, January 22\u201324). Extrinsic calibration for wide-baseline RGB-D camera network. Proceedings of the IEEE International Workshop on Multimedia Signal Processing, Jakarta, Indonesia.","DOI":"10.1109\/MMSP.2014.6958798"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"18985","DOI":"10.3390\/s150818985","article-title":"Extrinsic Calibration of Camera Networks Using a Sphere","volume":"15","author":"Guan","year":"2015","journal-title":"Sensors"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"698","DOI":"10.1109\/TPAMI.1987.4767965","article-title":"Least-Squares Fitting of Two 3-D Point Sets","volume":"9","author":"Arun","year":"1987","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_16","unstructured":"Bouguet, J.Y. Camera calibration toolbox for Matlab. Available online: http:\/\/www.vision.caltech.edu\/bouguetj\/calib_doc\/."},{"key":"ref_17","unstructured":"H\u00f6dlmoser, M., and Kampel, M. (December, January 29). Multiple Camera Self-calibration and 3D Reconstruction Using Pedestrians. Proceedings of the International Conference on Advances in Visual Computing, Las Vegas, NE, USA."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1038\/293133a0","article-title":"A computer algorithm for reconstructing a scene from two projections","volume":"293","year":"1981","journal-title":"Nature"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1007\/3-540-60268-2_296","article-title":"Triangulation","volume":"Volume 970","year":"1995","journal-title":"Computer Analysis of Images and Patterns"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1109\/TPAMI.2006.178","article-title":"Camera calibration from video of a walking human","volume":"28","author":"Lv","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Machine Intell."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Krahnstoever, N., and Mendonca, P.R.S. (2005, January 17\u201321). Bayesian autocalibration for surveillance. Proceedings of the IEEE International Conference on Computer Vision, Beijing, China.","DOI":"10.1109\/ICCV.2005.44"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Krahnstoever, N., and Mendonca, P.R.S. (2006, January 4\u20137). Autocalibration from Tracks of Walking People. Proceedings of the British Machine Vision Conference, Edinburgh, UK.","DOI":"10.5244\/C.20.12"},{"key":"ref_23","unstructured":"Liu, J., Collins, R.T., and Liu, Y. (September, January 29). Surveillance camera autocalibration based on pedestrian height distributions. Proceedings of the British Machine Vision Conference, Dundee, UK."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Liu, J., Collins, R.T., and Liu, Y. (2013, January 17\u201318). Robust autocalibration for a surveillance camera network. Proceedings of the IEEE Workshop on Applications of Computer Vision, Tampa, FL, USA.","DOI":"10.1109\/WACV.2013.6475051"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1007\/BF00127813","article-title":"Using Vanishing Points for Camera Calibration","volume":"4","author":"Caprile","year":"1990","journal-title":"Int. J. Comput. Vis."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Gardel, A., Garc\u00eda, J., Bravo, I., Espinosa, F., and Chateau, T. (2015, January 8\u201311). Camera calibration parameters for oriented person re-identification. Proceedings of the International Conference on Distributed Smart Camera, Seville, Spain.","DOI":"10.1145\/2789116.2789138"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Teixeira, L., Maffra, F., and Badii, A. (2014, January 8\u201310). Scene Understanding for Auto-Calibration of Surveillance Cameras. Proceedings of the Advances in Visual Computing: International Symposium on Visual Computing, Las Vegas, NV, USA.","DOI":"10.1007\/978-3-319-14364-4_65"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Schels, J., Liebelt, J., and Lienhart, R. (2011, January 6\u201313). Self-calibrating 3D context for retrieving people with luggage. Proceedings of the IEEE International Conference on Computer Vision Workshops, Barcelona, Spain.","DOI":"10.1109\/ICCVW.2011.6130483"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Micusik, B., and Pajdla, T. (2010, January 13\u201318). Simultaneous surveillance camera calibration and foot-head homology estimation from human detections. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5539786"},{"key":"ref_30","unstructured":"Possegger, H., R\u00fcther, M., Sternig, S., Mauthner, T., Klopschitz, M., Roth, P.M., and Bischof, H. (2012, January 1\u20133). Unsupervised Calibration of Camera Networks and Virtual PTZ Cameras. Proceedings of the Computer Vision Winter Workshop, Prlekija, Slovenia."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1023\/A:1007984508483","article-title":"Chirality","volume":"26","author":"Hartley","year":"1998","journal-title":"Int. J. Comput. Vis."},{"key":"ref_32","unstructured":"Werner, T., and Pajdla, T. (2001, January 7\u201314). Cheirality in epipolar geometry. Proceedings of the IEEE International Conference on Computer Vision, Vancouver, BC, Canada."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2691","DOI":"10.1109\/78.107418","article-title":"Motion and structure from point correspondences with error estimation: Planar surfaces","volume":"39","author":"Weng","year":"1991","journal-title":"IEEE Trans. Sign. Process."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1142\/S0218001488000285","article-title":"Motion and structure from motion in a piecewise planar environment","volume":"2","author":"Faugeras","year":"1988","journal-title":"Int. J. Pattern Recogn. Artif. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1007\/s001380050048","article-title":"Estimating 3-D Rigid Body Transformations: A Comparison of Four Major Algorithms","volume":"9","author":"Eggert","year":"1997","journal-title":"Mach. Vision Appl."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Tardif, J.P., Sturm, P., and Roy, S. (2006, January 7\u201313). Self-calibration of a General Radially Symmetric Distortion Model. Proceedings of the European Conference on Computer Vision, Leonardis, Graz, Austria.","DOI":"10.1007\/11744085_15"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Houben, S. (2014, January 8\u201311). Towards the intrinsic self-calibration of a vehicle-mounted omni-directional radially symmetric camera. Proceedings of the IEEE Intelligent Vehicles Symposium Proceedings, Dearborn, MI, USA.","DOI":"10.1109\/IVS.2014.6856497"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zivkovic, Z. (2004, January 23\u201326). Improved adaptive Gaussian mixture model for background subtraction. Proceedings of the IEEE International Conference on Pattern Recognition, Cambridge, UK.","DOI":"10.1109\/ICPR.2004.1333992"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1016\/1049-9660(91)90036-O","article-title":"Estimating 3-D Location Parameters Using Dual Number Quaternions","volume":"54","author":"Walker","year":"1991","journal-title":"CVGIP Image Underst."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1127","DOI":"10.1364\/JOSAA.5.001127","article-title":"Closed-form solution of absolute orientation using orthonormal matrices","volume":"5","author":"Horn","year":"1988","journal-title":"J. Opt. Soc. Am. A"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1364\/JOSAA.4.000629","article-title":"Closed-form solution of absolute orientation using unit quaternions","volume":"4","author":"Horn","year":"1987","journal-title":"J. Opt. Soc. Am. A"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/BF02289451","article-title":"A generalized solution of the orthogonal Procrustes problem","volume":"31","year":"1966","journal-title":"Psychometrika"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_44","unstructured":"Multi-camera pedestrians video. Available online: http:\/\/cvlab.epfl.ch\/data\/pom."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/5\/654\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,4]],"date-time":"2024-06-04T22:00:45Z","timestamp":1717538445000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/5\/654"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,5,9]]},"references-count":44,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2016,5]]}},"alternative-id":["s16050654"],"URL":"https:\/\/doi.org\/10.3390\/s16050654","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,5,9]]}}}