{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,6,9]],"date-time":"2024-06-09T00:07:17Z","timestamp":1717891637838},"reference-count":30,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2017,8,23]],"date-time":"2017-08-23T00:00:00Z","timestamp":1503446400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004385","name":"Universiteit Gent","doi-asserted-by":"publisher","award":["01D21213"],"id":[{"id":"10.13039\/501100004385","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Stereomatching is an effective way of acquiring dense depth information from a scene when active measurements are not possible. So-called lightfield methods take a snapshot from many camera locations along a defined trajectory (usually uniformly linear or on a regular grid\u2014we will assume a linear trajectory) and use this information to compute accurate depth estimates. However, they require the locations for each of the snapshots to be known: the disparity of an object between images is related to both the distance of the camera to the object and the distance between the camera positions for both images. Existing solutions use sparse feature matching for camera location estimation. In this paper, we propose a novel method that uses dense correspondences to do the same, leveraging an existing depth estimation framework to also yield the camera locations along the line. We illustrate the effectiveness of the proposed technique for camera location estimation both visually for the rectification of epipolar plane images and quantitatively with its effect on the resulting depth estimation. Our proposed approach yields a valid alternative for sparse techniques, while still being executed in a reasonable time on a graphics card due to its highly parallelizable nature.<\/jats:p>","DOI":"10.3390\/s17091939","type":"journal-article","created":{"date-parts":[[2017,8,23]],"date-time":"2017-08-23T15:32:27Z","timestamp":1503502347000},"page":"1939","source":"Crossref","is-referenced-by-count":0,"title":["Line-Constrained Camera Location Estimation in Multi-Image Stereomatching"],"prefix":"10.3390","volume":"17","author":[{"given":"Simon","family":"Donn\u00e9","sequence":"first","affiliation":[{"name":"IPI-UGent-imec, B-9000 Ghent, Belgium"}]},{"given":"Bart","family":"Goossens","sequence":"additional","affiliation":[{"name":"IPI-UGent-imec, B-9000 Ghent, Belgium"}]},{"given":"Wilfried","family":"Philips","sequence":"additional","affiliation":[{"name":"IPI-UGent-imec, B-9000 Ghent, Belgium"}]}],"member":"1968","published-online":{"date-parts":[[2017,8,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1016\/0004-3702(81)90024-2","article-title":"Determining optical flow","volume":"17","author":"Horn","year":"1981","journal-title":"Artif. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Gilliam, C., and Blu, T. (2015, January 19\u201324). Local All-Pass filters for optical flow estimation. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Brisbane, QLD, Australia.","DOI":"10.1109\/ICASSP.2015.7178227"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3260","DOI":"10.1109\/TIP.2013.2263149","article-title":"Motion Estimation Using the Correlation Transform","volume":"22","author":"Drulea","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Richardt, C., Orr, D., Davies, I., Criminisi, A., and Dodgson, N.A. (2010, January 5\u201311). Real-time spatiotemporal stereo matching using the dual-cross-bilateral grid. Proceedings of the European Conference on Computer Vision, Crete, Greece.","DOI":"10.1007\/978-3-642-15558-1_37"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ranftl, R., Gehrig, S., Pock, T., and Bischof, H. (2012, January 3\u20137). Pushing the limits of stereo using variational stereo estimation. Proceedings of the IEEE Intelligent Vehicles Symposium, Alcala de Henares, Spain.","DOI":"10.1109\/IVS.2012.6232171"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1744","DOI":"10.1109\/TPAMI.2011.236","article-title":"Motion Detail Preserving Optical Flow Estimation","volume":"34","author":"Xu","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Kennedy, R., and Taylor, C.J. (2015). Optical flow with geometric occlusion estimation and fusion of multiple frames. Energy Minimization Methods in Computer Vision and Pattern Recognition, Springer.","DOI":"10.1007\/978-3-319-14612-6_27"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Braux-Zin, J., Dupont, R., and Bartoli, A. (2013, January 1\u20138). A General Dense Image Matching Framework Combining Direct and Feature-Based Costs. Proceedings of the International Conference on Computer Vision, Sydney, NSW, Australia.","DOI":"10.1109\/ICCV.2013.30"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1109\/TPAMI.2008.265","article-title":"Direct Estimation of Nonrigid Registrations with Image-Based Self-Occlusion Reasoning","volume":"32","author":"Bartoli","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","unstructured":"Zhang, L., Zhang, K., Chang, T.S., Lafruit, G., Kuzmanov, G.K., and Verkest, D. (March, January 27). Real-Time High-Definition Stereo Matching on FPGA. Proceedings of the 19th ACM\/SIGDA International Symposium on Field Programmable Gate Arrays, Monterey, CA, USA."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1007\/s10851-010-0251-1","article-title":"A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging","volume":"40","author":"Chambolle","year":"2011","journal-title":"J. Math. Imaging Vis."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1109\/TPAMI.2003.1206509","article-title":"Stereo matching using belief propagation","volume":"25","author":"Sun","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","unstructured":"Wanner, S., Meister, S., and Goldluecke, B. (2013). Datasets and Benchmarks for Densely Sampled 4D Light Fields. Annual Workshop on Vision, Modeling & Visualization, The Eurographics Association."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Heber, S., Ranftl, R., and Pock, T. (2013). Variational Shape from Light Field. Energy Minimization Methods in Computer Vision and Pattern Recognition, Springer.","DOI":"10.1007\/978-3-642-40395-8_6"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1145\/2461912.2461926","article-title":"Scene Reconstruction from High Spatio-angular Resolution Light Fields","volume":"32","author":"Kim","year":"2013","journal-title":"ACM Trans. Graph."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Donn\u00e9, S., Goossens, B., Aelterman, J., and Philips, W. (2015, January 27\u201330). Variational Multi-Image Stereo Matching. Proceedings of IEEE International Conference on Image Processing, Quebec City, QC, Canada.","DOI":"10.1109\/ICIP.2015.7350929"},{"key":"ref_17","first-page":"653","article-title":"Rectification for any epipolar geometry","volume":"1","author":"Oram","year":"2001","journal-title":"BMVC"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Fusiello, A., and Irsara, L. (2008, January 8\u201311). Quasi-Euclidean uncalibrated epipolar rectification. Proceedings of the 19th International Conference on IEEE Pattern Recognition (ICPR), Tampa, FL, USA.","DOI":"10.1109\/ICPR.2008.4761561"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Levoy, M., and Hanrahan, P. (1996, January 4\u20139). Light Field Rendering. Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, New Orleans, LA, USA.","DOI":"10.1145\/237170.237199"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1109\/34.121783","article-title":"Single lens stereo with a plenoptic camera","volume":"14","author":"Adelson","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","unstructured":"(2017, August 17). Voodoo Camera Tracker. Available online: http:\/\/www.viscoda.com."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1603","DOI":"10.1109\/TPAMI.2007.70824","article-title":"Multiple-View Geometry Under the L\u221e-Norm","volume":"30","author":"Kahl","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","unstructured":"Olsson, C., Eriksson, A.P., and Kahl, F. (2007, January 14\u201321). Efficient optimization for L\u221e problems using pseudoconvexity. Proceedings of the 2007 IEEE 11th International Conference on Computer Vision, Rio de Janeiro, Brazil."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Goossens, B., De Vylder, J., and Philips, W. (2014, January 27\u201330). Quasar: A new heterogeneous programming framework for image and video processing algorithms on CPU and GPU. Proceedings of the IEEE International Conference on Image Processing, Paris, France.","DOI":"10.1109\/ICIP.2014.7025441"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zabih, R., and Woodfill, J. (1994, January 2\u20136). Non-parametric local transforms for computing visual correspondence. Proceedings of the European Conference on Computer Vision, Stockholm, Sweden.","DOI":"10.1007\/BFb0028345"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1007\/s10851-014-0529-9","article-title":"Mathematical Foundations and Generalisations of the Census Transform for Robust Optic Flow Computation","volume":"52","author":"Hafner","year":"2014","journal-title":"J. Math. Imaging Vis."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Bailer, C., Taetz, B., and Stricker, D. (2015, January 7\u201313). Flow Fields: Dense Correspondence Fields for Highly Accurate Large Displacement Optical Flow Estimation. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.457"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1016\/j.amc.2007.07.046","article-title":"Explicit formula for the inverse of a tridiagonal matrix by backward continued fractions","volume":"197","year":"2008","journal-title":"Appl. Math. Comput."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/S0024-3795(00)00262-7","article-title":"The inverse of a tridiagonal matrix","volume":"325","author":"Mallik","year":"2001","journal-title":"Linear Algebra Appl."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/9\/1939\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,8]],"date-time":"2024-06-08T09:57:38Z","timestamp":1717840658000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/9\/1939"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,8,23]]},"references-count":30,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2017,9]]}},"alternative-id":["s17091939"],"URL":"https:\/\/doi.org\/10.3390\/s17091939","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,8,23]]}}}