{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,7,17]],"date-time":"2024-07-17T21:18:17Z","timestamp":1721251097226},"reference-count":48,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2015,8,31]],"date-time":"2015-08-31T00:00:00Z","timestamp":1440979200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Image-based localization is one of the most widely researched localization techniques in the robotics and computer vision communities. As enormous image data sets are provided through the Internet, many studies on estimating a location with a pre-built image-based 3D map have been conducted. Most research groups use numerous image data sets that contain sufficient features. In contrast, this paper focuses on image-based localization in the case of insufficient images and features. A more accurate localization method is proposed based on a probabilistic map using 3D-to-2D matching correspondences between a map and a query image. The probabilistic feature map is generated in advance by probabilistic modeling of the sensor system as well as the uncertainties of camera poses. Using the conventional PnP algorithm, an initial camera pose is estimated on the probabilistic feature map. The proposed algorithm is optimized from the initial pose by minimizing Mahalanobis distance errors between features from the query image and the map to improve accuracy. To verify that the localization accuracy is improved, the proposed algorithm is compared with the conventional algorithm in a simulation and realenvironments<\/jats:p>","DOI":"10.3390\/s150921636","type":"journal-article","created":{"date-parts":[[2015,9,1]],"date-time":"2015-09-01T14:55:58Z","timestamp":1441119358000},"page":"21636-21659","source":"Crossref","is-referenced-by-count":13,"title":["A Probabilistic Feature Map-Based Localization System Using a Monocular Camera"],"prefix":"10.3390","volume":"15","author":[{"given":"Hyungjin","family":"Kim","sequence":"first","affiliation":[{"name":"Urban Robotics Laboratory (URL), Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro (373-1 Guseong-dong), Yuseong-gu, Daejeon 305-701, Korea"}]},{"given":"Donghwa","family":"Lee","sequence":"additional","affiliation":[{"name":"Urban Robotics Laboratory (URL), Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro (373-1 Guseong-dong), Yuseong-gu, Daejeon 305-701, Korea"}]},{"given":"Taekjun","family":"Oh","sequence":"additional","affiliation":[{"name":"Urban Robotics Laboratory (URL), Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro (373-1 Guseong-dong), Yuseong-gu, Daejeon 305-701, Korea"}]},{"given":"Hyun-Taek","family":"Choi","sequence":"additional","affiliation":[{"name":"Ocean System Engineering Research Division, Korea Research Institute of Ships and Ocean Engineering (KRISO), 32 1312 Beon-gil, Yuseong-daero, Yuseong-gu, Daejeon 305-343, Korea"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-5799-2026","authenticated-orcid":false,"given":"Hyun","family":"Myung","sequence":"additional","affiliation":[{"name":"Urban Robotics Laboratory (URL), Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro (373-1 Guseong-dong), Yuseong-gu, Daejeon 305-701, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2015,8,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"835","DOI":"10.1145\/1141911.1141964","article-title":"Photo tourism: Exploring photo collections in 3D","volume":"25","author":"Snavely","year":"2006","journal-title":"ACM Trans. Graph."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1109\/MC.2010.170","article-title":"Google street view: Capturing the world at street level","volume":"43","author":"Anguelov","year":"2010","journal-title":"Computer"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Li, Y., Snavely, N., and Huttenlocher, D.P. (2010, January 5\u201311). Location Recognition Using Prioritized Feature Matching. Proceedings of 11th European Conference on Computer Vision (ECCV), Heraklion, Rethymnon, Greece.","DOI":"10.1007\/978-3-642-15552-9_57"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Robertson, D.P., and Cipolla, R. (2004, January 1\u20135). An Image-Based System for Urban Navigation. Proceedings of the British Machine Vision Conference (BMVC), Nottingham, UK.","DOI":"10.5244\/C.18.84"},{"key":"ref_5","unstructured":"Kosecka, J., Zhou, L., Barber, P., and Duric, Z. (2003, January 18\u201320). Qualitative Image Based Localization in Indoors Environments. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Fairfax, VA, USA."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Napier, A., and Newman, P. (2012, January 3\u20137). Generation and Exploitation of Local Orthographic Imagery for Road Vehicle Localisation. Proceedings of the IEEE Symposium on Intelligent Vehicles (IV), Madrid, Spain.","DOI":"10.1109\/IVS.2012.6232165"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and van Gool, L. (2006, January 7\u201313). SURF: Speeded up Robust Features. Proceedings of the European Conference on Computer Vision (ECCV), Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhang, W., and Kosecka, J. (2006, January 14\u201316). Image Based Localization in Urban Environments. Proceedings of the IEEE Third International Symposium on 3D Data Processing, Visualization, and Transmission, Chapel Hill, NC, USA.","DOI":"10.1109\/3DPVT.2006.80"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Lu, G., and Kambhamettu, C. (2014, January 2). Image-Based Indoor Localization System Based on 3D SfM Model. Proceedings of the International Society for Optics and Photonics on IS&T\/SPIE Electronic Imaging, San Francisco, CA, USA.","DOI":"10.1117\/12.2038582"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kim, H., Lee, D., Oh, T., Lee, S.W., Choe, Y., and Myung, H. (2014, January 6\u20138). Feature-Based 6-DoF Camera Localization Using Prior Point Cloud and Images. Proceedings of the Robot Intelligence Technology and Applications (RiTA), Beijing, China.","DOI":"10.1007\/978-3-319-05582-4_1"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1109\/79.768574","article-title":"3D structure from 2D motion","volume":"16","author":"Jebara","year":"1999","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Triggs, B., McLauchlan, P.F., Hartley, R.I., and Fitzgibbon, A.W. (2000, January 21\u201322). Bundle Adjustment\u2013A Modern Synthesis. Proceedings of the International Workshop on Vision Algorithms: Theory and Practice, Corfu, Greece.","DOI":"10.1007\/3-540-44480-7_21"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Frahm, J.M., Fite-Georgel, P., Gallup, D., Johnson, T., Raguram, R., Wu, C., Jen, Y.H., Dunn, E., Clipp, B., and Lazebnik, S. (2010, January 5\u201311). Building Rome on a Cloudless Day. Proceedings of European Conference on Computer Vision (ECCV), Heraklion, Crete, Greece.","DOI":"10.1007\/978-3-642-15561-1_27"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Strecha, C., Pylvanainen, T., and Fua, P. (2010, January 13\u201318). Dynamic and Scalable Large Scale Image Reconstruction. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5540184"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1007\/s11263-007-0086-4","article-title":"Detailed real-time urban 3D reconstruction from video","volume":"78","author":"Pollefeys","year":"2008","journal-title":"Int. J. Comput. Vis."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Sattler, T., Leibe, B., and Kobbelt, L. (2011, January 6\u201313). Fast Image-Based Localization Using Direct 2D-to-3D Matching. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126302"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Irschara, A., Zach, C., Frahm, J.M., and Bischof, H. (2009, January 20\u201325). From Structure-from-Motion Point Clouds to Fast Location Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206587"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Lu, G., Ly, V., Shen, H., Kolagunda, A., and Kambhamettu, C. (2013, January 29\u201331). Improving Image-Based Localization through Increasing Correct Feature Correspondences. Proceedings of the International Symposium on Advances in Visual Computing, Crete, Greece.","DOI":"10.1007\/978-3-642-41914-0_31"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"930","DOI":"10.1109\/TPAMI.2003.1217599","article-title":"Complete solution classification for the perspective-three-point problem","volume":"25","author":"Gao","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s11263-008-0152-6","article-title":"EPnP: An accurate O(n) solution to the PnP problem","volume":"81","author":"Lepetit","year":"2009","journal-title":"Int. J. Comput. Vis."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zheng, Y., Kuang, Y., Sugimoto, S., Astrom, K., and Okutomi, M. (2013, January 1\u20138). Revisiting the pnp Problem: A Fast, General and Optimal Solution. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Sydney, NSW, Australia.","DOI":"10.1109\/ICCV.2013.291"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Garro, V., Crosilla, F., and Fusiello, A. (2012, January 13\u201315). Solving the pnp Problem with Anisotropic Orthogonal Procrustes Analysis. Proceedings of the Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission, Zurich, Switzerland.","DOI":"10.1109\/3DIMPVT.2012.40"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ferraz, L., Binefa, X., and Moreno-Noguer, F. (2014, January 23\u201328). Very Fast Solution to the PnP Problem with Algebraic Outlier Rejection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.71"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ferraz, L., Binefa, X., and Moreno-Noguer, F. (2014, January 1\u20135). Leveraging Feature Uncertainty in the PnP Problem. Proceedings of the British Machine Vision Conference (BMVC), Nottingham, UK.","DOI":"10.5244\/C.28.83"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1177\/0278364911434148","article-title":"RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments","volume":"31","author":"Henry","year":"2012","journal-title":"Int. J. Robot. Res."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1066","DOI":"10.1109\/TRO.2008.2004832","article-title":"FrameSLAM: From bundle adjustment to real-time visual mapping","volume":"24","author":"Konolige","year":"2008","journal-title":"IEEE Trans. Robot."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"12467","DOI":"10.3390\/s140712467","article-title":"Solution to the SLAM problem in low dynamic environments using a pose graph and an RGB-D sensor","volume":"14","author":"Lee","year":"2014","journal-title":"Sensors"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Davison, A.J. (2003, January 13\u201316). Real-Time Simultaneous Localisation and Mapping with a Single Camera. Proceedings of the 9th IEEE International Conference on Computer Vision, Nice, France.","DOI":"10.1109\/ICCV.2003.1238654"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Lemaire, T., Lacroix, S., and Sola, J. (2005, January 2\u20136). A practical 3D Bearing-Only SLAM Algorithm. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Edmonton, AB, Canada.","DOI":"10.1109\/IROS.2005.1545393"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Davison, A.J., Cid, Y.G., and Kita, N. (2004, January 5\u20137). Real-Time 3D SLAM with Wide-Angle Vision. Proceedings of the IFAC\/EURON Symposium on Intelligent Autonomous Vehicles, Lisbon, Portugal.","DOI":"10.1016\/S1474-6670(17)32089-X"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1052","DOI":"10.1109\/TPAMI.2007.1049","article-title":"MonoSLAM: Real-time single camera SLAM","volume":"29","author":"Davison","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","unstructured":"Jeong, W., and Lee, K.M. (2005, January 2\u20136). CV-SLAM: A New Ceiling Vision-Based SLAM Technique. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Edmonton, AB, Canada."},{"key":"ref_34","unstructured":"Bhandarkar, S.M., and Suk, M. (1988, January 12\u201314). Hough Clustering Technique for Surface Matching. Proceedings of the International Association of Pattern Recognition (IAPR) Workshop on Computer Vision, Tokyo, Japan."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1007\/s10846-011-9647-4","article-title":"Vision-based kidnap recovery with SLAM for home cleaning robots","volume":"67","author":"Lee","year":"2012","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_36","unstructured":"Costa, A., Kantor, G., and Choset, H. (May, January 26). Bearing-Only Landmark Initialization with Unknown Data Association. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), New Orleans, LA, USA."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Bailey, T. (2003, January 14\u201319). Constrained Initialisation for Bearing-Only SLAM. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Taipei, Taiwan.","DOI":"10.1109\/ROBOT.2003.1241882"},{"key":"ref_38","unstructured":"Stereo Accuracy and Error Model of XB3. Available online: http:\/\/www.ptgrey.com\/support\/downloads\/10403?."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1177\/027836498600500404","article-title":"On the representation and estimation of spatial uncertainty","volume":"5","author":"Smith","year":"1986","journal-title":"Int. J. Robot. Res."},{"key":"ref_40","unstructured":"Thrun, S., Burgard, W., and Fox, D. (2005). Probabilistic Robotics, MIT Press."},{"key":"ref_41","unstructured":"Beis, J.S., and Lowe, D.G. (1997, January 17\u201319). Shape Indexing Using Approximate Nearest-Neighbour Search in High-Dimensional Spaces. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Juan, Puerto Rico."},{"key":"ref_42","first-page":"401","article-title":"On a measure of divergence between two multinomial populations","volume":"7","author":"Bhattacharyya","year":"1946","journal-title":"Sankhy\u0101: Indian J. Stat."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_44","unstructured":"Murty, K.G., and Yu, F.T. (1988). Linear Complementarity, Linear and Nonlinear Programming, Heldermann Verlag."},{"key":"ref_45","unstructured":"Pioneer 3-AT. Available online: http:\/\/www.mobilerobots.com\/ResearchRobots\/P3AT.aspx."},{"key":"ref_46","unstructured":"Bumblebee XB3. Available online: http:\/\/www.ptgrey.com\/bumblebee-xb3-1394b-stereo-vision-camera-systems-2."},{"key":"ref_47","unstructured":"Huace X90 RTK-GPS. Available online: http:\/\/geotrax.in\/assets\/x90GNSS_Datasheet.pdf."},{"key":"ref_48","unstructured":"E2BOX IMU. Available online: http:\/\/www.e2box.co.kr\/124."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/9\/21636\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,3]],"date-time":"2024-06-03T21:03:46Z","timestamp":1717448626000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/9\/21636"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,8,31]]},"references-count":48,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2015,9]]}},"alternative-id":["s150921636"],"URL":"https:\/\/doi.org\/10.3390\/s150921636","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,8,31]]}}}