{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T16:14:16Z","timestamp":1740154456356,"version":"3.37.3"},"reference-count":49,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2019,6,4]],"date-time":"2019-06-04T00:00:00Z","timestamp":1559606400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41771480"],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"Real-time and high-precision localization information is vital for many modules of unmanned vehicles. At present, a high-cost RTK (Real Time Kinematic) and IMU (Integrated Measurement Unit) integrated navigation system is often used, but its accuracy cannot meet the requirements and even fails in many scenes. In order to reduce the costs and improve the localization accuracy and stability, we propose a precise and robust segmentation-based Lidar (Light Detection and Ranging) localization system aided with MEMS (Micro-Electro-Mechanical System) IMU and designed for high level autonomous driving. Firstly, we extracted features from the online frame using a series of proposed efficient low-level semantic segmentation-based multiple types feature extraction algorithms, including ground, road-curb, edge, and surface. Next, we matched the adjacent frames in Lidar odometry module and matched the current frame with the dynamically loaded pre-build feature point cloud map in Lidar localization module based on the extracted features to precisely estimate the 6DoF (Degree of Freedom) pose, through the proposed priori information considered category matching algorithm and multi-group-step L-M (Levenberg-Marquardt) optimization algorithm. Finally, the lidar localization results were fused with MEMS IMU data through a state-error Kalman filter to produce smoother and more accurate localization information at a high frequency of 200Hz. The proposed localization system can achieve 3~5 cm in position and 0.05~0.1\u00b0 in orientation RMS (Root Mean Square) accuracy and outperform previous state-of-the-art systems. The robustness and adaptability have been verified with localization testing data more than 1000 Km in various challenging scenes, including congested urban roads, narrow tunnels, textureless highways, and rain-like harsh weather.<\/jats:p>","DOI":"10.3390\/rs11111348","type":"journal-article","created":{"date-parts":[[2019,6,5]],"date-time":"2019-06-05T13:37:58Z","timestamp":1559741878000},"page":"1348","source":"Crossref","is-referenced-by-count":42,"title":["A Precise and Robust Segmentation-Based Lidar Localization System for Automated Urban Driving"],"prefix":"10.3390","volume":"11","author":[{"given":"Hang","family":"Liu","sequence":"first","affiliation":[{"name":"College of Surveying and Geo-Informatics, Tongji University, Shanghai 200092, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1056-9159","authenticated-orcid":false,"given":"Qin","family":"Ye","sequence":"additional","affiliation":[{"name":"College of Surveying and Geo-Informatics, Tongji University, Shanghai 200092, China"}]},{"given":"Hairui","family":"Wang","sequence":"additional","affiliation":[{"name":"Beijing Momenta Technology Company Limited, Beijing 100190, China"}]},{"given":"Liang","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing 210094, China"}]},{"given":"Jian","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing 210094, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,6,4]]},"reference":[{"key":"ref_1","unstructured":"Groves, P.D. (2013). Principles of GNSS, Inertial, and Multisensor Integrated Navigation Systems, Artech House."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Falco, G., Pini, M., and Marucco, G. (2017). Loose and tight GNSS\/INS integrations: Comparison of performance assessed in real urban scenarios. Sensors, 17.","DOI":"10.3390\/s17020255"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zhang, X., Miao, L., and Shao, H. (2016). Tracking architecture based on dual-filter with state feedback and its application in ultra-tight GPS\/INS integration. Sensors, 16.","DOI":"10.3390\/s16050627"},{"key":"ref_4","unstructured":"Wei, W., Zongyu, L., and Rongrong, X. (2004, January 1\u20133). INS\/GPS\/Pseudolite integrated navigation for land vehicle in urban canyon environments. Proceedings of the IEEE Conference on Cybernetics and Intelligent Systems, Singapore."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Woo, R., Yang, E.J., and Seo, D.W. (2019). A Fuzzy-Innovation-Based Adaptive Kalman Filter for Enhanced Vehicle Positioning in Dense Urban Environments. Sensors, 19.","DOI":"10.3390\/s19051142"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Choi, K., Suhr, J., and Jung, H. (2018). FAST Pre-Filtering-Based Real Time Road Sign Detection for Low-Cost Vehicle Localization. Sensors, 18.","DOI":"10.3390\/s18103590"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Wang, D., Xu, X., and Zhu, Y. (2018). A Novel Hybrid of a Fading Filter and an Extreme Learning Machine for GPS\/INS during GPS Outages. Sensors, 18.","DOI":"10.3390\/s18113863"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1016\/j.trc.2018.02.012","article-title":"Autonomous vehicle perception: The technology of today and tomorrow","volume":"89","author":"Gruyer","year":"2018","journal-title":"Transp. Res. Part C Emerg. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"344","DOI":"10.1109\/LRA.2017.2748180","article-title":"Ground-edge-based LIDAR localization without a reflectivity calibration for autonomous driving","volume":"3","author":"Castorena","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Gawel, A., Cieslewski, T., Dub\u00e9, R., Bosse, M., Siegwart, R., and Nieto, J. (2016, January 9\u201314). Structure-based vision-laser matching. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea.","DOI":"10.1109\/IROS.2016.7759053"},{"key":"ref_11","unstructured":"Roweis, S. (1996). Levenberg-Marquardt Optimization, University Of Toronto."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Hsu, C.M., and Shiu, C.W. (2019). 3D LiDAR-Based Precision Vehicle Localization with Movable Region Constraints. Sensors, 19.","DOI":"10.3390\/s19040942"},{"key":"ref_13","unstructured":"Forster, C., Pizzoli, M., and Scaramuzza, D. (June, January 31). SVO: Fast semi-direct monocular visual odometry. Proceedings of the IEEE international conference on robotics and automation (ICRA), Hong Kong, China."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Engel, J., Sch\u00f6ps, T., and Cremers, D. (2014, January 6\u201312). LSD-SLAM: Large-scale direct monocular SLAM. Proceedings of the European Conference on Computer Vision (ECCV), Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10605-2_54"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Qin, T., Li, P., and Shen, S. (2018, January 21\u201326). Relocalization, global optimization and map merging for monocular visual-inertial SLAM. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8460780"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Weiss, S., Achtelik, M.W., Lynen, S., Chli, M., and Siegwart, R. (2012, January 14\u201318). Real-time onboard visual-inertial state estimation and self-calibration of mavs in unknown environments. Proceedings of the IEEE International Conference on Robotics and Automation, St. Paul, MN, USA.","DOI":"10.1109\/ICRA.2012.6225147"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1007\/s10514-016-9548-2","article-title":"Low-drift and real-time lidar odometry and mapping","volume":"41","author":"Ji","year":"2017","journal-title":"Auton. Robot."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Moosmann, F., and Stiller, C. (2011, January 5\u20139). Velodyne slam. Proceedings of the IEEE Intelligent Vehicles Symposium (IV), Baden-Baden, Germany.","DOI":"10.1109\/IVS.2011.5940396"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kuramachi, R., Ohsato, A., Sasaki, Y., and Mizoguchi, H. (2015, January 6\u20139). G-ICP SLAM: An odometry-free 3D mapping system with robust 6DoF pose estimation. Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO), Zhuhai, China.","DOI":"10.1109\/ROBIO.2015.7418763"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Hess, W., Kohler, D., Rapp, H., and Andor, D. (2016, January 16\u201321). Real-time loop closure in 2D LIDAR SLAM. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487258"},{"key":"ref_21","first-page":"1147","article-title":"ORB-SLAM: A Versatile and Accurate Monocular SLAM System","volume":"31","author":"Montiel","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","article-title":"ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo and RGB-D Cameras","volume":"33","author":"Tardos","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1188","DOI":"10.1109\/TRO.2012.2197158","article-title":"Bags of Binary Words for Fast Place Recognition in Image Sequences","volume":"28","author":"Tardos","year":"2012","journal-title":"IEEE Trans. Robot."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Gao, X., Wang, R., Demmel, N., and Cremers, D. (2018, January 1\u20135). LDSO: Direct sparse odometry with loop closure. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.","DOI":"10.1109\/IROS.2018.8593376"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1109\/TPAMI.2017.2658577","article-title":"Direct sparse odometry","volume":"40","author":"Engel","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhang, J., and Singh, S. (2014, January 12\u201316). LOAM: Lidar Odometry and Mapping in Real-time. Proceedings of the Robotics: Science and Systems(RSS), Berkeley, CA, USA.","DOI":"10.15607\/RSS.2014.X.007"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are we ready for autonomous driving? the kitti vision benchmark suite. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Shan, T., and Englot, B. (2018, January 1\u20135). LeGO-LOAM: Lightweight and Ground-Optimized Lidar Odometry and Mapping on Variable Terrain. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.","DOI":"10.1109\/IROS.2018.8594299"},{"key":"ref_29","unstructured":"Besl, P.J., and McKay, N.D. (1992, January 12\u201315). Method for registration of 3-D shapes. Proceedings of the Sensor Fusion IV: Control Paradigms and Data Structures, Boston, MA, USA."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Deschaud, J.E. (2018, January 21\u201326). IMLS-SLAM: Scan-to-model matching based on 3D data. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8460653"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Levinson, J., Montemerlo, M., and Thrun, S. (2007, January 27\u201330). Map-based precision vehicle localization in urban environments. Proceedings of the Robotics: Science and Systems (RSS), Atlanta, GA, USA.","DOI":"10.15607\/RSS.2007.III.016"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Yoneda, K., Tehrani, H., Ogawa, T., Hukuyama, N., and Mita, S. (2014, January 8\u201311). Lidar scan feature for localization with highly precise 3-D map. Proceedings of the IEEE Intelligent Vehicles Symposium, Ypsilanti, MI, USA.","DOI":"10.1109\/IVS.2014.6856596"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Baldwin, I., and Newman, P. (, January 7\u201312). Laser-only road-vehicle localization with dual 2d push-broom lidars and 3d priors. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Vilamoura, Portugal.","DOI":"10.1109\/IROS.2012.6385677"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Chong, Z.J., Qin, B., Bandyopadhyay, T., Ang, M.H., Frazzoli, E., and Rus, D. (2013, January 6\u201310). Synthetic 2d lidar for precise vehicle localization in 3d urban environment. Proceedings of the IEEE International Conference on Robotics and Automation, Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6630777"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1177\/0278364917696568","article-title":"Robust LIDAR localization using multiresolution Gaussian mixture maps for autonomous driving","volume":"36","author":"Wolcott","year":"2017","journal-title":"Int. J. Robot. Res."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Wolcott, R.W., and Eustice, R.M. (2015, January 8\u201310). Fast LIDAR localization using multiresolution Gaussian mixture maps. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Lijiang, China.","DOI":"10.1109\/ICRA.2015.7139582"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Levinson, J., and Thrun, S. (2010, January 4\u20138). Robust vehicle localization in urban environments using probabilistic maps. Proceedings of the IEEE International Conference on Robotics and Automation, Anchorage, AK, USA.","DOI":"10.1109\/ROBOT.2010.5509700"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"23286","DOI":"10.3390\/s150923286","article-title":"INS\/GPS\/LiDAR integrated navigation system for urban and indoor environments using hybrid scan matching algorithm","volume":"15","author":"Gao","year":"2015","journal-title":"Sensors"},{"key":"ref_39","unstructured":"Qian, C., Liu, H., Tang, J., Chen, Y., Kaartinen, H., Kukko, A., Zhu, L., Liang, X., Chen, L., and Hyypp\u00e4, J. (2017). An integrated GNSS\/INS\/LiDAR-SLAM positioning method for highly accurate forest stem mapping. Remote Sens. Lett., 9."},{"key":"ref_40","unstructured":"Klein, I., and Filin, S. (2011, January 9\u201331). LiDAR and INS fusion in periods of GPS outages for mobile laser scanning mapping systems. Proceedings of the ISPRS Calgary 2011 Workshop, Calgary, AB, Canada."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Wan, G., Yang, X., Cai, R., Li, H., Zhou, Y., Wang, H., and Song, S. (2018, January 21\u201326). Robust and precise vehicle localization based on multi-sensor fusion in diverse city scenes. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8461224"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Li, J., Zhong, R., Hu, Q., and Ai, M. (2016). Feature-based laser scan matching and its application for indoor mapping. Sensors, 16.","DOI":"10.3390\/s16081265"},{"key":"ref_43","unstructured":"Grant, W.S., Voorhies, R.C., and Itti, L. (2018). Efficient Velodyne SLAM with point and plane features. Auton. Robot., 1\u201318."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"98","DOI":"10.5772\/63540","article-title":"On a hopping-points svd and hough transform-based line detection algorithm for robot localization and mapping","volume":"13","author":"Ravankar","year":"2016","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Yu, C., Liu, Z., Liu, X.J., Xie, F., Yang, Y., Wei, Q., and Fei, Q. (2018, January 1\u20135). DS-SLAM: A Semantic Visual SLAM towards Dynamic Environments. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.","DOI":"10.1109\/IROS.2018.8593691"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Bogoslavskyi, I., and Stachniss, C. (2016, January 9\u201314). Fast range image-based segmentation of sparse 3D laser scans for online operation. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea.","DOI":"10.1109\/IROS.2016.7759050"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Na, K., Byun, J., Roh, M., and Seo, B. (2013, January 2\u20136). The ground segmentation of 3D LIDAR point cloud with the optimized region merging. Proceedings of the International Conference on Connected Vehicles and Expo (ICCVE), Las Vegas, NV, USA.","DOI":"10.1109\/ICCVE.2013.6799834"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"3981","DOI":"10.1109\/TITS.2018.2789462","article-title":"Road-segmentation-based curb detection method for self-driving via a 3D-LiDAR sensor","volume":"19","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1062","DOI":"10.1080\/2150704X.2017.1349961","article-title":"Segmentation of building roofs from airborne LiDAR point clouds using robust voxel-based region growing","volume":"8","author":"Xu","year":"2017","journal-title":"Remote Sens. Lett."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/11\/1348\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T05:34:59Z","timestamp":1721367299000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/11\/1348"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,4]]},"references-count":49,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2019,6]]}},"alternative-id":["rs11111348"],"URL":"https:\/\/doi.org\/10.3390\/rs11111348","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2019,6,4]]}}}