{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,8,25]],"date-time":"2024-08-25T11:28:23Z","timestamp":1724585303273},"reference-count":33,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2020,11,9]],"date-time":"2020-11-09T00:00:00Z","timestamp":1604880000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61772185"],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"As overhead contact (OC) is an essential part of power supply systems in high-speed railways, it is necessary to regularly inspect and repair abnormal OC components. Relative to manual inspection, applying LiDAR (light detection and ranging) to OC inspection can improve efficiency, accuracy, and safety, but it faces challenges to efficiently and effectively segment LiDAR point cloud data and identify catenary components. Recent deep learning-based recognition methods are rarely employed to recognize OC components, because they have high computational complexity, while their accuracy needs to be improved. To track these problems, we first propose a lightweight model, RobotNet, with depthwise and pointwise convolutions and an attention module to recognize the point cloud. Second, we optimize RobotNet to accelerate its recognition speed on embedded devices using an existing compilation tool. Third, we design software to facilitate the visualization of point cloud data. Our software can not only display a large amount of point cloud data, but also visualize the details of OC components. Extensive experiments demonstrate that RobotNet recognizes OC components more accurately and efficiently than others. The inference speed of the optimized RobotNet increases by an order of magnitude. RobotNet has lower computational complexity than other studies. The visualization results also show that our recognition method is effective.<\/jats:p>","DOI":"10.3390\/s20216387","type":"journal-article","created":{"date-parts":[[2020,11,10]],"date-time":"2020-11-10T19:10:41Z","timestamp":1605035441000},"page":"6387","source":"Crossref","is-referenced-by-count":15,"title":["LiDAR Point Cloud Recognition and Visualization with Deep Learning for Overhead Contact Inspection"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-4330-240X","authenticated-orcid":false,"given":"Xiaohan","family":"Tu","sequence":"first","affiliation":[{"name":"Key Laboratory for Embedded and Network Computing of Hunan Province, Changsha 410082, China"},{"name":"College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082, China"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-1323-3175","authenticated-orcid":false,"given":"Cheng","family":"Xu","sequence":"additional","affiliation":[{"name":"Key Laboratory for Embedded and Network Computing of Hunan Province, Changsha 410082, China"},{"name":"College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082, China"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-0019-5154","authenticated-orcid":false,"given":"Siping","family":"Liu","sequence":"additional","affiliation":[{"name":"Key Laboratory for Embedded and Network Computing of Hunan Province, Changsha 410082, China"},{"name":"College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082, China"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-8907-3139","authenticated-orcid":false,"given":"Shuai","family":"Lin","sequence":"additional","affiliation":[{"name":"Key Laboratory for Embedded and Network Computing of Hunan Province, Changsha 410082, China"},{"name":"College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082, China"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-4355-1737","authenticated-orcid":false,"given":"Lipei","family":"Chen","sequence":"additional","affiliation":[{"name":"Key Laboratory for Embedded and Network Computing of Hunan Province, Changsha 410082, China"},{"name":"College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082, China"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-6625-0350","authenticated-orcid":false,"given":"Guoqi","family":"Xie","sequence":"additional","affiliation":[{"name":"Key Laboratory for Embedded and Network Computing of Hunan Province, Changsha 410082, China"},{"name":"College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082, China"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-4573-7375","authenticated-orcid":false,"given":"Renfa","family":"Li","sequence":"additional","affiliation":[{"name":"Key Laboratory for Embedded and Network Computing of Hunan Province, Changsha 410082, China"},{"name":"College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082, China"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"282","DOI":"10.1108\/SR-06-2017-0106","article-title":"Methodology for digital preservation of the cultural and patrimonial heritage: Generation of a 3D model of the Church St. Peter and Paul (Calw, Germany) by using laser scanning and digital photogrammetry","volume":"38","author":"Owda","year":"2018","journal-title":"Sens. Rev."},{"key":"ref_2","first-page":"57","article-title":"Generation of visually aesthetic and detailed 3D models of historical cities by using laser scanning and digital photogrammetry","volume":"8","author":"Fritsch","year":"2018","journal-title":"Digit. Appl. Archaeol. Cult. Herit."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1236021","DOI":"10.1155\/2020\/1236021","article-title":"Vision-Based Three-Dimensional Reconstruction and Monitoring of Large-Scale Steel Tubular Structures","volume":"2020","author":"Tang","year":"2020","journal-title":"Adv. Civ. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Balsa-Barreiro, J., and Fritsch, D. (2015). Generation of 3D\/4D Photorealistic Building Models. The Testbed Area for 4D Cultural Heritage World Project: The Historical Center of Calw (Germany). International Symposium on Visual Computing (ISVC), Springer.","DOI":"10.1007\/978-3-319-27857-5_33"},{"key":"ref_5","unstructured":"Mueller, A.R. (2014, September 14). LiDAR and Image Point Cloud Comparison. Available online: https:\/\/calhoun.nps.edu\/handle\/10945\/43960."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.rcim.2019.03.001","article-title":"Real-time detection of surface deformation and strain in recycled aggregate concrete-filled steel tubular columns via four-ocular vision","volume":"59","author":"Tang","year":"2019","journal-title":"Robot. Comput. Integr. Manuf."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1016\/j.optlaseng.2019.06.011","article-title":"High-accuracy multi-camera reconstruction enhanced by adaptive point cloud correction algorithm","volume":"122","author":"Chen","year":"2019","journal-title":"Opt. Lasers Eng."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2337","DOI":"10.1109\/TNNLS.2017.2654357","article-title":"A Parallel Multiclassification Algorithm for Big Data Using an Extreme Learning Machine","volume":"29","author":"Duan","year":"2018","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"919","DOI":"10.1109\/TPDS.2016.2603511","article-title":"A Parallel Random Forest Algorithm for Big Data in a Spark Cloud Computing Environment","volume":"28","author":"Chen","year":"2017","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1765","DOI":"10.1109\/TC.2018.2839719","article-title":"FlinkCL: An OpenCL-Based In-Memory Computing Architecture on Heterogeneous CPU-GPU Clusters for Big Data","volume":"67","author":"Chen","year":"2018","journal-title":"IEEE Trans. Comput."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Chen, L., Xu, C., Lin, S., Li, S., and Tu, X. (2020). A Deep Learning-Based Method for Overhead Contact System Component Recognition Using Mobile 2D LiDAR. Sensors, 20.","DOI":"10.3390\/s20082224"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"173366","DOI":"10.1109\/ACCESS.2019.2955753","article-title":"Contact Wire Support Defect Detection Using Deep Bayesian Segmentation Neural Networks and Prior Geometric Knowledge","volume":"7","author":"Kang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lin, S., Xu, C., Chen, L., Li, S., and Tu, X. (2020). LiDAR Point Cloud Recognition of Overhead Catenary System with Deep Learning. Sensors, 20.","DOI":"10.3390\/s20082212"},{"key":"ref_14","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21\u201326). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA."},{"key":"ref_15","unstructured":"Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017, January 4\u20139). PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"916","DOI":"10.1016\/j.future.2017.05.033","article-title":"Energy management for multiple real-time workflows on cyber\u2014Physical cloud systems","volume":"105","author":"Xie","year":"2020","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_17","unstructured":"Tu, X., Xu, C., Liu, S., Li, R., Xie, G., Huang, J., and Yang, L. (2020). Efficient monocular depth estimation for edge devices in internet of things. IEEE Trans. Ind. Informat., 1\u201312."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.future.2017.03.008","article-title":"Efficient task scheduling for budget constrained parallel applications on heterogeneous cloud computing systems","volume":"74","author":"Chen","year":"2017","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/j.future.2018.06.021","article-title":"A novel fuzzy deep-learning approach to traffic flow prediction with uncertain spatial\u2014Temporal data features","volume":"89","author":"Chen","year":"2018","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"104789","DOI":"10.1016\/j.knosys.2019.05.032","article-title":"Multi-pattern correlation tracking","volume":"181","author":"Nai","year":"2019","journal-title":"Knowl. Based Syst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1016\/j.ins.2020.01.015","article-title":"Reliable correlation tracking via dual-memory selection model","volume":"518","author":"Li","year":"2020","journal-title":"Inf. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3426","DOI":"10.1109\/TPDS.2017.2730876","article-title":"Energy-Efficient Scheduling Algorithms for Real-Time Parallel Applications on Heterogeneous Distributed Embedded Systems","volume":"28","author":"Xie","year":"2017","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1518","DOI":"10.1109\/TC.2017.2693186","article-title":"Energy-Efficient Resource Utilization for Heterogeneous Embedded Computing Systems","volume":"66","author":"Huang","year":"2017","journal-title":"IEEE Trans. Comput."},{"key":"ref_24","unstructured":"Chen, T., Moreau, T., Jiang, Z., Zheng, L., Yan, E., Cowan, M., Shen, H., Wang, L., Hu, Y., and Ceze, L. (2018, January 8\u201310). TVM: An Automated End-to-End Optimizing Compiler for Deep Learning. Proceedings of the 13th USENIX Conference on Operating Systems Design and Implementation, Carlsbad, CA, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhou, J., Han, Z., and Wang, L. (2018, January 27\u201329). A Steady Arm Slope Detection Method Based on 3D Point Cloud Segmentation. Proceedings of the IEEE 3rd International Conference on Image, Vision and Computing (ICIVC), Chongqing, China.","DOI":"10.1109\/ICIVC.2018.8492785"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Han, Z., Yang, C., and Liu, Z. (2019). Cantilever Structure Segmentation and Parameters Detection Based on Concavity and Convexity of 3D Point Clouds. IEEE Trans. Instrum. Meas.","DOI":"10.1109\/TIM.2019.2930158"},{"key":"ref_27","first-page":"2103","article-title":"3D point cloud segmentation, classification and recognition algorithm of railway scene","volume":"38","author":"Guo","year":"2017","journal-title":"Chin. J. Sci. Instrum."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Verdoja, F., Thomas, D., and Sugimoto, A. (2017, January 10\u201314). Fast 3D point cloud segmentation using supervoxels with geometry and color for 3D scene understanding. Proceedings of the IEEE International Conference on Multimedia and Expo (ICME), Hong Kong, China.","DOI":"10.1109\/ICME.2017.8019382"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Liu, Z., Zhong, J., Lyu, Y., Liu, K., Han, Y., Wang, L., and Liu, W. (2018, January 14\u201317). Location and fault detection of catenary support components based on deep learning. Proceedings of the IEEE International Instrumentation and Measurement Technology Conference (I2MTC), Houston, TX, USA.","DOI":"10.1109\/I2MTC.2018.8409637"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2679","DOI":"10.1109\/TIM.2018.2868490","article-title":"Deep Architecture for High-Speed Railway Insulator Surface Defect Detection: Denoising Autoencoder With Multitask Learning","volume":"68","author":"Kang","year":"2019","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8\u201314). CBAM: Convolutional Block Attention Module. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3372","DOI":"10.1080\/01431161.2014.903355","article-title":"Empirical study of variation in lidar point density over different land covers","volume":"35","author":"Lerma","year":"2014","journal-title":"Int. J. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1016\/j.measurement.2018.08.026","article-title":"Binocular vision measurement and its application in full-field convex deformation of concrete-filled steel tubular columns","volume":"130","author":"Tang","year":"2018","journal-title":"Measurement"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/21\/6387\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,17]],"date-time":"2024-08-17T06:30:45Z","timestamp":1723876245000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/21\/6387"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,9]]},"references-count":33,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["s20216387"],"URL":"https:\/\/doi.org\/10.3390\/s20216387","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,11,9]]}}}