{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,11,24]],"date-time":"2024-11-24T13:40:15Z","timestamp":1732455615665,"version":"3.28.0"},"reference-count":56,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T00:00:00Z","timestamp":1721347200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Qin Chuangyuan Scientists + Engineers Team Project of the Shaanxi Science and Technology Department","award":["2024QCY-KXJ-194"]},{"name":"2024 Graduate Innovation Fund Project of Xi\u2019an Polytechnic University","award":["chx2024027"]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"A weld is the main connection form of special equipment, and a weld is also the most vulnerable part of special equipment. Therefore, an effective detection of a weld is of great significance to improve the safety of special equipment. The traditional inspection method is not only time-consuming and labor-intensive, but also expensive. The welding seam tracking and inspection robot can greatly improve the inspection efficiency and save on inspection costs. Therefore, this paper proposes a welding seam tracking and inspection robot based on YOLOv8s-seg. Firstly, the MobileNetV3 lightweight backbone network is used to replace the backbone part of YOLOv8s-seg to reduce the model parameters. Secondly, we reconstruct C2f and prune the number of output channels of the new building module C2fGhost. Finally, in order to make up for the precision loss caused by the lightweight model, we add an EMA attention mechanism after each detection layer in the neck part of the model. The experimental results show that the accuracy of weld recognition reaches 97.8%, and the model size is only 4.88 MB. The improved model is embedded in Jetson nano, a robot control system for seam tracking and detection, and TensorRT is used to accelerate the reasoning of the model. The total reasoning time from image segmentation to path fitting is only 54 ms, which meets the real-time requirements of the robot for seam tracking and detection, and realizes the path planning of the robot for inspecting the seam efficiently and accurately.<\/jats:p>","DOI":"10.3390\/s24144690","type":"journal-article","created":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T17:12:57Z","timestamp":1721409177000},"page":"4690","source":"Crossref","is-referenced-by-count":1,"title":["Welding Seam Tracking and Inspection Robot Based on Improved YOLOv8s-Seg Model"],"prefix":"10.3390","volume":"24","author":[{"given":"Minghu","family":"Zhao","sequence":"first","affiliation":[{"name":"School of Science, Xi\u2019an Polytechnic University, Xi\u2019an 710048, China"}]},{"given":"Xinru","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Electronic Information, Xi\u2019an Polytechnic University, Xi\u2019an 710048, China"}]},{"given":"Kaihang","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Science, Xi\u2019an Polytechnic University, Xi\u2019an 710048, China"}]},{"given":"Zishen","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Science, Xi\u2019an Polytechnic University, Xi\u2019an 710048, China"}]},{"given":"Qi","family":"Dong","sequence":"additional","affiliation":[{"name":"School of Science, Xi\u2019an Polytechnic University, Xi\u2019an 710048, China"}]},{"given":"Pengfei","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Mechanical and Electrical Engineering, Xi\u2019an Polytechnic University, Xi\u2019an 710048, China"}]},{"given":"Yaoheng","family":"Su","sequence":"additional","affiliation":[{"name":"School of Science, Xi\u2019an Polytechnic University, Xi\u2019an 710048, China"}]}],"member":"1968","published-online":{"date-parts":[[2024,7,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Mom\u010dilovi\u0107, N., Ili\u0107, N., Kalajd\u017ei\u0107, M., Ivo\u0161evi\u0107, \u0160., and Petrovi\u0107, A. (2024). Effect of Corrosion-Induced Structural Degradation on the Ultimate Strength of a High-Tensile-Steel Ship Hull. J. Mar. Sci. Eng., 12.","DOI":"10.3390\/jmse12050745"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"137047","DOI":"10.1016\/j.conbuildmat.2024.137047","article-title":"Development and characterization of anti-cracking epoxy asphalt for steel deck pavement","volume":"438","author":"Li","year":"2024","journal-title":"Constr. Build. Mater."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1016\/j.enconman.2018.03.088","article-title":"Hydrogen production, storage, transportation and key challenges with applications: A review","volume":"165","author":"Abdalla","year":"2018","journal-title":"Energy Convers. Manag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1016\/j.oceaneng.2016.06.042","article-title":"Heat-treatment of clad steel plate for application of hull structure","volume":"122","author":"Song","year":"2016","journal-title":"Ocean Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1061\/(ASCE)CF.1943-5509.0000249","article-title":"Research on stress spectrum of steel decks in suspension bridge considering measured traffic flow","volume":"26","author":"Ji","year":"2012","journal-title":"J. Perform. Constr. Facil."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"20644","DOI":"10.1021\/acsomega.1c02837","article-title":"Cause analysis of the large-scale LPG explosion accident based on key investigation technology: A case study","volume":"6","author":"Qian","year":"2021","journal-title":"ACS Omega"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1080\/03088839.2016.1245449","article-title":"Analysis of occupational accidents encountered by deck cadets in maritime transportation","volume":"44","author":"Kum","year":"2017","journal-title":"Marit. Policy Manag."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1061\/(ASCE)0887-3828(2007)21:5(398)","article-title":"Collapse of steel bridges","volume":"21","author":"Biezma","year":"2007","journal-title":"J. Perform. Constr. Facil."},{"key":"ref_9","unstructured":"Broberg, P. (2014). Imaging and Analysis Methods for Automated Weld Inspection. [Ph.D. Thesis, Lule\u00e5 Tekniska Universitet]."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"5075","DOI":"10.3233\/JIFS-179993","article-title":"Visual inspection of weld surface quality","volume":"39","author":"Li","year":"2020","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Li, J., Li, B., Dong, L., Wang, X., and Tian, M. (2022). Weld seam identification and tracking of inspection robot based on deep learning network. Drones, 6.","DOI":"10.3390\/drones6080216"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"103326","DOI":"10.1016\/j.compind.2020.103326","article-title":"A review of vision-aided robotic welding","volume":"123","author":"Lei","year":"2020","journal-title":"Comput. Ind."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"101934","DOI":"10.1016\/j.rcim.2020.101934","article-title":"A welding task data model for intelligent process planning of robotic welding","volume":"64","author":"Shen","year":"2020","journal-title":"Robot. Comput. Integr. Manuf."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1007\/s00170-021-06782-4","article-title":"Precise seam tracking in robotic welding by an improved image processing approach","volume":"114","author":"Banafian","year":"2021","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"8631","DOI":"10.1109\/JSEN.2018.2867581","article-title":"A high-speed seam extraction method based on the novel structured-light sensor for arc welding robot: A review","volume":"18","author":"Yang","year":"2018","journal-title":"IEEE Sens. J."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1007\/s00170-015-7560-x","article-title":"Seam tracking based on Kalman filtering of micro-gap weld using magneto-optical image","volume":"83","author":"Gao","year":"2016","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ding, Y., Sun, Z., and Chen, Q. (2018, January 20\u201322). Non-contacted permanent magnetic absorbed wall-climbing robot for ultrasonic weld inspection of spherical tank. Proceedings of the MATEC Web of Conferences, Abu Dhabi, United Arab Emirates.","DOI":"10.1051\/matecconf\/201926902013"},{"key":"ref_18","unstructured":"Sogi, T., Kawaguchi, Y., Morisaki, H., Ohkawa, K., Kai, N., and Hayakawa, H. (2000, January 22\u201328). Inspection robot for spherical storage tanks. Proceedings of the 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies, Nagoya, Japan."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Jeon, K.-W., Jung, E.-J., Bae, J.-H., Park, S.-H., Kim, J.-J., Chung, G., Chung, H.-J., and Yi, H. (2024). Development of an In-Pipe Inspection Robot for Large-Diameter Water Pipes. Sensors, 24.","DOI":"10.3390\/s24113470"},{"key":"ref_20","unstructured":"Luo, G., Luo, C., Gao, S., Xu, J., Bao, X., Jiang, Z., and Ma, Z. Research on a Wall-Climbing Cleaning and Inspection Robot for Offshore Cylindrical Steel Structures Based on Magnetic Adsorption Technology, Available at SSRN 4837249."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"45693","DOI":"10.1109\/ACCESS.2024.3378580","article-title":"Target Recognition of Multi source Machine Vision Pan tilt Integrated Inspection Robot for Power Inspection","volume":"12","author":"Zhu","year":"2024","journal-title":"IEEE Access"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"100950","DOI":"10.1016\/j.arcontrol.2024.100950","article-title":"Design, modeling, and experimental analysis of the Crawler Unit for inspection in constrained space","volume":"57","author":"Leggieri","year":"2024","journal-title":"Annu. Rev. Control"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Mendoza, N., and Haghshenas-Jaryani, M. (2024). Combined Soft Grasping and Crawling Locomotor Robot for Exterior Navigation of Tubular Structures. Machines, 12.","DOI":"10.3390\/machines12030157"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1504\/IJHVS.2024.136243","article-title":"Influence on polygon effect with characteristic parameters of guide arc branch of the crawler robot","volume":"31","author":"Chen","year":"2024","journal-title":"Int. J. Heavy Veh. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1640","DOI":"10.1109\/TASE.2019.2909638","article-title":"A bionic robot navigation algorithm based on cognitive mechanism of hippocampus","volume":"16","author":"Yu","year":"2019","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1781","DOI":"10.1007\/s10237-022-01619-9","article-title":"Design and simulation analysis of a bionic ostrich robot","volume":"21","author":"Chen","year":"2022","journal-title":"Biomech. Model. Mechanobiol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2720873","DOI":"10.1155\/2019\/2720873","article-title":"Simulation analysis of bionic robot fish based on MFC materials","volume":"2019","author":"Zhang","year":"2019","journal-title":"Math. Probl. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1109\/TMECH.2012.2234473","article-title":"Wet adhesion inspired bionic climbing robot","volume":"19","author":"He","year":"2013","journal-title":"IEEE Asme Trans. Mechatron."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zhang, M., Jiao, S., Sun, L., and Li, M. (2024). Design and Optimization of the Wall Climbing Robot for Magnetic Particle Detection of Ship Welds. J. Mar. Sci. Eng., 12.","DOI":"10.3390\/jmse12040610"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"103879","DOI":"10.1016\/j.apor.2024.103879","article-title":"Design and analysis of a passive adaptive wall-climbing robot on variable curvature ship facades","volume":"143","author":"Yang","year":"2024","journal-title":"Appl. Ocean Res."},{"key":"ref_31","first-page":"64","article-title":"Design of Intelligent Detection System Based on Bionic Robot Snake","volume":"4","author":"Hua","year":"2021","journal-title":"Curric. Teach. Methodol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"5941","DOI":"10.1007\/s00170-024-13245-z","article-title":"An automatic feature point extraction method based on laser vision for robotic multi-layer multi-pass weld seam tracking","volume":"131","author":"Xu","year":"2024","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"121700","DOI":"10.1016\/j.eswa.2023.121700","article-title":"WeldNet: A deep learning based method for weld seam type identification and initial point guidance","volume":"238","author":"Ma","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"241","DOI":"10.5781\/JWJ.2020.38.3.2","article-title":"Machine learning for prediction of arc length for seam tracking in tandem welding","volume":"38","author":"Seo","year":"2020","journal-title":"J. Weld. Join."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Cai, W., Wang, J., Zhou, Q., Yang, Y., and Jiang, P. (2019, January 16\u201318). Equipment and machine learning in welding monitoring: A short review. Proceedings of the 5th International Conference on mechatronics and robotics engineering, Rome, Italy.","DOI":"10.1145\/3314493.3314508"},{"key":"ref_36","unstructured":"Ponweiser, W., Ayromlou, M., Vincze, M., Beltran, C., Madsen, O., and Gasteratos, A. (2001, January 20\u201322). RobVision: Vision based navigation for mobile robots. Proceedings of the Conference Documentation International Conference on Multisensor Fusion and Integration for Intelligent Systems, Baden-Baden, Germany."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1927","DOI":"10.1002\/rob.22233","article-title":"An automated nondestructive testing system for the surface of pressure pipeline welds","volume":"40","author":"Zhang","year":"2023","journal-title":"J. Field Robot."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1109\/JPROC.2023.3238524","article-title":"Object detection in 20 years: A survey","volume":"111","author":"Zou","year":"2023","journal-title":"Proc. IEEE"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"112424","DOI":"10.1016\/j.measurement.2022.112424","article-title":"A weld seam feature real-time extraction method of three typical welds based on target detection","volume":"207","author":"Deng","year":"2023","journal-title":"Measurement"},{"key":"ref_40","first-page":"271","article-title":"Vehicle wheel weld detection based on improved YOLO v4 algorithm","volume":"46","author":"Jiao","year":"2022","journal-title":"\u041ao\u043c\u043f\u044c\u044e\u0442\u0435\u0440\u043d\u0430\u044f \u041e\u043f\u0442\u0438\u043a\u0430"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1801","DOI":"10.1007\/s11760-022-02391-0","article-title":"A weld feature points detection method based on improved YOLO for welding robots in strong noise environment","volume":"17","author":"Song","year":"2023","journal-title":"Signal Image Video Process."},{"key":"ref_42","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention\u2013MICCAI 2015: 18th International Conference, Munich, Germany. proceedings, part III 18."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask r-cnn. Proceedings of the IEEE international conference on computer vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.jmapro.2021.10.019","article-title":"Real-time recognition of arc weld pool using image segmentation network","volume":"72","author":"Yu","year":"2021","journal-title":"J. Manuf. Process."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Lu, J., Yang, A., Chen, X., Xu, X., Lv, R., and Zhao, Z. (2022). A Seam Tracking Method Based on an Image Segmentation Deep Convolutional Neural Network. Metals, 12.","DOI":"10.3390\/met12081365"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"123787","DOI":"10.1016\/j.eswa.2024.123787","article-title":"Revolutionizing flame detection: Novelization in flame detection through transferring distillation for knowledge to pruned model","volume":"249","author":"Tao","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_47","unstructured":"(2023, May 20). Available online: https:\/\/www.kaggle.com\/datasets\/engineeringubu\/fsw-aa5083-aa5061."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Koonce, B., and Koonce, B. (2021). MobileNetV3. Convolutional Neural Networks with Swift for Tensorflow: Image Recognition and Dataset Categorization, Apress Berkeley.","DOI":"10.1007\/978-1-4842-6168-2"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.-C. (2018, January 18\u201322). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE conference on computer vision and pattern recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201322). Squeeze-and-excitation networks. Proceedings of the IEEE conference on computer vision and pattern recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Ouyang, D., He, S., Zhang, G., Luo, M., Guo, H., Zhan, J., and Huang, Z. (2023, January 4\u201310). Efficient multi-scale attention module with cross-spatial learning. Proceedings of the ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes, Greece.","DOI":"10.1109\/ICASSP49357.2023.10096516"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 11\u201318). Fast r-cnn. Proceedings of the IEEE international conference on computer vision, Las Condes, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Wang, C.-Y., Bochkovskiy, A., and Liao, H.-Y.M. (2023, January 18\u201322). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.00721"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"21299","DOI":"10.1038\/s41598-023-48318-8","article-title":"A guidance system for robotic welding based on an improved YOLOv5 algorithm with a RealSense depth camera","volume":"13","author":"Li","year":"2023","journal-title":"Sci. Rep."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"105857","DOI":"10.1016\/j.tust.2024.105857","article-title":"Automated detection and segmentation of tunnel defects and objects using YOLOv8-CM","volume":"150","author":"Zhang","year":"2024","journal-title":"Tunn. Undergr. Space Technol."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Yue, X., Qi, K., Na, X., Zhang, Y., Liu, Y., and Liu, C. (2023). Improved YOLOv8-Seg network for instance segmentation of healthy and diseased tomato plants in the growth stage. Agriculture, 13.","DOI":"10.3390\/agriculture13081643"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/14\/4690\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,24]],"date-time":"2024-11-24T13:19:59Z","timestamp":1732454399000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/14\/4690"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,19]]},"references-count":56,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2024,7]]}},"alternative-id":["s24144690"],"URL":"https:\/\/doi.org\/10.3390\/s24144690","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2024,7,19]]}}}