{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,23]],"date-time":"2024-09-23T04:27:46Z","timestamp":1727065666548},"reference-count":26,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,1,21]],"date-time":"2022-01-21T00:00:00Z","timestamp":1642723200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Aiming at the problems of low efficiency and poor accuracy in the product surface defect detection. In this paper, an online surface defects detection method based on YOLOV3 is proposed. Firstly, using lightweight network MobileNetV2 to replace the original backbone as the feature extractor to improve network speed. Then, we propose an extended feature pyramid network (EFPN) to extend the detection layer for multi-size object detection and design a novel feature fusing module (FFM) embedded in the extend layer to super-resolve features and capture more regional details. In addition, we add an IoU loss function to solve the mismatch between classification and bounding box regression. The proposed method is used to train and test on the hot rolled steel open dataset NEU-DET, which contains six typical defects of a steel surface, namely rolled-in scale, patches, crazing, pitted surface, inclusion and scratches. The experimental results show that our method achieves a satisfactory balance between performance and consumption and reaches 86.96% mAP with a speed of 80.96 FPS, which is more accurate and faster than many other algorithms and can realize real-time and high-precision inspection of product surface defects.<\/jats:p>","DOI":"10.3390\/s22030817","type":"journal-article","created":{"date-parts":[[2022,1,24]],"date-time":"2022-01-24T01:34:40Z","timestamp":1642988080000},"page":"817","source":"Crossref","is-referenced-by-count":36,"title":["Online Detection of Surface Defects Based on Improved YOLOV3"],"prefix":"10.3390","volume":"22","author":[{"given":"Xuechun","family":"Chen","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China"}]},{"given":"Jun","family":"Lv","sequence":"additional","affiliation":[{"name":"Faculty of Economics and Management, East China Normal University, Shanghai 200240, China"}]},{"given":"Yulun","family":"Fang","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China"}]},{"given":"Shichang","family":"Du","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"109185","DOI":"10.1016\/j.measurement.2021.109185","article-title":"A convolutional neural network-based method for workpiece surface defect detection","volume":"176","author":"Xing","year":"2021","journal-title":"Measurement"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"23367","DOI":"10.1007\/s11042-020-09152-6","article-title":"An improved MobileNet-SSD algorithm for automatic defect detection on vehicle body paint","volume":"79","author":"Zhang","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1111\/mice.12334","article-title":"Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types","volume":"33","author":"Cha","year":"2018","journal-title":"Comput.-Aided Civ. Infrastruct. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Zhou, Z., Lu, Q., Wang, Z., and Huang, H. (2019). Detection of micro-defects on irregular reflective surfaces based on improved faster R-CNN. Sensors, 19.","DOI":"10.3390\/s19225000"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.autcon.2018.08.006","article-title":"Automated detection of sewer pipe defects in closed-circuit television images using deep learning techniques","volume":"95","author":"Cheng","year":"2018","journal-title":"Autom. Constr."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1111\/mice.12351","article-title":"Unified vision-based methodology for simultaneous concrete defect detection and geolocalization","volume":"33","author":"Li","year":"2018","journal-title":"Comput.-Aided Civ. Infrastruct. Eng."},{"key":"ref_8","unstructured":"Zhang, C., Chang, C.C., and Jamshidi, M. (2018). Bridge damage detection using a single-stage detector and field inspection images. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Yin 2018, X., Chen, Y., Bouferguene, A., Zaman, H., Al-Hussein, M., and Kurach, L. (2020). A deep learning-based framework for an automated defect detection system for sewer pipes. Autom. Constr., 109, 102967.","DOI":"10.1016\/j.autcon.2019.102967"},{"key":"ref_10","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (July, January 26). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_11","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3932","DOI":"10.1049\/iet-ipr.2020.0841","article-title":"Defect detection of printed circuit board based on lightweight deep convolution network","volume":"14","author":"Shen","year":"2020","journal-title":"IET Image Process."},{"key":"ref_13","unstructured":"Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., and Keutzer, K. (2016). SqueezeNet: AlexNet-level accuracy with 50\u00d7 fewer parameters and <0.5 MB model size. arXiv."},{"key":"ref_14","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zhou, X., Lin, M., and Sun, J. (2018, January 18\u201322). Shufflenet: An extremely efficient convolutional neural network for mobile devices. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00716"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18\u201322). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature pyramid networks for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Wang, Z., Lin, Z., and Qi, H. (2019, January 15\u201320). Image super-resolution by neural texture transfer. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00817"},{"key":"ref_19","unstructured":"Shi, W., Caballero, J., Huszar, F., Totz, J., Aitken, A.P., Bishop, R., Rueckert, D., and Wang, Z. (July, January 26). Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017, January 22\u201329). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"103911","DOI":"10.1016\/j.imavis.2020.103911","article-title":"IoU-aware single-stage object detector for accurate localization","volume":"97","author":"Wu","year":"2020","journal-title":"Image Vis. Comput."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1493","DOI":"10.1109\/TIM.2019.2915404","article-title":"An end-to-end steel surface defect detection approach via fusing multiple hierarchical features","volume":"69","author":"He","year":"2019","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_23","first-page":"2503911","article-title":"RetinaNet With Difference Channel Attention and Adaptively Spatial Feature Fusion for Steel Surface Defect Detection","volume":"70","author":"Cheng","year":"2020","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Liu, X., and Gao, J. (2021, January 11\u201314). Surface Defect Detection Method of Hot Rolling Strip Based on Improved SSD Model. Proceedings of the International Conference on Database Systems for Advanced Applications, Taipei, Taiwan.","DOI":"10.1007\/978-3-030-73216-5_15"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"115401","DOI":"10.1088\/1361-6501\/ac0ca8","article-title":"A strip steel surface defect detection method based on attention mechanism and multi-scale maxpooling","volume":"32","author":"Tang","year":"2021","journal-title":"Meas. Sci. Technol."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8\u201314). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/3\/817\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,24]],"date-time":"2024-07-24T23:29:33Z","timestamp":1721863773000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/3\/817"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,21]]},"references-count":26,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["s22030817"],"URL":"https:\/\/doi.org\/10.3390\/s22030817","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,21]]}}}