{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,23]],"date-time":"2024-09-23T04:08:55Z","timestamp":1727064535341},"reference-count":36,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2019,2,4]],"date-time":"2019-02-04T00:00:00Z","timestamp":1549238400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Automobile surface defects like scratches or dents occur during the process of manufacturing and cross-border transportation. This will affect consumers\u2019 first impression and the service life of the car itself. In most worldwide automobile industries, the inspection process is mainly performed by human vision, which is unstable and insufficient. The combination of artificial intelligence and the automobile industry shows promise nowadays. However, it is a challenge to inspect such defects in a computer system because of imbalanced illumination, specular highlight reflection, various reflection modes and limited defect features. This paper presents the design and implementation of a novel automatic inspection system (AIS) for automobile surface defects which are the located in or close to style lines, edges and handles. The system consists of image acquisition and image processing devices, operating in a closed environment and noncontact way with four LED light sources. Specifically, we use five plane-array Charge Coupled Device (CCD) cameras to collect images of the five sides of the automobile synchronously. Then the AIS extracts candidate defect regions from the vehicle body image by a multi-scale Hessian matrix fusion method. Finally, candidate defect regions are classified into pseudo-defects, dents and scratches by feature extraction (shape, size, statistics and divergence features) and a support vector machine algorithm. Experimental results demonstrate that automatic inspection system can effectively reduce false detection of pseudo-defects produced by image noise and achieve accuracies of 95.6% in dent defects and 97.1% in scratch defects, which is suitable for customs inspection of imported vehicles.<\/jats:p>","DOI":"10.3390\/s19030644","type":"journal-article","created":{"date-parts":[[2019,2,5]],"date-time":"2019-02-05T16:31:07Z","timestamp":1549384267000},"page":"644","source":"Crossref","is-referenced-by-count":101,"title":["An Automatic Surface Defect Inspection System for Automobiles Using Machine Vision Methods"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-7725-2658","authenticated-orcid":false,"given":"Qinbang","family":"Zhou","sequence":"first","affiliation":[{"name":"State Key Laboratory of Mechanics and Control of Mechanical Structures, College of Aerospace Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China"}]},{"given":"Renwen","family":"Chen","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Mechanics and Control of Mechanical Structures, College of Aerospace Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China"}]},{"given":"Bin","family":"Huang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Mechanics and Control of Mechanical Structures, College of Aerospace Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China"}]},{"given":"Chuan","family":"Liu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Mechanics and Control of Mechanical Structures, College of Aerospace Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China"}]},{"given":"Jie","family":"Yu","sequence":"additional","affiliation":[{"name":"COMAC ShangHai Aircraft Design and Research Institute, Shanghai 201210, China"}]},{"given":"Xiaoqing","family":"Yu","sequence":"additional","affiliation":[{"name":"China National Aeronautical Ratio Electronics Research Institute, Shanghai 200241, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,2,4]]},"reference":[{"key":"ref_1","first-page":"1","article-title":"Visualization and detection of small defects on car-bodies","volume":"99","author":"Karbacher","year":"1999","journal-title":"Mode Vis."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1016\/j.rcim.2017.04.009","article-title":"On the detection of defects on specular car body surfaces","volume":"48","author":"Molina","year":"2017","journal-title":"Robot. Comput. Integr. Manuf."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/S0262-8856(02)00152-X","article-title":"A survey on industrial vision systems, applications and tools","volume":"21","author":"Malamas","year":"2003","journal-title":"Image Vis. Comput."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2189","DOI":"10.1109\/TIM.2012.2184959","article-title":"A real-time visual inspection system for discrete surface defects of rail heads","volume":"61","author":"Li","year":"2012","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A threshold selection method from gray-level histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_6","first-page":"713","article-title":"A fast algorithm for multilevel thresholding","volume":"17","author":"Liao","year":"2001","journal-title":"J. Inf. Sci. Eng."},{"key":"ref_7","first-page":"70","article-title":"Bi-level image thresholding","volume":"2","author":"Shahbazkia","year":"2008","journal-title":"BioSignals"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1117\/1.1631315","article-title":"Survey over image thresholding techniques and quantitative performance evaluation","volume":"13","author":"Sezgin","year":"2004","journal-title":"J. Electron. Imaging"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Armesto, L., Tornero, J., Herraez, A., and Asensio, J. (2011, January 9\u201313). Inspection system based on artificial vision for paint defects detection on cars bodies. Proceedings of the 2011 IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980570"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Immel, D.S., Cohen, M.F., and Greenberg, D.P. (1986). A radiosity method for non-diffuse environments. ACM Siggraph Computer Graphics, ACM.","DOI":"10.1145\/15922.15901"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kajiya, J.T. (1986). The rendering equation. ACM Siggraph Computer Graphics, ACM.","DOI":"10.1145\/15922.15902"},{"key":"ref_12","unstructured":"Fan, W., Lu, C., and Tsujino, K. (2015, January 22\u201324). An automatic machine vision method for the flaw detection on car\u2019s body. Proceedings of the 2015 IEEE 7th International Conference on Awareness Science and Technology (iCAST), Qinhuangdao, China."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kamani, P., Noursadeghi, E., Afshar, A., and Towhidkhah, F. (2011, January 16\u201317). Automatic paint defect detection and classification of car body. Proceedings of the 2011 7th Iranian Conference on Machine Vision and Image Processing, Tehran, Iran.","DOI":"10.1109\/IranianMVIP.2011.6121575"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Kamani, P., Afshar, A., Towhidkhah, F., and Roghani, E. (2011, January 12\u201314). Car body paint defect inspection using rotation invariant measure of the local variance and one-against-all support vector machine. Proceedings of the 2011 First International Conference on Informatics and Computational Intelligence, Bandung, Indonesia.","DOI":"10.1109\/ICI.2011.47"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Chung, Y.C., and Chang, M. (2006, January 18\u201321). Visualization of subtle defects of car body outer panels. Proceedings of the SICE-ICASE International Joint Conference, Busan, Korea.","DOI":"10.1109\/SICE.2006.315177"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1016\/j.measurement.2005.12.007","article-title":"Inspection of specular and painted surfaces with centralized fusion techniques","volume":"39","author":"Leon","year":"2006","journal-title":"Measurement"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Borsu, V., Yogeswaran, A., and Payeur, P. (2010, January 21\u201324). Automated surface deformations detection and marking on automotive body panels. Proceedings of the 2010 IEEE Conference on Automation Science and Engineering (CASE), Toronto, ON, Canada.","DOI":"10.1109\/COASE.2010.5584643"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Xiong, Z., Li, Q., Mao, Q., and Zou, Q. (2017). A 3D laser profiling system for rail surface defect detection. Sensors, 17.","DOI":"10.3390\/s17081791"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"063004","DOI":"10.1117\/1.JEI.25.6.063004","article-title":"Lining seam elimination algorithm and surface crack detection in concrete tunnel lining","volume":"25","author":"Qu","year":"2016","journal-title":"J. Electron. Imaging"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhang, L., Yang, F., Zhang, Y.D., and Zhu, Y.J. (2016, January 25\u201328). Road crack detection using deep convolutional neural network. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7533052"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Schmugge, S.J., Rice, L., Lindberg, J., Grizziy, R., Joffey, C., and Shin, M.C. (2017, January 24\u201331). Crack Segmentation by Leveraging Multiple Frames of Varying Illumination. Proceedings of the 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), Santa Rosa, CA, USA.","DOI":"10.1109\/WACV.2017.121"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1498","DOI":"10.1109\/TIP.2018.2878966","article-title":"DeepCrack: Learning Hierarchical Convolutional Features for Crack Detection","volume":"28","author":"Zou","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Xu, W., Tang, Z., Zhou, J., and Ding, J. (2013, January 15\u201318). Pavement crack detection based on saliency and statistical features. Proceedings of the 2013 20th IEEE International Conference on Image Processing (ICIP), Melbourne, Australia.","DOI":"10.1109\/ICIP.2013.6738843"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.patrec.2011.11.004","article-title":"CrackTree: Automatic crack detection from pavement images","volume":"33","author":"Zou","year":"2012","journal-title":"Pattern Recognit. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3434","DOI":"10.1109\/TITS.2016.2552248","article-title":"Automatic road crack detection using random structured forests","volume":"17","author":"Shi","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1145\/360825.360839","article-title":"Illumination for computer generated pictures","volume":"18","author":"Phong","year":"1975","journal-title":"Commun. ACM"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Whitted, T. (August, January 31). An improved illumination model for shaded display. Proceedings of the ACM Siggraph 2005 Courses, Los Angeles, CA, USA.","DOI":"10.1145\/1198555.1198743"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Lorenz, C., Carlsen, I.-C., Buzug, T.M., Fassnacht, C., and Weese, J. (1997, January 2\u20134). A multi-scale line filter with automatic scale selection based on the Hessian matrix for medical image segmentation. Proceedings of the International Conference on Scale-Space Theories in Computer Vision, Utrecht, The Netherlands.","DOI":"10.1007\/3-540-63167-4_47"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Frangi, A.F., Niessen, W.J., Vincken, K.L., and Viergever, M.A. (1998, January 11\u201313). Multiscale vessel enhancement filtering. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Cambridge, MA, USA.","DOI":"10.1007\/BFb0056195"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1388","DOI":"10.13031\/2013.30327","article-title":"Apple sorting with machine vision","volume":"29","author":"Rehkugler","year":"1986","journal-title":"Trans. ASAE"},{"key":"ref_31","unstructured":"(2018, October 13). Available online: https:\/\/en.wikipedia.org\/w\/index.php?title=Divergence&oldid=863835077."},{"key":"ref_32","unstructured":"Vapnik, V. (1998). Statistical Learning Theory, Wiley."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1145\/1961189.1961199","article-title":"LIBSVM: A library for support vector machines","volume":"2","author":"Chang","year":"2011","journal-title":"ACM Trans. Intel. Syst. Technol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Van Gool, L. (2006, January 7\u201313). Surf: Speeded up robust features. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_36","unstructured":"Prior, M.A., Simon, J., Herraez, A., Asensio, J.M., Tornero, J., Ruescas, A.V., and Armesto, L. (2013). Inspection System and Method of Defect Detection on Specular Surfaces. (US20130057678A1), U.S. Patent."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/3\/644\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,15]],"date-time":"2024-06-15T21:19:06Z","timestamp":1718486346000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/3\/644"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2,4]]},"references-count":36,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,2]]}},"alternative-id":["s19030644"],"URL":"https:\/\/doi.org\/10.3390\/s19030644","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,2,4]]}}}