{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T18:24:46Z","timestamp":1732040686045},"reference-count":34,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2021,7,21]],"date-time":"2021-07-21T00:00:00Z","timestamp":1626825600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["2017M3A9E2056461"],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Gachon University research fund","award":["2018-0324"]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"As technology evolves, more components are integrated into printed circuit boards (PCBs) and the PCB layout increases. Because small defects on signal trace can cause significant damage to the system, PCB surface inspection is one of the most important quality control processes. Owing to the limitations of manual inspection, significant efforts have been made to automate the inspection by utilizing high resolution CCD or CMOS sensors. Despite the advanced sensor technology, setting the pass\/fail criteria based on small failure samples has always been challenging in traditional machine vision approaches. To overcome these problems, we propose an advanced PCB inspection system based on a skip-connected convolutional autoencoder. The deep autoencoder model was trained to decode the original non-defect images from the defect images. The decoded images were then compared with the input image to identify the defect location. To overcome the small and imbalanced dataset in the early manufacturing stage, we applied appropriate image augmentation to improve the model training performance. The experimental results reveal that a simple unsupervised autoencoder model delivers promising performance, with a detection rate of up to 98% and a false pass rate below 1.7% for the test data, containing 3900 defect and non-defect images.<\/jats:p>","DOI":"10.3390\/s21154968","type":"journal-article","created":{"date-parts":[[2021,7,23]],"date-time":"2021-07-23T02:37:14Z","timestamp":1627007834000},"page":"4968","source":"Crossref","is-referenced-by-count":96,"title":["Printed Circuit Board Defect Detection Using Deep Learning via A Skip-Connected Convolutional Autoencoder"],"prefix":"10.3390","volume":"21","author":[{"given":"Jungsuk","family":"Kim","sequence":"first","affiliation":[{"name":"Department of Biomedical Engineering, Gachon University, 191 Hambakmoe-ro, Incheon 2199, Korea"}]},{"given":"Jungbeom","family":"Ko","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, Gachon University, 191 Hambakmoe-ro, Incheon 2199, Korea"}]},{"given":"Hojong","family":"Choi","sequence":"additional","affiliation":[{"name":"Department of Medial IT Convergence Engineering, Kumoh National Institute of Technology, 350-27 Gum-daero, Gumi 39253, Korea"}]},{"given":"Hyunchul","family":"Kim","sequence":"additional","affiliation":[{"name":"School of Information, University of California, Berkeley, 102 South Hall 4600, Berkeley, CA 94704, USA"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,21]]},"reference":[{"key":"ref_1","unstructured":"(2021, July 19). Radiant Vision System. Available online: https:\/\/www.radiantvisionsystems.com\/products."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Guo, F., and Guan, S.-A. (2011, January 20\u201321). Research of the Machine Vision Based PCB Defect Inspection System. Proceedings of the International Conference on Intelligence Science and Information Engineering, Washington, DC, USA.","DOI":"10.1109\/ISIE.2011.47"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1016\/j.cirpj.2016.04.010","article-title":"Process design for the management of changes in manufacturing: Toward a Manufacturing Change Management process","volume":"14","author":"Koch","year":"2016","journal-title":"CIRP J. Manuf. Sci. Technol."},{"key":"ref_4","first-page":"188","article-title":"A Review of PCB Defect Detection Using Image Processing","volume":"4","author":"Anoop","year":"2015","journal-title":"Intern. J. Eng. Innov. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s40684-016-0039-x","article-title":"Machine learning-based imaging system for surface defect inspection","volume":"3","author":"Park","year":"2016","journal-title":"Int. J. Precis. Eng. Manuf. Technol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Ciresan, D., Meier, U., and Schmidhuber, J. (2012, January 16\u201321). Multi-column deep neural networks for image classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248110"},{"key":"ref_9","unstructured":"Lee, D., Sugiyama, M., Luxburg, U., Guyon, I., and Garnett, R. (2016). Image Restoration Using Very Deep Convolutional Encoder-Decoder Networks with Symmetric Skip Connections. Advances in Neural Information Processing Systems, Curran Associates."},{"key":"ref_10","unstructured":"Guyon, I., Dror, G., Lemaire, V., Taylor, G., and Silver, D. (2012). Autoencoders, Unsupervised Learning, and Deep Architectures, PMLR."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Srimani, P.K., and Prathiba, V. (2016). Adaptive Data Mining Approach for PCB Defect Detection and Classification. Indian J. Sci. Technol., 9.","DOI":"10.17485\/ijst\/2016\/v9i44\/98964"},{"key":"ref_12","unstructured":"Huang, W., and Wei, P. (2019). A PCB Dataset for Defects Detection and Classification. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kivinen, J., and Mannila, H. (1994, January 24\u201327). The power of sampling in knowledge discovery. Proceedings of the Thirteenth ACM SIGACT-SIGMODSIGART Symposium on Principles of Database Systems, Minneapolis, MN, USA.","DOI":"10.1145\/182591.182601"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"309","DOI":"10.19026\/rjaset.9.1409","article-title":"A Review of Image Contrast Enhancement Methods and Techniques","volume":"9","author":"Maragatham","year":"2015","journal-title":"Res. J. Appl. Sci. Eng. Technol."},{"key":"ref_15","first-page":"2033","article-title":"Image Noise Reduction and Filtering Techniques","volume":"6","author":"Hambal","year":"2017","journal-title":"Int. J. Sci. Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1007730.1007733","article-title":"Editorial: Special Issue on Learning from Imbalanced Data Sets","volume":"6","author":"Chawla","year":"2004","journal-title":"SIGKDD Explor. Newsl."},{"key":"ref_17","unstructured":"Chollet, F. (2017). Deep Learning with Python, Manning Publications."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Turchenko, V., Chalmers, E., and Luczak, A. (2019). A Deep convolutional auto-encoder with pooling\u2014Unpooling layers in caffe. Int. J. Comput., 8\u201331.","DOI":"10.47839\/ijc.18.1.1270"},{"key":"ref_19","unstructured":"Theis, L., Shi, W., Cunningham, A., and Husz\u00e1r, F. (2017). Lossy Image Compression with Compressive Autoencoders. arXiv."},{"key":"ref_20","unstructured":"Choi, Y., El-Khamy, M., and Lee, J. (November, January 27). Variable Rate Deep Image Compression with a Conditional Autoencoder. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Korea."},{"key":"ref_21","first-page":"3371","article-title":"Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion","volume":"11","author":"Vincent","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1016\/j.neucom.2019.07.106","article-title":"DEVDAN: Deep evolving denoising autoencoder","volume":"390","author":"Ashfahani","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1016\/j.measurement.2019.06.029","article-title":"A sparse stacked denoising autoencoder with optimized transfer learning applied to the fault diagnosis of rolling bearings","volume":"146","author":"Sun","year":"2019","journal-title":"Measurement"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Sakurada, M., and Yairi, T. (2014, January 2). Anomaly Detection Using Autoencoders with Nonlinear Dimensionality Reduction. Proceedings of the MLSDA 2014 2nd Workshop on Machine Learning for Sensory Data Analysis, Gold Coast, Australia.","DOI":"10.1145\/2689746.2689747"},{"key":"ref_25","unstructured":"Zong, B., Song, Q., Min, M.R., Cheng, W., Lumezanu, C., Cho, D., and Chen, H. (May, January 30). Deep Autoencoding Gaussian Mixture Model for Unsupervised Anomaly Detection. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada."},{"key":"ref_26","unstructured":"Gong, D., Liu, L., Le, V., Saha, B., Mansour, M.R., Venkatesh, S., and Hengel, A.V.D. (November, January 27). Memorizing Normality to Detect Anomaly: Memory-Augmented Deep Autoencoder for Unsupervised Anomaly Detection. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Korea."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"108346","DOI":"10.1109\/ACCESS.2020.3001350","article-title":"Anomaly-Based Intrusion Detection from Network Flow Features Using Variational Autoencoder","volume":"8","author":"Zavrak","year":"2020","journal-title":"IEEE Access"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Masci, J., Meier, U., Cire\u015fan, D., and Schmidhuber, J. (2011, January 14\u201317). Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction. Proceedings of the International Conference on Artificial Neural Networks, Espoo, Finland.","DOI":"10.1007\/978-3-642-21735-7_7"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Scherer, D., M\u00fcller, A., and Behnke, S. (2010, January 15\u201318). Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition. Proceedings of the International Conference on Artificial Neural Networks, Thessaloniki, Greece.","DOI":"10.1007\/978-3-642-15825-4_10"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016). Deep Residual Learning for Image Recognition, Springer.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_31","unstructured":"Nair, V., and Hinton, G.E. (2010, January 21\u201324). Rectified Linear Units Improve Restricted Boltzmann Machines. Proceedings of the 27th International Conference on International Conference on Machine Learning, Haifa, Israel."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/0166-3615(95)00063-1","article-title":"Automated inspection of printed circuit boards through machine vision","volume":"28","author":"Wu","year":"1996","journal-title":"Comput. Ind."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Sammut, C., and Webb, G.I. (2011). Confusion Matrix. Encyclopedia of Machine Learning, Springer.","DOI":"10.1007\/978-0-387-30164-8"},{"key":"ref_34","unstructured":"Devries, T., and Taylor, G.W. (2017). Improved Regularization of Convolutional Neural Networks with Cutout. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/15\/4968\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,15]],"date-time":"2024-07-15T20:39:58Z","timestamp":1721075998000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/15\/4968"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,21]]},"references-count":34,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["s21154968"],"URL":"https:\/\/doi.org\/10.3390\/s21154968","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,21]]}}}