{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,7]],"date-time":"2024-10-07T04:04:27Z","timestamp":1728273867308},"reference-count":30,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2022,10,19]],"date-time":"2022-10-19T00:00:00Z","timestamp":1666137600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"publisher","award":["2019YFB1704600"],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"publisher","award":["52205523"],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"publisher","award":["2022M711248"],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Printed circuit board (PCB) defect detection plays a crucial role in PCB production, and the popular methods are based on deep learning and require large-scale datasets with high-level ground-truth labels, in which it is time-consuming and costly to label these datasets. Semi-supervised learning (SSL) methods, which reduce the need for labeled samples by leveraging unlabeled samples, can address this problem well. However, for PCB defects, the detection accuracy on small numbers of labeled samples still needs to be improved because the number of labeled samples is small, and the training process will be disturbed by the unlabeled samples. To overcome this problem, this paper proposed a semi-supervised defect detection method with a data-expanding strategy (DE-SSD). The proposed DE-SSD uses both the labeled and unlabeled samples, which can reduce the cost of data labeling, and a batch-adding strategy (BA-SSL) is introduced to leverage the unlabeled data with less disturbance. Moreover, a data-expanding (DE) strategy is proposed to use the labeled samples from other datasets to expand the target dataset, which can also prevent the disturbance by the unlabeled samples. Based on the improvements, the proposed DE-SSD can achieve competitive results for PCB defects with fewer labeled samples. The experimental results on DeepPCB indicate that the proposed DE-SSD achieves state-of-the-art performance, which is improved by 4.7 mAP at least compared with the previous methods.<\/jats:p>","DOI":"10.3390\/s22207971","type":"journal-article","created":{"date-parts":[[2022,10,20]],"date-time":"2022-10-20T02:19:53Z","timestamp":1666232393000},"page":"7971","source":"Crossref","is-referenced-by-count":12,"title":["Semi-Supervised Defect Detection Method with Data-Expanding Strategy for PCB Quality Inspection"],"prefix":"10.3390","volume":"22","author":[{"given":"Yusen","family":"Wan","sequence":"first","affiliation":[{"name":"School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-1485-0722","authenticated-orcid":false,"given":"Liang","family":"Gao","sequence":"additional","affiliation":[{"name":"School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-3730-0360","authenticated-orcid":false,"given":"Xinyu","family":"Li","sequence":"additional","affiliation":[{"name":"School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China"}]},{"given":"Yiping","family":"Gao","sequence":"additional","affiliation":[{"name":"School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Schwenck, A., Gr\u00f6zinger, T., G\u00fcnther, T., Schumacher, A., Schuhmacher, D., Werum, K., and Zimmermann, A. (2021). Characterization of a PCB based pressure sensor and its joining methods for the metal membrane. Sensors, 21.","DOI":"10.3390\/s21165557"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Kim, J., Ko, J., Choi, H., and Kim, H. (2021). Printed circuit board defect detection using deep learning via a skip-connected convolutional autoencoder. Sensors, 21.","DOI":"10.3390\/s21154968"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Gang, S., Fabrice, N., Chung, D., and Lee, J. (2021). Character Recognition of Components Mounted on Printed Circuit Board Using Deep Learning. Sensors, 21.","DOI":"10.3390\/s21092921"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"10817","DOI":"10.1109\/ACCESS.2016.2631658","article-title":"A machine vision based automatic optical inspection system for measuring drilling quality of printed circuit boards","volume":"5","author":"Wang","year":"2016","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1007\/s00170-006-0730-0","article-title":"Automated inspection of PCB components using a genetic algorithm template-matching approach","volume":"35","author":"Crispin","year":"2007","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1007\/s10044-017-0640-9","article-title":"An efficient similarity measure approach for PCB surface defect detection","volume":"21","author":"Gaidhane","year":"2018","journal-title":"Pattern Anal. Appl."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2117","DOI":"10.1109\/TIE.2021.3057026","article-title":"A novel defect detection algorithm for flexible integrated circuit package substrates","volume":"69","author":"Zhong","year":"2021","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Yuk, E.H., Park, S.H., Park, C.S., and Baek, J.G. (2018). Feature-learning-based printed circuit board inspection via speeded-up robust features and random forest. Appl. Sci., 8.","DOI":"10.3390\/app8060932"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"103807","DOI":"10.1016\/j.micpro.2020.103807","article-title":"Machine vision based online detection of PCB defect","volume":"82","author":"Liu","year":"2021","journal-title":"Microprocess. Microsyst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3507014","DOI":"10.1109\/TIM.2022.3153997","article-title":"A small-sized object detection oriented multi-scale feature fusion approach with application to defect detection","volume":"71","author":"Zeng","year":"2022","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3231","DOI":"10.1109\/TII.2020.3008703","article-title":"A generative adversarial network based deep learning method for low-quality defect image reconstruction and recognition","volume":"17","author":"Gao","year":"2020","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"7448","DOI":"10.1109\/TII.2019.2958826","article-title":"PGA-Net: Pyramid feature fusion and global context attention network for automated surface defect detection","volume":"16","author":"Dong","year":"2019","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_13","first-page":"1","article-title":"FPCB surface defect detection: A decoupled two-stage object detection framework","volume":"70","author":"Luo","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_14","unstructured":"He, F., Tang, S., Mehrkanoon, S., Huang, X., and Yang, J. (2020, January 2\u20134). A Real-time PCB Defect Detector Based on Supervised and Semi-supervised Learning. Proceedings of the European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, Bruges, Belgium."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3450","DOI":"10.1109\/TII.2020.3013277","article-title":"A real-time defect detection method for digital signal processing of industrial inspection applications","volume":"17","author":"Gao","year":"2020","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1049\/trit.2019.0019","article-title":"TDD-net: A tiny defect detection network for printed circuit boards","volume":"4","author":"Ding","year":"2019","journal-title":"CAAI Trans. Intell. Technol."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Jin, J., Feng, W., Lei, Q., Gui, G., and Wang, W. (2021, January 10\u201313). PCB defect inspection via Deformable DETR. Proceedings of the 2021 7th International Conference on Computer and Communications, Chengdu, China.","DOI":"10.1109\/ICCC54389.2021.9674579"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Tan, M., Pang, R., and Le, Q.V. (2020, January 13\u201319). Efficientdet: Scalable and efficient object detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01079"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Jin, J., Feng, W., Lei, Q., Gui, G., Li, X., Deng, Z., and Wang, W. (2021, January 22\u201324). Defect Detection of Printed Circuit Boards Using EfficientDet. Proceedings of the 2021 IEEE 6th International Conference on Signal and Image Processing, Nanjing, China.","DOI":"10.1109\/ICSIP52628.2021.9688801"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Redmon, J., and Farhadi, A. (2017, January 21\u201326). YOLO9000: Better, faster, stronger. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.690"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Xie, H., Li, Y., Li, X., and He, L. (2021, January 2\u20134). A method for surface defect detection of printed circuit board based on improved YOLOv4. Proceedings of the 2021 IEEE 2nd International Conference on Big Data, Artificial Intelligence and Internet of Things Engineering, Hangzhou, China.","DOI":"10.1109\/ICBAIE52039.2021.9390006"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"4411","DOI":"10.3934\/mbe.2021223","article-title":"Applying deep learning to defect detection in printed circuit boards via a newest model of you-only-look-once","volume":"18","author":"Adibhatla","year":"2021","journal-title":"Math. Biosci. Eng."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Lan, Z., Hong, Y., and Li, Y. (2021, January 22\u201324). An improved YOLOv3 method for PCB surface defect detection. Proceedings of the 2021 IEEE International Conference on Power Electronics, Computer Applications, Shenyang, China.","DOI":"10.1109\/ICPECA51329.2021.9362675"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"043004","DOI":"10.1117\/1.JEI.30.4.043004","article-title":"Printed circuit board defect detection based on MobileNet-Yolo-Fast","volume":"30","author":"Liu","year":"2021","journal-title":"J. Electron. Imaging"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Liao, X., Lv, S., Li, D., Luo, Y., Zhu, Z., and Jiang, C. (2021). YOLOv4-MN3 for PCB Surface Defect Detection. Appl. Sci., 11.","DOI":"10.3390\/app112411701"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"012167","DOI":"10.1088\/1742-6596\/1827\/1\/012167","article-title":"PCB Electronic component defect detection method based on improved YOLOv4 algorithm","volume":"1827","author":"Xin","year":"2021","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Volkau, I., Mujeeb, A., Wenting, D., Marius, E., and Alexei, S. (2019, January 2\u20134). Detection defect in printed circuit boards using unsupervised feature extraction upon transfer learning. Proceedings of the 2019 International Conference on Cyberworldsn, Kyoto, Japan.","DOI":"10.1109\/CW.2019.00025"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Putera, S.I., and Ibrahim, Z. (2010, January 5\u20137). Printed circuit board defect detection using mathematical morphology and MATLAB image processing tools. Proceedings of the 2010 2nd International Conference on Education Technology and Computer, Barcelona, Spain.","DOI":"10.1109\/ICETC.2010.5530052"},{"key":"ref_30","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 9\u201312). Faster r-cnn: Towards real-time object detection with region proposal networks. Proceedings of the International Conference on Neural Information Processing Systems, Istanbul, Turkey."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/20\/7971\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,6]],"date-time":"2024-10-06T04:53:23Z","timestamp":1728190403000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/20\/7971"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,19]]},"references-count":30,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["s22207971"],"URL":"https:\/\/doi.org\/10.3390\/s22207971","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,10,19]]}}}