{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T23:06:51Z","timestamp":1740179211006,"version":"3.37.3"},"reference-count":41,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,2,16]],"date-time":"2021-02-16T00:00:00Z","timestamp":1613433600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"The most frequent faults in rotating electrical machines occur in their rolling element bearings. Thus, an effective health diagnosis mechanism of rolling element bearings is necessary from operational and economical points of view. Recently, convolutional neural networks (CNNs) have been proposed for bearing fault detection and identification. However, two major drawbacks of these models are (a) their lack of ability to capture global information about the input vector and to derive knowledge about the statistical properties of the latter and (b) the high demand for computational resources. In this paper, short time Fourier transform (STFT) is proposed as a pre-processing step to acquire time-frequency representation vibration images from raw data in variable healthy or faulty conditions. To diagnose and classify the vibration images, the image classification transformer (ICT), inspired from the transformers used for natural language processing, has been suitably adapted to work as an image classifier trained in a supervised manner and is also proposed as an alternative method to CNNs. Simulation results on a famous and well-established rolling element bearing fault detection benchmark show the effectiveness of the proposed method, which achieved 98.3% accuracy (on the test dataset) while requiring substantially fewer computational resources to be trained compared to the CNN approach.<\/jats:p>","DOI":"10.3390\/make3010011","type":"journal-article","created":{"date-parts":[[2021,2,16]],"date-time":"2021-02-16T13:09:09Z","timestamp":1613480949000},"page":"228-242","source":"Crossref","is-referenced-by-count":31,"title":["A Combined Short Time Fourier Transform and Image Classification Transformer Model for Rolling Element Bearings Fault Diagnosis in Electric Motors"],"prefix":"10.3390","volume":"3","author":[{"given":"Christos T.","family":"Alexakos","sequence":"first","affiliation":[{"name":"Electrical Machines Laboratory, Depterment of Electrical & Computer Engineering, Democritus University of Thrace, 671 00 Xanthi, Hellas, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7390-3249","authenticated-orcid":false,"given":"Yannis L.","family":"Karnavas","sequence":"additional","affiliation":[{"name":"Electrical Machines Laboratory, Depterment of Electrical & Computer Engineering, Democritus University of Thrace, 671 00 Xanthi, Hellas, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9322-7324","authenticated-orcid":false,"given":"Maria","family":"Drakaki","sequence":"additional","affiliation":[{"name":"Department of Science and Technology, University Center of International Programmes of Studies, International Hellenic University, 570 01 Thermi, Hellas, Greece"}]},{"given":"Ioannis A.","family":"Tziafettas","sequence":"additional","affiliation":[{"name":"Electrical Machines Laboratory, Depterment of Electrical & Computer Engineering, Democritus University of Thrace, 671 00 Xanthi, Hellas, Greece"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Dineva, A., Mosavi, A., Ardabili, S.F., Vajda, I., Shamshirband, S., Rabczuk, T., and Chau, K.W. (2019). Review of Soft Computing Models in Design and Control of Rotating Electrical Machines. Energies, 12.","DOI":"10.3390\/en12061049"},{"key":"ref_2","unstructured":"Bazine, S., and Trigeassou, J.C. (2013). Faults in Electrical Machines and their Diagnosis. Electrical Machines Diagnosis, John Wiley & Sons, Inc."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1846","DOI":"10.1109\/TIE.2014.2361115","article-title":"Induction Machine Bearing Fault Detection by Means of Statistical Processing of the Stray Flux Measurement","volume":"62","author":"Frosini","year":"2015","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"810","DOI":"10.1109\/28.777188","article-title":"Failure Identification and Analysis for High-Voltage Induction Motors in the Petrochemical Industry","volume":"35","author":"Thorsen","year":"1999","journal-title":"IEEE Trans. Ind. Appl."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1109\/MIE.2013.2287651","article-title":"Trends in Fault Diagnosis for Electrical Machines: A Review of Diagnostic Techniques","volume":"8","author":"Henao","year":"2014","journal-title":"IEEE Ind. Electron. Mag."},{"key":"ref_6","first-page":"263","article-title":"Detection of Bearing Faults of Induction Motor Using Park\u2019s Vector Approach","volume":"2","author":"Neelam","year":"2010","journal-title":"Int. J. Eng. Technol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"4252","DOI":"10.1109\/TIE.2008.2003211","article-title":"A New Bearing Fault Detection Method in Induction Machines Based on Instantaneous Power Factor","volume":"55","author":"Ibrahim","year":"2008","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.ymssp.2015.04.021","article-title":"Rolling Element Bearing Diagnostics using the Case Western Reserve University data: A benchmark study","volume":"64","author":"Smith","year":"2015","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Toma, R.N., Prosvirin, A.E., and Kim, J.M. (2020). Bearing Fault Diagnosis of Induction Motors Using a Genetic Algorithm and Machine Learning Classifiers. Sensors, 20.","DOI":"10.3390\/s20071884"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Karnavas, Y.L., Chasiotis, I.D., and Vrangas, A. (September, January 29). Fault Diagnosis of Squirrel-Cage Induction Motor Broken Bars based on a Model Identification Method with Subtractive Clustering. Proceedings of the 2017 IEEE 11th International Symposium on Diagnostics for Electrical Machines, Power Electronics and Drives (SDEMPED), Tinos, Greece.","DOI":"10.1109\/DEMPED.2017.8062372"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Karatzinis, G., Boutalis, Y.S., and Karnavas, Y.L. (2018, January 19\u201322). Motor Fault Detection and Diagnosis Using Fuzzy Cognitive Networks with Functional Weights. Proceedings of the 2018 26th Mediterranean Conference on Control and Automation (MED), Zadar, Croatia.","DOI":"10.1109\/MED.2018.8443043"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1049\/iet-epa.2019.0619","article-title":"Study on Fault Diagnosis of Broken Rotor Bars in Squirrel Cage Induction Motors: A Multi-Agent System Approach using Intelligent Classifiers","volume":"14","author":"Drakaki","year":"2020","journal-title":"IET Electr. Power Appl."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"4203","DOI":"10.1016\/j.asoc.2011.03.014","article-title":"Bearing Fault Detection of Induction Motor using Wavelet and Support Vector Machines (SVMs)","volume":"11","author":"Konar","year":"2011","journal-title":"Appl. Soft Comput."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1561\/2000000039","article-title":"Deep Learning: Methods and Applications","volume":"7","author":"Deng","year":"2014","journal-title":"Found. Trends Signal Process."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Karnavas, Y.L., Plakias, S., and Chasiotis, I.D. (2021). Extracting Spatially Global and Local Attentive Features for Rolling Bearing Fault Diagnosis in Electrical Machines using Attention Stream Networks. IET Electr. Power Appl.","DOI":"10.1049\/elp2.12063"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"49","DOI":"10.3901\/JME.2015.21.049","article-title":"A Deep Learning-based Method for Machinery Health Monitoring with Big Data","volume":"51","author":"Lei","year":"2015","journal-title":"J. Mech. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1016\/j.patcog.2018.04.015","article-title":"Human Action Recognition by Means of Subtensor Projections and Dense Trajectories","volume":"81","author":"Carmona","year":"2018","journal-title":"Pattern Recogn."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"664","DOI":"10.1109\/TBME.2015.2468589","article-title":"Real-Time Patient-Specific ECG Classification by 1-D Convolutional Neural Networks","volume":"63","author":"Kiranyaz","year":"2016","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Hu, X., Lu, X., and Hori, C. (2014, January 12\u201314). Mandarin Speech Recognition using Convolution Neural Network with Augmented Tone Features. Proceedings of the The 9th International Symposium on Chinese Spoken Language Processing, Singapore.","DOI":"10.1109\/ISCSLP.2014.6936674"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1162\/neco.2009.10-08-881","article-title":"Convolutional Networks Can Learn to Generate Affinity Graphs for Image Segmentation","volume":"22","author":"Turaga","year":"2010","journal-title":"Neural Comput."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1016\/j.patcog.2017.10.013","article-title":"Recent Advances in Convolutional Neural Networks","volume":"77","author":"Gu","year":"2018","journal-title":"Pattern Recogn."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/j.ymssp.2018.05.050","article-title":"Deep Learning and its Applications to Machine Health Monitoring","volume":"115","author":"Zhao","year":"2019","journal-title":"Mech. Syst.d Signal Process."},{"key":"ref_23","first-page":"19","article-title":"Bearing Faults Condition Monitoring\u2014A Literature Survey","volume":"5","author":"Szabo","year":"2012","journal-title":"J. Comput. Sci. Control Syst."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Nguyen, T.P.K., Khlaief, A., Medjaher, K., Picot, A., Maussion, P., Tobon, D., Chauchat, B., and Cheron, R. (July, January 3). Analysis and Comparison of Multiple Features for Fault Detection and Prognostic in Ball Bearings. Proceedings of the 4th European Conference of the Prognostics and Health Management Society, Utrecht, The Netherlands.","DOI":"10.36001\/phme.2018.v4i1.435"},{"key":"ref_25","first-page":"429","article-title":"Theory of Communication. Part 1: The Analysis of Information","volume":"93","author":"Gabor","year":"1946","journal-title":"J. Inst. Electr. Eng.-Part III Radio Commun. Eng."},{"key":"ref_26","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention is All You Need. arXiv."},{"key":"ref_27","unstructured":"Ba, J.L., Kiros, J.R., and Hinton, G.E. (2016). Layer Normalization. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_29","unstructured":"Hendrycks, D., and Gimpel, K. (2020). Gaussian Error Linear Units (GELUs). arXiv."},{"key":"ref_30","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv."},{"key":"ref_31","unstructured":"Kingma, D., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1007\/s10845-015-1110-0","article-title":"Identifying Maximum Imbalance in Datasets for Fault Diagnosis of Gearboxes","volume":"29","author":"Santos","year":"2015","journal-title":"J. Intell. Manuf."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"107377","DOI":"10.1016\/j.measurement.2019.107377","article-title":"Machinery Fault Diagnosis with Imbalanced Data using Deep Generative Adversarial Networks","volume":"152","author":"Zhang","year":"2020","journal-title":"Measurement"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Lee, J.H., Pack, J.H., and Lee, I.S. (2019). Fault Diagnosis of Induction Motor Using Convolutional Neural Network. Appl. Sci., 9.","DOI":"10.3390\/app9152950"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Tra, V., Kim, J., Khan, S.A., and Kim, J.M. (2017). Bearing Fault Diagnosis under Variable Speed Using Convolutional Neural Networks and the Stochastic Diagonal Levenberg-Marquardt Algorithm. Sensors, 17.","DOI":"10.3390\/s17122834"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Hsueh, Y.M., Ittangihal, V.R., Wu, W.B., Chang, H.C., and Kuo, C.C. (2019). Fault Diagnosis System for Induction Motors by CNN Using Empirical Wavelet Transform. Symmetry, 11.","DOI":"10.3390\/sym11101212"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1016\/j.ymssp.2015.10.025","article-title":"Deep Neural Networks: A Promising Tool for Fault Characteristic Mining and Intelligent Diagnosis of Rotating Machinery with Massive Data","volume":"72\u201373","author":"Jia","year":"2016","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2445","DOI":"10.1007\/s00500-017-2940-9","article-title":"A Novel Intelligent Diagnosis Method using Optimal LS-SVM with Improved PSO Algorithm","volume":"23","author":"Deng","year":"2017","journal-title":"Soft Comput."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"115002","DOI":"10.1088\/0957-0233\/26\/11\/115002","article-title":"Rolling Bearing Fault Diagnosis using an Optimization Deep Belief Network","volume":"26","author":"Shao","year":"2015","journal-title":"Meas. Sci. Technol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1007\/s11265-018-1378-3","article-title":"A Generic Intelligent Bearing Fault Diagnosis System Using Compact Adaptive 1D CNN Classifier","volume":"91","author":"Eren","year":"2018","journal-title":"J. Signal Process. Syst."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1080\/21642583.2019.1661311","article-title":"Research on Fault Diagnosis of Time-Domain Vibration Signal based on Convolutional Neural Networks","volume":"7","author":"Li","year":"2019","journal-title":"Syst. Sci. Control Eng."}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/3\/1\/11\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,8]],"date-time":"2024-07-08T10:01:50Z","timestamp":1720432910000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/3\/1\/11"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,16]]},"references-count":41,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,3]]}},"alternative-id":["make3010011"],"URL":"https:\/\/doi.org\/10.3390\/make3010011","relation":{},"ISSN":["2504-4990"],"issn-type":[{"type":"electronic","value":"2504-4990"}],"subject":[],"published":{"date-parts":[[2021,2,16]]}}}