Abstract
Convolutional neural network has been widely investigated for machinery condition monitoring, but its performance is highly affected by the learning of input signal representation and model structure. To address these issues, this paper presents a comprehensive deep convolutional neural network (DCNN) based condition monitoring framework to improve model performance. First, various signal representation techniques are investigated for better feature learning of the DCNN model by transforming the time series signal into different domains, such as the frequency domain, the time–frequency domain, and the reconstructed phase space. Next, the DCNN model is customized by taking into account the dimension of model, the depth of layers, and the convolutional kernel functions. The model parameters are then optimized by a mini-batch stochastic gradient descendent algorithm. Experimental studies on a gearbox test rig are utilized to evaluate the effectiveness of presented DCNN models, and the results show that the one-dimensional DCNN model with a frequency domain input outperforms the others in terms of fault classification accuracy and computational efficiency. Finally, the guidelines for choosing appropriate signal representation techniques and DCNN model structures are comprehensively discussed for machinery condition monitoring.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abdeljaber O, Avci O, Kiranyaz S, Gabbouj M, Inman DJ (2017) Real-time vibration-based structural damage detection using one-dimensional convolutional neural networks. J Sound Vib 388:154–170
Bouvrie J (2006) Notes on convolutional neural networks. Unpublished, http://cogprints.org/5869/1/cnn_tutorial.pdf. Accessed 26 Feb 2019
Deng L, Hinton G, Kingsbury B (2013) New types of deep neural network learning for speech recognition and related applications: an overview. In: IEEE international conference on acoustic speech signal process, pp 8599–8603. https://doi.org/10.1109/icassp.2013.6639344
Ding X, He Q (2017) Energy-fluctuated multiscale feature learning with deep convnet for intelligent spindle bearing fault diagnosis. IEEE Trans Instrum Meas 66(8):1926–1935
Fu Y, Zhang Y, Gao Y, Gao H, Mao T, Zhou H, Li D (2017) Machining vibration states monitoring based on image representation using convolutional neural networks. Eng Appl Artif Intell 65:240–251
Gangsar P, Tiwari R (2017) Comparative investigation of vibration and current monitoring for prediction of mechanical and electrical faults in induction motor based on multiclass-support vector machine algorithms. Mech Syst Signal Process 94:464–481
Guo X, Chen L, Shen C (2016) Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis. Measurement 93:490–502
Heinrich P, Schwabe G (2018) Facilitating informed decision-making in financial service encounters. Bus Inf Syst Eng 60(4):317–329
Ince T, Kiranyaz S, Eren L, Askar M, Gabbouj M (2016) Real-time motor fault detection by one-dimensional convolutional neural networks. IEEE Trans Ind Electron 63:7067–7075
Jing L, Zhao M, Li P, Xu X (2017) A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox. Measurement 111:1–10
Kliková B, Raidl A (2011) Reconstruction of phase space of dynamical systems using method of time delay. In: Proceedings of 20th annual conference Dr students—WDS 2011, pp 83–87
Ko KE, Sim KB (2018) Deep convolutional framework for abnormal behavior detection in a smart surveillance system. Eng Appl Artif Intell 67:226–234
Konar P, Chattopadhyay P (2011) Bearing fault detection of induction motor using wavelet and Support Vector Machines (SVMs). Appl Soft Comput J 11(6):4203–4211
LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2323
LeCun Y, Bengio Y, Hinton G (2005) Deep learning. Nature 521:436–444
Lee SJ, Kim SW (2017) Localization of the slab information in factory scenes using deep convolutional neural networks. Expert Syst Appl 77:34–43
Leng J, Jiang P (2016) A deep learning approach for relationship extraction from interaction context in social manufacturing paradigm. Knowl Based Syst 100:188–199
Leng J, Chen Q, Mao N, Jinag P (2018) Combining granular computing technique with deep learning for service planning under social manufacturing contexts. Knowl Based Syst 143:295–306
Liu R, Meng G, Yang B, Sun C, Chen X (2016) Dislocated time series convolutional neural architecture: an intelligent fault diagnosis approach for electric machine. IEEE Trans Ind Inform 13(3):1310–1320
Lu Y, Xu X, Xu J (2014) Development of a hybrid manufacturing cloud. J Manuf Syst 33:551–566
Matt C (2018) Fog computing. Bus Inf Syst Eng 60(4):351–355
Nalchigar S, Eric Y (2018) Designing business analytics solutions—a model-driven approach. Bus Inf Syst Eng. https://doi.org/10.1007/s12599-018-0555-z
Povinelli RJ, Johnson MT, Lindgren AC, Ye J (2004) Time series classification using Gaussian mixture models of reconstructed phase spaces. IEEE Trans Knowl Data Eng 16:779–783
Ren L, Zhang L, Wang L, Tao F, Chai X (2017) Cloud manufacturing: key characteristics and applications. Int J Comput Integr Manuf 30:501–515
Residual F, Using V, Neural A (2018) Decision support for the automotive industry. Bus Inf Syst Eng. https://doi.org/10.1007/s12599-018-0527-3
Richter A, Heinrich P, Stocker A, Schwabe G (2018) Digital work design. Bus Inf Syst Eng 60(3):259–264
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. In: Proceedings of international conference on learning Representations, pp 1–14. https://arxiv.org/abs/1409.1556. Accessed 14 Mar 2019
Su H, Li X, Yang B, Wen Z (2018) Wavelet support vector machine-based prediction model of dam deformation. Mech Syst Signal Process 110:412–427
Sun C, Wang P, Yan R, Gao RX (2016) A sparse approach to fault severity classification for gearbox monitoring. In: Proceedings of the 19th international conference on information fusion. Heidelberg, IEEE, pp 2303–2308
Szegedy C, Ioffe S, Vanhoucke V, Alemi A (2017) Inception-v4, Inception-ResNet and the impact of residual connections on learning. In: 31st AAAI conference on artificial intelligence, San Francisco, pp 4278–4284
Tao F, Cheng J, Qi Q (2018a) IIHub: an industrial Internet-of-Things hub toward smart manufacturing based on cyber-physical system. IEEE Trans Ind Inform 14(5):2271–2280
Tao F, Qi Q, Liu A, Kusiak A (2018b) Data-driven smart manufacturing. J Manuf Syst 48:157–169. https://doi.org/10.1016/j.jmsy.2018.01.006
van der Maaten L, Hinton G (2008) Visualizing data using t-SNE. J Mach Learn Res 1(620):267–284
Verstraete D, Engineering M, Engineering M (2017) Deep learning enabled fault diagnosis using time-frequency image analysis of rolling element bearings. Hindawi Shock Vib 2017:1–29
Wang J (2016) A multi-scale convolution neural network for featureless fault diagnosis. In: Proceedings of the international symposium on flexible automation. IEEE, Cleveland, pp 65–70
Wang L, Torngren M, Onori M (2015) Current status and advancement of cyber-physical systems in manufacturing. J Manuf Syst 37:517–527
Wang P, Ananya Yan R, Gao RX (2017) Virtualization and deep recognition for system fault classification. J Manuf Syst 44:310–316
Wang J, Ma Y, Zhang L, Gao RX, Wu D (2018) Deep learning for smart manufacturing: methods and applications. J Manuf Syst 48:144–156. https://doi.org/10.1016/j.jmsy.2018.01.003
Wu S, Zhong S, Liu Y (2017) Deep residual learning for image steganalysis. Multimed Tools Appl 77(9):10437–10453
Yan R, Gao RX, Chen X (2014) Wavelets for fault diagnosis of rotary machines: a review with applications. Sig Process 96:1–15
Ye Y, Hu T, Zhang C, Luo W (2016) Design and development of a CNC machining process knowledge base using cloud technology. Int J Adv Manuf Technol 94:3413–3425
Ye Y, Hu T, Yang Y, Zhu W, Zhang C (2018) A knowledge based intelligent process planning method for controller of computer numerical control machine tools. J Intell Manuf 2018:1–17. https://doi.org/10.1007/s10845-018-1401-3
Zhang W, Peng G, Li C (2017) Rolling element bearings fault intelligent diagnosis based on convolutional neural networks using raw sensing signal. In: Proceeding of the twelfth international conference on intelligent information hiding and multimedia signal processing, Springer, Cham, pp 77–84
Zhao R, Yan R, Chen Z, Mao K, Wang P, Gao RX (2019) Deep learning and its applications to machine health monitoring. Mech Syst Signal Process 100:439–453
Acknowledgements
This research acknowledges the financial support partially provided by Natural Science Foundation of China (No. U1862104), National Key Research and Development Program of China (No. 2016YFC0802103), and the Fundamental Research Funds for the Central Universities (No. ZX20180008). The constructive comments from the anonymous reviewers are greatly appreciated to help improve the paper.
Author information
Authors and Affiliations
Corresponding authors
Additional information
Accepted after one revision by the editors of the special edition.
Rights and permissions
About this article
Cite this article
Wang, J., Ma, Y., Huang, Z. et al. Performance Analysis and Enhancement of Deep Convolutional Neural Network. Bus Inf Syst Eng 61, 311–326 (2019). https://doi.org/10.1007/s12599-019-00593-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12599-019-00593-4