{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,4,30]],"date-time":"2025-04-30T08:46:05Z","timestamp":1746002765800,"version":"3.37.3"},"reference-count":49,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2023,10,17]],"date-time":"2023-10-17T00:00:00Z","timestamp":1697500800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the Natural Science Foundation of Hebei","award":["No. E2021209148"]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["51804122, 52074123"],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"The characteristics of acoustic emission signals generated in the process of rock deformation and fission contain rich information on internal rock damage. The use of acoustic emissions monitoring technology can analyze and identify the precursor information of rock failure. At present, in the field of acoustic emissions monitoring and the early warning of rock fracture disasters, there is no real-time identification method for a disaster precursor characteristic signal. It is easy to lose information by analyzing the characteristic parameters of traditional acoustic emissions to find signals that serve as precursors to disasters, and analysis has mostly been based on post-analysis, which leads to poor real-time recognition of disaster precursor characteristics and low application levels in the engineering field. Based on this, this paper regards the acoustic emissions signal of rock fracture as a kind of speech signal generated by rock fracture uses this idea of speech recognition for reference alongside spectral analysis (STFT) and Mel frequency analysis to realize the feature extraction of acoustic emissions from rock fracture. In deep learning, based on the VGG16 convolutional neural network and AlexNet convolutional neural network, six intelligent real-time recognition models of rock fracture and key acoustic emission signals were constructed, and the network structure and loss function of traditional VGG16 were optimized. The experimental results show that these six deep-learning models can achieve the real-time intelligent recognition of key signals, and Mel, combined with the improved VGG16, achieved the best performance with 87.68% accuracy and 81.05% recall. Then, by comparing multiple groups of signal recognition models, Mel+VGG-FL proposed in this paper was verified as having a high recognition accuracy and certain recognition efficiency, performing the intelligent real-time recognition of key acoustic emission signals in the process of rock fracture more accurately, which can provide new ideas and methods for related research and the real-time intelligent recognition of rock fracture precursor characteristics.<\/jats:p>","DOI":"10.3390\/s23208513","type":"journal-article","created":{"date-parts":[[2023,10,17]],"date-time":"2023-10-17T12:25:09Z","timestamp":1697545509000},"page":"8513","source":"Crossref","is-referenced-by-count":3,"title":["Real-Time Recognition Method for Key Signals of Rock Fracture Acoustic Emissions Based on Deep Learning"],"prefix":"10.3390","volume":"23","author":[{"given":"Lin","family":"Sun","sequence":"first","affiliation":[{"name":"Hebei Green Intelligent Mining Technology Innovation Center, Tangshan 063210, China"},{"name":"College of Artificial Intelligence, North China University of Science and Technology, Tangshan 063210, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-2488-4768","authenticated-orcid":false,"given":"Lisen","family":"Lin","sequence":"additional","affiliation":[{"name":"Hebei Green Intelligent Mining Technology Innovation Center, Tangshan 063210, China"},{"name":"College of Artificial Intelligence, North China University of Science and Technology, Tangshan 063210, China"}]},{"given":"Xulong","family":"Yao","sequence":"additional","affiliation":[{"name":"Hebei Green Intelligent Mining Technology Innovation Center, Tangshan 063210, China"},{"name":"College of Mining Engineering, North China University of Science and Technology, Tangshan 063210, China"}]},{"given":"Yanbo","family":"Zhang","sequence":"additional","affiliation":[{"name":"Hebei Green Intelligent Mining Technology Innovation Center, Tangshan 063210, China"},{"name":"College of Mining Engineering, North China University of Science and Technology, Tangshan 063210, China"}]},{"given":"Zhigang","family":"Tao","sequence":"additional","affiliation":[{"name":"School of Mechanical and Architectural Engineering, China University of Mining and Technology-Beijing, Beijing 100083, China"},{"name":"State Key Laboratory for Geomechanics and Deep Underground Engineering, Beijing 100083, China"}]},{"given":"Peng","family":"Ling","sequence":"additional","affiliation":[{"name":"Hebei Green Intelligent Mining Technology Innovation Center, Tangshan 063210, China"},{"name":"College of Mining Engineering, North China University of Science and Technology, Tangshan 063210, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,17]]},"reference":[{"key":"ref_1","first-page":"5387459","article-title":"Acoustic emission characteristics and failure mechanism of fractured rock under different loading rates","volume":"2017","author":"Zhang","year":"2017","journal-title":"Shock Vib."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1585","DOI":"10.1007\/s00603-021-02727-1","article-title":"An energy-based method to determine rock brittleness by considering rock damage","volume":"55","author":"Wang","year":"2022","journal-title":"Rock Mech."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"818452","DOI":"10.3389\/feart.2022.818452","article-title":"Research on coal acoustic emission characteristics and damage evolution during cyclic loading","volume":"10","author":"Su","year":"2022","journal-title":"Front. Earth Sci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1520\/GTJ20160164","article-title":"Estimation of the compressive strength of intact rock using non-destructive testing method based on total sound-signal energy","volume":"40","author":"Son","year":"2017","journal-title":"Geotech. Test. J."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"115282","DOI":"10.1016\/j.carbpol.2019.115282","article-title":"Analysis of pectin biopolymer phase states using acoustic emissions","volume":"227","author":"Zheng","year":"2020","journal-title":"Carbohydr. Polym."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.ultras.2013.06.015","article-title":"Energy monitoring and analysis during deformation of bedded-sandstone: Use of acoustic emission","volume":"54","author":"Wasantha","year":"2014","journal-title":"Ultrasonics"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1134\/S1061830914020065","article-title":"Application acoustic emission method during concrete frost resistance","volume":"50","author":"Pazdera","year":"2014","journal-title":"Russ. J. Nondestr. Test."},{"key":"ref_8","first-page":"139","article-title":"Acoustic emission diagnosis for human joint cartilage diseases","volume":"17","author":"Wierzcholski","year":"2015","journal-title":"Acta Bioeng. Biomech."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1007\/s10346-014-0491-z","article-title":"Quantification of reactivated landslide behaviour using acoustic emission monitoring","volume":"12","author":"Dixon","year":"2015","journal-title":"Landslides"},{"key":"ref_10","first-page":"483","article-title":"Analysis of correlation between fracture scale and frequency characteristic of rock mass and its engineering verification","volume":"37","author":"Jiang","year":"2016","journal-title":"Rock Soil Mech."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1007\/s12517-019-4706-4","article-title":"Study on main Frequency precursor characteristics of Acoustic Emission from Deep buried Dali Rock explosion","volume":"12","author":"Mei","year":"2019","journal-title":"Arab. J. Geosci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1007\/s11249-013-0193-z","article-title":"Tribological behavior of sheet metal forming process using acoustic emission characteristics","volume":"52","author":"Salehi","year":"2013","journal-title":"Tribol. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"120435","DOI":"10.1016\/j.conbuildmat.2020.120435","article-title":"Evaluation of internal microcrack evolution in red sandstone based on time\u2013frequency domain characteristics of acoustic emission signals","volume":"260","author":"Zhao","year":"2020","journal-title":"Constr. Build. Mater."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Lukovenkova, O., Marapulets, Y., and Solodchuk, A. (2022). Adaptive Approach to Time-Frequency Analysis of AE Signals of Rocks. Sensors, 22.","DOI":"10.3390\/s22249798"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1133","DOI":"10.1007\/s00034-019-01168-0","article-title":"Study on spectrum characteristics and clustering of acoustic emission signals from rock fracture","volume":"39","author":"Zhang","year":"2020","journal-title":"Circ. Syst. Signal Pract."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2785","DOI":"10.1007\/s00603-017-1252-9","article-title":"Acoustic emission characteristics of sedimentary rocks under high-velocity waterjet impingement","volume":"50","author":"Tian","year":"2017","journal-title":"Rock Mech."},{"key":"ref_17","first-page":"375","article-title":"Optimization method for key characteristic signal of acoustic emission in rock fracture","volume":"39","author":"Yao","year":"2018","journal-title":"Rock Soil Mech."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1631\/FITEE.1700808","article-title":"Visual interpretability for deep learning: A survey","volume":"19","author":"Zhang","year":"2018","journal-title":"Front. Inform. Technol. Electron. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2352","DOI":"10.1162\/neco_a_00990","article-title":"Deep convolutional neural networks for image classification: A comprehensive review","volume":"29","author":"Rawat","year":"2017","journal-title":"Neural Comput."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2367","DOI":"10.1049\/iet-ipr.2019.0157","article-title":"State-of-art analysis of image denoising methods using convolutional neural networks","volume":"13","author":"Thakur","year":"2019","journal-title":"IET Image Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.imavis.2019.06.005","article-title":"Reinforcement learning for neural architecture search: A review","volume":"89","author":"Jaafra","year":"2019","journal-title":"Image. Vision Comput."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Kek, T., Poto\u010dnik, P., Misson, M., Bergant, Z., Sorgente, M., Govekar, E., and \u0160turm, R. (2022). Characterization of Biocomposites and Glass Fiber Epoxy Composites Based on Acoustic Emission Signals, Deep Feature Extraction, and Machine Learning. Sensors, 22.","DOI":"10.3390\/s22186886"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3078","DOI":"10.1007\/s11771-020-4530-8","article-title":"Discrimination of mining microseismic events and blasts using convolutional neural networks and original waveform","volume":"27","author":"Dong","year":"2020","journal-title":"J. Cent. South Univ."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.compositesa.2015.05.003","article-title":"Feasibility and limitations of damage identification in composite materials using acoustic emission","volume":"75","author":"Maillet","year":"2015","journal-title":"Compos. Part A"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/S0263-8223(03)00068-0","article-title":"Acoustic emission characterization of failure modes in composites with ANN","volume":"61","author":"Bhat","year":"2003","journal-title":"Compos. Struct."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1109\/JAS.2017.7510508","article-title":"Recent progresses in deep learning based acoustic models","volume":"4","author":"Yu","year":"2017","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1109\/78.277845","article-title":"Generalized sliding FFT and its application to implementation of block LMS adaptive filters","volume":"42","author":"Gazor","year":"1994","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1571","DOI":"10.1109\/TIM.2009.2027772","article-title":"Composite interpolated fast Fourier transform with the Hanning window","volume":"59","author":"Chen","year":"2010","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2071","DOI":"10.1007\/s11277-019-06373-3","article-title":"Feature extraction methods in language identification: A survey","volume":"107","author":"Deshwal","year":"2019","journal-title":"Wireless Pers. Commun."},{"key":"ref_30","first-page":"1947","article-title":"Classification of ship radiated noise based on bi-logarithmic scale spectrum and convolutional network","volume":"44","author":"Xu","year":"2022","journal-title":"J. Electron. Inf. Technol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/S0898-1221(01)85004-5","article-title":"Quadratic B-spline curve interpolation","volume":"41","author":"Cheng","year":"2001","journal-title":"Comput. Math. Appl."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1186\/s40537-021-00444-8","article-title":"Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions","volume":"8","author":"Alzubaidi","year":"2021","journal-title":"J. Big Data"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Naranjo-Torres, J., Mora, M., Hern\u00e1ndez-Garc\u00eda, R., Barrientos, R.J., Fredes, C., and Valenzuela, A. (2020). A review of convolutional neural network applied to fruit image processing. Appl. Sci., 10.","DOI":"10.3390\/app10103443"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2179","DOI":"10.1007\/s40747-021-00428-4","article-title":"Methods for image denoising using convolutional neural network: A review","volume":"7","author":"Ilesanmi","year":"2021","journal-title":"Complex. Intell. Syst."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"5408","DOI":"10.1109\/TGRS.2018.2815613","article-title":"Hyperspectral image classification with deep learning models","volume":"56","author":"Yang","year":"2018","journal-title":"IEEE Trans. Geosci. Electron."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"524","DOI":"10.5152\/dir.2022.201097","article-title":"CT images-based 3D convolutional neural network to predict early recurrence of solitary hepatocellular carcinoma after radical hepatectomy","volume":"28","author":"Cui","year":"2022","journal-title":"Diagn. Interv. Radiol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"4520","DOI":"10.1109\/TGRS.2017.2693346","article-title":"Learning sensor-specific spatial-spectral features of hyperspectral images via convolutional neural networks","volume":"55","author":"Mei","year":"2017","journal-title":"IEEE Trans. Geosci. Electron."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"28941","DOI":"10.1007\/s11042-021-11119-0","article-title":"Visual speech recognition for small scale dataset using VGG16 convolution neural network","volume":"80","author":"Patilkulkarni","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1109\/TPAMI.2018.2858826","article-title":"Focal loss for dense object detection","volume":"42","author":"Lin","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"177997","DOI":"10.1109\/ACCESS.2019.2958825","article-title":"Diagnostic model of coronary microvascular disease combined with full convolution deep network with balanced cross-entropy cost function","volume":"7","author":"Pan","year":"2019","journal-title":"IEEE Access"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1007\/s11770-022-0976-9","article-title":"Intelligent identification method and application of seismic faults based on a balanced classification network","volume":"19","author":"Yang","year":"2022","journal-title":"Appl. Geophys."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.patcog.2019.02.023","article-title":"The impact of class imbalance in classification performance metrics based on the binary confusion matrix","volume":"91","author":"Luque","year":"2019","journal-title":"Pattern Recognit."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"19083","DOI":"10.1109\/ACCESS.2022.3151048","article-title":"MLCM: Multi-label confusion matrix","volume":"10","author":"Heydarian","year":"2022","journal-title":"IEEE Access"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"4969","DOI":"10.3390\/e15114969","article-title":"Probabilistic confusion entropy for evaluating classifiers","volume":"15","author":"Wang","year":"2013","journal-title":"Entropy"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1703","DOI":"10.1109\/TVCG.2014.2346660","article-title":"Visual methods for analyzing probabilistic classification data","volume":"20","author":"Alsallakh","year":"2014","journal-title":"IEEE Trans. Visual Comput. Graphics"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Zayed, A. (2018). Advances in Shannon\u2019s Sampling Theory, Routledge.","DOI":"10.1201\/9781315136905"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Zhang, H., Wu, C., Zhang, Z., Zhu, Y., Lin, H., Zhang, Z., and Smola, A. (2022). Resnest: Split-attention networks. arXiv.","DOI":"10.1109\/CVPRW56347.2022.00309"},{"key":"ref_48","unstructured":"Tan, M., and Le, Q. (2021, January 18\u201324). Efficientnetv2: Smaller models and faster training. Proceedings of the 38th International Conference on Machine Learning, Online."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van, D., and Weinberger, K. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8513\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,15]],"date-time":"2025-01-15T15:50:20Z","timestamp":1736956220000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8513"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,17]]},"references-count":49,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["s23208513"],"URL":"https:\/\/doi.org\/10.3390\/s23208513","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,10,17]]}}}