Abstract
Nowadays, gunshot detection is closely related to social security, but it needs more attention. The data driven method for gunshot detection which a large corpus of gunshots will be needed for training a neural network is urgently needed. To address this requirement, we propose a novel unified framework, the Gunshot Generation and Detection (GGD), specifically designed for gunshot event detection. It merges an audio generation model with a detection model to partially alleviate the issue of data scarcity problem. Comparative analysis indicates that the GGD model surpasses non-generative models. Remarkably, it outperforms models employing data augmentation techniques. Furthermore, the GGD framework is easy to incorporate with diverse detection network architectures, such as VGGish and Mobile Net. When coupled with a Convolutional Neural Network (CNN), our methodology yields recall varying from 93.98% to 98.20%. These findings demonstrate that this integrated approach significantly enhances the detection performance of gunshot detection models.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Irvin-Erickson, Y., Bai, B., et al.: The effect of gun violence on local economies. Urban Institute, Washington, DC (2016)
Tuncer, T., Dogan, S., Akbal, E., et al.: An automated gunshot audio classification method based on finger pattern feature generator and iterative relieff feature selector. Adıyaman Üniversitesi Mühendislik Bilim. Derg. 8, 225–243 (2021)
Ding, W., He, L.: Adaptive multi-scale detection of acoustic events. IEEE/ACM Trans. Audio, Speech Lang. Proc. 28, 294–306 (2020)
Kao, C.C., Sun, M., Wang W., et al.: A comparison of pooling methods on lstm models for rare acoustic event classification. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2020)
Katsis, L.K., Hill, A.P., et al.: Automated detection of gunshots in tropical forests using convolutional neural networks. Ecol. Ind. 141, 109128 (2022)
Nichol, A., Dhariwal, P., Ramesh, A., et al.: GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Model. arXiv.2112.10741. (2021)
Yang, D., et al.: Diffsound: discrete diffusion model for text-to-sound generation. IEEE/ACM Trans, Audio Speech Lang. Proc. 31, 1720–1733 (2023)
Borsos, Z., Marinier, R., Vincent, D., et al.: AudioLM: a Language Modeling Approach to Audio Generation, arXiv. 2209.03143 (2022)
Huang, R., Huang, J., Yang, D., et al.: Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models, arXiv. 2301.12661. (2023)
Alex, M., Lauren, O., Gabe, M., Ryan, H., Bruce, W., George, M.: Low cost gunshot detection using deep learning on the Raspberry Pi. In: IEEE Conference Proceedings (2019)
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., Ommer, B.: High-resolution image synthesis with latent diffusion models. In: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2022)
Singh, R.B., Zhuang, H.: Measurements, analysis, classification, and detection of gunshot and gunshot-like sounds. Sensors 22(23), 9170 (2022)
Arslan, Y.: Impulsive sound detection by a novel energy formula and its usage for gunshot recognition. arXiv preprint arXiv:1706.08759, (2017)
Bajzik, J., Prinosil, J., Koniar, D.: Gunshot detection using convolutional neural networks. In: 2020 24th International Conference Electronics, pp. 1–5. IEEE (2020)
Bajzik, J., Prinosil, J., Jarina, R., Mekyska, J.: Independent channel residual convolutional network for gunshot detection. Inter. J. Adv. Comput. Sci. Appli. (IJACSA) 13(4) (2022)
Dos Santos, R., Kassetty, A., Nilizadeh, S.: Disrupting audio event detection deep neural networks with white noise. Technologies 64 (2021)
Nijhawan, R., Ansari, S.A., Kumar, S., et al.: Gun identification from gunshot audios for secure public places using transformer learning. Sci. Rep. 12(1), 13300 (2022)
Busse, C., et al.: Improved gunshot classification by using artificial data. In: 2019 AES International Conference on Audio Forensics (2019)
Park, J., et al.: Enemy Spotted: in-game gun sound dataset for gunshot classification and localization. In: 2022 IEEE Conference on Games, pp. 56–63 (2022)
Gong, Y., Lai, C.-I., Chung, Y.-A., Glass, J.: Ssast: selfsupervised audio spectrogram transformer. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, pp. 10699–10709 (2022)
Olaf Ronneberger: U-Net: convolutional networks for biomedical image segmentation. In: Nassir Navab (ed.) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III, pp. 234–241. Springer International Publishing, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Jain, J., et al.: Denoising diffusion probabilistic models: HO. Adv. Neural. Inf. Process. Syst. 33, 6840–6851 (2020)
Elizalde, B., Deshmukh, S., Ismail, M., Wang, H.: CLAP: Learning Audio Concepts From Natural Language Supervision (2022)
Gunshot Audio Forensics Dataset (2017). http://cadreforensics.com/audio/,
Hershey, S., Chaudhuri, S., Ellis, D. P.W., et.al.: CNN architectures for large-scale audio classification. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 131–135. (2017)
Howard, A., et al.: MobileNets: efficient convolutional neural networks for mobile vision applications. In: Computer Vision and Pattern Recognition (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Yin, J. et al. (2024). A Joint Framework with Audio Generation for Rare Gunshot Event Detection. In: Liu, F., Sadanandan, A.A., Pham, D.N., Mursanto, P., Lukose, D. (eds) PRICAI 2023: Trends in Artificial Intelligence. PRICAI 2023. Lecture Notes in Computer Science(), vol 14326. Springer, Singapore. https://doi.org/10.1007/978-981-99-7022-3_13
Download citation
DOI: https://doi.org/10.1007/978-981-99-7022-3_13
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-7021-6
Online ISBN: 978-981-99-7022-3
eBook Packages: Computer ScienceComputer Science (R0)