Abstract
The issue of driver drowsiness poses a considerable safety risk, which can result in accidents and loss of life. To confront this issue, reliable and user-friendly systems that can detect early signs of drowsiness are needed. Vision-based drowsiness detection (DDD) systems have emerged as a promising approach to achieve this goal. DDD systems combine image processing methods with artificial intelligence to monitor the driver’s eyes and facial expressions and identify signs of drowsiness. In this work, we present a DDD approach using vision transformers (ViT). The attention mechanism in our proposed method focuses on the specific patches of the input image which contribute to the drowsiness phenomenon. Empirical results on the UTA-RLDD dataset show that our proposed model achieves a high level of test accuracy of 98.10 and an average prediction time of 17 ms per frame. Hence, our approach offers a solution for detecting early signs of drowsiness, providing drivers with enough time to take corrective action and reduce accident risks.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Adhinata, F.D., Rakhmadani, D.P., Wijayanto, D.: Fatigue detection on face image using facenet algorithm and k-nearest neighbor classifier. J. Inf. Syst. Eng. Bus. Intell. 7(1), 22–30 (2021). https://doi.org/10.20473/jisebi.7.1.22-30, https://e-journal.unair.ac.id/JISEBI/article/view/24144
Dosovitskiy, A., et al.: An image is worth 16\(\,times\,\)16 words: transformers for image recognition at scale (2020). https://doi.org/10.48550/ARXIV.2010.11929
Ghoddoosian, R., Galib, M., Athitsos, V.: A realistic dataset and baseline temporal model for early drowsiness detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (2019)
Kang, N., et al.: Driver drowsiness detection based on 3d convolution neural network with optimized window size. In: 2022 13th International Conference on Information and Communication Technology Convergence (ICTC), pp. 425–428 (2022). https://doi.org/10.1109/ICTC55196.2022.9952988
King, D.E.: Dlib-ml: a machine learning toolkit. J. Mach. Learn. Res. 10, 1755–1758 (2009)
Magán, E., Sesmero, M.P., Alonso-Weber, J.M., Sanchis, A.: Driver drowsiness detection by applying deep learning techniques to sequences of images. Appl. Sci. 12(3) (2022). https://doi.org/10.3390/app12031145, https://www.mdpi.com/2076-3417/12/3/1145
Phan, A.C., Nguyen, N.H.Q., Trieu, T.N., Phan, T.C.: An efficient approach for detecting driver drowsiness based on deep learning. Appl. Sci. 11(18) (2021). https://doi.org/10.3390/app11188441, https://www.mdpi.com/2076-3417/11/18/8441
Sara A. Alameen, A.M.A.: A lightweight driver drowsiness detection system using 3dcnn with LSTM. Comput. Syst. Sci. Eng. 44(1), 895–912 (2023). https://doi.org/10.32604/csse.2023.024643, http://www.techscience.com/csse/v44n1/48052
Tamanani, R., Muresan, R., Al-Dweik, A.: Estimation of driver vigilance status using real-time facial expression and deep learning. IEEE Sens. Lett. PP, 1 (2021). https://doi.org/10.1109/LSENS.2021.3070419
Xiao, Z., Hu, Z., Geng, L., Zhang, F., Wu, J., Li, Y.: Fatigue driving recognition network: fatigue driving recognition via convolutional neural network and long short-term memory units. IET Intell. Transp. Syst. 13, 1410–1416(6) (2019). https://digital-library.theiet.org/content/journals/10.1049/iet-its.2018.5392
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Usmani, S., Chandwani, B., Sadhya, D. (2024). Driver Drowsiness Detection Using Vision Transformer. In: Kaur, H., Jakhetiya, V., Goyal, P., Khanna, P., Raman, B., Kumar, S. (eds) Computer Vision and Image Processing. CVIP 2023. Communications in Computer and Information Science, vol 2009. Springer, Cham. https://doi.org/10.1007/978-3-031-58181-6_37
Download citation
DOI: https://doi.org/10.1007/978-3-031-58181-6_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-58180-9
Online ISBN: 978-3-031-58181-6
eBook Packages: Computer ScienceComputer Science (R0)