Abstract
Drowsy drivers contribute to high rates of road accidents, leading to numerous fatalities and injuries. The dangers of drowsiness extend beyond the roads, affecting workplaces that require continuous attention and focus. This work aims to develop a non-intrusive, real-time system capable of assessing the user’s drowsiness level by processing physiological signals collected by smartwatch sensors. The study utilized photoplethysmography (PPG) and heart rate data from a smartwatch, labeled with an adapted Karolinska Sleepiness Scale (KSS). Deep Learning techniques were used to fine-tune hyperparameters and train a 1-dimensional Convolutional Neural Network to reach better prediction performance on drowsiness data. Besides, a 5-fold cross-validation technique was used to evaluate performance and create an ensemble, enhancing prediction robustness through election method. The results show significant prediction accuracy using the ensemble on test data (91.41%). The final pre-trained model was integrated into the smartwatch, creating a real-time drowsiness detection system. This system alerts the user through sound and vibration feedback, preventing them from falling asleep and reducing the risk of accidents.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The pre-processed dataset, without the normalization and window structuring steps, is available at https://www.kaggle.com/datasets/vitoraugustx/drowsiness-dataset.
References
ABRAMET: Problemas na saúde do motorista deixaram mais de 200 mil feridos e 12,4 mil mortos, entre 2014 e 2019, no brasil (Outubro 2019). https://abramet.com.br/noticias/saude-no-transito-abramet/
ABRAMET: Sono e direção não combinam. dormir ao volante está entre as principais causas de mortes no trânsito. Jornal Medicina de Tráfego 2, 1–8 (2019)
Aggarwal, V., Gupta, V., Singh, P., Sharma, K., Sharma, N.: Detection of spatial outlier by using improved z-score test. In: 2019 3rd International Conference on Trends in Electronics and Informatics (ICOEI), pp. 788–790. IEEE (2019). https://doi.org/10.1109/ICOEI.2019.8862582
Barnes, C.M., Wagner, D.T.: Changing to daylight saving time cuts into sleep and increases workplace injuries. J. Appl. Psychol. 94(5), 1305–1317 (2009). https://doi.org/10.1037/a0015320
Bergstra, J., Bengio, Y.: Random search for hyper-parameter optimization. J. Mach. Learn. Res. 13(null), 281–305 (2012). https://www.jmlr.org/papers/volume13/bergstra12a/bergstra12a.pdf
Chandel, R.S., Sharma, S., Kaur, S., Singh, S., Kumar, R.: Smart watches: a review of evolution in bio-medical sector. Mater. Today Proc. 50, 1053–1066 (2022). https://doi.org/10.1016/j.matpr.2021.07.460, 2nd International Conference on Functional Material, Manufacturing and Performances (ICFMMP-2021)
Dietterich, T.G.: Ensemble methods in machine learning. In: Multiple Classifier Systems, pp. 1–15. Springer Berlin Heidelberg, Berlin, Heidelberg (2000). https://doi.org/10.1007/3-540-45014-9_1
Hawkins, D.M.: The problem of overfitting. J. Chem. Inf. Comput. Sci. 44(1), 1–12 (2004). https://doi.org/10.1021/ci0342472
Kohavi, R.: A study of cross-validation and bootstrap for accuracy estimation and model selection. In: Proceedings of the 14th International Joint Conference on Artificial Intelligence - Volume 2, pp. 1137–1143. IJCAI’95, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA (1995). https://dl.acm.org/doi/10.5555/1643031.1643047
Kundinger, T., Riener, A.: The potential of wrist-worn wearables for driver drowsiness detection: a feasibility analysis. In: Proceedings of the 28th ACM Conference on User Modeling, Adaptation and Personalization, pp. 117–125. UMAP ’20, Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3340631.3394852
Kundinger, T., Sofra, N., Riener, A.: Assessment of the potential of wrist-worn wearable sensors for driver drowsiness detection. Sensors 20(4) (2020). https://doi.org/10.3390/s20041029
Lee, H., Lee, J., Shin, M.: Using wearable ECG/PPG sensors for driver drowsiness detection based on distinguishable pattern of recurrence plots. Electronics 8(2) (2019). https://doi.org/10.3390/electronics8020192
Nasir, S., Yurder, Y.: Consumers’ and physicians’ perceptions about high tech wearable health products. Procedia Soc. Behav. Sci. 195, 1261–1267 (2015). https://doi.org/10.1016/j.sbspro.2015.06.279, world Conference on Technology, Innovation and Entrepreneurship
Reisner, A., Shaltis, P.A., McCombie, D., Asada, H.H., Warner, D.S., Warner, M.A.: Utility of the photoplethysmogram in circulatory monitoring. Anesthesiology 108(5), 950–958 (2008). https://doi.org/10.1097/ALN.0b013e31816c89e1
Rundo, F., Spampinato, C., Battiato, S., Trenta, F., Conoci, S.: Advanced 1d temporal deep dilated convolutional embedded perceptual system for fast car-driver drowsiness monitoring. In: 2020 AEIT International Conference of Electrical and Electronic Technologies for Automotive (AEIT AUTOMOTIVE), pp. 1–6 (2020). https://doi.org/10.23919/AEITAUTOMOTIVE50086.2020.9307400
Rundo, F., Spampinato, C., Conoci, S.: Ad-hoc shallow neural network to learn hyper filtered photoplethysmographic (ppg) signal for efficient car-driver drowsiness monitoring. Electronics 8(8) (2019). https://doi.org/10.3390/electronics8080890
Zhang, Y., Tsujikawa, M., Onishi, Y.: Sleep/wake classification via remote PPG signals. In: 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 3226–3230 (2019). https://doi.org/10.1109/EMBC.2019.8857097
Åkerstedt, T., Gillberg, M.: Subjective and objective sleepiness in the active individual. Int. J. Neurosci. 52(1–2), 29–37 (1990). https://doi.org/10.3109/00207459008994241, pMID: 2265922
Acknowledgments
We thank PPG-CCMC (PPG-CCMC is the acronym for Programa de Pós-Graduação em Ciências de Computação e Matemática Computacional in Portuguese.), University of São Paulo and Federal University of Rio Grande, which made this work possible. This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior – Brasil (CAPES) – Finance Code 001 and iTEC/FURG.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Pereira, V.A.d.R., Berri, R.A., Osório, F.S. (2025). Drowsiness Detection Using Vital Sign Sensors and Deep Learning on Smartwatches. In: Julian, V., et al. Intelligent Data Engineering and Automated Learning – IDEAL 2024. IDEAL 2024. Lecture Notes in Computer Science, vol 15346. Springer, Cham. https://doi.org/10.1007/978-3-031-77731-8_12
Download citation
DOI: https://doi.org/10.1007/978-3-031-77731-8_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-77730-1
Online ISBN: 978-3-031-77731-8
eBook Packages: Computer ScienceComputer Science (R0)