Methods for detecting and removing ocular artifacts from EEG signals in drowsy driving warning systems: A survey | Multimedia Tools and Applications Skip to main content

Advertisement

Log in

Methods for detecting and removing ocular artifacts from EEG signals in drowsy driving warning systems: A survey

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In the last decade, drowsiness while driving has been identified as a major factor behind a large number of fatal traffic accidents around the world. This highly prevalent problem has caused significant loss of life, injuries, property damage, and economic losses in many parts of the world. For that, great efforts have been made to introduce driver’s drowsiness detection systems for reducing and preventing traffic accidents in many cities in the world. Among the existing driver assistance systems, the one based on the EEG signal measurement is the most popular and relevant system. Nevertheless, EEG signals can be easily altered by many kinds of artifacts arising from sources other than the brain, such as muscle (EMG), cardiac (ECG), and ocular (EOG) activities. In the midst of them, ocular artifacts are one of the most important noise sources among the others. In this paper, we give an in-depth review on techniques used to detect and eliminate ocular artifacts from EEG recordings for all potential EEG-based drowsiness warning applications. Initially, we present an overview of some significant artifact types that can be observed in EEG signals and we study their impact on drowsiness detection applications. Subsequently, we review many approaches to artifact rejection, categorize and compare them based on their ability to eliminate EOG artifacts. Finally, we provide an innovative idea based on the IoT Cloud, which might be the succeeding step for safe driving, for alerting the driver when is getting drowsy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. NHTSA is an agency of the United States federal government, which is part of the Department of Transportation. Its task is designated as “Save Lives, Prevent Injury, Reduce Vehicle Accidents,” related to transportation safety in the United States.

Abbreviations

AF ::

Adaptive Filtering

BSS ::

Blind Source Separation

CCA ::

Canonical Correlation Analysis

DOST ::

Discrete Orthonormal Stockwell Transform

DWT ::

Discrete Wavelet Transform

ECG ::

Electrocardiogram

EMD ::

Empirical Mode Decomposition

EEMD ::

Ensemble Empirical Mode Decomposition

EEG ::

Electroencephalography

EMG ::

Electromyogram

EOG ::

Electrooculography

GPS ::

Global Positioning System

GSM ::

Global System for Mobile

ICA ::

Independent Component Analysis

ICs ::

Independent Components

ICA-R ::

Independent Component Analysis with Reference

IMF ::

Multiple Intrinsic Mode Functions

IoT ::

Internet of Things

LWT ::

Lifting Wavelet Transform

MSE ::

Multiscale Sample Entropy

OA ::

Ocular Artifact

PCA ::

Principal Component Analysis

REOG ::

Radial EOG

RLS::

Recursive Least Squares

SNR::

Signal-to-Noise Ratio

SOS ::

Second Order Statistics

ST ::

Statistical Thresholding

SWT ::

Stationary Wavelet Transform

UT ::

Universal Thresholding

WT ::

Wavelet Transform

References

  1. Akerstedt T, Basseti C, Cirignotta F, Garcia-Borreguero D, Gonçalves M, Horne J, Léger D, ParTinen M, Penzel T, Philip P, Verster J-C (2013) La somnolence au volant -Livre Blanc-

  2. Aniket M, Arpit L, Krupa BN (2015) Removal of ocular artifacts in EEG signals using adapted wavelet and adaptive filtering. In: The proceedings of the international conference for innovation in biomedical engineering and life sciences, IFMBE proc, vol 56, pp 62–67

  3. Arnin J, Anopas D, Horapong M, Triponyuwasi P, Yamsa-ard T, Iampetch S, Wongsawat Y (2013) Wireless-based portable EEG-EOG monitoring for real time drowsiness detection. In: Proceedings of 35th Annual international conference of the IEEE EMBS, pp 4977–4980

  4. Bansal D, Mahajan R (2019) EEG-based brain-computer interfaces: Cognitive analysis and control applications, 1st Edition ISBN: 9780128146873

  5. Barrachina J, Garrido P, Fogue M, Martinez FJ, Cano JC, Calafate CT, Manzoni P (2012) VEACON: A vehicular accident ontology designed to improve safety on the roads. J Netw Comput Appl 35(6):1891–1900

    Article  Google Scholar 

  6. Behera S, Mohanty MN (2018) A statistical approach for ocular artifact removal in brain signals. In: The proceedings of the 2nd International Conference on Data Science and Business Analytics (ICDSBA), Changsha, pp 500–503

  7. Botta A, de Donato W, Persico V, Pescap A (2016) Integration of cloud computing and internet of things: A survey. future generation computer systems, vol 56. Elsevier, Amsterdam, pp 684–700

    Google Scholar 

  8. Brion A (2011) Consequences of sleep loss in adolescence. Médecine du Sommeil 8(4):145–151

    Article  Google Scholar 

  9. Çinar S, Acir N (2017) A novel system for automatic removal of ocular artefacts in EEG by using outlier detection methods and independent component analysis. Expert Syst Appl 68(C):36–44

    Article  Google Scholar 

  10. Chacon-Murguia MI, Prieto-Resendiz C (2015) Detecting driver drowsiness: a survey of system designs and technology. IEEE Consum Electron Mag 4 (4):107–119

    Article  Google Scholar 

  11. Chacon-Murguia MI, Prieto-Resendiz C (2015) Detecting driver drowsiness: a survey of system designs and technology. IEEE Consum Electron Mag 4 (4):107–119

    Article  Google Scholar 

  12. Chang TH, Hsu CS, Wang C, Yang LK (2008) Onboard measurement and warning module for irregular vehicle behavior. IEEE Trans Intell Transp Syst 9(3):501–513

    Article  Google Scholar 

  13. Čolić A, Marques O, Furht B (2014) Driver drowsiness detection: Systems and solutions. Part of the Springer Briefs in Computer Science book series (BRIEFS COMPUTER). Springer, Cham. ISBN: 978-3-319-11534-4

    Book  Google Scholar 

  14. Correa AG, Orosco L, Laciar E (2014) Automatic detection of drowsiness in EEG records based on multimodal analysis. Med Eng Phys 36(2):224–249

    Google Scholar 

  15. Cuomo S, Farina R, Piccialli F (2018) An inverse Bayesian scheme for the denoising of ECG signals. J Netw Comput Appl 115:48–58

    Article  Google Scholar 

  16. Deepthi AS, Rao KV (2014) Anomaly detection using principal component analysis. Inter J Comput Sci Technol 5(4):124–126

    Google Scholar 

  17. Dharmadhikari O, Bhor R, Mahajan P, Kumbhar HV (2015) Survey on driver’s drowsiness detection system. Inter J Comput Appl (0975–8887) 132(5):16–19

    Google Scholar 

  18. Di-Flumeri G, Arico P, Borghini G, Colosimo A, Babiloni F (2016) A new regression-based method for the eye blinks artifacts correction in the EEG signal, without using any EOG channel. In: Proceedings of the 38th annual international conference of the IEEE engineering in medicine and biology society (EMBC), pp 3187–3190

  19. Electromyograms (n.d.) (2003) Miller-Keane Encyclopedia and Dictionary of Medicine, Nursing, and Allied Health, Seventh Edition. Retrieved July 13 2019 from https://medical-dictionary.thefreedictionary.com/electromyograms Accessed 13 July 2019

  20. Faber J (2004) Detection of different levels of vigilance by EEG pseudo spectra. Neural Network World 14(3–4):285–290

    Google Scholar 

  21. Fatourechi M, Bashashati A, Ward RK, Birch GE (2007) EMG And EOG artifacts in brain computer interface systems: A survey. Clin Neurophysiol 118(3):480–494

    Article  Google Scholar 

  22. Gotman J, Skuce DR, Thompson CJ, Gloor P, Ives JR, Ray WF (1973) Clinical applications of spectral analysis and extraction of features from electroencephalograms with slow waves in adult patients. Electroencephalogr Clin Neurophysiol 35(3):225–235

    Article  Google Scholar 

  23. Gratton G, Coles MGH, Donchin E (1983) A new method for off-line removal of ocular artifact. Electroencephalogr Clin Neurophysiol 55(4):468–484

    Article  Google Scholar 

  24. Guerrero-Mosquera C, Navia-Vazquez A (2012) Automatic removal of ocular artefacts using adaptive filtering and independent component analysis for electroencephalogram data. IET Signal Process 6(2):99–106

    Article  MathSciNet  Google Scholar 

  25. He P, Wilson G, Russel C (2004) Removal of ocular artifacts from electroencephalogram by adaptive filtering. Med Biol Eng Comput 42 (3):407–412

    Article  Google Scholar 

  26. Hu S, Zheng G, Peters B (2013) Driver fatigue detection from electroencephalogram spectrum after electrooculography artefact removal. IET Intell Transp Syst 7(1):105–113

    Article  Google Scholar 

  27. Huang NE, Shen Z, Long SR, Wu MC, Shih HH, Zheng Q, Yen NC, Tung CC, Liu HH (1998) The empirical mode decomposition and the hilbert spectrum for nonlinear and non-stationary time series analysis. Proc Math Phys Eng Sci 454(1971):903–995

    Article  MathSciNet  MATH  Google Scholar 

  28. Inuso G, la Foresta F, Mammone N, Morabito FC (2007) Brain activity investigation by EEG processing: Wavelet analysis, kurtosis and renyi’s entropy for artifact detection. International Conference on Information Acquisition, pp 195–200

  29. Islam MdK, Rastegarnia A, Yang Z (2016) Methods for artifact detection and removal from scalp EEG: A review. Clin Neurophysiol 46(4–5):287–305

    Article  Google Scholar 

  30. Jafarifarmand A, Badamchizadeh MA (2013) Artifacts removal in EEG signal using a new neural network enhanced adaptive filter. Neurocomputing 103 (1):222–231

    Article  Google Scholar 

  31. Jiang X, Bian GB, Tian Z (2019) Removal of artifacts from EEG signals: A Review. Sensors 19(987):1–18

    Google Scholar 

  32. Jirayucharoensak S, Israsena P (2013) Automatic removal of EEG artifacts using ICA and lifting wavelet transform. In: Proceedings of International computer science and engineering conference, pp 136– 139

  33. Kaplan S, Guvensan MA, Yavuz AG, Karalurt Y (2015) Driver behavior analysis for safe driving: A survey. IEEE Trans Intell Transp Syst 16 (6):3017–3032

    Article  Google Scholar 

  34. Kavitha PT, Lau CT, Premkumar AB, filtering AB (2007) Modified ocular artifact removal technique from EEG by adaptive filtering. In: Proceedings of the 6th International conference on information communications & signal processing, pp 1–5

  35. Khatun S, Mahajan R, Morshed BI (2016) Comparative study of wavelet-based unsupervised ocular artifact removal techniques for single-channel EEG data. IEEE J Transl Eng Health Med 4:1–8

    Article  Google Scholar 

  36. Khatwani P, Tiwari A (2013) A survey on different noise removal techniques of EEG signals. Inter J Adv Res Comput Commun Eng 2(2):1091–1095

    Google Scholar 

  37. Knipling RR, Wang JS (1995) Revised estimates of the US drowsy driver crash problem size based on general estimates system case reviews. In: Annual proceedings of the association for the advancement of automotive medicine, vol 39, pp 451–466

  38. Kozielski S, Mrozek D, Kasprowski P, Małysiak-Mrozek B, Kostrzewa D (2016) Beyond databases, architectures and structures: Advanced technologies for data mining and knowledge discovery. In: The proceedings of the 12th international conference: BDAS

  39. Kumar PS, Arumuganathan R, Sivakumar K, Vimal C (2008) Removal of ocular artifacts in the EEG through wavelet transform without using an EOG reference channel. Inter J Open Problems Comput Sci Math 1(3):189–200

    MATH  Google Scholar 

  40. Kumar P, Saini R, Roy PP, Dogra DP (2017) A bio-signal based framework to secure mobile devices. J Netw Comput Appl 89:62–71

    Article  Google Scholar 

  41. Lakshmi MR, Prasad TV, rakash VC (2014) Survey on EEG signal processing methods. Inter J Adv Res Comput Sci Software Eng 4(1):84–91

    Google Scholar 

  42. Lee KJ, Park C, Lee B (2015) Elimination of ECG artifacts from a single-channel EEG using sparse derivative method. In: The proceedings of the international conference on systems, man, and cybernetics, pp 2384–2389

  43. Lin CT, Wu RC, Liang SF, Chao WH, Chen YJ, Jung TP (2005) EEG-Based drowsiness estimation for safety driving using independent component analysis. IEEE Trans Circuits Syst I Regul Pap 52(12):2726–2738

    Article  Google Scholar 

  44. Mahajan R, Morshed BI (2015) Unsupervised eye blink artifact denoising of EEG data with modified multiscale sample entropy, kurtosis and wavelet-ICA. IEEE J Biomed Health Inform 19(1):158–165

    Article  Google Scholar 

  45. Majmudar CA, Morshed BI (2016) Autonomous OA removal in real-time from single channel EEG data on a wearable device using a hybrid algebraic-wavelet algorithm. ACM Trans Embed Comput Syst 16(1):1–16

    Article  Google Scholar 

  46. Mannan MMN, Kamran MA, Jeong MY (2018) Identification and removal of physiological artifacts from electroencephalogram aignals: A review. IEEE Access 6:30630–30652

    Article  Google Scholar 

  47. Mantri S, Dukare V, Yeole S (2013) A survey: fundamental of EEG. Inter J Adv Res Comput Sci Manag Stud 1(4):83–89

    Google Scholar 

  48. Minhas AA, Jabbar S, Farhan M, ul Islam MN (2019) Smart methodology for safe life on roads with active drivers based on real-time risk and behavioral monitoring. Journal of Ambient Intelligence and Humanized Computing

  49. Mohammedi M, Omar M, Bouabdallah A (2018) Automatic removal of ocular artifacts in EEG signals for driver’s drowsiness detection: A survey. In: The proceedings of the 7th IEEE international conference on smart communications in network technologies (SaCoNeT), pp 188–193

  50. Morales JM, Di Stasi LL, Díaz-Piedra C, Morillas C, Romero S (2015) Real-time monitoring of biomedical signals to improve road safety. In: Rojas, I., Joya, G., Catala, A. (eds) Advances in computational intelligence. IWANN 2015. Lecture notes in computer science, vol 9094. Springer, Cham, pp 89–97

  51. North AW (1965) Accuracy and precision of electrooculographic recording. Investig Ophthalmol 4(3):343–348

    Google Scholar 

  52. Ocvirk T (2020) The association between sleep and physical activity in hypertensive individuals, Master’s Thesis, Department of Biology of Physical Activity University of Jyväskylä

  53. Pham T, Ma W, Tran D, Nguyen P, Phung D (2013) A study on the feasibility of using EEG signals for authentication purpose. Chapter: Neural information processing, vol 8227 of the series Lecture Notes in Computer Science, pp 562–569

  54. Picot A, Charbonnier S, Caplier A (2009) Monitoring drowsiness on-line using a single encephalographic channel, Recent Advances in Biomedical Engineering, Rijeka, Croatia: IN-TECH, pp 145–164

  55. Qi G, Zhao S, Ceder A(Avi), Guan W, Yan X (2021) Evaluating the removal composition of common artefacts in EEG signals for driving behaviour analysis. Accid Anal Prev 159:1–12

    Article  Google Scholar 

  56. Rashed-Al-Mahfuz Md, Islam Md, Hirose K, Molla MdkI (2013) Rabiul Artifact suppression and analysis of brain activities with electroencephalography signals. Neural Regen Res 8(16):1500–1513

    Google Scholar 

  57. Rau PS (2005) Drowsy driver detection and warning system for commercial vehicle drivers: Field operational test design, data analyses, and progress. In: Proceedings of 19th International conference on enhanced safety of vehicles Washington, DC, pp 1–7

  58. Razzaque MA, Milojevic-Jevric M, Palade A, Clarke S (2016) Middleware for internet of things: A survey. IEEE Int Things J 3(1):70–95

    Article  Google Scholar 

  59. Reaz MBI, Hussain MS, Mohd-Yasin F (2006) Techniques of EMG signal analysis: detection, processing, classification and applications. Biol Proced Online 8(1):11–35

    Article  Google Scholar 

  60. Roy V, Shukla S (2015) A survey on artifacts detection techniques for electroencephalography (EEG) Signals. Int J Multimed Ubiquitous Eng 10(3):425–442

    Article  Google Scholar 

  61. Sandberg D, Ȧkerstedt T, Anund A, Kecklund G, Wahde M (2011) Detecting driver sleepiness using optimized nonlinear combinations of sleepiness indicators. IEEE Trans Intell Transp Syst 12(1):97– 108

    Article  Google Scholar 

  62. Sarhan A (2019) Cloud-based IoT platform: Challenges and applied solutions. Chapter 6 IGI Global, pp 116–147

  63. Seal A, Reddy PPN, Chaithanya P, Meghana A, Jahnavi K, Krejcar O, Hudak R (2020) An EEG database and its initial benchmark emotion classification performance. Comput Math Methods Med 2020(8303465):1–14

    Article  Google Scholar 

  64. Sehgal T, Maindalkar S, More S (2016) Safety device for drowsy driving using IoT. Inter J Adv Res Comput Commun Eng 5(9):186–188

    Google Scholar 

  65. Shwetha T, Rao JP, Sreenivasu B (2017) Iot based driver alerteness and health monitoring system. Int J Adv Res Electron Commun Eng 6(10):1093–1099

    Google Scholar 

  66. Singh D, Tripathi G, Jara AJ (2014) A survey of internet-of-things: Future vision, architecture, challenges and services. In: Proceedings of IEEE world forum on internet of things, pp 287–292

  67. Subha DP, Joseph PK, Acharya RU, Lim CM (2010) EEG Signal analysis: a survey. J Med Syst 34(2):195–212

    Article  Google Scholar 

  68. Statistics related to drowsy driver crashes. <http://www.americanindian.net/sleepstats.html>. Accessed 26 April 2019

  69. Sundararajan A, Pons A, Sarwat AI (2015) A generic framework for EEG-based biometric authentication. In: Proceedings of the 12th International conference on information technology - New generations, pp 139–144

  70. Sweeney KT, McLoone SF, Ward TE (2013) The use of ensemble empirical mode decomposition with canonical correlation analysis as a novel artifact removal technique. IEEE Trans Biomed Eng 60(1):97–105

    Article  Google Scholar 

  71. Teplan M (2002) Fundamentals of EEG measurement. Meas Sci Rev 2(2):1–11

    Google Scholar 

  72. The royal society for the prevention of accidents Driver fatigue and road accidents: A literature review and position paper. Technical report, Birmingham, U.K, pp 1–24

  73. Tiganj Z, Mboup M, Pouzat C, Lotfi B (2010) An algebraic method for eye blink artifacts detection in single channel EEG recordings. In: Proceedings of the 17th international conference on biomagnetism advances in biomagnetism–BIOMAG 2010, pp 175–178

  74. Tijerina L, Gleckler M, Stoltzfus D, Johnston S, Goodman MJ, Wierwille WW (1999) A preliminary assessment of algorithms for drowsy and inattentive driver detection on the road. National Highway Trafic Safety Administration, Report Number DOT HS 808 (TBD)

  75. Tuncer T, Dogan S, Ertam F, Subasi A (2020) A dynamic center and multi threshold point based stable feature extraction network for driver fatigue detection utilizing EEG signals. Cognitive Neurodynamics, pp 1–15

  76. Turan G, Gupta S (2013) Road accidents prevention system using driver’s drowsiness detection. Inter J Adv Res Comput Eng Technol 2(11):2981–2983

    Google Scholar 

  77. Ueno H, Kaneda M, Tsukino M (1994) Development of drowsiness detection system. In: Proceedings of VNIS’94 - 1994 vehicle navigation and information systems conference, pp 15–20, DOI https://doi.org/10.1109/VNIS.1994.396873, (to appear in print)

  78. Ullah A, Ahmed S, Siddiqui L, Faisal N (2015) Real time driver’s srowsiness detection system based on eye conditions. Inter J Sci Eng Res 6(3):125–131

    Google Scholar 

  79. Upadhyay R, Padhy PK, Kankar PK (2015) Ocular artifact removal from EEG signals using discrete orthonormal stockwell transform. In: Proceedings of the Annual IEEE India Conference (INDICON), pp 1–5, DOI https://doi.org/10.1109/INDICON.2015.7443617, (to appear in print)

  80. Vanlaar W, Simpson HM, Mayhew D, Robertson R (2007) Fatigued and drowsy driving: Attitudes, concerns and practices of ontario drivers. Technical report, Traffic Injury Research Foundation, pp 1–32

  81. Verleger R, Gasser T, Möcks J (1982) Correction of EOG artifacts in event-related potentials of the EEG: Aspects of reliability and validity. Psychophysiology 19(4):472–480

    Article  Google Scholar 

  82. Vigon L, Saatchi MR, Mayhew JEW, Fernandes R (2000) Quantitative evaluation of techniques for ocular artefact filtering of EEG waveforms. IEE Proc-Sci, Meas Technol 147(5):219–228

    Article  Google Scholar 

  83. Wang H, Dragomir A, Abbasi NI, Li J, Thakor NV, Bezerianos A (2018) A novel real-time driving fatigue detection system based on wireless dry EEG. Cogn Neurodyn 12(4):365–376

    Article  Google Scholar 

  84. Wang H, Wu C, Li T, He Y, Chen P, Bezerianos A (2019) Driving fatigue classification based on fusion entropy analysis combining EOG and EEG. IEEE Access 7:1–12

    Google Scholar 

  85. Wang Q, Yang J, Ren M, Zheng Y (2006) Driver fatigue detection: a survey. In: Proceedings of the 6th World congress on intelligent control and automation, pp 8587–8591

  86. Woestenburg JC, Verbaten MN, Slangen JL (1983) The removal of the eye-movement artifact from the EEG by regression analysis in the frequency domain. Biol Psychol 16(1–2):127–147

    Article  Google Scholar 

  87. Wu Z, Huang NE (2009) Ensemble empirical mode decomposition: a noise-assisted data analysis method. Adv Adapt Data Anal 1(1):1–41

    Article  Google Scholar 

  88. Zikov T, Bibian S, Dumont GA, Huzmezan M, Ries CR (2002) A wavelet based de-noising technique for ocular artifact correction of the electroencephalogram. In: Proceedings of the IEEE engineering in medicine and biology 24th Annual conference and the fall meeting of the biomedical engineering society, pp 98–105

  89. Zou S, Qiu T, Huang P, Bai X, Liu C (2020) Constructing multi-scale entropy based on the empirical mode decomposition(EMD) and its application in recognizing driving fatigue, Journal of Neuroscience Methods, pp 1–16

Download references

Acknowledgment

This work was carried out in the framework of the research activities of the LIMED (laboratory of Medical Computing) laboratory, which is affiliated to the faculty of exact sciences of the university of Bejaia and the IRISA laboratory, university of South Brittany, France. It was done in collaboration with the Labex MS2T, which was funded by the French Government, through the program “Investments for the future” managed by the National Agency for Research (Reference ANR-11-IDEX-0004-02). Finally, this work has been sponsored by the General Directorate for Scientific Research and Technological Development, Ministry of Higher Education and Scientific Research (DGRSDT), Algeria.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mohamed Mohammedi.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mohammedi, M., Omar, M. & Bouabdallah, A. Methods for detecting and removing ocular artifacts from EEG signals in drowsy driving warning systems: A survey. Multimed Tools Appl 82, 17687–17714 (2023). https://doi.org/10.1007/s11042-022-13822-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13822-y

Keywords

Navigation