Eye movement analysis for activity recognition using electrooculography
- PMID: 20421675
- DOI: 10.1109/TPAMI.2010.86
Eye movement analysis for activity recognition using electrooculography
Abstract
In this work, we investigate eye movement analysis as a new sensing modality for activity recognition. Eye movement data were recorded using an electrooculography (EOG) system. We first describe and evaluate algorithms for detecting three eye movement characteristics from EOG signals-saccades, fixations, and blinks-and propose a method for assessing repetitive patterns of eye movements. We then devise 90 different features based on these characteristics and select a subset of them using minimum redundancy maximum relevance (mRMR) feature selection. We validate the method using an eight participant study in an office environment using an example set of five activity classes: copying a text, reading a printed paper, taking handwritten notes, watching a video, and browsing the Web. We also include periods with no specific activity (the NULL class). Using a support vector machine (SVM) classifier and person-independent (leave-one-person-out) training, we obtain an average precision of 76.1 percent and recall of 70.5 percent over all classes and participants. The work demonstrates the promise of eye-based activity recognition (EAR) and opens up discussion on the wider applicability of EAR to other activities that are difficult, or even impossible, to detect using common sensing modalities.
Similar articles
-
Feature selection in classification of eye movements using electrooculography for activity recognition.Comput Math Methods Med. 2014;2014:713818. doi: 10.1155/2014/713818. Epub 2014 Dec 9. Comput Math Methods Med. 2014. PMID: 25574185 Free PMC article.
-
Automatic removal of eye-movement and blink artifacts from EEG signals.Brain Topogr. 2010 Mar;23(1):105-14. doi: 10.1007/s10548-009-0131-4. Epub 2009 Dec 29. Brain Topogr. 2010. PMID: 20039116
-
The misclassification of blinks as saccades: implications for investigations of eye movement dysfunction in schizophrenia.Psychophysiology. 2001 Sep;38(5):761-7. Psychophysiology. 2001. PMID: 11577899 Clinical Trial.
-
A model-based objective evaluation of eye movement correction in EEG recordings.IEEE Trans Biomed Eng. 2006 Feb;53(2):246-53. doi: 10.1109/TBME.2005.862533. IEEE Trans Biomed Eng. 2006. PMID: 16485753 Clinical Trial.
-
[A review on voluntary or involuntary eye movement classification methods based on electro-oculogram and their applications].Sheng Wu Yi Xue Gong Cheng Xue Za Zhi. 2022 Aug 25;39(4):833-840. doi: 10.7507/1001-5515.202108066. Sheng Wu Yi Xue Gong Cheng Xue Za Zhi. 2022. PMID: 36008348 Free PMC article. Review. Chinese.
Cited by
-
How do personality traits modulate real-world gaze behavior? Generated gaze data shows situation-dependent modulations.Front Psychol. 2024 Jan 10;14:1144048. doi: 10.3389/fpsyg.2023.1144048. eCollection 2023. Front Psychol. 2024. PMID: 38268808 Free PMC article.
-
Human Emotion Recognition: Review of Sensors and Methods.Sensors (Basel). 2020 Jan 21;20(3):592. doi: 10.3390/s20030592. Sensors (Basel). 2020. PMID: 31973140 Free PMC article. Review.
-
Soft, conformal bioelectronics for a wireless human-wheelchair interface.Biosens Bioelectron. 2017 May 15;91:796-803. doi: 10.1016/j.bios.2017.01.044. Epub 2017 Jan 25. Biosens Bioelectron. 2017. PMID: 28152485 Free PMC article.
-
Visuo-acoustic stimulation that helps you to relax: A virtual reality setup for patients in the intensive care unit.Sci Rep. 2017 Oct 16;7(1):13228. doi: 10.1038/s41598-017-13153-1. Sci Rep. 2017. PMID: 29038450 Free PMC article. Clinical Trial.
-
Proposals and Comparisons from One-Sensor EEG and EOG Human-Machine Interfaces.Sensors (Basel). 2021 Mar 22;21(6):2220. doi: 10.3390/s21062220. Sensors (Basel). 2021. PMID: 33810122 Free PMC article.
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources