Compact convolutional neural networks for classification of asynchronous steady-state visual evoked potentials
- PMID: 30279309
- DOI: 10.1088/1741-2552/aae5d8
Compact convolutional neural networks for classification of asynchronous steady-state visual evoked potentials
Abstract
Objective: Steady-state visual evoked potentials (SSVEPs) are neural oscillations from the parietal and occipital regions of the brain that are evoked from flickering visual stimuli. SSVEPs are robust signals measurable in the electroencephalogram (EEG) and are commonly used in brain-computer interfaces (BCIs). However, methods for high-accuracy decoding of SSVEPs usually require hand-crafted approaches that leverage domain-specific knowledge of the stimulus signals, such as specific temporal frequencies in the visual stimuli and their relative spatial arrangement. When this knowledge is unavailable, such as when SSVEP signals are acquired asynchronously, such approaches tend to fail.
Approach: In this paper, we show how a compact convolutional neural network (Compact-CNN), which only requires raw EEG signals for automatic feature extraction, can be used to decode signals from a 12-class SSVEP dataset without the need for user-specific calibration.
Main results: The Compact-CNN demonstrates across subject mean accuracy of approximately 80%, out-performing current state-of-the-art, hand-crafted approaches using canonical correlation analysis (CCA) and Combined-CCA. Furthermore, the Compact-CNN approach can reveal the underlying feature representation, revealing that the deep learner extracts additional phase- and amplitude-related features associated with the structure of the dataset.
Significance: We discuss how our Compact-CNN shows promise for BCI applications that allow users to freely gaze/attend to any stimulus at any time (e.g. asynchronous BCI) as well as provides a method for analyzing SSVEP signals in a way that might augment our understanding about the basic processing in the visual cortex.
Similar articles
-
EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces.J Neural Eng. 2018 Oct;15(5):056013. doi: 10.1088/1741-2552/aace8c. Epub 2018 Jun 22. J Neural Eng. 2018. PMID: 29932424
-
A convolutional neural network for steady state visual evoked potential classification under ambulatory environment.PLoS One. 2017 Feb 22;12(2):e0172578. doi: 10.1371/journal.pone.0172578. eCollection 2017. PLoS One. 2017. PMID: 28225827 Free PMC article.
-
A Convolutional Neural Network for the Detection of Asynchronous Steady State Motion Visual Evoked Potential.IEEE Trans Neural Syst Rehabil Eng. 2019 Jun;27(6):1303-1311. doi: 10.1109/TNSRE.2019.2914904. Epub 2019 May 7. IEEE Trans Neural Syst Rehabil Eng. 2019. PMID: 31071044
-
[A review of researches on decoding algorithms of steady-state visual evoked potentials].Sheng Wu Yi Xue Gong Cheng Xue Za Zhi. 2022 Apr 25;39(2):416-425. doi: 10.7507/1001-5515.202111066. Sheng Wu Yi Xue Gong Cheng Xue Za Zhi. 2022. PMID: 35523564 Free PMC article. Review. Chinese.
-
[Progresses and prospects on frequency recognition methods for steady-state visual evoked potential].Sheng Wu Yi Xue Gong Cheng Xue Za Zhi. 2022 Feb 25;39(1):192-197. doi: 10.7507/1001-5515.202102031. Sheng Wu Yi Xue Gong Cheng Xue Za Zhi. 2022. PMID: 35231981 Free PMC article. Review. Chinese.
Cited by
-
Current Status, Challenges, and Possible Solutions of EEG-Based Brain-Computer Interface: A Comprehensive Review.Front Neurorobot. 2020 Jun 3;14:25. doi: 10.3389/fnbot.2020.00025. eCollection 2020. Front Neurorobot. 2020. PMID: 32581758 Free PMC article. Review.
-
Motor Imagery Multi-Tasks Classification for BCIs Using the NVIDIA Jetson TX2 Board and the EEGNet Network.Sensors (Basel). 2023 Apr 21;23(8):4164. doi: 10.3390/s23084164. Sensors (Basel). 2023. PMID: 37112504 Free PMC article.
-
A novel brain-controlled prosthetic hand method integrating AR-SSVEP augmentation, asynchronous control, and machine vision assistance.Heliyon. 2024 Feb 19;10(5):e26521. doi: 10.1016/j.heliyon.2024.e26521. eCollection 2024 Mar 15. Heliyon. 2024. PMID: 38463871 Free PMC article.
-
Convolutional Neural Network with a Topographic Representation Module for EEG-Based Brain-Computer Interfaces.Brain Sci. 2023 Feb 5;13(2):268. doi: 10.3390/brainsci13020268. Brain Sci. 2023. PMID: 36831811 Free PMC article.
-
Decoding P300 Variability Using Convolutional Neural Networks.Front Hum Neurosci. 2019 Jun 14;13:201. doi: 10.3389/fnhum.2019.00201. eCollection 2019. Front Hum Neurosci. 2019. PMID: 31258469 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources