{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,15]],"date-time":"2024-09-15T00:53:43Z","timestamp":1726361623152},"reference-count":48,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2020,6,20]],"date-time":"2020-06-20T00:00:00Z","timestamp":1592611200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Recognition of motor imagery intention is one of the hot current research focuses of brain-computer interface (BCI) studies. It can help patients with physical dyskinesia to convey their movement intentions. In recent years, breakthroughs have been made in the research on recognition of motor imagery task using deep learning, but if the important features related to motor imagery are ignored, it may lead to a decline in the recognition performance of the algorithm. This paper proposes a new deep multi-view feature learning method for the classification task of motor imagery electroencephalogram (EEG) signals. In order to obtain more representative motor imagery features in EEG signals, we introduced a multi-view feature representation based on the characteristics of EEG signals and the differences between different features. Different feature extraction methods were used to respectively extract the time domain, frequency domain, time-frequency domain and spatial features of EEG signals, so as to made them cooperate and complement. Then, the deep restricted Boltzmann machine (RBM) network improved by t-distributed stochastic neighbor embedding(t-SNE) was adopted to learn the multi-view features of EEG signals, so that the algorithm removed the feature redundancy while took into account the global characteristics in the multi-view feature sequence, reduced the dimension of the multi-visual features and enhanced the recognizability of the features. Finally, support vector machine (SVM) was chosen to classify deep multi-view features. Applying our proposed method to the BCI competition IV 2a dataset we obtained excellent classification results. The results show that the deep multi-view feature learning method further improved the classification accuracy of motor imagery tasks.<\/jats:p>","DOI":"10.3390\/s20123496","type":"journal-article","created":{"date-parts":[[2020,6,23]],"date-time":"2020-06-23T13:05:33Z","timestamp":1592917533000},"page":"3496","source":"Crossref","is-referenced-by-count":50,"title":["Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature Learning"],"prefix":"10.3390","volume":"20","author":[{"given":"Jiacan","family":"Xu","sequence":"first","affiliation":[{"name":"School of Information Science and Engineering, Northeastern University, Shenyang 110819, China"}]},{"given":"Hao","family":"Zheng","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Shenyang University of Technology, Shenyang 110870, China"}]},{"given":"Jianhui","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Northeastern University, Shenyang 110819, China"}]},{"given":"Donglin","family":"Li","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Northeastern University, Shenyang 110819, China"}]},{"given":"Xiaoke","family":"Fang","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Northeastern University, Shenyang 110819, China"}]}],"member":"1968","published-online":{"date-parts":[[2020,6,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1032","DOI":"10.1016\/S1474-4422(08)70223-0","article-title":"Brain-computer interfaces in neurological rehabilitation","volume":"7","author":"Daly","year":"2008","journal-title":"Lancet Neurol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3677","DOI":"10.1007\/s00521-017-2950-7","article-title":"Application of artificial bee colony algorithm in feature optimization for motor imagery EEG classification","volume":"30","author":"Miao","year":"2017","journal-title":"Neural Comput. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"066010","DOI":"10.1088\/1741-2552\/ab3bb4","article-title":"Convolutional neural networks for decoding of covert attention focus and saliency maps for EEG feature visualization","volume":"16","author":"Farahat","year":"2019","journal-title":"J. Neural Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.ins.2019.01.053","article-title":"A novel method for classification of BCI multi-class motor imagery task based on Dempster-Shafer theory","volume":"484","author":"Razi","year":"2019","journal-title":"Inf. Sci."},{"key":"ref_5","first-page":"733","article-title":"Decoding of ankle flexion and extension from cortical current sources estimated from non-invasive brain activity recording methods","volume":"11","author":"Hyoudou","year":"2017","journal-title":"Front. Neurosci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1186\/s12859-017-1964-6","article-title":"An improved discriminative filter bank selection approach for motor imagery EEG signal classification using mutual information","volume":"18","author":"Kumar","year":"2017","journal-title":"Bmc Bioinf."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"132720","DOI":"10.1109\/ACCESS.2019.2941867","article-title":"Densely Feature Fusion Based on Convolutional Neural Networks for Motor Imagery EEG Classification","volume":"7","author":"Li","year":"2019","journal-title":"IEEE Access"},{"key":"ref_8","unstructured":"Chin, Z.Y., Ang, K.K., Wang, C.C., Auan, C.T., Zhang, H.H., and IEEE (2009, January 3\u20136). Multi-class Filter Bank Common Spatial Pattern for Four-Class Motor Imagery BCI. Proceedings of the 2009 Annual International Conference of the Ieee Engineering in Medicine and Biology Society, New York, NY, USA."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1016\/S1567-424X(09)70400-3","article-title":"Brain-Computer interfaces (BCIs) for communication and control","volume":"57","author":"Wolpaw","year":"2004","journal-title":"Suppl. Clin. Neurophysiol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1109\/TNSRE.2016.2646763","article-title":"EEG-based strategies to detect motor imagery for control and rehabilitation","volume":"25","author":"Ang","year":"2017","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1207","DOI":"10.1007\/s10462-019-09694-8","article-title":"Filtering techniques for channel selection in motor imagery EEG applications: A survey","volume":"53","author":"Baig","year":"2020","journal-title":"Artif. Intell. Rev."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"957","DOI":"10.1007\/s13246-018-0691-2","article-title":"Multi-class EEG classification of motor imagery signal by finding optimal time segments and features using SNR-based mutual information","volume":"41","author":"Mahmoudi","year":"2018","journal-title":"Australas. Phys. Eng. Sci. Med."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.measurement.2019.07.070","article-title":"Analysis and classification of hybrid BCI based on motor imagery and speech imagery","volume":"147","author":"Wang","year":"2019","journal-title":"Measurement."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Majidov, I., and Whangbo, T. (2019). Efficient Classification of Motor Imagery Electroencephalography Signals Using Deep Learning Methods. Sensors, 19.","DOI":"10.3390\/s19071736"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1861","DOI":"10.1007\/s11517-018-1821-4","article-title":"A new parameter tuning approach for enhanced motor imagery EEG signal classification","volume":"56","author":"Kumar","year":"2018","journal-title":"Med. Biol Eng. Comput."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1170","DOI":"10.1109\/TNSRE.2019.2915621","article-title":"A Channel-Projection Mixed-Scale Convolutional Neural Network for Motor Imagery EEG Decoding","volume":"27","author":"Li","year":"2019","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_17","unstructured":"Ang, K.K., Chin, Z.Y., Zhang, H.H., and Guan, C.T. (2008, January 8). Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface. Proceedings of the 2008 IEEE International Joint Conference on Neural Networks, New York, NY, USA."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1541","DOI":"10.1109\/TBME.2005.851521","article-title":"Spatio-spectral filters for improving the classification of single trial EEG","volume":"52","author":"Lemm","year":"2005","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2274","DOI":"10.1109\/TBME.2006.883649","article-title":"Combined optimization of spatial and temporal filters for improving brain-computer interfacing","volume":"53","author":"Dornhege","year":"2006","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Novi, Q., Guan, C., Dat, T.H., and Xue, P. (2007, January 2\u20135). Sub-band Common Spatial Pattern (SBCSP) for Brain-Computer Interface. Proceedings of the 2007 3rd International IEEE\/EMBS Conference on Neural Engineering, Kohala Coast, HI, USA.","DOI":"10.1109\/CNE.2007.369647"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2730","DOI":"10.1109\/TBME.2009.2026181","article-title":"A new discriminative common spatial pattern method for motor imagery brain-computer interfaces","volume":"56","author":"Thomas","year":"2009","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/TFUZZ.2016.2637405","article-title":"Recognition of epileptic EEG signals using a novel multiview TSK fuzzy system","volume":"25","author":"Jiang","year":"2017","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1109\/TNSRE.2018.2803066","article-title":"A hybrid network for ERP detection and analysis based on restricted Boltzmann machine","volume":"26","author":"Li","year":"2018","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1109\/TNSRE.2019.2892960","article-title":"Spatial-temporal discriminative restricted Boltzmann machine for event-related potential detection and analysis","volume":"27","author":"Li","year":"2019","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1109\/TNSRE.2016.2601240","article-title":"A deep learning scheme for motor imagery classification based on restricted boltzmann machines","volume":"25","author":"Lu","year":"2017","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_26","first-page":"384","article-title":"Learning a parametric embedding by preserving local structure","volume":"5","author":"Maaten","year":"2009","journal-title":"J. Mach. Learn. Res."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1016\/j.cmpb.2019.105076","article-title":"Upper limb complex movements decoding from pre-movement EEG signals using wavelet common spatial patterns","volume":"183","author":"Mohseni","year":"2020","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.cmpb.2016.02.020","article-title":"Subject-based feature extraction by using fisher WPD-CSP in brain-computer interfaces","volume":"129","author":"Yang","year":"2016","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1109\/MSP.2008.4408441","article-title":"Optimizing spatial filters for robust EEG single-trial analysis","volume":"25","author":"Blankertz","year":"2008","journal-title":"IEEE Signal. Process. Mag."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.jneumeth.2016.12.010","article-title":"Discriminative spatial-frequency-temporal feature extraction and classification of motor imagery EEG: An sparse regression and Weighted Naive Bayesian Classifier-based approach","volume":"278","author":"Miao","year":"2017","journal-title":"J. Neurosci. Methods"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1016\/j.neucom.2009.07.012","article-title":"An efficient hybrid linear and kernel CSP approach for EEG feature extraction","volume":"73","author":"Nasihatkon","year":"2009","journal-title":"Neurocomputing"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1485","DOI":"10.1109\/TFUZZ.2017.2728521","article-title":"A new self-regulated neuro-fuzzy framework for classification of EEG signals in motor imagery BCI","volume":"26","author":"Jafarifarmand","year":"2018","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1016\/j.neucom.2016.08.083","article-title":"Extracting the nonlinear features of motor imagery EEG using parametric t-SNE","volume":"218","author":"Li","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1126\/science.1127647","article-title":"Reducing the dimensionality of data with neural networks","volume":"313","author":"Hinton","year":"2006","journal-title":"Science"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1527","DOI":"10.1162\/neco.2006.18.7.1527","article-title":"A fast learning algorithm for deep belief nets","volume":"18","author":"Hinton","year":"2006","journal-title":"Neural Comput."},{"key":"ref_36","unstructured":"Hinton, G., and Roweis, S. (2003, January 1). Stochastic neighbor embedding. Proceedings of the Advances in Neural Information Processing Systems, Cambridge, MA, USA."},{"key":"ref_37","first-page":"2579","article-title":"Visualizing Data using t-SNE","volume":"9","author":"Laurens","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"He, L.M., Yang, X.B., and Lu, H.J. (2007, January 19\u201322). A Comparison of Support Vector Machines Ensemble for Classification. Proceedings of the 2007 International Conference on Machine Learning and Cybernetics, Hong Kong, China.","DOI":"10.1109\/ICMLC.2007.4370773"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Dai, M., Zheng, D., Na, R., Wang, S., and Zhang, S. (2019). EEG classification of motor imagery using a novel deep learning framework. Sensors, 19.","DOI":"10.3390\/s19030551"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"39","DOI":"10.3389\/fnins.2012.00039","article-title":"Filter bank common spatial pattern algorithm on BCI competition IV datasets 2a and 2b","volume":"6","author":"Ang","year":"2012","journal-title":"Front. Neurosci."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"5619","DOI":"10.1109\/TNNLS.2018.2789927","article-title":"Learning temporal information for brain-computer interface using convolutional neural networks","volume":"29","author":"Sakhavi","year":"2018","journal-title":"IEEE Trans. Neural Netw Learn. Syst."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"026001","DOI":"10.1088\/1741-2560\/13\/2\/026001","article-title":"User-customized brain computer interfaces using Bayesian optimization","volume":"13","author":"Bashashati","year":"2016","journal-title":"J. Neural Eng."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1109\/TBME.2015.2487738","article-title":"Separable common spatio-spectral patterns for motor imagery BCI systems","volume":"63","author":"Aghaei","year":"2016","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/j.eswa.2017.11.007","article-title":"A multi-class EEG-based BCI classification using multivariate empirical mode decomposition based filtering and Riemannian geometry","volume":"95","author":"Gaur","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1016\/j.asoc.2018.11.031","article-title":"Classification of multiple motor imagery using deep convolutional neural networks and spatial filters","volume":"75","year":"2019","journal-title":"Appl. Soft Comput."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2301","DOI":"10.1109\/TNNLS.2015.2475618","article-title":"Optimizing Single-Trial EEG Classification by Stationary Matrix Logistic Regression in Brain-Computer Interface","volume":"27","author":"Zeng","year":"2016","journal-title":"IEEE Trans. Neural Netw Learn. Syst"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1109\/TNSRE.2016.2587939","article-title":"Motor imagery classification based on bilinear sub-manifold learning of symmetric positive-definite matrices","volume":"25","author":"Xie","year":"2017","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/12\/3496\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,30]],"date-time":"2024-06-30T05:50:07Z","timestamp":1719726607000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/12\/3496"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,20]]},"references-count":48,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,6]]}},"alternative-id":["s20123496"],"URL":"https:\/\/doi.org\/10.3390\/s20123496","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,20]]}}}