{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,6]],"date-time":"2024-10-06T01:08:28Z","timestamp":1728176908641},"reference-count":39,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2021,7,4]],"date-time":"2021-07-04T00:00:00Z","timestamp":1625356800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100010418","name":"Institute for Information and Communications Technology Promotion","doi-asserted-by":"publisher","award":["2017-0-00432"],"id":[{"id":"10.13039\/501100010418","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Assistant devices such as meal-assist robots aid individuals with disabilities and support the elderly in performing daily activities. However, existing meal-assist robots are inconvenient to operate due to non-intuitive user interfaces, requiring additional time and effort. Thus, we developed a hybrid brain\u2013computer interface-based meal-assist robot system following three features that can be measured using scalp electrodes for electroencephalography. The following three procedures comprise a single meal cycle. (1) Triple eye-blinks (EBs) from the prefrontal channel were treated as activation for initiating the cycle. (2) Steady-state visual evoked potentials (SSVEPs) from occipital channels were used to select the food per the user\u2019s intention. (3) Electromyograms (EMGs) were recorded from temporal channels as the users chewed the food to mark the end of a cycle and indicate readiness for starting the following meal. The accuracy, information transfer rate, and false positive rate during experiments on five subjects were as follows: accuracy (EBs\/SSVEPs\/EMGs) (%): (94.67\/83.33\/97.33); FPR (EBs\/EMGs) (times\/min): (0.11\/0.08); ITR (SSVEPs) (bit\/min): 20.41. These results revealed the feasibility of this assistive system. The proposed system allows users to eat on their own more naturally. Furthermore, it can increase the self-esteem of disabled and elderly peeople and enhance their quality of life.<\/jats:p>","DOI":"10.3390\/s21134578","type":"journal-article","created":{"date-parts":[[2021,7,5]],"date-time":"2021-07-05T02:35:22Z","timestamp":1625452522000},"page":"4578","source":"Crossref","is-referenced-by-count":13,"title":["A Hybrid Brain\u2013Computer Interface for Real-Life Meal-Assist Robot Control"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"http:\/\/orcid.org\/0000-0001-7671-0162","authenticated-orcid":false,"given":"Jihyeon","family":"Ha","sequence":"first","affiliation":[{"name":"Center for Bionics, Korea Institute of Science and Technology, Seoul 02792, Korea"},{"name":"Department of Biomedical Engineering, Hanyang University, Seoul 04763, Korea"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-1236-0754","authenticated-orcid":false,"given":"Sangin","family":"Park","sequence":"additional","affiliation":[{"name":"Center for Bionics, Korea Institute of Science and Technology, Seoul 02792, Korea"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-3795-3318","authenticated-orcid":false,"given":"Chang-Hwan","family":"Im","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, Hanyang University, Seoul 04763, Korea"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-5769-1039","authenticated-orcid":false,"given":"Laehyun","family":"Kim","sequence":"additional","affiliation":[{"name":"Center for Bionics, Korea Institute of Science and Technology, Seoul 02792, Korea"},{"name":"Department of HY-KIST Bio-Convergence, Hanyang University, Seoul 04763, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,4]]},"reference":[{"key":"ref_1","unstructured":"(2021, May 19). World Health Organization. Available online: https:\/\/www.who.int\/health-topics\/disability#tab=tab_1."},{"key":"ref_2","unstructured":"(2021, May 19). World Health Organization. Available online: https:\/\/www.who.int\/health-topics\/ageing#tab=tab_1."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1145\/3127874","article-title":"Healthcare robotics","volume":"60","author":"Riek","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Wang, F., Zhang, X., Fu, R., and Sun, G. (2018). Study of the home-auxiliary robot based on BCI. Sensors, 18.","DOI":"10.3390\/s18061779"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Choi, J., Kim, K.T., Jeong, J.H., Kim, L., Lee, S.J., and Kim, H. (2020). Developing a Motor Imagery-Based Real-Time Asynchronous Hybrid BCI Controller for a Lower-Limb Exoskeleton. Sensors, 20.","DOI":"10.3390\/s20247309"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Perera, C.J., Naotunna, I., Sadaruwan, C., Gopura, R.A.R.C., and Lalitharatne, T.D. (2016, January 9\u201312). SSVEP based BMI for a meal assistance robot. Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary.","DOI":"10.1109\/SMC.2016.7844580"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Bhattacharjee, T., Gordon, E.K., Scalise, R., Cabrera, M.E., Caspi, A., Cakmak, M., and Srinivasa, S.S. (2020, January 23\u201326). Is more autonomy always better? Exploring preferences of users with mobility impairments in robot-assisted feeding. Proceedings of the 2020 ACM\/IEEE International Conference on Human-Robot Interaction, Cambridge, UK.","DOI":"10.1145\/3319502.3374818"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Mahmud, S., Lin, X., and Kim, J.-H. (2020, January 6\u20138). Interface for Human Machine Interaction for assistant devices: A review. Proceedings of the 2020 10th Annual Computing and Communication Workshop and Conference (CCWC), Las Vegas, NV, USA.","DOI":"10.1109\/CCWC47524.2020.9031244"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1016\/j.procir.2020.05.259","article-title":"Review on existing VR\/AR solutions in human\u2013robot collaboration","volume":"97","author":"Dianatfar","year":"2021","journal-title":"Procedia CIRP"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Chamola, V., Vineet, A., Nayyar, A., and Hossain, E. (2020). Brain-Computer Interface-Based Humanoid Control: A Review. Sensors, 20.","DOI":"10.3390\/s20133620"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zero, E., Bersani, C., and Sacile, R. (2021). Identification of Brain Electrical Activity Related to Head Yaw Rotations. Sensors, 21.","DOI":"10.3390\/s21103345"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"8316485","DOI":"10.1155\/2017\/8316485","article-title":"Noninvasive electroencephalogram based control of a robotic arm for writing task using hybrid BCI system","volume":"2017","author":"Gao","year":"2017","journal-title":"BioMed Res. Int."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Park, S., Cha, H.-S., Kwon, J., Kim, H., and Im, C.-H. (2020, January 26\u201328). Development of an online home appliance control system using augmented reality and an ssvep-based brain-computer interface. Proceedings of the 2020 8th International Winter Conference on Brain-Computer Interface (BCI), Gangwon, Korea.","DOI":"10.1109\/BCI48061.2020.9061633"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"101687","DOI":"10.1016\/j.bspc.2019.101687","article-title":"A hybrid BCI-controlled smart home system combining SSVEP and EMG for individuals with paralysis","volume":"56","author":"Chai","year":"2020","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lee, T., Kim, M., and Kim, S.-P. (2020). Improvement of P300-Based Brain-Computer Interfaces for Home Appliances Control by Data Balancing Techniques. Sensors, 20.","DOI":"10.3390\/s20195576"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Park, S., Han, C.-H., and Im, C.-H. (2020). Design of Wearable EEG Devices Specialized for Passive Brain-Computer Interface Applications. Sensors, 20.","DOI":"10.3390\/s20164572"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Antoniou, E., Bozios, P., Christou, V., Tzimourta, K.D., Kalafatakis, K., Tsipouras, M.G., Giannakeas, N., and Tzallas, A.T. (2021). EEG-Based Eye Movement Recognition Using the Brain-Computer Interface and Random Forests. Sensors, 21.","DOI":"10.3390\/s21072339"},{"key":"ref_18","first-page":"1017","article-title":"Fundamental of Electroencephalogram (EEG) Review for Brain-Computer Interface (BCI) System","volume":"6","author":"Hasbulah","year":"2019","journal-title":"Int. Res. J. Eng. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"25","DOI":"10.3389\/fnbot.2020.00025","article-title":"Current Status, Challenges, and Possible Solutions of EEG-Based Brain-Computer Interface: A Comprehensive Review","volume":"14","author":"Rashid","year":"2020","journal-title":"Front. Neurorobot."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2610","DOI":"10.1109\/TBME.2006.886577","article-title":"Frequency recognition based on canonical correlation analysis for SSVEP-based BCIs","volume":"53","author":"Lin","year":"2006","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1016\/j.neucom.2017.03.082","article-title":"The extension of multivariate synchronization index method for SSVEP-based BCI","volume":"269","author":"Zhang","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Laport, F., Iglesia, D., Dapena, A., Castro, P.M., and Vazquez-Araujo, F.J. (2021). Proposals and Comparisons from One-Sensor EEG and EOG Human-Machine Interfaces. Sensors, 21.","DOI":"10.3390\/s21062220"},{"key":"ref_23","unstructured":"Kothe, C., Medine, D., and Grivich, M. (2021, May 19). Lab Streaming Layer. Available online: https:\/\/github.com\/sccn\/labstreaminglayer."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Borghini, G., Aric\u00f2, P., Di Flumeri, G., Sciaraffa, N., and Babiloni, F. (2019). Correlation and similarity between cerebral and non-cerebral electrical activity for user\u2019s states assessment. Sensors, 19.","DOI":"10.3390\/s19030704"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Di Flumeri, G., Aric\u00f2, P., Borghini, G., Colosimo, A., and Babiloni, F. (2016, January 16\u201320). A new regression-based method for the eye blinks artifacts correction in the EEG signal, without using any EOG channel. Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA.","DOI":"10.1109\/EMBC.2016.7591406"},{"key":"ref_26","unstructured":"Rabiner, L.R., Gold, B., and Yuen, C. (2016). Theory and Application of Digital Signal Processing, Prentice-Hall."},{"key":"ref_27","unstructured":"(2021, May 21). NT Robot. Available online: http:\/\/www.ntrobot.net\/shop_contents\/myboard_read.htm?load_type=&page_idx=0&tag_on=&h_search_c=0&h_search_v=&me_popup=&myboard_code=product&page_limit=12&idx=46206&page=1&category_idx=."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1162\/pres.19.1.35","article-title":"Openvibe: An open-source software platform to design, test, and use brain\u2013computer interfaces in real and virtual environments","volume":"19","author":"Renard","year":"2010","journal-title":"Presence Teleoperators Virtual Environ."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Han, C.-H., Kim, E., and Im, C.-H. (2020). Development of a brain\u2013computer interface toggle switch with low false-positive rate using respiration-modulated photoplethysmography. Sensors, 20.","DOI":"10.3390\/s20020348"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Perera, C.J., Lalitharatne, T.D., and Kiguchi, K. (June, January 29). EEG-controlled meal assistance robot with camera-based automatic mouth position tracking and mouth open detection. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989208"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1109\/TNSRE.2013.2253801","article-title":"Discrimination between control and idle states in asynchronous SSVEP-based brain switches: A pseudo-key-based approach","volume":"21","author":"Pan","year":"2013","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1743-0003-8-39","article-title":"Asynchronous BCI control using high-frequency SSVEP","volume":"8","author":"Diez","year":"2011","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1109\/TNSRE.2009.2039495","article-title":"BCI demographics: How many (and what kinds of) people can use an SSVEP BCI?","volume":"18","author":"Allison","year":"2010","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"6968713","DOI":"10.1155\/2020\/6968713","article-title":"EEG-controlled wall-crawling cleaning robot using SSVEP-based brain-computer interface","volume":"2020","author":"Shao","year":"2020","journal-title":"J. Healthc. Eng."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"95","DOI":"10.3389\/fnbot.2020.583641","article-title":"Hybrid BCI Based on SSVEP and EOG for Robotic Arm Control","volume":"14","author":"Zhu","year":"2020","journal-title":"Front. Neurorobot."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"103101","DOI":"10.1016\/j.dsp.2021.103101","article-title":"An embedded lightweight SSVEP-BCI electric wheelchair with hybrid stimulator","volume":"116","author":"Na","year":"2021","journal-title":"Digit. Signal Process."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wang, Y., Zhang, X., Li, K., Wang, J., and Chen, X. (2020, January 23\u201326). Humanoid Robot Control System Based on AR-SSVEP. Proceedings of the 2020 6th International Conference on Computing and Artificial Intelligence, Tianjin, China.","DOI":"10.1145\/3404555.3404625"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"6362","DOI":"10.1109\/TIM.2020.2970846","article-title":"Wearable brain-computer interface instrumentation for robot-based rehabilitation by augmented reality","volume":"69","author":"Arpaia","year":"2020","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1111\/joor.12774","article-title":"Effect of food properties and chewing condition on the electromyographic activity of the posterior tongue","volume":"46","author":"Manda","year":"2019","journal-title":"J. Oral Rehabil."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/13\/4578\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,15]],"date-time":"2024-07-15T00:40:02Z","timestamp":1721004002000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/13\/4578"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,4]]},"references-count":39,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["s21134578"],"URL":"https:\/\/doi.org\/10.3390\/s21134578","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,4]]}}}