Abstract
In this paper, we propose the use of a social robot to support professional figures in performing cognitive screening and stimulation. We implemented tools that allow us to automatize the evaluation of a subject’s cognitive abilities. More specifically, we programmed the humanoid robot Pepper to administer, in a fully automated and “friendly” way, three cognitive assessment tasks: Word List Recall (WLR), Attentive Matrices (AM), and the Rey-Osterrieth Complex Figure (ROCF). For WLR, we displayed the word list on the robot’s tablet, and the speech recognition module to record the recalled words. AM was delivered by asking the subjects to use and mark numbers on the tablet. For ROCF, we implemented two novel score assessment algorithms based on the processing of the picture drawn by the subjects and acquired through the robot camera. In particular, for ROCF, correlation analysis was conducted to compare automatically computed scores with a human psychologist’s. Our results suggest that the human psychologist’s workload can be reliably reduced thanks to the support of the robot.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
SoftBank Robotics https://www.softbankrobotics.com.
References
Agrigoroaie, R., Tapus, A.: Influence of robot’s interaction style on performance in a Stroop task. In: Kheddar, A., et al. (eds.) Social Robotics. LNCS, vol. 10652, pp. 95–104. Springer, Heidelberg (2017). https://doi.org/10.1007/978-3-319-70022-9_10
Baxter, P., Ashurst, E., Read, R., Kennedy, J., Belpaeme, T.: Robot education peers in a situated primary school study: personalisation promotes child learning. PLoS ONE 12(5), e0178126 (2017)
Boumans, R., Van Meulen, F., Hindriks, K., Neerincx, M., Olde Rikkert, M.: Proof of concept of a social robot for patient reported outcome measurements in elderly persons. In: Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, pp. 73–74 (2018)
Canham, R., Smith, S.L., Tyrrell, A.M.: Automated scoring of a neuropsychological test: the Rey Osterrieth complex figure. In: Proceedings of the 26th Euromicro Conference. EUROMICRO 2000. Informatics: Inventing the Future, vol. 2, pp. 406–413. IEEE (2000)
Kidd, C.D., Breazeal, C.: A robotic weight loss coach. In: Proceedings of the National Conference on Artificial Intelligence, vol. 22, p. 1985. AAAI Press/MIT Press. Cambridge/Menlo Park (2007)
Kidd, C.D.: Designing for long-term human-robot interaction and application to weight loss (2008)
Moetesum, M., Siddiqi, I., Ehsan, S., Vincent, N.: Deformation modeling and classification using deep convolutional neural networks for computerized analysis of neuropsychological drawings. Neural Comput. Appl. 32, 1–25 (2020). https://doi.org/10.1007/s00521-020-04735-8
Neff, M., Wang, Y., Abbott, R., Walker, M.: Evaluating the effect of gesture and language on personality perception in conversational agents. In: Allbeck, J., Badler, N., Bickmore, T., Pelachaud, C., Safonova, A. (eds.) IVA 2010. LNCS (LNAI), vol. 6356, pp. 222–235. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15892-6_24
Niculescu, A., van Dijk, B., Nijholt, A., Li, H., See, S.L.: Making social robots more attractive: the effects of voice pitch, humor and empathy. Int. J. Soc. Robot. 5(2), 171–191 (2013). https://doi.org/10.1007/s12369-012-0171-x
Olaronke, I., Oluwaseun, O., Rhoda, I.: State of the art: a study of human-robot interaction in healthcare. Int. J. Inf. Eng. Electron. Bus. 9, 43–55 (2017)
Petric, F., Kovacić, Z.: No data? No problem! expert system approach to designing a POMDP framework for robot-assisted ASD diagnostics. In: Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, pp. 209–210 (2018)
Plutchik, R.: The nature of emotions: human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. Am. Sci. 89(4), 344–350 (2001)
Rossi, S., Dell’Aquila, E., Bucci, B.: Evaluating the emotional valence of affective sounds for child-robot interaction. In: Salichs, M.A., et al. (eds.) ICSR 2019. LNCS (LNAI), vol. 11876, pp. 505–514. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-35888-4_47
Rossi, S., Santangelo, G., Staffa, M., Varrasi, S., Conti, D., Di Nuovo, A.: Psychometric evaluation supported by a social robot: personality factors and technology acceptance. In: 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 802–807. IEEE (2018)
Rossi, S., Staffa, M., Tamburro, A.: Socially assistive robot for providing recommendations: comparing a humanoid robot with a mobile application. Int. J. Soc. Robot. 10(2), 265–278 (2018). https://doi.org/10.1007/s12369-018-0469-4
Spinnler, H.: Standardizzazione e taratura italiana di test neuropsicologici. Ital. J. Neurol. Sci. 6, 21–120 (1987)
Varrasi, S., Di Nuovo, S., Conti, D., Di Nuovo, A.: A social robot for cognitive assessment. In: Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, pp. 269–270 (2018)
Varrasi, S., Di Nuovo, S., Conti, D., Di Nuovo, A.: Social robots as psychometric tools for cognitive assessment: a pilot test. In: Ficuciello, F., Ruggiero, F., Finzi, A. (eds.) Human Friendly Robotics. Springer Proceedings in Advanced Robotics, vol. 7, pp. 99–112. Springer, Heidelberg (2019). https://doi.org/10.1007/978-3-319-89327-3_8
Watanabe, K., et al.: The Rey-Osterrieth complex figure as a measure of executive function in childhood. Brain Dev. 27(8), 564–569 (2005)
Willis, S.L., et al.: Long-term effects of cognitive training on everyday functional outcomes in older adults. JAMA 296(23), 2805–2814 (2006)
Wilson, R.S., et al.: Participation in cognitively stimulating activities and risk of incident Alzheimer disease. JAMA 287(6), 742–748 (2002)
Acknowledgments
This study was partially funded by MIUR (Italian Ministry of Education, Universities, and Research) within the PRIN2015 research project UPA4SAR - User-centered Profiling and Adaptation for Socially Assistive Robotics (grant n. 2015KBL78T).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Sangiovanni, S., Spezialetti, M., D’Asaro, F.A., Maggi, G., Rossi, S. (2020). Administrating Cognitive Tests Through HRI: An Application of an Automatic Scoring System Through Visual Analysis. In: Wagner, A.R., et al. Social Robotics. ICSR 2020. Lecture Notes in Computer Science(), vol 12483. Springer, Cham. https://doi.org/10.1007/978-3-030-62056-1_31
Download citation
DOI: https://doi.org/10.1007/978-3-030-62056-1_31
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-62055-4
Online ISBN: 978-3-030-62056-1
eBook Packages: Computer ScienceComputer Science (R0)