Abstract
The capacity for social interaction, communication and recognition of emotions is a characteristic that the human being possesses and that allows him/her to be socially included. However, some have difficulties in expressing and interpreting emotional states, which can contribute to their marginalisation in society. A particular case is children with Autism Spectrum Disorder. These children have difficulties in social interaction and manifest repetitive patterns. In this work, a serious game is being developed in which an avatar (ZECA avatar) is able to interact with the child, through challenges and training of certain facial movements that will be validated by the system, facilitating imitation and recognition of emotions (happiness, sadness, anger, surprise and fear). The tests performed in the laboratory environment allowed to conclude the adequacy of the game for promoting emotional states in a friendly way.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Martins, C.: Face a face com o Autismo-será a Inclusão um mito ou uma realidade?, Escola Superior de Educação João de Deus, Lisboa (2012). (in Portuguese)
Costa, S., Soares, F., Pereira, A.P., Santos, C., Hiolle, A.: A pilot study using imitation and storytelling scenarios as activities for labelling emotions by children with autism using a humanoid robot. In: The Fourth Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, IEEE ICDL-EPIROB 2014, Genova, Italy, 13–16 October (2014)
Silva, V., Soares, F., Esteves, J.S.: Mirroring and recognizing emotions through facial expressions for a RoboKind platform. In: IEEE ENBENG 2017 - 5th Portuguese Meeting in Bioengineering, Coimbra, Portugal, 16–18 February 2017
Costa, S., Soares, F., Santos, C., Pereira, A.P., Hiolle, A., Silva, V.: Socio-emotional development in children with autism spectrum disorders using a humanoid robot, interaction studies (in press)
Azevedo, J., Silva, V., Soares, F., Pereira, A.P., Esteves, J.S.: An application to promote emotional skills in children with autism spectrum disorders. In: Göbel, S., et al. (eds.) Serious Games JCSG 2018. LNCS, vol. 11243, pp. 282–287. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-02762-9_30
Dautenhahn, K., Billard, A.: Games children with autism can play with robota, a humanoid robotic doll. In: Keates, S., Langdon, P., Clarkson, P.J., Robinson, P. (eds.) Universal Access and Assistive Technology, pp. 179–190. Springer, London (2002). https://doi.org/10.1007/978-1-4471-3719-1_18
Dautenhahn, K., et al.: KASPAR - a minimally expressive humanoid robot for human-robot interaction research. Appl. Bionics Biomech. 6(3–4), 369–397 (2009)
Kozima, H., Michalowski, M.P., Nakagawa, C.: Keepon. Int. J. Soc. Robot. 1(1), 3–18 (2008)
Miskam, M.A., Shamsuddin, S., Samat, M., Yussof, H., Ainudin, H., Omar, A.: Humanoid robot NAO as a teaching tool of emotion recognition for children with autism using the Android app. In: 2014 International Symposium on Micro-NanoMechatronics and Human Science, MHS 2014, pp. 2–6 (2015)
Freitas, H., Costa, P., Silva, V., Pereira, A.P., Soares, F., Sena Esteves, J.: Using a humanoid robot as the promoter of the interaction with children in the context of educational games. Int. J. Mechatron. Appl. Mech. 1(1), 282–288 (2017)
Silva, V., Soares, F., Sena Esteves, J.: Mirroring emotion system – on-line synthesizing facial expressions on a robot face. In: 8th International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT), Lisboa, Portugal, 18–20 October 2016
LuxAI: “QTrobot - LuxAI.com,”. http://luxai.com/qtrobot/. Accessed 6 Dec 2018
Livox: Livox: para pessoas com deficiências e transtornos de aprendizagem. http://www.livox.com.br/pt/quem-somos/#sobre. Accessed 6 Dec 2018. (in Portuguese)
Tobii Dynavox logo: “Sono Flex for Communicator 5 - Tobii Dynavox.” https://www.tobiidynavox.com/software/content/sono-flex-for-communicator-5/. Accessed 7 Dec 2018
TippyTalk - Comunicação Instantânea para Pessoas Não Verbais. (n.d.). http://www.tippy-talk.com/. Accessed 16 Jan 2019. (in Portuguese)
Ferreira, V.: Utilização das tecnologias em crianças com perturbações do espectro autista em contexto da Prática de Ensino Supervisionada, Universidade Católica Portuguesa, Centro Regional de Braga, Faculdade de Ciências Sociais, Braga (2013). (in Portuguese)
Ekman, P., Rosenberg, E.L.: What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS). Oxford University Press, Oxford (2005)
Darwin, C.: The Expression of Emotions in Man and Animals. D. Appleton and Company, New York (1897)
Baltrušaitis, T., Mahmoud, M., Robinson, P.: Cross-dataset learning and person-specific normalisation for automatic action unit detection. In: Facial Expression Recognition and Analysis Challenge. In: IEEE International Conference on Automatic Face and Gesture Recognition (2015)
Fuse -> Adobe. Fuse (Beta). Accessed 30 April 2019. https://www.adobe.com/products/fuse/features.html
Mixamo -> Adobe. Mixamo. Accessed 30 April 2019. https://www.mixamo.com/
Acknowledgments
This work has been supported by COMPETE: POCI-01-0145-FEDER-007043 and FCT – Fundação para a Ciência e Tecnologia within the Project Scope: UID/CEC/00319/2019. Vinicius Silva also thanks FCT for the PhD scholarship SFRH/BD/SFRH/BD/133314/2017.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Santos, P., Silva, V., Soares, F., Simões, A. (2019). Facial Virtual Tracking: A System to Mirror Emotions. In: Moura Oliveira, P., Novais, P., Reis, L. (eds) Progress in Artificial Intelligence. EPIA 2019. Lecture Notes in Computer Science(), vol 11805. Springer, Cham. https://doi.org/10.1007/978-3-030-30244-3_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-30244-3_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-30243-6
Online ISBN: 978-3-030-30244-3
eBook Packages: Computer ScienceComputer Science (R0)