Abstract
This research explores interactive games using hand and face tracking with a robot as a tool for autism therapy. The robot is equipped with a head and two arms, each with two degrees of freedom, and a camera. We trained a classifier to detect human hands and subsequently, used this classifier along with a standard face tracker to create two interactive games. In the first game the robot waits for the child to initiate an interaction by raising one or both hands. In the second game, the robot initiates interactions. These games are designed to increase attention, promote turn-taking skills and encourage child-led verbal and non-verbal communication through simple imitative play. This research makes two specific contributions: (1) We present a low-cost robot design which measures and adapts to a child’s actions during interactive games and, (2) we train and test a hand detector, based on Haar-like features, which is usable in various kinds of human-robot interactions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Barczak, A.L.C., Dadgostar, F.: Real-time hand tracking using a set of co-operative classifiers based on haar-like features. Res. Lett. Inf. Math. Sci. 7, 29–42 (2005)
Bradski, G.: The OpenCV Library. Dr. Dobb’s Journal of Software Tools, 120–126 (November 2000)
Bradski, G.R.: Computer vision face tracking for use in a perceptual user interface. Intel Technology Journal (1998)
Dautenhahn, K.: Robots as social actors: Aurora and the case of autism. In: Proc. Cognitive Technology Conference, pp. 359–374 (1999)
Dautenhahn, K., Werry, I.: Issues of robot-human interaction dynamics in the rehabilitation of children with autism. In: Proc. International Conference on the Simulation of Adaptive Behavior, pp. 519–528 (2000)
Duquette, A., Mercier, H., Michaud, F.: Investigating the use of a mobile robotic toy as an imitation agent for children with autism. In: International Conference on Epigenetic Robotics (2006)
Ferrari, E., Robins, B., Dautenhahn, K.: Therapeutic and educational objectives in robot assisted play for children with autism. In: Proc. IEEE International Symposium on Robot and Human Interactive Communication (2009)
Kozima, H., Nakagawa, C., Yasuda, Y.: Children-robot interaction: a pilot study in autism therapy. Progress in Brain Research 164, 385–400 (2007)
Lienhart, R., Maydt, J.: An extended set of Haar-like features for rapid object detection. In: Proc. IEEE International Conference on Image Processing, pp. 900–903 (2002)
Marti, P., Pollini, A., Rullo, A., Shibata, T.: Engaging with artificial pets. In: Proc. Conference on European Association of Cognitive Ergonomics, pp. 99–106 (2005)
Buehler, P., Everingham, M., Huttenlocher, D., Zisserman, A.: Long term arm and hand tracking for continuous sign language tv broadcasts. In: British Machine Vision Conference (2008)
Patrizia, M., Claudio, M., Leonardo, G., Alessandro, P.: A robotic toy for children with special needs: from requirements to design. In: Proc. IEEE International Conference on Rehabilitation Robotics, pp. 918–923 (2009)
Pierno, A.C., Maria, M., Lusher, D., Castiello, U.: Robotic movement elicits visuomotor priming in children with autism. Neuropsychologia 46, 448–454 (2008)
Robins, B., Dautenhahn, K., Boekhorst, R., Billard, A.: Robots as assistive technology - does appearance matter? In: Proc. IEEE International Workshop on Robot and Human Interactive Communication, pp. 277–282 (2004)
Robins, B., Dautenhahn, K., Dickerson, P.: From isolation to communication: a case study evaluation of robot assisted play for children with autism with a minimally expressive humanoid robot. In: Proc. International Conference on Advances in Computer-Human Interactions (2009)
Schapire, R.E.: The boosting approach to machine learning: An overview. In: Denison, D.D., Hansen, M.H., Holmes, C., Mallick, B., Yu, B. (eds.) Nonlinear Estimation and Classification. Springer, Heidelberg (2003)
Tapus, A., Tapus, C., Matarić, M.J.: User-robot personality matching and assistive robot behavior adaptation for post-stroke rehabilitation therapy. Intelligent Service Robotics Journal, 169–183 (April 2008)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition., vol. 1, pp. 511–518 (2001)
Viola, P., Jones, M.: Robust real-time face detection. International Journal of Computer Vision 57(2), 137–154 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Boccanfuso, L., O’Kane, J.M. (2010). Adaptive Robot Design with Hand and Face Tracking for Use in Autism Therapy. In: Ge, S.S., Li, H., Cabibihan, JJ., Tan, Y.K. (eds) Social Robotics. ICSR 2010. Lecture Notes in Computer Science(), vol 6414. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17248-9_28
Download citation
DOI: https://doi.org/10.1007/978-3-642-17248-9_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17247-2
Online ISBN: 978-3-642-17248-9
eBook Packages: Computer ScienceComputer Science (R0)