Abstract
The overarching goal of the FaceBots project is to support the achievement of sustainable long-term human-robot relationships through the creation of robots with face recognition and natural language capabilities, which exploit and publish online information, and especially social information available on Facebook, and which achieve two significant novelties. The underlying experimental hypothesis is that such relationships can be significantly enhanced if the human and the robot are gradually creating a pool of episodic memories that they can co-refer to (“shared memories”), and if they are both embedded in a social web of other humans and robots they mutually know (“shared friends”). We present a description of system architecture, as well as important concrete results regarding face recognition and transferability of training, with training and testing sets coming from either one or a combination of two sources: an onboard camera which can provide sequences of images, as well as facebook-derived photos. Furthermore, early interaction-related results are presented, and evaluation methodologies as well as interesting extensions are discussed.
References
[1] N. Mitsunaga, T. Miyashita, H. Ishiguro, K. Kogure, and N. Hagita, Robovie-IV: A Communication Robot Interacting with People Daily in an Office, In Proceedings of IROS 2006, p. 5066-5072.10.1109/IROS.2006.282594Search in Google Scholar
[2] C.D. Kidd, C. Breazeal, Robots at home: Understanding long-term human-robot interaction, In proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 22-26 Sept. 2008, pp 3230-3235.10.1109/IROS.2008.4651113Search in Google Scholar
[3] J. Sung, H.I. Christensen, and R.E. Grinter, Robots in the Wild: Understanding Long-Term Use. In Proceedings of the 4th ACM/IEEE international conference on Human robot interaction (HRI '09). San Jose, USA, 2009.10.1145/1514095.1514106Search in Google Scholar
[4] C. Breazeal, Emotion and sociable humanoid robots, International Journal of Human-Computer Studies, Volume 59, Issues 1-2, Applications of Affective Computing in Human-Computer Interaction, July 2003, Pages 119-155, ISSN 1071-5819, DOI: 10.1016/S1071-5819(03)00018-1.10.1016/S1071-5819(03)00018-1Search in Google Scholar
[5] A.G. Brooks, J. Gray, G. Hoffman, A. Lockerd, H. Lee, and C. Breazeal, Robot's play: interactive games with sociable machines. Computer Entertainment. 2, 3 (Jul. 2004), 10-10.Search in Google Scholar
[6] M.A. Salichs, R. Barber, A.M. Khamis, M. Malfaz, J.F. Gorostiza, R. Pacheco; R. Rivas, A. Corrales, E. Delgado. Maggie: A Robotic Platform for Human-Robot Social Interaction. IEEE International Conference on Robotics, Automation and Mechatronics (RAM 2006). Bangkok. Thailand. Jun, 2006.10.1109/RAMECH.2006.252754Search in Google Scholar
[7] H. Ishiguro, T. Ono, M. Imai, T. Maeda, T. Kanda, R. Nakatsu, Robovie: an interactive humanoid robot. Industrial Robot: An International Journal, Volume 28, Number 6, 2001, pp. 498-504(7)Search in Google Scholar
[8] H. Okuno, K. Nakadai, and H. Kitano, Social Interaction of Humanoid RobotBased on Audio-Visual Tracking, In Proceedings of the International Conference on Industrial, Engineering & Other Applications of Applied Intelligent Systems IEA/AIE 2002, p.140-173.10.1007/3-540-48035-8_70Search in Google Scholar
[9] N. Mavridis, Grounded Situation Models for Situated Conversational Assistants, PhD thesis, Massachusetts Institute of Technology, available online at MIT DSpace Collections Archive at http://hdl.handle.net/1721.1/38523 and at http://www.drnikolaos-mavridis.comSearch in Google Scholar
[10] M. Bennewitz, F. Faber, J. Dominik, M. Schreiber, and S. Behnke, Multimodal Conversation between a Humanoid Robot and Multiple Persons. In Proc. MCHI ws at AAAI05.Search in Google Scholar
[11] T. Kanda, T. Hirano, D. Eaton, H. Ishiguro, Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial. In Human-Computer Interaction, 19(1&2):61-84.10.1207/s15327051hci1901&2_4Search in Google Scholar
[12] T. Kanda, R. Sato, N. Saiwaki, H. and Ishiguro, A Two-Month Field Trial in an Elementary School for Long-Term Human-Robot Interaction, IEEE Transactions on Robotics, 23, 5 (2007), pp. 962-971Search in Google Scholar
[13] L. Ahn, R. Liu, M. Blum, Peekaboom: A Game for Locating Objects in Images. In ACM Conference on Human Factors in Computing Systems CHI 2006. p. 55-64.Search in Google Scholar
[14] European Union RoboEarth project website, available online at : http://www.roboearth.orgSearch in Google Scholar
[15] Pioneer 3 / PeopleBot Human-Robot Interaction Robot Operations Manual, ActivMedia Robotics, 44 Concord St., Peterborough NH, 03458Search in Google Scholar
[16] Point Grey Research, Inc., Vancouver, Canada, provider of pan-tilt-zoom camera motorization base units, web site available online at: http://www.ptgrey.comSearch in Google Scholar
[17] Directed Perception, Inc., 890C Cowan Road, Burlingame, CA 94010, provider of BumbleBee stereo cameras, web site available online at: http://www.dperception.comSearch in Google Scholar
[18] The Internet Communications Engine, ZeroC Inc., web site available online at: http://www.zeroc.com/ice.htmlSearch in Google Scholar
[19] P. Viola and M. Jones. Robust real-time object detection. International Journal of Computer Vision, 57(2):137-154, 2004.10.1023/B:VISI.0000013087.49260.fbSearch in Google Scholar
[20] D. Bolme, R. Beveridge, M. Teixeira and B. Draper (2003) The CSU Face Identification Evaluation System: Its Purpose, Features and Structure, International Conference on Vision Systems, pp 304-311, Graz, Austria, April 1-3.10.1007/3-540-36592-3_29Search in Google Scholar
[21] A.V. Nefian and M.H. Hayes, Hidden markov models for face detection and recognition, in Proceedings of the International Conference on Image Processing, 1998.Search in Google Scholar
[22] W. Walker, P. Lamere, P. Kwok, B. Raj, R. Singh, E. Gouvea, P. Wolf, and J. Woelfel. Sphinx-4: A flexible open source framework for speech recognition. Technical Report TR-2004-139, Sun Microsystems Laboratories, 2004.Search in Google Scholar
[23] ActivMedia Robotics, Aria library reference manual, Technical Report (1.1.10), 2002.Search in Google Scholar
[24] N. Mavridis, and D. Hanson, The IbnSina Center: An Augmented Reality Theater with Intelligent Robotic and Virtual Characters, in Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication Ro-MAN 2009, Toyama, Japan.10.1109/ROMAN.2009.5326148Search in Google Scholar
[25] N. Mavridis, A. Dhaheri, L. Dhaheri, M. Khanji, N. Darmaki, Transforming IbnSina into an Advanced Multilingual Interactive Android Robot, in Proceedings of the IEEE GCC Conference, 2011.10.1109/IEEEGCC.2011.5752467Search in Google Scholar
[26] N. Mavridis, E. Machado, et al., Real-time Teleoperation of an Industrial Robotic Arm Through Human Arm Movement Imitation, in Proceedings of the International Symposium on Robotics and Intelligent Sensors (IRIS), 2010, Nagoya, Japan.Search in Google Scholar
[27] C. Christoforou, N. Mavridis, et al., Android tele-operation through Brain-Computer Interfacing: A real-world demo with non-expert users, in Proceedings of the International Symposium on Robotics and Intelligent Sensors (IRIS), 2010, Nagoya, Japan.Search in Google Scholar
[28] N. Mavridis, W. Kazmi, P. and Toulis, Friends with Faces: How Social Networks Can Enhance Face Recognition and Vice Versa, in Book “Computational Social Networks Analysis: Trends, Tools and Research Advances”, Springer Verlag, 2009.10.1007/978-1-84882-229-0_18Search in Google Scholar
[29] Touchgraph Limited Liability Company, web site available online at : http://www.touchgraph.com/Search in Google Scholar
[30] N. Mavridis, “Robot Friends: Artificial Agents entering Human Social Networks”, in Book “The Networked Self: Identity, Community and Culture on Social Network Sites”, Routledge, New York, 2010.Search in Google Scholar
© Nikolaos Mavridis et al.
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.
