, Volume 1, Issue 3, pp 169–178 | Cite as

FaceBots: Steps towards enhanced long-term human-robot interaction by utilizing and publishing online social information

  • Nikolaos MavridisEmail author
  • Michael Petychakis
  • Alexandros Tsamakos
  • Panos Toulis
  • Shervin Emami
  • Wajahat Kazmi
  • Chandan Datta
  • Chiraz BenAbdelkader
  • Andry Tanoto
Research Article


The overarching goal of the FaceBots project is to support the achievement of sustainable long-term human-robot relationships through the creation of robots with face recognition and natural language capabilities, which exploit and publish online information, and especially social information available on Facebook, and which achieve two significant novelties. The underlying experimental hypothesis is that such relationships can be significantly enhanced if the human and the robot are gradually creating a pool of episodic memories that they can co-refer to (“shared memories”), and if they are both embedded in a social web of other humans and robots they mutually know (“shared friends”). We present a description of system architecture, as well as important concrete results regarding face recognition and transferability of training, with training and testing sets coming from either one or a combination of two sources: an onboard camera which can provide sequences of images, as well as facebook-derived photos. Furthermore, early interaction-related results are presented, and evaluation methodologies as well as interesting extensions are discussed.


Human-Robot Interaction social networks conversational robots face recognition long-term HRI 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    N. Mitsunaga, T. Miyashita, H. Ishiguro, K. Kogure, and N. Hagita, Robovie-IV: A Communication Robot Interacting with People Daily in an Office, In Proceedings of IROS 2006, p. 5066–5072.Google Scholar
  2. [2]
    C.D. Kidd, C. Breazeal, Robots at home: Understanding longterm human-robot interaction, In proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 22–26 Sept. 2008, pp 3230–3235.Google Scholar
  3. [3]
    J. Sung, H.I. Christensen, and R.E. Grinter, Robots in the Wild: Understanding Long-Term Use. In Proceedings of the 4th ACM/IEEE international conference on Human robot interaction (HRI’ 09). San Jose, USA, 2009.Google Scholar
  4. [4]
    C. Breazeal, Emotion and sociable humanoid robots, International Journal of Human-Computer Studies, Volume 59,Issues 1–2, Applications of Affective Computing in Human-Computer Interaction, July 2003, Pages 119–155, ISSN 1071-5819, DOI: 10.1016/S1071-5819(03)00018-1.CrossRefGoogle Scholar
  5. [5]
    A.G. Brooks, J. Gray, G. Hoffman, A. Lockerd, H. Lee, and C. Breazeal, Robot’s play: interactive games with sociable machines. Computer Entertainment. 2,3 (Jul. 2004), 10–10.CrossRefGoogle Scholar
  6. [6]
    M.A. Salichs, R. Barber, A.M. Khamis, M. Malfaz, J.F. Gorostiza, R. Pacheco; R. Rivas, A. Corrales, E. Delgado. Maggie: A Robotic Platform for Human-Robot Social Interaction. IEEE International Conference on Robotics, Automation and Mechatronics (RAM 2006). Bangkok. Thailand. Jun, 2006.Google Scholar
  7. [7]
    H. Ishiguro, T. Ono, M. Imai, T. Maeda, T. Kanda, R. Nakatsu, Robovie: an interactive humanoid robot. Industrial Robot: An International Journal, Volume 28, Number 6, 2001, pp. 498–504(7)CrossRefGoogle Scholar
  8. [8]
    H. Okuno, K. Nakadai, and H. Kitano, Social Interaction of Humanoid RobotBased on Audio-Visual Tracking, In Proceedings of the International Conference on Industrial, Engineering & Other Applications of Applied Intelligent Systems IEA/AIE 2002, p.140–173.Google Scholar
  9. [9]
    N. Mavridis, Grounded Situation Models for Situated Conversational Assistants, PhD thesis, Massachusetts Institute of Technology, available online at MIT DSpace Collections Archive at and at
  10. [10]
    M. Bennewitz, F. Faber, J. Dominik, M. Schreiber, and S. Behnke, Multimodal Conversation between a Humanoid Robot and Multiple Persons. In Proc. MCHI ws at AAAI05.Google Scholar
  11. [11]
    T. Kanda, T. Hirano, D. Eaton, H. Ishiguro, Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial. In Human-Computer Interaction, 19(1–2):61–84.Google Scholar
  12. [12]
    T. Kanda, R. Sato, N. Saiwaki, and H. Ishiguro, A Two-Month Field Trial in an Elementary School for Long-Term Human-Robot Interaction, IEEE Transactions on Robotics, 23,5 (2007), pp. 962–971CrossRefGoogle Scholar
  13. [13]
    L. Ahn, R. Liu, M. Blum, Peekaboom: A Game for Locating Objects in Images. In ACM Conference on Human Factors in Computing Systems CHI 2006. p. 55–64.Google Scholar
  14. [14]
    European Union RoboEarth project website, available online at:
  15. [15]
    Pioneer 3 / PeopleBot Human-Robot Interaction Robot Operations Manual, ActivMedia Robotics, 44 Concord St., Peterborough NH, 03458Google Scholar
  16. [16]
    Point Grey Research, Inc., Vancouver, Canada, provider of pan-tilt-zoom camera motorization base units, web site available online at:
  17. [17]
    Directed Perception, Inc., 890C Cowan Road, Burlingame, CA 94010, provider of BumbleBee stereo cameras, web site available online at:
  18. [18]
    The Internet Communications Engine, ZeroC Inc., web site available online at:
  19. [19]
    P. Viola and M. Jones. Robust real-time object detection. International Journal of Computer Vision, 57(2):137–154, 2004.CrossRefGoogle Scholar
  20. [20]
    D. Bolme, R. Beveridge, M. Teixeira and B. Draper (2003) The CSU Face Identification Evaluation System: Its Purpose, Features and Structure, International Conference on Vision Systems, pp 304–311, Graz, Austria, April 1–3.Google Scholar
  21. [21]
    A.V. Nefian and M.H. Hayes, Hidden markov models for face detection and recognition, in Proceedings of the International Conference on Image Processing, 1998.Google Scholar
  22. [22]
    W. Walker, P. Lamere, P. Kwok, B. Raj, R. Singh, E. Gouvea, P. Wolf, and J. Woelfel. Sphinx-4: A flexible open source framework for speech recognition. Technical Report TR-2004-139, Sun Microsystems Laboratories, 2004.Google Scholar
  23. [23]
    ActivMedia Robotics, Aria library reference manual, Technical Report (1.1.10), 2002.Google Scholar
  24. [24]
    N. Mavridis, and D. Hanson, The IbnSina Center: An Augmented Reality Theater with Intelligent Robotic and Virtual Characters, in Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication Ro-MAN 2009, Toyama, Japan.Google Scholar
  25. [25]
    N. Mavridis, A. Dhaheri, L. Dhaheri, M. Khanji, N. Darmaki, Transforming IbnSina into an Advanced Multilingual Interactive Android Robot, in Proceedings of the IEEE GCC Conference, 2011.Google Scholar
  26. [26]
    N. Mavridis, E. Machado, et al., Real-time Teleoperation of an Industrial Robotic Arm Through Human Arm Movement Imitation, in Proceedings of the International Symposium on Robotics and Intelligent Sensors (IRIS), 2010, Nagoya, Japan.Google Scholar
  27. [27]
    C. Christoforou, N. Mavridis, et al., Android tele-operation through Brain-Computer Interfacing: A real-world demo with non-expert users, in Proceedings of the International Symposium on Robotics and Intelligent Sensors (IRIS), 2010, Nagoya, Japan.Google Scholar
  28. [28]
    N. Mavridis, W. Kazmi, and P. Toulis, Friends with Faces: How Social Networks Can Enhance Face Recognition and Vice Versa, in Book “Computational Social Networks Analysis: Trends, Tools and Research Advances”, Springer Verlag, 2009.Google Scholar
  29. [29]
    Touchgraph Limited Liability Company, web site available online at:
  30. [30]
    N. Mavridis, “Robot Friends: Artificial Agents entering Human Social Networks”, in Book “The Networked Self: Identity, Community and Culture on Social Network Sites”, Routledge, New York, 2010.Google Scholar

Copyright information

© © Versita Warsaw and Springer-Verlag Wien 2010

Authors and Affiliations

  • Nikolaos Mavridis
    • 1
    Email author
  • Michael Petychakis
    • 1
  • Alexandros Tsamakos
    • 1
  • Panos Toulis
    • 1
  • Shervin Emami
    • 1
  • Wajahat Kazmi
    • 1
  • Chandan Datta
    • 1
  • Chiraz BenAbdelkader
    • 1
  • Andry Tanoto
    • 1
  1. 1.Interactive Robots and Media LabUnited Arab Emirates UniversityAl AinUAE

Personalised recommendations