Skip to main content
SpringerLink
Log in

Behavioral overlays for non-verbal communication expression on a humanoid robot

  • Published:
Autonomous Robots Aims and scope Submit manuscript

Abstract

This research details the application of non-verbal communication display behaviors to an autonomous humanoid robot, including the use of proxemics, which to date has been seldom explored in the field of human-robot interaction. In order to allow the robot to communicate information non-verbally while simultaneously fulfilling its existing instrumental behavior, a “behavioral overlay” model that encodes this data onto the robot's pre-existing motor expression is developed and presented. The state of the robot's system of internal emotions and motivational drives is used as the principal data source for non-verbal expression, but in order for the robot to display this information in a natural and nuanced fashion, an additional para-emotional framework has been developed to support the individuality of the robot's interpersonal relationships with humans and of the robot itself. An implementation on the Sony QRIO is described which overlays QRIO's existing EGO architecture and situated schema-based behaviors with a mechanism for communicating this framework through modalities that encompass posture, gesture and the management of interpersonal distance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  • Althaus, P., Ishiguro, H., Kanda, T., Miyashita, T., and Christensen, H.I. 2004. Navigation for human-robot interaction tasks. In Proc. International Conference on Robotics and Automation, vol. 2, pp. 1894–1900.

  • Aoyama, K. and Shimomura, H. 2005. Real world speech interaction with a humanoid robot on a layered robot behavior control architecture. In Proc. International Conference on Robotics and Automation.

  • Bailenson, J.N., Blascovich, J., Beall, A.C., and Loomis, J.M. 2003. Interpersonal distance in immersive virtual environments. Personality and Social Psychology Bulletin, 29:819–833.

    Google Scholar 

  • Beskow, J. and McGlashan, S. 1997, OLGA—a conversational agent with gestures. In Proc. IJCAI-97 Workshop on Animated Interface Agents: Making Them Intelligent.

  • Bethel, C.L. and Murphy, R.R. 2006. Affective expression in appearance-constrained robots. In Proceedings of the 2006 ACM Conference on Human-Robot Interaction (HRI 2006), Salt Lake City, Utah, pp. 327–328.

  • Blankenship, V., Hnat, S.M., Hess, T.G., and Brown, D.R. 2004. Reciprocal interaction and similarity of personality attributes. Journal of Social and Personal Relationships, 1:415–432.

    Google Scholar 

  • Bowlby, J. 1969. Attachment & Loss Volume 1: Attachment. Basic Books.

  • Breazeal, C. 2000, Sociable Machines: Expressive Social Exchange Between Humans and Robots. PhD thesis, Massachusetts Institute of Technology.

  • Breazeal, C. 2003. Towards sociable robots. Robotics and Autonomous Systems, 42(3–4):167–175.

  • Breazeal, C., Brooks, A.G., Gray, J., Hoffman, G., Kidd, C., Lee, H., Lieberman, J., Lockerd, A., and Chilongo, D. 2004. Tutelage and collaboration for humanoid robots. International Journal of Humanoid Robots, 1(2):315–348.

    Google Scholar 

  • Brooks, A.G., Berlin, M., Gray, J., and Breazeal, C. 2005. Untethered robotic play for repetitive physical tasks. In Proc. ACM International Conference on Advances in Computer Entertainment, Valencia, Spain.

  • Byrne, D. and Griffit, W. 1969. Similarity and awareness of similarity of personality characteristic determinants of attraction. Journal of Experimental Research in Personality, 3:179–186.

    Google Scholar 

  • Cassell, J. and Vilhjalmsson, H. 1999. Fully embodied conversational avatars: Making communicative behaviors autonomous. Autonomous Agents and Multiagent Systems, 2:45–64.

    Google Scholar 

  • Chi, D., Costa, M., Zhao, L., and Badler, N. 2000. The EMOTE model for effort and shape. In Proc. 27th Annual Conf. on Computer Graphics and Interactive Techniques (SIGGRAPH '00), pp. 173–182.

  • Christensen, H.I. and Pacchierotti, E. 2005. Embodied social interaction for robots. In Dautenhahn, K. (ed.), Proceedings of the 2005 Convention of the Society for the Study of Artificial Intelligence and Simulation of Behaviour (AISB-05), Hertsfordshire, pp. 40–45.

  • Davies, M. and Stone, T. 1995. Mental Simulation. Blackwell Publishers, Oxford, UK.

  • Dittmann, A. 1978. The role of body movement in communication. Nonverbal Behavior and Communication, Lawrence Erlbaum Associates, Hillsdale.

  • Ekman, P. and Davidson, R.J. 1994. The Nature of Emotion. Oxford University Press.

  • Fong, T., Nourbakhsh, I., and Dautenhahn, K. 2003. A survey of socially interactive robots. Robotics and Autonomous Systems, 42:143–166.

    Google Scholar 

  • Fridlund, A. 1994. Human Facial Expression: An Evolutionary View. Academic Press, San Diego, CA.

  • Fujita, M., Kuroki, Y., Ishida, T., and Doi, T. 2003. Autonomous behavior control architecture of entertainment humanoid robot sdr-4x. In Proc. International Conference on Intelligent Robots and Systems, Las Vegas, NV, pp. 960–967.

  • Giese, M.A. and Poggio, T. 2000. Morphable models for the analysis and synthesis of complex motion pattern. International Journal of Computer Vision, 38(1):59–73.

    Google Scholar 

  • Gordon, R. 1986. Folk psychology as simulation. Mind and Language, 1:158–171.

  • Guye-Vuilleme, A., Capin, T.K., Pandzic, I.S., Thalmann, N.M., and Thalmann, D. 1998. Nonverbal communication interface for collaborative virtual environments. In Proc. Collaborative Virtual Environments (CVE 98), pp. 105–112.

  • Hall, E.T. 1966. The Hidden Dimension. Doubleday, Garden City, NY.

  • Hara, F., Akazawa, H., and Kobayashi, H. 2001. Realistic facial expressions by sma driven face robot. In Proceedings of IEEE International Workshop on Robot and Human Interactive Communication, pp. 504–510.

  • Heal, J. 2003. Understanding Other Minds from the Inside. Cambridge University Press, Cambridge, UK, pp. 28–44.

  • Jordan, P.W. 2000. Designing Pleasurable Products: An Introduction to the New Human Factors. Taylor & Francis Books Ltd., UK.

  • Kanda, T., Hirano, T., Eaton, D., and Ishiguro, H. 2004. Interactive robots as social partners and peer tutors for children. Human-Computer Interaction, 19:61–84.

    Google Scholar 

  • Kiesler, D.J. 1983. The 1982 interpersonal circle: A taxonomy for complementarity in human transactions. Psychological Review, 90:185–214.

    Google Scholar 

  • Knapp, M. 1972. Nonverbal Communication in Human Interaction. Reinhart and Winston, Inc., New York.

  • Kopp, S. and Wachsmuth, I. 2000. A knowledge-based approach for lifelike gesture animation. Proc. ECAI-2000.

  • Kopp, S. and Wachsmuth, I. 2002. Model-based animation of coverbal gesture. Proc. Computer Animation.

  • Likhachev, M. and Arkin, R.C. 2000. Robotic comfort zones. In Proceedings of SPIE: Sensor Fusion and Decentralized Control in Robotic Systems III Conference, Vol. 4196, pp. 27–41.

  • Machotka, P. and Spiegel, J. 1982. The Articulate Body. Irvington.

  • McCrae, R.R. and Costa, P.T. 1996. Toward a new generation of personality theories: Theoretical contexts for the five-factor model. In Wiggins, J.S. (ed.), Five-Factor Model of Personality. Guilford, New York, pp. 51–87.

  • Nakauchi, Y. and Simmons, R. 2000. A social robot that stands in line. In Proc. International Conference on Intelligent Robots and Systems, Vol. 1, pp. 357–364.

  • Nass, C. and Lee, K.M. 2001. Does computer-generated speech manifest personality? experimental test of recognition, similarity-attraction, and consistence-attraction. Journal of Experimental Psychology, Applied, 7(3):171–181.

    Google Scholar 

  • Orford, J. 1986. The rules of interpersonal complementarity: Does hostility beget hostility and dominance, submission? Psychological Review, 93:365–377.

    Google Scholar 

  • Pacchierotti, E., Christensen, H.I., and Jensfelt, P. 2005. Human-robot embodied interaction in hallway settings: A pilot user study. In Proceedings of the 2005 IEEE International Workshop on Robots and Human Interactive Communication, pp. 164–171.

  • Peters, R.A. II, Campbell, C.C., Bluethmann, W.J., and Huber, E. 2003. Robonaut task learning through teleoperation. In Proc. International Conference on Robotics and Automation, Taipei, Taiwan, pp. 2806–2811.

  • Reeves, B. and Nass, C. 1996. The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. Cambridge University Press, Cambridge, England.

  • Rose, C., Cohen, M. and Bodenheimer, B. 1998. Verbs and adverbs: Multidimensional motion interpolation. IEEE Computer Graphics and Applications, 18(5):32–40.

    Google Scholar 

  • Sawada, T., Takagi, T., Hoshino, Y., and Fujita, M. 2004. Learning behavior selection through interaction based on emotionally grounded symbol concept. In Proc. IEEE-RAS/RSJ Int'l Conf. on Humanoid Robots (Humanoids 04).

  • Smith, C. 2005. Behavior Adaptation for a Socially Interactive Robot. Master's thesis, KTH Royal Institute of Technology, Stockholm, Sweden.

  • te Boekhorst, R., Walters, M., Koay, K.L., Dautenhahn, K., and Nehaniv, C. 2005. A study of a single robot interacting with groups of children in a rotation game scenario. In Proc. 6th IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA 2005), Espoo, Finland.

  • Thorisson, K.R. 1996. Communicative Humanoids: A Computational Model of Psychosocial Dialogue Skills. PhD thesis, MIT Media Laboratory, Cambridge, MA.

  • Walters, M.L., Dautenhahn, K., Koay, K.L., Kaouri, C., te Boekhorst, R., Nehaniv, C.L., Werry, I., and Lee, D. 2005a. Close encounters: Spatial distances between people and a robot of mechanistic appearance. In Proceedings of the 5th {IEEE-RAS International Conference on Humanoid Robots (Humanoids 05), Tsukuba, Japan, pp. 450–455.

  • Walters, M.L., Dautenhahn, K., te Boekhorst, R., Koay, K.L., Kaouri, C., Woods, S., Nehaniv, C.L., Lee, D., and Werry, I. 2005b. The influence of subjects’ personality traits on personal spatial zones in a human-robot interaction experiment. In Proceedings of IEEE Ro-Man 2005, 14th Annual Workshop on Robot and Human Interactive Communication, IEEE Press, Nashville, Tennessee, pp. 347–352.

  • Weitz, S. 1974. Nonverbal Communication: Readings With Commentary, Oxford University Press.

  • Yamasaki, N. and Anzai, Y. 1996. Active interface for human-robot interaction. In Proc. International Conference on Robotics and Automation, pp. 3103–3109.

  • Yan, C., Peng, W., Lee, K.M., and Jin, S. 2004. Can robots have personality? an empirical study of personality manifestation, social responses, and social presence in human-robot interaction. In 54th Annual Conference of the International Communication Association.

  • Zecca, M., Roccella, S., Carrozza, M.C., Cappiello, G., Cabibihan, J.-J., Dario, P., Takanobu, H., Matsumoto, M., Miwa, H., Itoh, K., and Takanishi, A. 2004. On the development of the emotion expression humanoid robot WE-4RII with RCH-1. In Proc. IEEE-RAS/RSJ Int'l Conf. on Humanoid Robots (Humanoids '04), Los Angeles, California.

Download references

Acknowledgments

The work described in this document was performed at Sony Intelligence Dynamics Laboratories (SIDL) during a summer research internship program. The authors wish to gratefully acknowledge the generous support and assistance provided by Yukiko Hoshino, Kuniaki Noda, Kazumi Aoyama, Hideki Shimomura, the rest of the staff and management of SIDL, and the other summer internship students, in the realization of this research.

Author information

Authors and Affiliations

  1. Robotic Life Group, MIT Media Laboratory, 77 Massachusetts Avenue, Cambridge, MA, USA

    Andrew G. Brooks

  2. Mobile Robot Laboratory and GVU Center, College of Computing, Georgia Institute of Technology, Atlanta, GA, USA

    Ronald C. Arkin

Authors
  1. Andrew G. Brooks
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ronald C. Arkin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andrew G. Brooks.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Brooks, A.G., Arkin, R.C. Behavioral overlays for non-verbal communication expression on a humanoid robot. Auton Robot 22, 55–74 (2007). https://doi.org/10.1007/s10514-006-9005-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10514-006-9005-8

Keywords

Search

Navigation