Using the Interaction Rhythm as a Natural Reinforcement Signal for Social Robots: A Matter of Belief
In this paper, we present the results of a pilot study of a human robot interaction experiment where the rhythm of the interaction is used as a reinforcement signal to learn sensorimotor associations. The algorithm uses breaks and variations in the rhythm at which the human is producing actions. The concept is based on the hypothesis that a constant rhythm is an intrinsic property of a positive interaction whereas a break reflects a negative event. Subjects from various backgrounds interacted with a NAO robot where they had to teach the robot to mirror their actions by learning the correct sensorimotor associations. The results show that in order for the rhythm to be a useful reinforcement signal, the subjects have to be convinced that the robot is an agent with which they can act naturally, using their voice and facial expressions as cues to help it understand the correct behaviour to learn. When the subjects do behave naturally, the rhythm and its variations truly reflects how well the interaction is going and helps the robot learn efficiently. These results mean that non-expert users can interact naturally and fruitfully with an autonomous robot if the interaction is believed to be natural, without any technical knowledge of the cognitive capacities of the robot.
KeywordsFacial Expression Autonomous Robot Reinforcement Signal Social Robot Human Partner
Unable to display preview. Download preview PDF.
- 2.Oudeyer, P.-Y., Kaplan, F., Hafner, V.: Intrinsic motivation systems for autonomous mental development. IEEE Transactions on Evolutionary Computation 2(11) (2007)Google Scholar
- 3.Bowlby, J.: Attachment and loss. Attachment, vol. 1. Basics Books, New York (1969)Google Scholar
- 5.Tronick, E.: The neurobehavioral and social-emotional development of infants and children. WW Norton and Company, New York (2007)Google Scholar
- 7.Nadel, J., Prepin, K., Okanda, M.: Experiencing contigency and agency: first step toward self-understanding. Interaction Studies 2, 447–462 (2005)Google Scholar
- 8.Hiolle, A., Cañamero, L.: Why should you care? an arousal-based model of exploratory behavior for autonomous robots. In: Bullock, S., Noble, J., Watson, R., Bedau, M.A. (eds.) Artificial Life XI: Proceedings of the Eleventh International Conference on the Simulation and Synthesis of Living Systems, pp. 242–248. MIT Press, Cambridge (2008)Google Scholar
- 9.Hiolle, A., Cañamero, L.: Developing sensorimotor associations through attachment bonds. In: Prince, C., Balkenius, C., Berthouze, L., Kozima, H., Littman, M. (eds.) Proc. 7th Intl. Wksp. on Epigenetic Robotics, pp. 45–52. Lund University Cognitive Studies (2007)Google Scholar
- 10.Hiolle, A., Bard, A.,, K., Cañamero, L.: Assessing human responses to different robot attachment profiles. In: Proceedings of the 18th International Symposium on Robot and Human Interactive Communication, pp. 251–257 (2009)Google Scholar
- 12.Andry, P., Garnault, N., Gaussier, P.: Using the interaction rhythm to build an internal reinforcement signal: a tool for intuitive hri. In: Prince, C., Balkenius, C., Berthouze, L., Kozima, H., Littman, M. (eds.) Proceedings of the Ninth Int. Conf. on Epigenetic Robotics, Lund University Cognitive Studies (2009)Google Scholar