Effects of Different Kinds of Robot Feedback

  • Kerstin Fischer
  • Katrin S. Lohan
  • Chrystopher Nehaniv
  • Hagen Lehmann
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8239)


In this paper, we investigate to what extent tutors’ behavior is influenced by different kinds of robot feedback. In particular, we study the effects of online robot feedback in which the robot responds either contingently to the tutor’s social behavior or by tracking the objects presented. Also, we investigate the impact of the robot’s learning success on tutors’ tutoring strategies. Our results show that only in the condition in which the robot’s behavior is socially contingent, the human tutors adjust their behavior to the robot. In the developmentally equally plausible object-driven condition, in which the robot tracked the objects presented, tutors do not change their behavior significantly, even though in both conditions the robot develops from a prelinguistic stage to producing keywords. Socially contingent robot feedback has thus the potential to influence tutors’ behavior over time. Display of learning outcomes, in contrast, only serves as feedback on robot capabilities when it is coupled with online social feedback.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Wrede, B., Schillingmann, L., Rohlfing, K.J.: Making Use of Multi-Modal Synchrony: A Model of Acoustic Packaging to Tie Words to Actions, ch. 10, pp. 224–240. IGI Global, Hershey (2013)Google Scholar
  2. 2.
    Fernald, A., Weisleder, A.: Early language experience is vital to developing fluency in understanding. In: Neuman, S., Dickinson, D. (eds.) Handbook of Early Literacy Research, vol. 3. Guiltford Publications, New York (2011)Google Scholar
  3. 3.
    Gergely, G., Watson, J.: Early socio-emotional development: Contingency perception and the social-biofeedback model. In: Early Social Cognition: Understanding Others in the First Months of Life, pp. 101–136 (1999)Google Scholar
  4. 4.
    Watson, J.: Contingency perception in early social development. Social Perception in Infants, 157–176 (1985)Google Scholar
  5. 5.
    Csibra, G.: Recognizing communicative intentions in infancy. Mind & Language 25(2), 141–168 (2010)CrossRefGoogle Scholar
  6. 6.
    Nourbakhsh, I., Kunz, C., Willeke, T.: The mobot museum robot installations: A five year experiment. In: Proceedings of the 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems, Las Vegas, Nevada, pp. 3636–3641 (October 2003)Google Scholar
  7. 7.
    Sidner, C., Lee, C., Kidd, C., Lesh, N., Rich, C.: Explorations in engagement for humans and robots. Artificial Intelligence 166(1-2), 140–164 (2005)CrossRefGoogle Scholar
  8. 8.
    Yoshikawa, Y., Shinozawa, K., Ishiguro, H.: Social reflex hypothesis on blinking interaction. In: Proceedings of the 29th Annual Conference of the Cognitive Science Society, pp. 725–730 (2007)Google Scholar
  9. 9.
    Breazeal, C.: Toward sociable robots. Robotics and Autonomous Systems 42(3), 167–175 (2003)CrossRefMATHGoogle Scholar
  10. 10.
    Kose-Bagci, H., Broz, F., Shen, Q., Dautenhahn, K., Nehaniv, C.L.: As time goes by: Representing and reasoning about timing in human-robot interaction studies. In: AAAI Spring Symposium: It’s All in the Timing (2010)Google Scholar
  11. 11.
    Lohan, K.S., Rohlfing, K.J.R., Pitsch, K., Saunders, J., Lehmann, H., Nehaniv, C.L., Fischer, K., Wrede, B.: Tutor spotter: Proposing a feature set and evaluating it in a robotic system. International Journal of Social Robotics 4(2), 131–146 (2012)CrossRefGoogle Scholar
  12. 12.
    Fischer, K., Lohan, K.S., Saunders, J., Nehaniv, C., Wrede, B., Rohlfing, K.: The impact of the contingency of robot feedback on HRI. In: International Conference on Cooperative Technological Systems (CTS 2013), San Diego, May 20-24 (2013)Google Scholar
  13. 13.
    Fischer, K., Saunders, J.: Getting acquainted with a developing robot. In: Salah, A.A., Ruiz-del-Solar, J., Meriçli, Ç., Oudeyer, P.-Y. (eds.) HBU 2012. LNCS, vol. 7559, pp. 125–133. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  14. 14.
    Metta, G., Natale, L., Nori, F., Sandini, G., Vernon, D., Fadiga, L., Von Hofsten, C., Rosander, K., Lopes, M., Santos-Victor, J., et al.: The icub humanoid robot: An open-systems platform for research in cognitive development. Neural Networks 23(8), 1125–1134 (2010)CrossRefGoogle Scholar
  15. 15.
    Lohan, K., Pitsch, K., Rohlfing, K., Fischer, K., Saunders, J., Lehmann, H., Nehaniv, C., Wrede, B.: Contingency allows the robot to spot the tutor and to learn from interaction. In: ICDL-EpiRob 2011 (2011)Google Scholar
  16. 16.
    Matatyaho, D., Gogate, L.: Type of maternal object motion during synchronous naming predicts preverbal infants’ learning of word–object relations. Infancy 13(2), 172–184 (2008)CrossRefGoogle Scholar
  17. 17.
    Gogate, L., Bolzani, L., Betancourt, E.: Attention to maternal multimodal naming by 6-to 8-month-old infants and learning of word–object relations. Infancy 9(3), 259–288 (2006)CrossRefGoogle Scholar
  18. 18.
    de Barbaro, K., Johnson, C.M., Forster, D., Deak, G.O.: Temporal dynamics of multimodal multiparty interactions: A micrognesis of early social interaction. In: Spink, A., et al. (eds.) Proceedings of Measuring Behavior 2010, Eindhoven, The Netherlands, pp. 247–249 (2010)Google Scholar
  19. 19.
    Saunders, J., Nehaniv, C.L., Lyon, C.: Robot learning of lexical semantics from sensorimotor interaction and the unrestricted speech of human tutors. In: Proc. Second International Symposium on New Frontiers in Human-Robot Interaction, AISB Convention, Leicester, UK (2010)Google Scholar
  20. 20.
    Saunders, J., Lehmann, H., Sato, Y., Nehaniv, C.L.: Towards using prosody to scaffold lexical meaning in robots. In: Proceedings of ICDL-EpiRob 2011. IEEE (2011)Google Scholar
  21. 21.
    Fischer, K., Lohan, K., Foth, K.: Levels of embodiment: Linguistic analyses of factors influencing HRI. In: Proceedings of HRI 2012, Boston, Mass., MA (March 2012)Google Scholar
  22. 22.
    Chung, C.K., Pennebaker, J.W.: The psychological function of function words. In: Fiedler, K. (ed.) Social Communication: Frontiers of Social Psychology, pp. 343–359. Psychology Press, New York (2007)Google Scholar
  23. 23.
    Horton, W.S., Gerrig, R.J.: The impact of memory demands on audience design during language production. Cognition 96, 127–142 (2005)CrossRefGoogle Scholar
  24. 24.
    Cross, T.G., Nienhuys, T.G., Kirkman, M.: Parent–child interaction with receptively disabled children: Some determinants of maternal speech style. In: Nelson, K. (ed.) Children’s Language, vol. 5, pp. 247–290. Erlbaum, Hillsdale (1985)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Kerstin Fischer
    • 1
  • Katrin S. Lohan
    • 2
  • Chrystopher Nehaniv
    • 3
  • Hagen Lehmann
    • 3
  1. 1.Department of Design and CommunicationUniversity of Southern DenmarkSonderborgDenmark
  2. 2.iCub FacilityInstituto Italiano di TecnologiaGenovaItaly
  3. 3.Adaptive SystemsUniversity of HertfordshireUK

Personalised recommendations