Skip to main content
SpringerLink
Log in

Dialogue Models for Socially Intelligent Robots

  • Conference paper
  • First Online:
Book cover Social Robotics (ICSR 2018)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11357))

Included in the following conference series:

Abstract

Dialogue capability is an important functionality of robot agents: interactive social robots must not only help humans in their everyday tasks, they also need to explicate their own actions, instruct human partners about practical tasks, provide requested information, and maintain interesting chat about a wide range of topics. This paper discusses the type of architecture required for such dialogue capability, emphasizing the need for robot communication to afford natural interaction and provide complementarity to standard cognitive architectures.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Allwood, J.: Linguistic Communication as Action and Cooperation. Gothenburg Monographs in Linguistics, vol. 2. University of Göteborg, Göteborg (1976)

    Google Scholar 

  2. Belpaeme, T., et al.: Guidelines for designing social robots as second language tutors. Int. J. Soc. Robot. 10, 325–341 (2018)

    Article  Google Scholar 

  3. Brethes, L., Menezes, P., Lerasle, F., Hayet, J.: Face tracking and hand gesture recognition for human-robot interaction. In: Proceedings of IEEE International Conference on Robotics and Automation, pp. 1901–1906 (2004)

    Google Scholar 

  4. Clark, H.H., Schaefer, E.F.: Collaborating on contributions to conversation. Lang. Cogn. Process. 2, 19–41 (1987)

    Article  Google Scholar 

  5. Feldman, R., Rim, B.: Fundamentals of Nonverbal Behavior. Cambridge University Press, Cambridge (1991)

    Google Scholar 

  6. Fujie, S., Fukushima, K., Kobayashi, T.: A conversation robot with back-channel feedback function based on linguistic and non-linguistic information. In: Proceedings of 2nd International Conference on Autonomous Robots and Agents (ICARA-2004), pp. 379–384 (2004)

    Google Scholar 

  7. Hagita, N., Ishiguro, H., Miyashita, T., Kanda, T., Shiomi, M., Kuwabara, K.: Symbiosis of human and communication robots. In: Cetto, J.A., Ferrier, J.L., Costa dias Pereira, J., Filipe, J. (eds.) Informatics in Control Automation and Robotics, vol. 15. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-79142-3_2

    Chapter  Google Scholar 

  8. Han, J.G., et al.: Collecting multi-modal data of human-robot interaction. In: Proceedings of the 2nd International Conference on Cognitive Infocommunications (CogInfoCom), pp. 1–4 (2011)

    Google Scholar 

  9. Harnad, S.: The symbol grounding problem. Physica D 42, 335–346 (1990)

    Article  Google Scholar 

  10. Inoue, K., Milhorat, P., Lala, D., Zhao, T., Kawahara, T.: Talking with ERICA, an autonomous android. In: Proceedings of the SIGDIAL 2016 Conference, Los Angeles, USA, pp. 212–215 (2016)

    Google Scholar 

  11. Jokinen, K.: Constructive Dialogue Modelling – Speech Interaction with Rational Agents. Wiley, Chichester (2009)

    Book  Google Scholar 

  12. Jokinen, K., McTear, M.: Spoken Dialogue Systems. Morgan and Claypool, San Rafael (2009)

    Book  Google Scholar 

  13. Jokinen, K., Furukawa, H., Nishida, M., Yamamoto, S.: Modelling eye-gaze behaviour for intraction management. In: ACM TiiS (2012)

    Google Scholar 

  14. Jokinen, K., Nishimura, S., Watanabe, K., Nishimura, T.: Human-robot dialogues for explaining activities. In: Proceedings of IWSDS 2018, Singapore (2018)

    Google Scholar 

  15. Jokinen, K., Nishimura, S., Fukuda, K., Nishimura, T.: Dialogues with IoT companions - enabling human interaction with intelligent service items. In: Proceedings of the 2nd International Conference on Companion Technology (ICCT 2017), pp. 1–3. IEEE (2017)

    Google Scholar 

  16. Jokinen, K., Trong, T.N., Wilcock, G.: Body movements and laughter recognition: experiments in first encounter dialogues. In: Proceedings of the ICMI Workshop MA3HMI 2016 (2016)

    Google Scholar 

  17. Jokinen, K., Wilcock, G.: Constructive interaction for talking about interesting topics. In: Proceedings of the 8th LREC 2012, Istanbul (2012)

    Google Scholar 

  18. Jokinen, K., Wilcock, G.: Multimodal open-domain conversations with the Nao robot. In: Mariani, J., Rosset, S., Garnier-Rizet, M., Devillers, L. (eds.) Natural Interaction with Robots, Knowbots and Smartphones, pp. 213–224. Springer, New York (2014). https://doi.org/10.1007/978-1-4614-8280-2_19

    Chapter  Google Scholar 

  19. Laird, J.E., Lebiere, C., Rosenbloom, P.S.: A standard model of the mind: toward a common computational framework across artificial intelligence, cognitive science, neurosciene, and robotics. AI Mag. 38(4), 13–26 (2017)

    Article  Google Scholar 

  20. Lemaignan, S., Ros, R., Sisbot, E.A., Alami, R., Beetz, M.: Grounding the interaction: anchoring situated discourse in everyday human-robot interaction. Int. J. Soc. Robot. 4, 181–199 (2012)

    Article  Google Scholar 

  21. Li, J., Monroe, W., Ritter, A., Galley, M., Gao, J., Jurafsky, D.: Deep reinforcement learning for dialogue generation (2016)

    Google Scholar 

  22. Marin-Urias, L.F., Sisbot, E.A., Pandey, A.K., Tadakuma, R., Alami, R.: Towards shared attention through geometric reasoning for human robot interaction. In: The 9th IEEE-RAS International Conference on Humanoid Robots, Humanoids 2009, pp. 331–336 (2009)

    Google Scholar 

  23. Matsuyama, Y., Taniyama, H., Fujie, S., Kobayashi, T.: Framework of communication activation robot participating in multiparty conversation. In: AAAI Fall Symposium Dialog with Robots (2010)

    Google Scholar 

  24. McDonald, D., Burstein, M., Pustejovsky, J.: Assembling the ECIpedia: refining concepts in context. ACS Poster Collection, pp. 1–19 (2018)

    Google Scholar 

  25. Milhorat, P., et al.: A conversational dialogue manager for the humanoid robot ERICA. In: Proceedings of the International Workshop Spoken Dialogue Systems (IWSDS) (2017)

    Google Scholar 

  26. Milward, D., Beveridge, M.: Ontology-based dialogue systems. In: IJCAI Workshop on Knowledge and Reasoning in Practical Dialogue Systems (2003)

    Google Scholar 

  27. Moratz, R., Tenbrink, T.: Affordance-based human-robot interaction. In: Rome, E., Hertzberg, J., Dorffner, G. (eds.) Towards Affordance-Based Robot Control. LNCS (LNAI), vol. 4760, pp. 63–76. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-77915-5_5

    Chapter  Google Scholar 

  28. Nooraei, B., Rich C., Sidner, C.: A real-time architecture for embodied conversational agents: beyond turn-taking. In: The 7th International Conference on Advances in Computer-Human Interactions (2014)

    Google Scholar 

  29. Reeves, N., Nass, C.: The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. Cambridge University Press, New York (1996)

    Google Scholar 

  30. Serban, I.V., Sordoni, A., Bengio, Y., Courville, A., Pineau, J.: Building end-to-end dialogue systems using generative hierarchical neural network models. In: Proceedings of AAAI (2016)

    Google Scholar 

  31. Serban, I.V., et al.: A hierarchical latent variable encoder-decoder model for generating dialogues. arXiv:1605.06069 (2016)

  32. Smith, I.G. (ed.): The Internet of Things 2012: New Horizons. IERC-Internet of Things European Research Cluster, Halifax (2012)

    Google Scholar 

  33. Sordoni, A., et al.: A neural network approach to context-sensitive generation of conversational responses. In: Proceedings of the Conference of the NAACL-HLT 2015 (2015)

    Google Scholar 

  34. Tay, B., Jung, Y., Park, T.: When stereotypes meet robots: the double-edge sword of robot gender and personality in human–robot interaction. Comput. Hum. Behav. 38, 75–84 (2014)

    Article  Google Scholar 

  35. Traum, D.R., Allen, J.F.: Discourse obligations in dialogue processing. In: Proceedings of the 32nd Annual Meeting of ACL, Morristown, NJ, USA, pp. 1–8 (1994)

    Google Scholar 

  36. Wilcock, G., Jokinen, K.: Generating responses and explanations from RDF/XML and DAML + OIL. In: Proceedings of the IJCAI-03 Workshop on Practical Dialogue Systems, Mexico (2003)

    Google Scholar 

  37. Wilcock, G., Jokinen, K.: Multilingual WikiTalk: Wikipedia-based talking robots that switch languages. In: Proceedings of the SIGDIAL 2015 Conference, pp. 162–164 (2015)

    Google Scholar 

  38. Wimmer, H., Perner, J.: Beliefs about beliefs: representation and constraining function of wrong beliefs in young children’s understanding of deception. Cognition 13, 103–128 (1983)

    Article  Google Scholar 

  39. de Wit, J., et al.: Exploring the effect of gestures and adaptive tutoring on children’s comprehension of L2 vocabularies. In: Proceedings of HRI 2017 Workshop on Robots for Learning (2017)

    Google Scholar 

  40. Yoshida, Y., Nishimura, T., Jokinen, K.: Biomechanics for understanding movements in daily activities. In: Proceedings of the LREC Workshop on Language and Body in Real Life (2018)

    Google Scholar 

Download references

Acknowledgements

The author wishes to thank the team members for useful discussions on ontologies and dialogue modelling, and the NEDO project for the support of the work.

Author information

Authors and Affiliations

  1. AIRC AIST Tokyo Waterfront, Tokyo, Japan

    Kristiina Jokinen

Authors
  1. Kristiina Jokinen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kristiina Jokinen .

Editor information

Editors and Affiliations

  1. The National University of Singapore, Singapore, Singapore

    Shuzhi Sam Ge

  2. Qatar University, Doha, Qatar

    John-John Cabibihan

  3. University Carlos III de Madrid, Madrid, Spain

    Miguel A. Salichs

  4. Canterbury University, Auckland, New Zealand

    Elizabeth Broadbent

  5. Wichita State University, Wichita, KS, USA

    Hongsheng He

  6. The Pennsylvania State University, University Park, PA, USA

    Alan R. Wagner

  7. Universidad Carlos III de Madrid, Madrid, Spain

    Álvaro Castro-González

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Jokinen, K. (2018). Dialogue Models for Socially Intelligent Robots. In: Ge, S., et al. Social Robotics. ICSR 2018. Lecture Notes in Computer Science(), vol 11357. Springer, Cham. https://doi.org/10.1007/978-3-030-05204-1_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-05204-1_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-05203-4

  • Online ISBN: 978-3-030-05204-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation