Advertisement

Dialogue with Robots to Support Symbiotic Autonomy

  • Andrea Vanzo
  • Danilo Croce
  • Emanuele Bastianelli
  • Guglielmo Gemignani
  • Roberto Basili
  • Daniele Nardi
Chapter
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 427)

Abstract

Service Robotics is finding solutions to enable effective interaction with users. Among the several issues, the need of adapting robots to the way humans usually communicate is becoming a key and challenging task. In this context the design of robots that understand and reply in Natural Language plays a central role, especially when interactions involve untrained users. In particular, this is even more stressed in the framework of Symbiotic Autonomy, where an interaction is always required for the robot to accomplish a given task. In this article, we propose a framework to model dialogues with robotic platforms, enabling effective and natural dialogic interactions. The framework relies on well-known theories as well as on perceptually informed spoken language understanding processors, giving rise to interactions that are tightly bound to the operating scenario.

Keywords

Dialogue modeling Symbiotic autonomy Mobile service robots 

References

  1. 1.
    Rosenthal, S., Biswas, J., Veloso, M.: An effective personal mobile robot agent through symbiotic human-robot interaction. In: Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems, vol. 1, pp. 915–922. International Foundation for Autonomous Agents and Multiagent Systems (2010)Google Scholar
  2. 2.
    Bohus, D., Horvitz, E., Kanda, T., Mutlu, B., Raux, A.: Introduction to the special issue on dialog with robots. AI Mag. 32(4), 15–16 (2011)Google Scholar
  3. 3.
    Winograd, T.: Procedures as a representation for data in a computer program for understanding natural language. Cogn. Psychol. 3(1), 1–191 (1972)CrossRefGoogle Scholar
  4. 4.
    Zuo, X., Iwahashi, N., Funakoshi, K., Nakano, M., Taguchi, R., Matsuda, S., Sugiura, K., Oka, N.: Detecting robot-directed speech by situated understanding in physical interaction. Trans. Jpn. Soc. Artif. Intell. 25(6), 670–682 (2010)CrossRefGoogle Scholar
  5. 5.
    Kruijff, G., Zender, H., Jensfelt, P., Christensen, H.: Situated dialogue and understanding spatial organization: knowing what is where and what you can do there. In: Proceedings of the 15th IEEE International Symposium on Robot and Human Interactive Communication, 2006, ROMAN 2006, pp. 328–333 (2006)Google Scholar
  6. 6.
    Bastianelli, E., Bloisi, D., Capobianco, R., Cossu, F., Gemignani, G., Iocchi, L., Nardi, D.: On-line semantic mapping. In: Proceedings of the 16th International Conference on Advanced Robotics (ICAR). pp. 1–6 (2013)Google Scholar
  7. 7.
    Rybski, P.E., Yoon, K., Stolarz, J., Veloso, M.M.: Interactive robot task training through dialog and demonstration. In: Proceedings of the ACM/IEEE International Conference on Human-robot Interaction, pp. 49–56. HRI ’07, ACM, New York, NY, USA (2007)Google Scholar
  8. 8.
    Gemignani, G., Bastianelli, E., Nardi, D.: Teaching robots parametrized executable plans through spoken interaction. In: Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems, pp. 851–859. AAMAS ’15, International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC (2015)Google Scholar
  9. 9.
    Gemignani, G., Klee, S.D., Veloso, M., Nardi, D.: On task recognition and generalization in long-term robot teaching. In: Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems. pp. 1879–1880. AAMAS ’15, International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC (2015)Google Scholar
  10. 10.
    Lemaignan, S., Alami, R.: “talking to my robot”: From knowledge grounding to dialogue processing. In: Proceedings of the 8th ACM/IEEE International Conference on Human-robot Interaction. pp. 409–410. HRI ’13, IEEE Press, Piscataway, NJ, USA (2013)Google Scholar
  11. 11.
    Kollar, T., Tellex, S., Roy, D., Roy, N.: Toward understanding natural language directions. In: Proceedings of the 5th ACM/IEEE International Conference on Human-robot Interaction, pp. 259–266. HRI ’10, IEEE Press, Piscataway, NJ, USA (2010)Google Scholar
  12. 12.
    MacMahon, M., Stankiewicz, B., Kuipers, B.: Walk the talk: Connecting language, knowledge, and action in route instructions. In: Proceedings of the 21st National Conference on Artificial Intelligence, vol. 2, pp. 1475–1482. AAAI’06, AAAI Press (2006)Google Scholar
  13. 13.
    Bastianelli, E., Castellucci, G., Croce, D., Basili, R., Nardi, D.: Effective and robust natural language understanding for human-robot interaction. In: Proceedings of 21st European Conference on Artificial Intelligence, pp. 57–62. IOS Press (2014)Google Scholar
  14. 14.
    Bastianelli, E., Croce, D., Basili, R., Nardi, D.: Using semantic maps for robust natural language interaction with robots. In: Sixteenth Annual Conference of the International Speech Communication Association (2015)Google Scholar
  15. 15.
    Vanzo, A., Croce, D., Bastianelli, E., Basili, R., Nardi, D.: Robust spoken language understanding for house service robots. In: Proceedings of the 17th International Conference on Intelligent Text Processing and Computational Linguistics CICLing 2016. Konya, Turkey, April 3–9, 2016Google Scholar
  16. 16.
    Bastianelli, E., Croce, D., Basili, R., Nardi, D.: Using semantic models for robust natural language human robot interaction. In: Gavanelli, M., Lamma, E., Riguzzi, F. (eds.) AI*IA 2015 Advances in Artificial Intelligence: XIVth International Conference of the Italian Association for Artificial Intelligence, pp. 343–356. Springer International Publishing (2015)Google Scholar
  17. 17.
    Bastianelli, E., Croce, D., Vanzo, A., Basili, R., Nardi, D.: A discriminative approach to grounded spoken language understanding in interactive robotics. In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI 2016. New York, USA, July 9–15, 2016Google Scholar
  18. 18.
    Chernova, S., DePalma, N., Breazeal, C.: Crowdsourcing real world human-robot dialog and teamwork through online multiplayer games. AI Mag. 32(4), 100–111 (2011)Google Scholar
  19. 19.
    Kollar, T., Perera, V., Nardi, D., Veloso, M.M.: Learning environmental knowledge from task-based human-robot dialog. In: ICRA, pp. 4304–4309. IEEE (2013)Google Scholar
  20. 20.
    Fang, R., Liu, C., She, L., Chai, J.Y.: Towards situated dialogue: revisiting referring expression generation. In: EMNLP, pp. 392–402 (2013)Google Scholar
  21. 21.
    Fang, R., Doering, M., Chai, J.Y.: Collaborative models for referring expression generation in situated dialogue. In: Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, pp. 1544–1550 (2014)Google Scholar
  22. 22.
    Stoia, L., Shockley, D.M., Byron, D.K., Fosler-Lussier, E.: Noun phrase generation for situated dialogs. In: Proceedings of the Fourth International Natural Language Generation Conference, pp. 81–88. INLG ’06, Association for Computational Linguistics, Stroudsburg, PA, USA (2006)Google Scholar
  23. 23.
    Garoufi, K., Koller, A.: Automated planning for situated natural language generation. In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp. 1573–1582. ACL ’10, Association for Computational Linguistics, Stroudsburg, PA, USA (2010)Google Scholar
  24. 24.
    Qu, S., Chai, J.Y.: Context-based word acquisition for situated dialogue in a virtual world. J. Artif. Intell. Res. 247–277 (2010)Google Scholar
  25. 25.
    Peltason, J., Wrede, B.: The curious robot as a case-study for comparing dialog systems. AI Mag. 32(4), 85–99 (2011)Google Scholar
  26. 26.
    Marge, M., Rudnicky, A.I.: Miscommunication recovery in physically situated dialogue. In: Proceedings of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, p. 22 (2015)Google Scholar
  27. 27.
    Scheutz, M., Cantrell, R., Schermerhorn, P.W.: Toward humanlike task-based dialogue processing for human robot interaction. AI Mag. 32(4), 77–84 (2011)Google Scholar
  28. 28.
    Brenner, M., Kruijff-Korbayová, I.: A continual multiagent planning approach to situated dialogue. In: Proceedings of the Semantics and Pragmatics of Dialogue (LONDIAL), p. 61 (2008)Google Scholar
  29. 29.
    Ross, R.J., Bateman, J.: Agency & information state in situated dialogues: analysis & computational modelling. In: Proceedings of the DiaHolmia, p. 113 (2009)Google Scholar
  30. 30.
    Bastianelli, E., Croce, D., Vanzo, A., Basili, R., Nardi, D.: Perceptually informed spoken language understanding for service robotics. In: Proceedings of the IJCAI2016 Workshop on Autonomous Mobile Service Robots. To appear (2016)Google Scholar
  31. 31.
    Klee, S.D., Gemignani, G., Nardi, D., Veloso, M.: Graph-based task libraries for robots: generalization and autocompletion. In: Proceedings of the 14th Italian Conference on Artificial Intelligence (2015)Google Scholar
  32. 32.
    Traum, D., Larsson, S.: The information state approach to dialogue management. In: Current and New Directions in Discourse and Dialogue, Text, Speech and Language Technology, vol. 22, pp. 325–353. Springer, Netherlands (2003)Google Scholar
  33. 33.
    Stolcke, A., Coccaro, N., Bates, R., Taylor, P., Van Ess-Dykema, C., Ries, K., Shriberg, E., Jurafsky, D., Martin, R., Meteer, M.: Dialogue act modeling for automatic tagging and recognition of conversational speech. Comput. Linguist. 26(3), 339–373 (2000)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media Singapore 2017

Authors and Affiliations

  • Andrea Vanzo
    • 1
  • Danilo Croce
    • 2
  • Emanuele Bastianelli
    • 3
  • Guglielmo Gemignani
    • 1
  • Roberto Basili
    • 2
  • Daniele Nardi
    • 1
  1. 1.Department of Computer, Control and Management Engineering “Antonio Ruberti”Sapienza University of RomeRomeItaly
  2. 2.Department of Enterprise EngineeringUniversity of Roma Tor VergataRomeItaly
  3. 3.Department of Civil Engineering and Computer Science EngineeringUniversity of Roma Tor VergataRomeItaly

Personalised recommendations