Skip to main content
SpringerLink
Log in

Knowledge Engineering and Planning for Social Human–Robot Interaction: A Case Study

  • Chapter
  • First Online:
Knowledge Engineering Tools and Techniques for AI Planning

Abstract

The core task of automated planning is goal-directed action selection; this task is not unique to the planning community, but is also relevant to numerous other research areas within AI. One such area is interactive systems, where a fundamental component called the interaction manager selects actions in the context of conversing with humans using natural language. Although this has obvious parallels to automated planning, using a planner to address the interaction management task relies on appropriate engineering of the underlying planning domain and planning problem to capture the necessary dynamics of the world, the agents involved, their actions, and their knowledge. In this chapter, we describe work on using domain-independent automated planning for action section in social human–robot interaction, focusing on work from the JAMES (Joint Action for Multimodal Embodied Social Systems) robot bartender project.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://james-project.eu/.

References

  1. Amazon (2020) Alexa Skills Kit Official Site. https://developer.amazon.com/en-GB/alexa/alexa-skills-kit, accessed: 2020-02-09

  2. Appelt D (1985) Planning English Sentences. Cambridge University Press

    Google Scholar 

  3. Asher N, Lascarides A (2003) Logics of Conversation. Cambridge University Press

    Google Scholar 

  4. Benotti L (2008) Accommodation through tacit sensing. In: Proceedings of LONDIAL 2008, London, United Kingdom, pp 75–82

    Google Scholar 

  5. Brenner M, Kruijff-Korbayová I (2008) A continual multiagent planning approach to situated dialogue. In: Proceedings of LONDIAL 2008, pp 67–74

    Google Scholar 

  6. Bui TH (2006) Multimodal dialogue management - state of the art. Tech. Rep. 06–01, University of Twente (UT), Enschede, The Netherlands

    Google Scholar 

  7. Cohen P, Levesque H (1990) Rational interaction as the basis for communication. In: Intentions in Communication, MIT Press, Cambridge, MA, pp 221–255

    Google Scholar 

  8. Fikes RE, Nilsson NJ (1971) STRIPS: A new approach to the application of theorem proving to problem solving. Artificial Intelligence 2:189–208

    Article  Google Scholar 

  9. Foster ME, Petrick RPA (2017) Separating representation, reasoning, and implementation for interaction management: Lessons from automated planning. In: Dialogues with Social Robots: Enablements, Analyses, and Evaluation, Springer Singapore, Singapore, pp 93–107, https://doi.org/10.1007/978-981-10-2585-3_7

    Chapter  Google Scholar 

  10. Foster ME, Gaschler A, Giuliani M, Isard A, Pateraki M, Petrick RPA (2012) Two people walk into a bar: Dynamic multi-party social interaction with a robot agent. In: Proceedings of ICMI 2012, pp 3–10, https://doi.org/10.1145/2388676.2388680

    Article  Google Scholar 

  11. Foster ME, Gaschler A, Giuliani M (2017) Automatically classifying user engagement for dynamic multi-party human–robot interaction. International Journal of Social Robotics 9(5):659–674, https://doi.org/10.1007/s12369-017-0414-y

    Article  Google Scholar 

  12. Fox M, Long D, Magazzeni D (2017) Explainable planning. In: Proceedings of the IJCAI Workshop on Explainable AI

    Google Scholar 

  13. Giuliani M, Petrick RPA, Foster ME, Gaschler A, Isard A, Pateraki M, Sigalas M (2013) Comparing task-based and socially intelligent behaviour in a robot bartender. In: Proceedings of ICMI 2013, https://doi.org/10.1145/2522848.2522869

    Google Scholar 

  14. Google (2020) Dialogflow. https://dialogflow.com/, accessed: 2020-02-09

  15. Hovy E (1988) Generating natural language under pragmatic constraints. Lawrence Erlbaum Associates, Hillsdale, NJ, USA

    Google Scholar 

  16. ICAPS (2019) ICAPS Competitions. http://www.icaps-conference.org/index.php/Main/Competitions, accessed: 2019-08-01

  17. Isard A, Matheson C (2012) Rhetorical structure for natural language generation in dialogue. In: Proceedings of SemDial-2012 (SeineDial), pp 161–162

    Google Scholar 

  18. Janarthanam S, Hastie H, Deshmukh A, Aylett R, Foster ME (2015) A reusable interaction management module: Use case for empathic robotic tutoring. In: Proceedings of goDIAL 2015, Gothenburg, Sweden

    Google Scholar 

  19. Johnston M, Bangalore S, Vasireddy G, Stent A, Ehlen P, Walker M, Whittaker S, Maloor P (2002) MATCH: An architecture for multimodal dialogue systems. In: Proceedings of ACL 2002, Philadelphia, Pennsylvania, USA, pp 376–383

    Google Scholar 

  20. Jokinen K, McTear M (2009) Spoken dialogue systems. Synthesis Lectures on Human Language Technologies 2(1):1–151

    Article  Google Scholar 

  21. Koller A, Stone M (2007) Sentence generation as planning. In: Proceedings of ACL 2007, Prague, Czech Republic, pp 336–343

    Google Scholar 

  22. Larsson S, Traum DR (2000) Information state and dialogue management in the TRINDI dialogue move engine toolkit. Natural Language Engineering 6(3&4):323–340, https://doi.org/10.1017/S1351324900002539

    Article  Google Scholar 

  23. Lison P (2015) A hybrid approach to dialogue management based on probabilistic rules. Computer Speech & Language https://doi.org/10.1016/j.csl.2015.01.001

    Book  Google Scholar 

  24. Loth S, Huth K, De Ruiter JP (2013) Automatic detection of service initiation signals used in bars. Frontiers in Psychology 4(557), https://doi.org/10.3389/fpsyg.2013.00557

  25. Mann WC, Thompson SA (1988) Rhetorical structure theory: Toward a functional theory of text organization. Text 8(3):243–281

    Article  Google Scholar 

  26. McDermott D, Ghallab M, Howe A, Knoblock C, Ram A, Veloso M, Weld D, Wilkins D (1998) PDDL – The Planning Domain Definition Language (Version 1.2). Technical Report CVC TR-98-003/DCS TR-1165, Yale Center for Computational Vision and Control

    Google Scholar 

  27. McTear M, Callejas Z, Griol D (2016) The Conversational Interface. Springer International Publishing, https://doi.org/10.1007/978-3-319-32967-3

  28. Olaso JM, Milhorat P, Himmelsbach J, Boudy J, Chollet G, Schlögl S, Torres MIT (2016) A multi-lingual evaluation of the vAssist spoken dialog system: Comparing Disco and RavenClaw. In: Proceedings of IWSDS 2016, Saariselkä, Finland

    Google Scholar 

  29. Papaioannou I, Dondrup C, Lemon O (2018) Human-robot interaction requires more than slot filling - multi-threaded dialogue for collaborative tasks and social conversation. In: Proceedings of the FAIM/ISCA Workshop on Artificial Intelligence for Multimodal Human Robot Interaction, pp 61–64

    Google Scholar 

  30. Pateraki M, Sigalas M, Chliveros G, Trahanias P (2013) Visual human-robot communication in social settings. In: Proceedings of ICRA Workshop on Semantics, Identification and Control of Robot-Human-Environment Interaction

    Google Scholar 

  31. Peltason J, Wrede B (2011) The curious robot as a case-study for comparing dialog systems. AI Magazine 32(4):85–99, https://doi.org/10.1609/aimag.v32i4.2382

    Article  Google Scholar 

  32. Perrault CR, Allen JF (1980) A plan-based analysis of indirect speech acts. American Journal of Computational Linguistics 6(3–4):167–182

    Google Scholar 

  33. Petrick RPA, Bacchus F (2002) A knowledge-based approach to planning with incomplete information and sensing. In: Proceedings of AIPS 2002, pp 212–221

    Google Scholar 

  34. Petrick RPA, Bacchus F (2004) Extending the knowledge-based approach to planning with incomplete information and sensing. In: Proceedings of ICAPS 2004, pp 2–11

    Google Scholar 

  35. Petrick RPA, Foster ME (2013) Planning for social interaction in a robot bartender domain. In: Proceedings of ICAPS 2013, Rome, Italy

    Google Scholar 

  36. Rintanen J (2004) Complexity of planning with partial observability. In: Proceedings of ICAPS 2004, pp 345–354

    Google Scholar 

  37. Wang Z, Lemon O (2013) A simple and generic belief tracking mechanism for the dialog state tracking challenge: On the believability of observed information. In: Proceedings of SIGDIAL 2013

    Google Scholar 

  38. White M (2006) Efficient realization of coordinate structures in Combinatory Categorial Grammar. Research on Language and Computation 4(1):39–75

    Article  MathSciNet  Google Scholar 

  39. Young RM, Moore JD (1994) DPOCL: a principled approach to discourse planning. In: Proceedings of INLG 2004, Kennebunkport, Maine, USA, pp 13–20

    Google Scholar 

Download references

Acknowledgements

The authors thank their JAMES colleagues who helped implement the bartender system: Andre Gaschler, Manuel Giuliani, Amy Isard, Maria Pateraki, and Richard Tobin. This research has received funding from the European Union’s 7th Framework Programme under grant No. 270435 (JAMES, http://james-project.eu/).

Author information

Authors and Affiliations

  1. Department of Computer Science, Heriot-Watt University, Edinburgh, UK

    Ronald P. A. Petrick

  2. School of Computing Science, University of Glasgow, Glasgow, UK

    Mary Ellen Foster

Authors
  1. Ronald P. A. Petrick
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mary Ellen Foster
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ronald P. A. Petrick .

Editor information

Editors and Affiliations

  1. Department of Computer Science, University of Huddersfield, Huddersfield, UK

    Mauro Vallati

  2. Department of Computer Science, University of Huddersfield, Huddersfield, UK

    Diane Kitchin

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Petrick, R.P.A., Foster, M.E. (2020). Knowledge Engineering and Planning for Social Human–Robot Interaction: A Case Study. In: Vallati, M., Kitchin, D. (eds) Knowledge Engineering Tools and Techniques for AI Planning. Springer, Cham. https://doi.org/10.1007/978-3-030-38561-3_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-38561-3_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-38560-6

  • Online ISBN: 978-3-030-38561-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation