Abstract
This paper presents how extraction, representation and use of symbolic knowledge from real-world perception and human-robot verbal and non-verbal interaction can actually enable a grounded and shared model of the world that is suitable for later high-level tasks such as dialogue understanding. We show how the anchoring process itself relies on the situated nature of human-robot interactions. We present an integrated approach, including a specialized symbolic knowledge representation system based on Description Logics, and case studies on several robotic platforms that demonstrate these cognitive capabilities.
Similar content being viewed by others
References
Alami R, Chatila R, Fleury S, Ghallab M, Ingrand F (1998) An architecture for autonomy. Int J Robot Res 17(4):315
Austin J, Urmson J, Sbisà M (1962) How to do things with words. Harvard University Press, Harvard
Baerlocher P, Boulic R (2004) An inverse kinematics architecture enforcing an arbitrary number of strict priority levels. Vis Comput Int J Comput Graph 20(6):402–417
Beetz M, Mösenlechner L, Tenorth M (2010) CRAM—a cognitive robot abstract machine for everyday manipulation in human environments. In: IEEE/RSJ international conference on intelligent robots and systems
Blisard SN (2005) Modeling spatial referencing language for human-robot interaction. In: Proc IEEE intl workshop on robot and human interactive communication, pp 698–703
Brick T, Scheutz M (2007) Incremental natural language processing for HRI. In: Proceedings of the ACM/IEEE international conference on human-robot interaction
Coradeschi S, Saffiotti A (2003) An introduction to the anchoring problem. Robot Auton Syst 43(2–3):85–96
Dale R, Reiter E (1995) Computational interpretations of the Gricean maxims in the generation of referring expressions. Cogn Sci 19(2):233–263
Daoutis M, Coradeshi S, Loutfi A (2009) Grounding commonsense knowledge in intelligent systems. J Ambient Intell Smart Environ:311–321
Flavell JH (1992) Perspectives on perspective taking. Lawrence Erlbaum Associates, pp 107–139
Gruber J (1965) Studies in lexical relations. PhD thesis, Massachusetts Institute of Technology
Gunderson J, Gunderson L (2008) Robots, reasoning, and reification. Springer, Berlin
Gutiérrez JPM (2001) Directed motion in English and Spanish, vol 11. Universidad de Sevilla, chap Semantic Role Lists
Harnad S (1990) The symbol grounding problem. Physica D 42(1–3):335–346
Hawes N, Hanheide M, Hargreaves J, Page B, Zender H, Jensfelt P (2011) Home alone: autonomous extension and correction of spatial representations. In: Proceedings of the international conference on robotics and automation
Huwel S, Wrede B, Sagerer G (2006) Robust speech understanding for multi-modal human-robot communication. In: The 15th IEEE international symposium on robot and human interactive communication
Jain D, Mösenlechner L, Beetz M (2009) Equipping robot control programs with first-order probabilistic reasoning capabilities. In: International conference on robotics and automation (ICRA)
Kelleher JD, Costello FJ (2009) Applying computational models of spatial prepositions to visually situated dialog. Comput Linguist 35:271–306
Kipper K, Korhonen A, Ryant N, Palmer M (2008) A large-scale classification of English verbs. Lang Resour Eval 42(1):21–40
Kruijff G, Lison P, Benjamin T, Jacobsson H, Zender H, Kruijff-Korbayová I, Hawes N (2010) Situated dialogue processing for human-robot interaction. In: Cognitive Systems, pp 311–364
Lemaignan S, Ros R, Mösenlechner L, Alami R, Beetz M (2010) ORO, a knowledge management platform for cognitive architectures in robotics. In: IEEE/RSJ international conference on intelligent robots and systems
Leslie A (2000) Theory of mind as a mechanism of selective attention. In: The new cognitive neurosciences, pp 1235–1247
Matuszek C, Fox D, Koscher K (2010) Following directions using statistical machine translation. In: Proc of int’l conf on human-robot interaction. ACM Press, New York
Mavridis N, Roy D (2005) Grounded situation models for robots: bridging language, perception, and action. In: AAAI-05 workshop on modular construction of human-like intelligence
Moll H, Tomasello M (2006) Level 1 perspective-taking at 24 months of age. Br J Dev Psychol 24(3):603–614
Nakamura Y (1990) Advanced robotics: redundancy and optimization. Addison-Wesley/Longman, Boston
O’Keefe J (1999) The spatial prepositions. MIT Press, New York
Regier T, Carlson L (2001) Grounding spatial language in perception: an empirical and computational investigation. J Exp Psychol
Ros R, Lemaignan S, Sisbot EA, Alami R, Steinwender J, Hamann K, Warneken F (2010) Which one? Grounding the referent based on efficient human-robot interaction. In: 19th IEEE international symposium in robot and human interactive communication
Ros R, Sisbot EA, Lemaignan S, Pandey A, Alami R (2010) Robot, tell me what you know about …?: Expressing robot’s knowledge through interaction. In: Proceedings of the ICRA workshop on interactive communication for autonomous intelligent robots (ICAIR), pp 26–29
Roy D, Reiter E (2005) Connecting language to the world. Artif Intell
Scassellati B (2002) Theory of mind for a humanoid robot. Auton Robots 12(1):13–24
Searle JR (1976) A classification of illocutionary acts. Lang Soc 5(01):1–23
Searle JR (1980) Minds, brains, and programs. Behav Brain Sci 3:417–424
Shapiro S, Bona J (2009) The GLAIR cognitive architecture. In: AAAI fall symposium series
Sisbot E, Ros R, Alami R (2011) Situation assessment for human-robot interaction. In: 20th IEEE international symposium in robot and human interactive communication
Sloman A (2007) Why symbol-grounding is both impossible and unnecessary, and why theory-tethering is more powerful anyway. Tech rep, Research Note No COSY-PR-0705
Sloman A (2009) Some requirements for human-like robots: why the recent over-emphasis on embodiment has held up progress. Creating Brain-like Intelligence, pp 248–277
Steels L (2007) The symbol grounding problem has been solved. So what’s next? In: Symbols, embodiment and meaning. Oxford University Press, Oxford
Suh I, Lim G, Hwang W, Suh H, Choi J, Park Y (2007) Ontology-based multi-layered robot knowledge framework (omrkf) for robot intelligence. In: IEEE/RSJ international conference on intelligent robots and systems
Tenorth M, Beetz M (2009) KnowRob—knowledge processing for autonomous personal robots. In: IEEE/RSJ international conference on intelligent robots and systems
Tversky B, Lee P, Mainwaring S (1999) Why do speakers mix perspectives? Spatial Cogn Comput 1(4):399–412
Vrecko A, Skocaj D, Hawes N, Leonardis A (2009) A computer vision integration model for a multi-modal cognitive system. In: IEEE/RSJ international conference on intelligent robots and systems. IEEE, New York, pp 3140–3147
Zender H, Kruijff G, Kruijff-Korbayová I (2009) Situated resolution and generation of spatial referring expressions for robotic assistants. In: Proceedings of the twenty-first international joint conference on artificial intelligence, pp 1604–1609
Ziemke T (1999) Rethinking grounding. In: Understanding representation in the cognitive sciences, pp 177–190
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lemaignan, S., Ros, R., Sisbot, E.A. et al. Grounding the Interaction: Anchoring Situated Discourse in Everyday Human-Robot Interaction. Int J of Soc Robotics 4, 181–199 (2012). https://doi.org/10.1007/s12369-011-0123-x
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12369-011-0123-x