Abstract
Alignment forms the basis of successful communication. It can be seen as the most efficient means for action coordination of cooperating agents, covering adaptation processes operating without an explicit exchange of information states. One critical condition of alignment consists of joint attention. We present work on equipping a virtual human with the capability of reaching joint attention with its human interlocutor. On the one hand, mechanisms to detect the human’s focus of attention are employed. On the other hand, basic cognitive as well as intentional processes underlying the phenomenon of joint attention are incorporated in our agent’s cognitive architecture. In this context, a dynamic working memory and a partner model accounting for theory of mind and intentionality are crucial constituents.
Keywords
- joint attention
- alignment
- virtual humans
- theory of mind
This is a preview of subscription content, access via your institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Pickering, M.J., Garrod, S.: Alignment as the basis for successful communication. Research on Language and Computation 4(2), 203–228 (2006)
Deak, G.O., Fasel, I., Movellan, J.: The emergence of shared attention: Using robots to test developmental theories. In: Proc. of the First Intl. Workshop on Epigenetic Robotics. Lund University Cognitive Studies, vol. 85, pp. 95–104 (2001)
Tomasello, M., Carpenter, M., Call, J., Behne, T., Moll, H.: Understanding and sharing intentions: The origins of cultural cognition. Behavioral and Brain Sciences 28, 675–691 (2005)
Leßmann, N., Kopp, S., Wachsmuth, I.: Situated interaction with a virtual human - perception, action, and cognition. In: Rickheit, G., Wachsmuth, I. (eds.) Situated Communication, pp. 287–323. Mouton de Gruyter, Berlin (2006)
Brinck, I.: The objects of attention. In: Proc. of ESPP 2003, Torino, pp. 1–4 (2003)
Cohen, J., Aston-Jones, G., Gilzenrat, M.: A systems-level perspective on attention and cognitive control. In: Posner, M. (ed.) Cognitive Neuroscience of Attention, pp. 71–90. Guilford Publications, New York (2004)
Posner, M., Petersen, S.: The attention system of the human brain. Annu. Rev. Neurosci. 13, 25–42 (1990)
Nuku, P., Bekkering, H.: Joint attention: Inferring what others perceive (and don’t perceive). Conscious and Cognition 17(1), 339–349 (2008)
Hobson, R.P.: What puts the jointness into joint attention? In: Eilan, N., Hoerl, C., McCormack, T., Roessler, J. (eds.) Joint attention: communication and other minds, pp. 185–204. Oxford University Press, Oxford (2005)
Courtney, S.M.: Attention and cognitive control as emergent properties of information representation in working memory. Cognitive, Affective & Behavioral Neuroscience 4(4), 501–516 (2004)
Cowan, N.: An embedded-processes model of working memory. In: Miyake, A., Shah, P. (eds.) Models of Working Memory, Mechanisms of Active Maintenance and Executive Control, pp. 62–102. Cambridge University Press, Cambridge (1999)
Oberauer, K.: Access to information in working memory: Exploring the focus of attention. J. of Exp. Psych.: Learning, Memory, and Cognition 28, 411–421 (2002)
Baron-Cohen, S.: The eye-direction detector (edd) and the shared attention mechanism (sam): two cases for evolutionary psychology. In: Moore, C., Dunham, P. (eds.) Joint Attention: Its origins and role in development, pp. 41–61. L. Erlbaum, Mahwah (1994)
Tomasello, M.: Joint attention as social cognition. In: Moore, C., Dunham, P. (eds.) Joint Attention: Its origin and role in development, pp. 103–128. L. Erlbaum, Mahwah (1995)
Kim, Y., Hill, R.W., Traum, D.R.: Controlling the focus of perceptual attention in embodied conversational agents. In: Proceedings AAMAS, pp. 1097–1098 (2005)
Gu, E., Badler, N.I.: Visual attention and eye gaze during multiparty conversations with distractions. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 193–204. Springer, Heidelberg (2006)
Nagai, Y., Hosoda, K., Morita, A., Asada., M.: A constructive model for the development of joint attention. ConnectionScience 15(4), 211–229 (2003)
Doniec, M., Sun, G., Scassellati, B.: Active learning of joint attention. In: IEEE/RSJ International Conference on Humanoid Robotics (2006)
Ogasawara, Y., Okamoto, M., Nakano, Y., Nishida, T.: Establishing natural communication environment between a human and a listener robot. In: AISB Symposium on Conversational Informatics, pp. 42–51 (2005)
Breazeal, C., Brooks, A., Gray, J., Hoffman, G., Kidd, C., Lee, H., Lieberman, J., Lockerd, A., Chilongo, D.: Tutelage and collaboration for humanoid robots. International Journal of Humanoid Robots 1(2), 315–348 (2004)
Kaplan, F., Hafner, V.: The challenges of joint attention. Interaction Studies 7(2), 135–169 (2006)
Rao, A., Georgeff, M.: Modeling rational behavior within a BDI-architecture. In: Proc. Intl. Conf. on Principles of Knowledge Repr. and Planning, pp. 473–484 (1991)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Pfeiffer-Leßmann, N., Wachsmuth, I. (2008). Toward Alignment with a Virtual Human - Achieving Joint Attention. In: Dengel, A.R., Berns, K., Breuel, T.M., Bomarius, F., Roth-Berghofer, T.R. (eds) KI 2008: Advances in Artificial Intelligence. KI 2008. Lecture Notes in Computer Science(), vol 5243. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85845-4_36
Download citation
DOI: https://doi.org/10.1007/978-3-540-85845-4_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85844-7
Online ISBN: 978-3-540-85845-4
eBook Packages: Computer ScienceComputer Science (R0)