Conversation Envisioning Framework for Situated Conversation

  • Maryam Sadat Mirzaei
  • Qiang Zhang
  • Stef van der Struijk
  • Toyoaki Nishida
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10868)


This paper introduces virtual reality conversation envisioning (VRCE) framework as an effective approach for analyzing situated conversations. The goal of VRCE is to raise understanding of shared information, facilitate common ground formation and promote smooth communication, especially in cross-cultural interactions. In this method, a situated conversational scenario is reconstructed in a VR environment to enable detailed analysis from first and third person view, empowered by flexible traverse in the time dimension. This framework allows participants and meta-participants (observers) to actively engage in the envisioning process in VR. A conversation description language (CDL) is introduced for encoding the obtained interpretations and developing a conversation envisioner. We focused on a bargaining scenario as a situated conversation with rich cultural practices. Preliminary experiments with this scenario indicated the effectiveness of VRCE to achieve better reasoning about the situation and received positive participant feedback.


Conversation envisioning Virtual reality Situated conversation Conversation description language 


  1. 1.
    Tomasello, M.: Origins of Human Communication. MIT Press, Cambridge (2010)Google Scholar
  2. 2.
    Kasper, G., Wagner, J.: Conversation analysis in applied linguistics. Annu. Rev. Appl. Linguist. 34, 171–212 (2014)CrossRefGoogle Scholar
  3. 3.
    Nishida, T., Nakazawa, A., Ohmoto, Y., Mohammad, Y.: Conversational Informatics. Springer, Tokyo (2014). Scholar
  4. 4.
    Traum, D.R.: A computational theory of grounding in natural language conversation. Technical report, Rochester University, NY, Department of Computer Science (1994)Google Scholar
  5. 5.
    Nakano, Y.I., Reinstein, G., Stocky, T., Cassell, J.: Towards a model of face-to-face grounding. In: Proceedings of the 41st Annual Meeting on ACL, pp. 553–561 (2003)Google Scholar
  6. 6.
    Visser, T., Traum, D., DeVault, D., et al.: A model for incremental grounding in spoken dialogue systems (2012)Google Scholar
  7. 7.
    Rickheit, G., Wachsmuth, I.: Situated Communication. Walter de Gruyter, Berlin (2006)Google Scholar
  8. 8.
    Clancey, W.J.: Situated Cognition: On Human Knowledge and Computer Representations. Cambridge University Press, Cambridge (1997)Google Scholar
  9. 9.
    Rubin, J.Z., Brown, B.R.: The Social Psychology of Bargaining and Negotiation. Academic Press, San Diego (1975)Google Scholar
  10. 10.
    Güth, W.: On ultimatum bargaining experimentsa personal review. J. Econ. Behav. Organ. 27(3), 329–344 (1995)CrossRefGoogle Scholar
  11. 11.
    Nouri, E., Georgila, K., Traum, D.: Culture-specific models of negotiation for virtual characters: multi-attribute decision-making based on culture-specific values. AI Soc. 32(1), 51–63 (2017)CrossRefGoogle Scholar
  12. 12.
    Hofstede, G.J., Jonker, C.M., Verwaart, T.: An agent model for the influence of culture on bargaining. In: Proceedings of the 1st International Working Conference on Human Factors and Computational Models in Negotiation. ACM (2008)Google Scholar
  13. 13.
    Thompson, L.: Mind and Heart of the Negotiator. Prentice Hall Press, Upper Saddle River (2000)Google Scholar
  14. 14.
    Wellman, H.M.: Making Minds: How Theory of Mind Develops. Oxford University Press, New York (2014)Google Scholar
  15. 15.
    Clark, H.H.: Using Language. Cambridge University Press, Cambridge (1996)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.RIKEN Center for Advanced Intelligence Project (AIP)KyotoJapan
  2. 2.Graduate School of InformaticsKyoto UniversityKyotoJapan

Personalised recommendations