Skip to main content
SpringerLink
Log in

Towards Conversation Envisioning for Cognitive Robots

  • Chapter
  • First Online:
Blended Cognition

Part of the book series: Springer Series in Cognitive and Neural Systems ((SSCNS,volume 12))

  • 436 Accesses

Abstract

This chapter proposes a new conceptual framework for visualizing conversational interactions to build a common ground for productive human-robot interaction. We address conversation envisioning as a process of building and maintaining common ground by incorporating new information into the shared information structure. We discuss how we can build a common ground for human robot interaction by using a synthetic evidential study (SES) as an underlying methodology. We review the main ideas in SES, which integrates role playing game, agent play, and in-situ group discussion to uncover tacit thoughts and interaction of participants. We then introduce the idea of conversation envisioning in which we employ virtual reality for graphic recording (VRGR) to extend the framework of SES so that both observers and participants can visualize their thoughts in conversation. We also consider emotion and its relation to common ground to better analyze the conversation. We focus on a bargaining scenario, to illustrate how the framework of SES could be employed to help people realize subtle socio-ethical issues in social activities to design a robot that can engage in social interactions with people as well as other robots as well.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Schematic, propositional, analogical and associative representational systems.

References

  • Azzam T, Evergreen S, Germuth AA, Kistler SJ (2013) Data visualization and evaluation. N Dir Eval 2013(139):7–32

    Article  Google Scholar 

  • Barrett LF (2014) The conceptual act theory: a précis. Emot Rev 6(4):292–297. [Online] Available: https://doi.org/10.1177/1754073914534479

    Article  Google Scholar 

  • Barrett LF (2017) How emotions are made: the secret life of the brain. Houghton Mifflin Harcourt, Boston/New York

    Google Scholar 

  • Clark HH (1996) Using language. Cambridge University Press, Cambridge/New York

    Book  Google Scholar 

  • Couper-Kuhlen E (2015) What does grammar tell us about action? Pragmat Q Publ Int Pragmat Assoc (IPrA) 24(3):623–647

    Google Scholar 

  • Ekman P (2016) What scientists who study emotion agree about. Perspect Psychol Sci 11(1):31–34

    Article  Google Scholar 

  • Ekman P, Cordaro D (2011) What is meant by calling emotions basic. Emot Rev 3(4):364–370

    Article  Google Scholar 

  • Emmorey K, Tversky B, Taylor HA (2000) Using space to describe space: perspective in speech, sign, and gesture. Spat Cogn Comput 2(3):157–180

    Article  Google Scholar 

  • Goffman E (1967) Interaction ritual: essays on face-to-face interaction. Aldine Transaction, Oxford

    Google Scholar 

  • Güth W (1995) On ultimatum bargaining experiments – a personal review. J Econ Behav Organ 27(3):329–344

    Article  Google Scholar 

  • Harsanyi JC (2016) Bargaining. Palgrave Macmillan, London, pp 1–10

    Google Scholar 

  • Hofstede GJ, Jonker CM, Verwaart T (2008) An agent model for the influence of culture on bargaining. In: Proceedings of the 1st International Working Conference on Human Factors and Computational Models in Negotiation, Delft, The Netherlands, 08–09 Dec 2008. ACM, pp 39–46. https://dl.acm.org/citation.cfm?id=1609175

  • Miller GA (1995) Wordnet: a lexical database for English. Commun ACM 38(11):39–41

    Article  Google Scholar 

  • Moors A, Ellsworth PC, Scherer KR, Frijda NH (2013) Appraisal theories of emotion: state of the art and future development. Emot Rev 5(2):119–124

    Article  Google Scholar 

  • Nakano YI, Reinstein G, Stocky T, Cassell J (2003) Towards a model of face-to-face grounding. In: Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, vol 1. Association for Computational Linguistics, pp 553–561

    Google Scholar 

  • Nishida T, Nakazawa A, Ohmoto Y, Mohammad Y (2014) Conversational informatics: a data-intensive approach with emphasis on nonverbal communication. Springer, Tokyo

    Google Scholar 

  • Nishida T, Nakazawa A, Ohmoto Y, Nitschke C, Mohammad Y, Thovuttikul S, Lala D, Abe M, Ookaki T (2015) Synthetic evidential study as primordial soup of conversation. In: International Workshop on Databases in Networked Information Systems. Springer, pp 74–83

    Google Scholar 

  • Nishida T, Abe M, Ookaki T, Lala D, Thovuttikul S, Song H, Mohammad Y, Nitschke C, Ohmoto Y, Nakazawa A et al (2015) Synthetic evidential study as augmented collective thought process–preliminary report. In: Asian Conference on Intelligent Information and Database Systems, Bali, Indonesia, 23–25 Mar 2015. Springer, pp 13–22. https://doi.org/10.1007/978-3-319-15702-3

    Google Scholar 

  • Nouri E, Georgila K, Traum D (2017) Culture-specific models of negotiation for virtual characters: multi-attribute decision-making based on culture-specific values. AI Soc 32(1):51–63

    Article  Google Scholar 

  • Ohmoto Y, Kataoka M, Nishida T (2014) The effect of convergent interaction using subjective opinions in the decision-making process. In: Proceedings of the Cognitive Science Society, vol 36, no. 36

    Google Scholar 

  • Ohmoto Y, Suyama T, Nishida T (2016a) A method to alternate the estimation of global purposes and local objectives to induce and maintain the intentional stance. In: Proceedings of the Fourth International Conference on Human Agent Interaction, Biopolis, Singapore, 04–07 Oct. ACM, pp 379–385

    Google Scholar 

  • Ohmoto Y, Ookaki T, Nishida T (2016b) A support system to accumulate interpretations of multiple story timelines. Procedia Comput Sci 96:607–616

    Article  Google Scholar 

  • Ookaki T, Abe M, Yoshino M, Ohmoto Y, Nishida T (2015) Synthetic evidential study for deepening inside their heart. In: International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, Seoul, South Korea, 10–12 June 2015. Springer, pp 161–170. https://doi.org/10.1007/978-3-319-19066-2

    Google Scholar 

  • Posner J, Russell JA, Peterson BS (2005) The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology. Dev Psychopathol 17(3):715–734

    Article  Google Scholar 

  • Rubin JZ, Brown BR (1975) The social psychology of bargaining and negotiation. Academic, San Diego

    Google Scholar 

  • Thompson L (2000) The Mind and heart of the negotiator. Prentice Hall Press, Upper Saddle River

    Google Scholar 

  • Tomasello M (2010) Origins of human communication. MIT Press, Cambridge/London

    Google Scholar 

  • Traum DR (1994) A computational theory of grounding in natural language conversation. Rochester Univ NY Dept of Computer Science, Technical Report

    Google Scholar 

  • Tversky B (2011) Visualizing thought. Top Cogn Sci 3(3):499–535

    Article  Google Scholar 

  • Wellman HM (2014) Making minds: how theory of mind develops. Oxford University Press, New York

    Book  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. RIKEN AIP, Kyoto, Japan

    Maryam Sadat Mirzaei

  2. Kyoto University, Kyoto, Japan

    Qiang Zhang, Stef van der Struijk & Toyoaki Nishida

Authors
  1. Maryam Sadat Mirzaei
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qiang Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Stef van der Struijk
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Toyoaki Nishida
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maryam Sadat Mirzaei .

Editor information

Editors and Affiliations

  1. Universitat Autònoma de Barcelona, Bellaterra (Cerdanyola del Vallès), Spain

    Jordi Vallverdú

  2. American College of Thessaloniki, Thessaloniki, Greece

    Vincent C. Müller

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG (outside the USA)

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Mirzaei, M.S., Zhang, Q., der Struijk, S.v., Nishida, T. (2019). Towards Conversation Envisioning for Cognitive Robots. In: Vallverdú, J., Müller, V. (eds) Blended Cognition. Springer Series in Cognitive and Neural Systems, vol 12. Springer, Cham. https://doi.org/10.1007/978-3-030-03104-6_7

Download citation

Publish with us

Policies and ethics

Search

Navigation