Conversation Quantization as a Foundation of Conversational Intelligence

  • Toyoaki Nishida
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7813)


The long term goal of this research is to build artificial conversational intelligence that can set up or participate in the fluent conversational interactions as good as people in order to benefit each other. This paper discusses conversation quanta as a foundation of conversational intelligence. In contrast to conversational systems for which much emphasis has been placed on the symbolic processing and algorithms, our approach is data-intensive, allowing for the conversational system to acquire the depth and proficiency in interaction in an incremental fashion, in addition to the broad coverage and robustness.


Conversational Intelligence Conversational Informatics 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Nishida, T. (ed.): Conversational Informatics: an Engineering Approach. John Wiley & Sons Ltd, London (2007)Google Scholar
  2. 2.
    Goffman, E.: Behavior in Public Places. The Free Press (1963)Google Scholar
  3. 3.
    Goffman, E.: Forms of Talk. University of Pennsylvania Press (1981)Google Scholar
  4. 4.
    Austin, J.L.: How to Do Things with Words. Harvard University Press (1962)Google Scholar
  5. 5.
    Searle, J.: Speech Acts. Cambridge University Press (1969)Google Scholar
  6. 6.
    Clark, H.H.: Using Language. Cambridge University Press (1996)Google Scholar
  7. 7.
    Richmond, V.P., McCroskey, J.C., Mickson III, M.L.: Nonverbal Behavior in Interper-sonal Relations. Pearson Education, Inc. (1995)Google Scholar
  8. 8.
    Kendon, A.: Gesture. Cambridge University Press (2004)Google Scholar
  9. 9.
    Kendon, A.: Some Functions of Gaze-direction in Social Interaction. Acta Psychologica 26, 22–63 (1967)CrossRefGoogle Scholar
  10. 10.
    Sacks, H., Schegloff, E.A., Jefferson, G.A.: A Simplest Systematics for the Organization of Turn-Taking in Conversation. Language, 50, 696–735 (1974) Google Scholar
  11. 11.
    Duncan, J. S.: On the Structure of Speaker-Auditor Interaction during Speaking Turns, Lang. Soc. 2, 161–180 (1974)Google Scholar
  12. 12.
    Goodwin, C.: Conversational organization: interaction between speakers and hearers. Academic Press (1981)Google Scholar
  13. 13.
    McNeill, D.: Gesture and Thought. The University of Chicago Press (2005)Google Scholar
  14. 14.
    Green Jr., B.F., Wolf, A.K., Chomsky, C., Laughery, K.: Baseball: an automatic question-answerer. Papers Presented at the AFIPS Joint Computer Conferences, May 9-11, pp. 219–224 (1961)Google Scholar
  15. 15.
    Weizenbaum, J.: ELIZA – a computer program for the study of natural language communication between man and machine, Contextual understanding by computers. Communications of the ACM 10(8), 474–480 (1967)MATHCrossRefGoogle Scholar
  16. 16.
    Winograd, T.: Understanding Natural Language. Academic Press (1972)Google Scholar
  17. 17.
    Erman, L.D., Hayes-Roth, F., Lesser, V.R., Reddy, D.R.: The Hearsay-II Speech-Understanding System: Integrating Knowledge to Resolve Uncertainty. Computing Surveys 12(2), 213–253 (1980)CrossRefGoogle Scholar
  18. 18.
    Bolt, R.A.: “Put-That-There”: Voice and gesture at the graphics interface. In: Proceedings of the 7th Annual Conference on Computer Graphics and Interactive Techniques, vol. 14(3), pp. 262–270 (1980)Google Scholar
  19. 19.
    Sculley, J., Byrne, J.A.: Odyssey: Pepsi to Apple: A Journey of Adventure, Ideas, and the Future (1987)Google Scholar
  20. 20.
    Ball, G., Ling, D., Kurlander, D., Miller, J., Pugh, D., Skelly, T., Stankosky, A., Thiel, D., Van Dantzich, M., Wax, T.: Lifelike Computer Characters: The Persona Project at Microsoft Research. In: Bradshaw, J.M. (ed.) Software Agents. AAAI/MIT Press, Menlo Park (1997)Google Scholar
  21. 21.
    Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.): Embodied Conversational Agents. MIT Press (2000)Google Scholar
  22. 22.
    Prendinger, H., Ishizuka, M. (eds.): Life-like Characters – Tools, Affective Functions and Applications. Springer (2004)Google Scholar
  23. 23.
    Nishida, T.: Conversation quantisation for conversational knowledge process. Int. J. Computational Science and Engineering 3(2), 134–144 (2007)Google Scholar
  24. 24.
    Nishida, T.: Augmenting Conversational Environment. International Journal of Cognitive Informatics and Cognitive Computing (IJCINI) (in press)Google Scholar
  25. 25.
    Nishida, T.: An Engineering Approach to Conversational Informatics. In: Okumura, M., Bekki, D., Satoh, K. (eds.) JSAI-isAI 2012. LNCS, vol. 7258, pp. 226–239. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  26. 26.
    Sumi, Y., Nishida, T., Bono, M., Kijima, H.: IMADE: Research Environment of Real-World Interactions for Structural Understanding and Content Extraction of Conversation. IPSJ Magazine 49(8), 945–949 (2008) (in Japanese)Google Scholar
  27. 27.
    Ohmoto, Y., Ohashi, H., Lala, D., Mori, S., Sakamoto, K., Kinoshita, K., Nishida, T.: ICIE: immersive environment for social interaction based on socio-spatial information. In: Proc. Conference on Technologies and Applications of Artificial Intelligence (TAAI 2011), pp. 119–125 (2011)Google Scholar
  28. 28.
    Polanyi, M.: The Tacit Dimension, Garden City: Doubleday & Co (1966)Google Scholar
  29. 29.
    Lala, D., Nishida, T.: VISIE: A spatially immersive interaction environment using real-time human measurement. In: Proc. GrC 2011, pp. 363–368 (2011)Google Scholar
  30. 30.
    Huang, H., Cerekovic, A., Pandzic, I., Nakano, Y., Nishida, T.: The design of a generic framework for integrating ECA components. In: Proc. of 7th International Conference of Autonomous Agents and Multiagent Systems (AAMAS 2008), Estoril, Portugal, pp. 128–135 (2008)Google Scholar
  31. 31.
    Huang, H.H., Cerekovic, A., Pandzic, I.S., Nakano, Y.I., Nishida, T.: Toward a multiculture adaptive virtual tour guide agent with a modular approach. AI & Society 24(3), 225–235 (2009)CrossRefGoogle Scholar
  32. 32.
    Huang, H.H., Furukawa, T., Ohashi, H., Nishida, T., Cerekovic, A., Pandzic, I.S., Nakano, Y.I.: How multiple concurrent users react to a quiz agent attentive to the dynamics of their game participation. Proc. AAMAS 2010, 1281–1288 (2010)Google Scholar
  33. 33.
    Hacker, B.A., Wankerl, T., Kiselev, A., Huang, H.H., Merckel, L., Okada, S., Schlichter, J., Abdikkev, A., Nishida, T.: Incorporating Intentional and Emotional Behaviors into a Virtual Human for Better Customer-Engineer-Interaction. In: Proc. 10th International Conference on Telecommunications (ConTEL 2009), pp. 163–170 (2009)Google Scholar
  34. 34.
    Kipp, M.: Gesture Generation By Imitation: From Human Behavior To Computer Character Animation., Boca Raton, Florida (2004)Google Scholar
  35. 35.
    Rehm, M., Nakano, Y., André, E., Nishida, T.: Culture-Specific First Meeting Encounters between Virtual Agents. In: Prendinger, H., Lester, J.C., Ishizuka, M. (eds.) IVA 2008. LNCS (LNAI), vol. 5208, pp. 223–236. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  36. 36.
    Yano, M.: Construction of 3-dimensional Recording Environments for Multi-party Conversation with RGB-depth Sensors. Master thesis, Department of Intelligence Science and Technology, Kyoto University (2012) (in Japanese) Google Scholar
  37. 37.
    Mohammad, Y.F.O., Nishida, T., Okada, S.: Unsupervised simultaneous learning of ges-tures, actions and their associations for Human-Robot Interaction. In: Proc. IROS 2009, pp. 2537–2544 (2009)Google Scholar
  38. 38.
    Mohammad, Y.F.O., Nishida, T.: Learning interaction protocols using augmented Baysian networks applied to guided navigation. In: Proc. IROS 2010, pp. 4119–4126 (2010)Google Scholar
  39. 39.
    Mohammad, Y., Nishida, T.: Fluid Imitation: Learning from Unplanned Demonstrations. International Journal of Social Robotics 4(4), 369–382 (2012)CrossRefGoogle Scholar
  40. 40.
    Ohmoto, Y., Miyake, T., Nishida, T.: Dynamic estimation of emphasizing points for user satisfaction evaluations. In: Proc. the 34th Annual Conference of the Cognitive Science Society, pp. 2115–2120 (2012)Google Scholar
  41. 41.
    Ohmoto, Y., Kataoka, M., Miyake, T., Nishida, T.: A method to dynamically estimate emphasizing points and degree by using verbal and nonverbal information and physiological indices. In: Proc. GrC 2011, pp. 508–514 (2011)Google Scholar
  42. 42.
    Lala, D., Nishida, T.: Joint Activity Theory as a Framework for Natural Body Expression in Autonomous Agents. In: 1st International Workshop on Multimodal Learning Analytics, Santa Monica, CA (October 26, 2012)Google Scholar
  43. 43.
    Eisenberg, N., Eggum, N.D., Di Giunta, L.: Empathy-related responding: associations with prosocial behavior, Aggression, and Intergroup Relations. Social Issues and Policy Review 4(1), 143–180 (2010)CrossRefGoogle Scholar
  44. 44.
    Nishida, T.: Towards Mutual Dependency between Empathy and Technology, 25th anniversary volume. AI & Society (online first, 2012) Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Toyoaki Nishida
    • 1
  1. 1.Graduate School of InformaticsKyoto UniversitySakyo-kuJapan

Personalised recommendations