Skip to main content
SpringerLink
Log in
Book cover

JSAI International Symposium on Artificial Intelligence

JSAI-isAI 2012: New Frontiers in Artificial Intelligence pp 242–256Cite as

Management of Intersubjectivity and Progressivity through Simultaneous Gestural Matching

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 7856))

Abstract

By analyzing the storytelling sequence in a communicative retelling task, this article investigates how participants manage two potentially competing orientations (intersubjectivity and progressivity of storytelling) through Simultaneous Gestural Matching (SGM) between the teller and hearer. Participants of talk-in-interaction have their own space to exhibit their understanding of the conversation visually through nonverbal behaviors such as gestures and posture. SGM is the spatiotemporal coordination of these nonverbal behaviors. Detailed analysis of talk-in-interaction demonstrates that SGM enables participants to show visual, public display of their understanding and thereby contributes to creating intersubjectivity among participants without disrupting the progressivity of storytelling in a manner that is sensitive to the structure of the activity.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   49.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Heritage, J.: Intersubjectivity and progressivity in person (and place) reference. In: Stivers, T., Enfield, N. (eds.) Person Reference in Interaction: Linguistic, Cultural and Social Perspectives, pp. 255–280. Cambridge University Press (2007)

    Google Scholar 

  2. LeBaron, C., Koschmann, T.: Gesture and the Transparency of Understanding. In: Glenn, P., LeBaron, C., Mandelbaum, J. (eds.) Studies in Language and Social Interaction. In Honor of Robert Hopper, pp. 119–130. Erlbaum, Mahway (2003)

    Google Scholar 

  3. Streeck, J.: Laborious Intersubjectivity: Attentional Struggle and Embodied Communication in an Auto-Shop. In: Wachsmuth, I., Lenzen, M., Knoblich, G. (eds.) Embodied Communication in Humans and Machines, pp. 201–228. Oxford University Press (2008)

    Google Scholar 

  4. Joh, A., Hosoma, H.: Simultaneous gestural matching in multi-party conversation (Taninzu kaiwa ni okeru jihatuteki gesture no douki). Cognitive Studies (Ninchi Kagaku) 16(1), 103–119 (2009)

    Google Scholar 

  5. Lerner, G.H.: Turn-sharing: The choral co-production of talk-in-interaction. In: Ford, C., Fox, B., Thompson, S. (eds.) The Language of Turn and Sequence, pp. 225–256. Oxford University Press (2002)

    Google Scholar 

  6. Davis, M.: Interaction Rhythms: Periodicity in Communicative Behavior. Human Sciences Press, New York (1982)

    Google Scholar 

  7. Bernieri, F., Rosenthal, R.: Interpersonal coordination: Behavior matching and interactional synchrony. In: Feldman, R., Rime, B. (eds.) Fundamentals of Nonverbal Behavior: Studies in Emotion and Social Interaction, pp. 401–432. Cambridge University Press (1991)

    Google Scholar 

  8. Schegloff, E.A.: Repair after next turn: the last structurally provided defence of intersubjectivity in conversation. American Journal of Sociology 97(5), 1295–1345 (1992)

    Article  Google Scholar 

  9. Schegloff, E.A., Jefferson, G., Sacks, H.: The preference for self-correction in the organization of repair in conversation. Language 53(2), 361–382 (1977)

    Article  Google Scholar 

  10. Hayashi, M.: Referential problems and turn construction: An exploration of an intersection between grammar and interaction. Text 25(4), 437–468 (2005)

    Article  Google Scholar 

  11. Kushida, S.: Referrer-initiated recognition search: on the management of recognition and progressivity (Shijisya ga kaishi suru ninsiki tansaku: Ninshiki to sinkousei no yarikuri). Japanese Journal of Language in Society (Syakai gengo kagaku) 10(2), 96–108 (2008)

    MathSciNet  Google Scholar 

  12. Sacks, H., Schegloff, E.A.: Two preferences in the organization of reference to persons in conversation and their interaction. In: Psathas, G. (ed.) Everyday Language: Studies in Ethnomethodology, pp. 15–21. Irvington, New York (1979)

    Google Scholar 

  13. Sacks, H.: Lectures on conversation. Blackwell, Oxford (1992)

    Google Scholar 

  14. Streeck, J.: On projection. In: Goody, E. (ed.) Interaction and Social Intelligence, pp. 84–110. Cambridge University Press (1995)

    Google Scholar 

  15. Kita, S., Özyürek, A.: What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language 48(1), 16–32 (2003)

    Article  Google Scholar 

  16. McNeill, D.: Hand and Mind: What Gestures Reveal about Thought. The University of Chicago Press (1992)

    Google Scholar 

  17. Lerner, G.H.: Assisted storytelling: Deploying shared knowledge as a practical matter. Qualitative Sociology 15(3), 247–271 (1992)

    Article  Google Scholar 

  18. Hosoma, H.: Sequential structures of gestures in adjacency pairs (Washa koutai wo koeru gesture no jikan koozoo: Rinsetsu pea no baai). Cognitive Studies (Ninchi Kagaku) 16(1), 91–102 (2009)

    Google Scholar 

  19. Mondada, L.: Multimodal resources for turn-taking: pointing and the emergence of possible next speakers. Discourse Studies 9(2), 194–225 (2007)

    Article  Google Scholar 

  20. Peräkylä, A., Ruusuvuori, J.: Facial expression in an assessment. In: Knoblauch, H., Raab, J., Soeffner, H.-G., Schnettler, B. (eds.) Video-Analysis: Methodology and Methods. Qualitative Audiovisual Data Analysis in Sociology, pp. 127–142. Frankfurt Peter Lang (2006)

    Google Scholar 

  21. Kushida, S.: Interaction order and conversation analysis (Sougo koui chitsujo to kaiwa bunseki: “hanashi te” to “kyou-seiin sei” wo meguru sanka no soshiki ka). Sekai sisou sya, Kyoto (2006)

    Google Scholar 

  22. Kendon, A.: Gesture: Visible action as utterance. Cambridge University Press (2004)

    Google Scholar 

  23. Schegloff, E.A.: Sequence Organization in Interaction. Cambridge University Press (2007)

    Google Scholar 

  24. McNeill, D.: Gesture and thought. The University of Chicago Press (2005)

    Google Scholar 

  25. Iwasaki, S.: Initiating interactive turn spaces in Japanese conversation: Local projection and collaborative action. Discourse Processes 46(2), 226–246 (2009)

    Article  Google Scholar 

  26. Heritage, J.: A change-of-state token and aspects of its sequential placement. In: Atkinson, J.M., Heritage, J. (eds.) Structures of Social Action, pp. 299–345. Cambridge University Press (1984)

    Google Scholar 

  27. Goodwin, C.: Time in action. Current Anthropology 43, 19–35 (2002)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Japan Society for the Promotion of Science, Japan

    Ayami Joh

  2. Department of Human Cultures, University of Shiga Prefecture, 2500, Hassaka-cho, Hikone, 522-8533, Japan

    Ayami Joh

Authors
  1. Ayami Joh
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. National Institute of Advanced Industrial Science and Technology (AIST), Japan

    Yoichi Motomura

  2. Tohoku University, Kawauchi 41, 980-8576, Aoba-ku, Sendai, Japan

    Alastair Butler

  3. Ochanomizu University, 2-1-1 Bunkyo-ku, 122-8610, Tokyo, Japan

    Daisuke Bekki

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Joh, A. (2013). Management of Intersubjectivity and Progressivity through Simultaneous Gestural Matching. In: Motomura, Y., Butler, A., Bekki, D. (eds) New Frontiers in Artificial Intelligence. JSAI-isAI 2012. Lecture Notes in Computer Science(), vol 7856. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39931-2_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-39931-2_18

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-39930-5

  • Online ISBN: 978-3-642-39931-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation