Advertisement

Linguistic and Non-verbal Cues for the Induction of Silent Feedback

  • Maria Koutsombogera
  • Harris Papageorgiou
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5967)

Abstract

The aim of this study is to analyze certain linguistic (dialogue acts, morphosyntactic units, semantics) and non-verbal cues (face, hand and body gestures) that may induce the silent feedback of a participant in face-to-face discussions. We analyze the typology and functions of the feedback expressions as attested in a corpus of TV interviews and then we move on to the investigation of the immediately preceding context to find systematic evidence related to the production of feedback. Our motivation is to look into the case of active listening by processing data from real dialogues based on the discourse and lexical content that induces the listener’s reactions.

Keywords

Silent feedback multimodal dialogues non-verbal expressions dialogue acts morphosyntactic structures semantics 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Allwood, J., Nivre, J., Ahlsén, E.: On the semantics and pragmatics of linguistic feedback. Journal of Semantics 9(1), 1–29 (1993)CrossRefGoogle Scholar
  2. 2.
    Allwood, J., Cerrato, L.: A Study of Gestural Feedback Expressions. In: Paggio, P., Jokinen, K., Jönsson, A. (eds.) First Nordic Symposium on Multimodal Communication, Copenhagen, pp. 7–22 (2003)Google Scholar
  3. 3.
    Bertrand, R., Ferré, G., Blache, P., Espesser, R., Rauzy, S.: Backchannels revisited from a multimodal perspective. In: Proceedings of International Conference on Auditory-Visual Speech Processing (AVSP 2007), pp. 1–17 (2007b)Google Scholar
  4. 4.
    Ahlsén, E., Allwood, J., Nivre, J.: Feedback in different social activities. In: Juel-Henrichsen, P. (ed.) Nordic Research on Relations Between Utterances. Copenhagen Working Papers in LSP 3, pp. 9–37 (2003)Google Scholar
  5. 5.
    Allwood, J., Kopp, S., Grammer, K., Ahlsén, E., Oberzaucher, E., Koppensteiner, M.: The analysis of embodied communicative feedback in multimodal corpora: a prerequisite for behavior simulation. Journal on Language Resources and Evaluation 41(3-4), 255–272 (2007)CrossRefGoogle Scholar
  6. 6.
    Condon, W.S., Ogston, W.: Speech and Body Motion Synchrony of the Speaker-Hearer. In: Horton, D.L., Jenkins, J.J. (eds.) Perception of Language, Merrill, Columbus, Ohio, pp. 150–173 (1971)Google Scholar
  7. 7.
    Kendon, A.: Movement coordination in social interaction: some examples described. In: Kendon, A. (ed.) Conducting Interaction: Patterns of Behavior in Focused Encounters, pp. 91–116. Cambridge University Press, Cambridge (1990)Google Scholar
  8. 8.
    Allwood, J., Cerrato, L., Jokinen, K., Navarretta, C., Paggio, P.: The MUMIN Coding Scheme for the Annotation of Feedback, Turn Management and Sequencing Phenomena. Multimodal Corpora for Modeling Human Multimodal Behaviour. Journal on Language Resources and Evaluation 41(3-4), 273–287 (2007)CrossRefGoogle Scholar
  9. 9.
    Koutsombogera, M., Papageorgiou, H.: Multimodality Issues in Conversation Analysis of Greek TV Interviews. In: Esposito, A., Hussain, A., Marinaro, M., Martone, R. (eds.) Multimodal Signals: Cognitive and Algorithmic Issues. LNCS, vol. 5398, pp. 40–46. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  10. 10.
    Clark, H.H., Schaefer, E.F.: Contributing to discourse. Cognitive Science 13, 259–294 (1989)CrossRefGoogle Scholar
  11. 11.
    Bunt, H.C.: Dimensions in Dialogue Act Annotation. In: Proceedings of Fifth International Conference on Language Resources and Evaluation, pp. 1444–1448. ELRA, Paris (2006)Google Scholar
  12. 12.
    Ford, C.E., Thompson, S.A.: Interactional Units in Conversation: Syntactic, Intonational, and Pragmatic Resources for the Management of Turns. In: Ochs, E., Schegloff, E.A., Thompson, S.A. (eds.) Interaction and Grammar, pp. 134–184. Cambridge University Press, Cambridge (1996)CrossRefGoogle Scholar
  13. 13.
    McNeill, D.: Hand and Mind: What Gestures Reveal About Thought. University of Chicago Press, Chicago (1992)Google Scholar
  14. 14.
    Sinclair, J. (Editor-in-Chief): Collins COBUILD English Grammar. Collins, London (1990)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Maria Koutsombogera
    • 1
    • 2
  • Harris Papageorgiou
    • 1
  1. 1.Institute for Language & Speech ProcessingAthensGreece
  2. 2.Department of LinguisticsUniversity of AthensAthensGreece

Personalised recommendations