The analysis of embodied communicative feedback in multimodal corpora: a prerequisite for behavior simulation
- 263 Downloads
Communicative feedback refers to unobtrusive (usually short) vocal or bodily expressions whereby a recipient of information can inform a contributor of information about whether he/she is able and willing to communicate, perceive the information, and understand the information. This paper provides a theory for embodied communicative feedback, describing the different dimensions and features involved. It also provides a corpus analysis part, describing a first data coding and analysis method geared to find the features postulated by the theory. The corpus analysis part describes different methods and statistical procedures and discusses their applicability and the possible insights gained with these methods.
KeywordsCommunicative embodied feedback Contact Perception Understanding Emotions Multimodal Embodied communication
We thank the Ludwig Boltzmann Institute for Urban Ethology in Vienna for help with data collection and transcription, the Department of Linguistics and SSKKII Center for Cognitive Science, Göteborg University, and the ZiF Center of Interdisciplinary Research in Bielefeld/Germany.
- Allwood, J. (1976). Linguistic communication as action and cooperation. Gothenburg monographs in linguistics 2. Göteborg University, Department of Linguistics.Google Scholar
- Allwood, J. (2000). Structure of dialog. In M. Taylor, D. Bouwhuis, & F. Neel (Eds.), The structure of multimodal dialogue II (pp. 3–24). Amsterdam: Benjamins.Google Scholar
- Allwood, J., Cerrato, L., Dybjær, L., Jokinen, K., Navaretta, C., & Paggio, P. (2005). The MUMIN Multimodal Coding Scheme. NorFA Yearbook 2005.Google Scholar
- Bakeman, R., & Quera, V. (1995). Analyzing interaction: Sequential analysis with SDIS and GSEQ. New York: Cambridge University Press.Google Scholar
- Kopp, S., Gesellensetter, L., Krämer, N., & Wachsmuth, I. (2005): A conversational agents as museum guide: design and evaluation of a real-world application. In Panayiotopoulos et al. (Eds.) Intelligent Virtual Agents, LNAI 3661 (pp. 329–343). Berlin: Springer-Verlag.Google Scholar
- Kopp, S., Allwood, J., Grammer, K., Ahlsen, E., & Stocksmeier, T. (2008): Modeling Embodied Feedback With Virtual Humans. In I. Wachsmuth & G. Knoblich (Eds.), Modeling embodied communication in robots and virtual humans, LNAI 4930. Springer-Verlag.Google Scholar
- Magnusson, M. S. (2000). Discovering hidden time patterns in behavior: T-patterns and their detection. Behavior Research Methods and Instrumentation, 32, 93–110.Google Scholar
- Peirce, C. S. (1931). In C. Hartshorne, P. Weiss & A. Burks (Eds.), Collected Papers of Charles Sanders Peirce, 1931–1958, 8 vols. Cambridge, Mass.: Harvard University Press.Google Scholar
- Popper, K. (1959). The logic of scientific discovery (trans. Logik der Forschung). London: Hutchinson.Google Scholar
- Wiener, N. (1948). Cybernetics or control and communication in the animal and the machine. MIT Press.Google Scholar