Language Resources and Evaluation

, Volume 41, Issue 3, pp 273–287

The MUMIN coding scheme for the annotation of feedback, turn management and sequencing phenomena


  • Jens Allwood
    • University of Göteborg
  • Loredana Cerrato
    • TMH/CTT, KTH
  • Kristiina Jokinen
    • University of Helsinki
  • Costanza Navarretta
    • University of Copenhagen
    • University of Copenhagen

DOI: 10.1007/s10579-007-9061-5

Cite this article as:
Allwood, J., Cerrato, L., Jokinen, K. et al. Lang Resources & Evaluation (2007) 41: 273. doi:10.1007/s10579-007-9061-5


This paper deals with a multimodal annotation scheme dedicated to the study of gestures in interpersonal communication, with particular regard to the role played by multimodal expressions for feedback, turn management and sequencing. The scheme has been developed under the framework of the MUMIN network and tested on the analysis of multimodal behaviour in short video clips in Swedish, Finnish and Danish. The preliminary results obtained in these studies show that the reliability of the categories defined in the scheme is acceptable, and that the scheme as a whole constitutes a versatile analysis tool for the study of multimodal communication behaviour.


Multimodal annotationFeedbackHand and facial gestures

Copyright information

© Springer Science+Business Media B.V. 2008