Language Resources and Evaluation

, Volume 41, Issue 3, pp 273-287

First online:

The MUMIN coding scheme for the annotation of feedback, turn management and sequencing phenomena

  • Jens AllwoodAffiliated withUniversity of Göteborg
  • , Loredana CerratoAffiliated withTMH/CTT, KTH
  • , Kristiina JokinenAffiliated withUniversity of Helsinki
  • , Costanza NavarrettaAffiliated withUniversity of Copenhagen
  • , Patrizia PaggioAffiliated withUniversity of Copenhagen Email author 

Rent the article at a discount

Rent now

* Final gross prices may vary according to local VAT.

Get Access


This paper deals with a multimodal annotation scheme dedicated to the study of gestures in interpersonal communication, with particular regard to the role played by multimodal expressions for feedback, turn management and sequencing. The scheme has been developed under the framework of the MUMIN network and tested on the analysis of multimodal behaviour in short video clips in Swedish, Finnish and Danish. The preliminary results obtained in these studies show that the reliability of the categories defined in the scheme is acceptable, and that the scheme as a whole constitutes a versatile analysis tool for the study of multimodal communication behaviour.


Multimodal annotation Feedback Hand and facial gestures