Multimodal Signals: Cognitive and Algorithmic Issues

COST Action 2102 and euCognition International School Vietri sul Mare, Italy, April 21-26, 2008 Revised Selected and Invited Papers

  • Anna Esposito
  • Amir Hussain
  • Maria Marinaro
  • Raffaele Martone

Part of the Lecture Notes in Computer Science book series (LNCS, volume 5398)

Also part of the Lecture Notes in Artificial Intelligence book sub series (LNAI, volume 5398)

Table of contents

  1. Front Matter
  2. Interactive and Unsupervised Multimodal Systems

    1. Gérard Chollet, Anna Esposito, Annie Gentes, Patrick Horain, Walid Karam, Zhenbo Li et al.
      Pages 1-23
    2. Maria Koutsombogera, Harris Papageorgiou
      Pages 40-46
    3. Dirk Heylen, Mannes Poel, Anton Nijholt
      Pages 60-66
    4. Mark ter Maat, Dirk Heylen
      Pages 67-74
    5. Marcos Faundez-Zanuy
      Pages 94-103
    6. Josef Chaloupka, Jan Nouza, Jindrich Zdansky, Petr Cerva, Jan Silovsky, Martin Kroul
      Pages 104-111
    7. Goranka Zoric, Karlo Smid, Igor S. Pandzic
      Pages 112-120
    8. Alina E. Lascu, Alexandru V. Georgescu
      Pages 130-136
    9. René Hempel, Patrick Westfeld
      Pages 137-144
  3. Verbal and Nonverbal Communication Signals

    1. Maciej Karpinski
      Pages 164-169
    2. Isabella Poggi
      Pages 170-186
    3. Uli Sauerland, Mathias Schenner
      Pages 197-207

About these proceedings


This book constitutes the thoroughly refereed post-conference
proceedings of the COST Action 2102 and euCognition supported international school on Multimodal Signals: "Cognitive and Algorithmic Issues" held in Vietri sul Mare, Italy, in April 2008.

The 34 revised full papers presented were carefully reviewed and selected from participants’ contributions and invited lectures given at the workshop. The volume is organized in two parts; the first on Interactive and Unsupervised Multimodal Systems contains 14 papers. The papers deal with the theoretical and computational issue of defining algorithms, programming languages, and determinist models to recognize
and synthesize multimodal signals. These are facial and vocal
expressions of emotions, tones of voice, gestures, eye contact, spatial arrangements, patterns of touch, expressive movements, writing patterns, and cultural differences, in anticipation of the implementation of intelligent avatars and interactive dialogue systems that could be exploited to improve user access to future telecommunication services. The second part of the volume, on Verbal and Nonverbal Communication Signals, presents 20 original studies devoted to the modeling of timing synchronisation between speech production, gestures, facial and head movements in human communicative expressions and on their mutual contribution for an effective communication.


algorithms animation systems architecture audiovisual processing avatar cognition communication computer-assisted surgery conversation analysis dialects emotion recognition gesture modeling programming language speech processing

Editors and affiliations

  • Anna Esposito
    • 1
  • Amir Hussain
    • 2
  • Maria Marinaro
    • 3
  • Raffaele Martone
    • 4
  1. 1.Department of PsychologySecond University of Naples, and IIASSVietri sul Mare (SA)Italy
  2. 2.Department of Computing Science & MathematicsUniversity of StirlingStirlingScotland, UK
  3. 3.Dipartimento di Fisica “E.R. Caianiello”Università degli Studi di Salerno, Italy and IIASSBaronissi (SA)Italy
  4. 4.Dip. di Ingegneria dell’ InformazioneSeconda Università di NapoliAversa (CE)Italy

Bibliographic information

  • DOI
  • Copyright Information Springer-Verlag Berlin Heidelberg 2009
  • Publisher Name Springer, Berlin, Heidelberg
  • eBook Packages Computer Science
  • Print ISBN 978-3-642-00524-4
  • Online ISBN 978-3-642-00525-1
  • Series Print ISSN 0302-9743
  • Series Online ISSN 1611-3349
  • About this book