Advertisement

A Phonetic Analysis of Natural Laughter, for Use in Automatic Laughter Processing Systems

  • Jérôme Urbain
  • Thierry Dutoit
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6974)

Abstract

In this paper, we present the detailed phonetic annotation of the publicly available AVLaughterCycle database, which can readily be used for automatic laughter processing (analysis, classification, browsing, synthesis, etc.). The phonetic annotation is used here to analyze the database, as a first step. Unsurprisingly, we find that h-like phones and central vowels are the most frequent sounds in laughter. However, laughs can contain many other sounds. In particular, nareal fricatives (voiceless friction in the nostrils) are frequent both in inhalation and exhalation phases. We show that the airflow direction (inhaling or exhaling) changes significantly the duration of laughter sounds. Individual differences in the choice of phones and their duration are also examined. The paper is concluded with some perspectives the annotated database opens.

Keywords

Equal Error Rate Speech Synthesis Virtual Agent Phonetic Transcription Annotate Database 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bachorowski, J.A., Smoski, M.J., Owren, M.J.: The acoustic features of human laughter. Journal of the Acoustical Society of America 110, 1581–1597 (2007)CrossRefGoogle Scholar
  2. 2.
    Bennett, M.P., Lengacher, C.: Humour and laughter may influence health. III. Laughter and Health Outcomes. Evidence-based Complementary and Alternative Medicine 5(1), 37–40 (2008)CrossRefGoogle Scholar
  3. 3.
    Boersma, P., Weenink, D.: Praat: doing phonetics by computer (version 5.2.11) (computer program), www.praat.org (retrieved on January 20, 2011)
  4. 4.
    Carletta, J.: Unleashing the killer corpus: experiences in creating the multi-everything AMI Meeting Corpus. Language Resources and Evaluation Journal 41(2), 181–190 (2007)CrossRefGoogle Scholar
  5. 5.
    Chafe, W.: The Importance of not being earnest. In: The Feeling Behind Laughter and Humor., paperback 2009 edn. Consciousness & Emotion Book Series, vol. 3. John Benjamins Publishing Company, Amsterdam (2007)Google Scholar
  6. 6.
    Cox, T.: Laughter’s secrets: faking it – the results. New Scientist (July 27, 2010), http://www.newscientist.com/article/dn19227-laughters-secrets-faking-it--the-results.html
  7. 7.
    Esling, J.H.: States of the larynx in laughter. In: Proc. of the Interdisciplinary Workshop on the Phonetics of Laughter, Saarbrücken, Germany, pp. 15–20 (2007)Google Scholar
  8. 8.
    Hunt, A., Black, A.: Unit selection in a concatenative speech synthesis system using a large speech database. In: ICASSP, pp. 373–376. IEEE, Los Alamitos (1996)Google Scholar
  9. 9.
    Janin, A., Baron, D., Edwards, J., Ellis, D., Gelbart, D., Morgan, N., Peskin, B., Pfau, T., Shriberg, E., Stolcke, A., et al.: The ICSI meeting corpus. In: Proc. of ICASSP 2003, vol. 1, p. I–364. IEEE, Hong-Kong (2003)Google Scholar
  10. 10.
    Kennedy, L., Ellis, D.: Laughter detection in meetings. In: NIST ICASSP 2004 Meeting Recognition Workshop, Montreal, pp. 118–121 (2004)Google Scholar
  11. 11.
    Knox, M.T., Morgan, N., Mirghafori, N.: Getting the last laugh: automatic laughter segmentation in meetings. In: INTERSPEECH 2008, Brisbane, Australia (2008)Google Scholar
  12. 12.
    Ladefoged, P.: A course in phonetics, http://hctv.humnet.ucla.edu/departments/linguistics/VowelsandConsonants/course/chapter1/chapter1.html (consulted on January 20, 2011)
  13. 13.
    Lasarcyk, E., Trouvain, J.: Imitating conversational laughter with an articulatory speech synthesis. In: Proc. of the Interdisciplinary Workshop on the Phonetics of Laughter, Saarbrücken, Germany, pp. 43–48 (2007)Google Scholar
  14. 14.
    Mahony, D.L.: Is laughter the best medicine or any medicine at all? Eye on Psi. Chi. 4(3), 18–21 (2000)Google Scholar
  15. 15.
    Petridis, S., Pantic, M.: Is this joke really funny? Judging the mirth by audiovisual laughter analysis. In: Proc. of ICME 2009, New York, USA, pp. 1444–1447 (2009)Google Scholar
  16. 16.
    Pompino-Marschall, B., Kowal, S., O’Connell, D.C.: Some phonetic notes on emotion: laughter, interjections and weeping. In: Proc. of the Interdisciplinary Workshop on the Phonetics of Laughter, Saarbrücken, Germany, pp. 41–42 (2007)Google Scholar
  17. 17.
    Ruch, W., Ekman, P.: The expressive pattern of laughter. In: Kaszniak, A. (ed.) Emotion, Qualia and Consciousness. World Scientific Publishers, Tokyo (2001)Google Scholar
  18. 18.
    Sundaram, S., Narayanan, S.: Automatic acoustic synthesis of human-like laughter. Journal of the Acoustical Society of America 121(1), 527–535 (2007)CrossRefGoogle Scholar
  19. 19.
    Szameitat, D.P., Alter, K., Szameitat, A.J., Wildgruber, D., Sterr, A., Darwin, C.J.: Acoustic profiles of distinct emotional expressions in laughter. The Journal of the Acoustical Society of America 126(1), 354–366 (2009)CrossRefGoogle Scholar
  20. 20.
    Tokuda, K., Zen, H., Black, A.: An HMM-based speech synthesis system applied to english. In: 2002 IEEE TTS Workshop, Santa Monica, California (2002)Google Scholar
  21. 21.
    Trouvain, J.: Segmenting phonetic units in laughter. In: Proc. of the 15th International Congress of Phonetic Sciences, Barcelona, Spain, pp. 2793–2796 (2003)Google Scholar
  22. 22.
    Truong, K.P., van Leeuwen, D.A.: Evaluating automatic laughter segmentation in meetings using acoustic and acoustic-phonetic features. In: Proc. of the Interdisciplinary Workshop on the Phonetics of Laughter. Saarbrücken, Germany (2007)Google Scholar
  23. 23.
    Urbain, J., Bevacqua, E., Dutoit, T., Moinet, A., Niewiadomski, R., Pelachaud, C., Picart, B., Tilmanne, J., Wagner, J.: The AVLaughterCycle database. In: Proc. of LREC 2010, Valletta, Malta (2010)Google Scholar
  24. 24.
    Urbain, J., Niewiadomski, R., Bevacqua, E., Dutoit, T., Moinet, A., Pelachaud, C., Picart, B., Tilmanne, J., Wagner, J.: AVLaughterCycle: Enabling a virtual agent to join in laughing with a conversational partner using a similarity-driven audiovisual laughter animation. JMUI 4(1), 47–58 (2010), special Issue: eNTERFACE 2009 Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Jérôme Urbain
    • 1
  • Thierry Dutoit
    • 1
  1. 1.Faculté Polytechnique de Mons, TCTS LabUniversité de Mons - UMONSMonsBelgium

Personalised recommendations