Towards a Framework of Critical Multimodal Analysis: Emotion in a Film Trailer

  • Maria Bortoluzzi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5641)


This paper presents a pilot study in the analysis of emotion integrating approaches from traditionally separate theoretical backgrounds: socio-semiotic studies and cognitive studies. The general aim is to identify a flexible and comprehensive framework for critical multimodal analysis of visual, verbal (oral, written and a blend of the two), kinetic, sound, music and graphic aspects. The case-study, exemplifying this kind of integrated approach in its initial stages, identifies the voices of emotion as expressed in the trailer of the film An Inconvenient Truth (2006) and discusses their intertextual and interdiscoursal characteristics. Aspects of the on-going research projects are discussed.


Multimodality Emotion Socio-semiotic Analysis Critical Discourse Studies 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Baldry, A. (ed.): Multimodality and Multimediality in the Distance Learning Age. Palladino, Campobasso (2000)Google Scholar
  2. 2.
    Baldry, A.: A Multimodal Approach to Text Studies in English. Palladino, Campobasso (2005)Google Scholar
  3. 3.
    Baldry, A., Thibault, P.J.: Multimodal Transcription and Text Analysis Equinox, London (2006)Google Scholar
  4. 4.
    Bakhtin, M.: The Dialogical Imagination. University of Texas Press, Austin (1981)Google Scholar
  5. 5.
    Bednarek, M.: Emotion Talk across Corpora. Palgrave Macmillan, Basingstoke (2008)CrossRefGoogle Scholar
  6. 6.
    Cortese, G., Duszak, A. (eds.): Identity, Community, Discourse. English in Intercultural Settings. Peter Lang, Bern (2005)Google Scholar
  7. 7.
    Damasio, A.R.: Looking for Spinoza: Joy, Sorrow and the Feeling Brain. Harvest Books, Washington (2003)Google Scholar
  8. 8.
    Damasio, A.R.: Emotion in the perspective of an integrated nervous system. Brain Research Reviews 26(2-3), 83–86 (1998)CrossRefGoogle Scholar
  9. 9.
    Damasio, A.R.: The Feeling of What Happens: Body, Emotion and the Making of Consciousness, London, Heinemann (1999)Google Scholar
  10. 10.
    Davies, M., Ravelli, L. (eds.): Advances in Systemic Linguistics. Recent Theory and Practice. Pinter, London (1992)Google Scholar
  11. 11.
    Dusi, N.: Le forme del trailer come manipolazione intrasemiotica. In: Pezzini, I. (ed.) Trailer, spot, clip, siti, banner, Le forme brevi della comunicazione audiovisiva, pp. 31–66. Meltemi, Roma (2002)Google Scholar
  12. 12.
    Ekman, P.: Should we call it expression or communication? Social Science Research 10(4), 333–344 (1997)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Ekman P.: Basic Emotions (1999), (last accessed, 20-1-2009)
  14. 14.
    Esposito, A., et al. (eds.): Multimodal Signals: Cognitive and Algorithmic Issues. Springer, Berlin (2009)Google Scholar
  15. 15.
    Fairclough, N. (ed.): Critical Language Awareness. Longman, London (1992)Google Scholar
  16. 16.
    Fairclough, N.: Language and Power, 2nd edn. Pearson Education, London (2001)Google Scholar
  17. 17.
    Fairclough, N.: Analysing Discourse: Textual Analysis for Social Research. Routledge, London (2003)Google Scholar
  18. 18.
    Fairclough, N.: Language and Globalization. Routledge, London (2006)Google Scholar
  19. 19.
    Fedeli, D.: Emozioni e successo scolastico. Carocci, Roma (2006)Google Scholar
  20. 20.
    Forceville, C.: Pictorial Metaphor in Advertising. Routledge, London (1996)CrossRefGoogle Scholar
  21. 21.
    Forceville, C.: Metaphor in Pictures and Multimodal Representations. In: Gibbs, R. (ed.) The Cambridge Handbook of Metaphor and Though, pp. 462–481. C.U.P., Cambridge (2008)CrossRefGoogle Scholar
  22. 22.
    Fussell, S.R.: The Verbal Communication of Emotions. In: An Interdisciplinary Perspective. Lawrence Erlbaum Associates, Mahwah (2002)Google Scholar
  23. 23.
    Gallois, C.: Group membership, social rules, and power: a socio-psychological perspective on emotional communication. Journal of Pragmatics 22, 301–324 (1994)CrossRefGoogle Scholar
  24. 24.
    Goatly, A.: Washing the Brain – Metaphor and Hidden Ideology. John Benjamins, Amsterdam (2007)CrossRefGoogle Scholar
  25. 25.
    Halliday, M.A.K.: An Introduction to Functional Grammar, 2nd edn. Edward Arnold, London (1994)Google Scholar
  26. 26.
    Halliday, M.A.K., Matthiessen, C.M.I.M.: An Introduction to Functional Grammar, 3rd edn. Edward Arnold, London (2004)Google Scholar
  27. 27.
    Hasan, R., Matthiessen, C., Webster, J. (eds.): Continuing Discourse on Language. A Functional Perspective. Continuum, London (2005)Google Scholar
  28. 28.
    Hodge, R., Kress, G.: Language as Ideology, 2nd edn. Routledge, London (1993)Google Scholar
  29. 29.
    Holquist, M.: Glossary. In: Bakhtin, M. (ed.) The Dialogical Imagination, pp. 423–434. University of Texas Press, Austin (1981)Google Scholar
  30. 30.
    Hunston, S., Thompson, G. (eds.): Evaluation in Text: Authorial Stance and the Construction of Discourse. Oxford University Press, Oxford (2000)Google Scholar
  31. 31.
    Iedema, R.: Multimodality, resemiotization: extending the analysis of discourse as multi-semiotic practice. Visual Communication 2(1), 29–57 (2003)CrossRefGoogle Scholar
  32. 32.
    Johnson-Laird, P.N., Oatley, K.: The language of emotions: An analysis of a semantic field. Cognition and Emotion 3, 81–123 (1898)CrossRefGoogle Scholar
  33. 33.
    Kővecses, Z.: Metaphor and emotion. Cambridge University Press, Cambridge (2000)Google Scholar
  34. 34.
    Kővecses, Z.: Metaphor in Culture. Cambridge University Press, Cambridge (2005)CrossRefGoogle Scholar
  35. 35.
    Kress, G.: Literacy in the New Media Age. Routledge, London (2003)CrossRefGoogle Scholar
  36. 36.
    Kress, G., van Leeuwen, T.: Multimodal Discourse. Edward Arnold, London (2001)Google Scholar
  37. 37.
    Kress, G., van Leeuwen, T.: Colour as a semiotic mode: notes for a grammar of colour. Visual Communication 1(3), 343–368 (2002)CrossRefGoogle Scholar
  38. 38.
    Kress, G., van Leeuwen, T.: Reading Images: The Grammar of Visual Design. Routledge, London (2006)Google Scholar
  39. 39.
    Lakoff, G., Johnson, M.: Metaphors We Live By. The Chicago University Press, Chicago (1980) Google Scholar
  40. 40.
    Lassen, I., Strunck, J., Vestergaard, T. (eds.): Mediating Ideology in Text and Image. John Benjamins, Amsterdam (2006)Google Scholar
  41. 41.
    Ledoux, J.: Il cervello emotivo. Baldini and Castoldi, Milano (1998)Google Scholar
  42. 42.
    Maier, C.D.: The Promotional Genre of Film Trailers: Persuasive Structures in a Multimodal Form. Unpublished Ph.D Thesis, Aarhus school of Business, University of Aarhus, Denmark (2006)Google Scholar
  43. 43.
    Martin, J.R.: English Text: System and Structure. John Benjamins, Amsterdam (1992)CrossRefGoogle Scholar
  44. 44.
    Martin, J.R., White, P.R.R.: The Language of Evaluation: Appraisal in English. Palgrave, London (2005)CrossRefGoogle Scholar
  45. 45.
    Martin, J.R., Wodak, R. (eds.): Re/reading the past. Critical and functional perspectives on time and value. John Benjamins, Amsterdam (2003)Google Scholar
  46. 46.
    Niemeier, S., Dirven, R. (eds.): The Language of Emotions. John Benjamins, Amsterdam (1997)Google Scholar
  47. 47.
    Norris, S.: Analysing Multimodal Interaction: A Methodological Framework. Routledge, London (2004)Google Scholar
  48. 48.
    Norris, S., Jones, R.H. (eds.): Discourse in Action. Introducing Mediated Discourse Analysis. Routledge, London (2005)Google Scholar
  49. 49.
    Oatley, K., keltner, D., Jenkins, J.: Understanding Emotions. Blackwell, Oxford (2006)Google Scholar
  50. 50.
    O’Halloran, K. (ed.): Multimodal Discourse Analysis. Systemic-Functional Perspectives. Continuum, London (2004)Google Scholar
  51. 51.
    Riley, P.: Epistemic Communities: The Social Knowledge System, Discourse and Identity. In: Cortese, G., Riley, P. (eds.) Domain-specific English. Textual Practices across Communities and Classrooms, pp. 41–64. Peter Lang, Bern (2002)Google Scholar
  52. 52.
    Robinson, J.: Deeper than Reason: Emotion and Its Role in Literature, Music, and Art. O.U.P., Oxford (2005)CrossRefGoogle Scholar
  53. 53.
    Semino, E.: Metaphor in Discourse. C.U.P., Cambridge (2008)Google Scholar
  54. 54.
    Scherer, K.R.: What are Emotions? And how can they be measured? Social Science Information 44(4), 695–729 (2005)CrossRefGoogle Scholar
  55. 55.
    Turner, J., Stets, J.E.: The Sociology of Emotions. C.U.P., Cambridge (2005)CrossRefGoogle Scholar
  56. 56.
    Van Dijk, T.A.: Critical Discourse Analysis. In: Schriffrin, D., Tannen, D., Hamilton, H.E. (eds.) The Handbook of Discourse Analysis, pp. 352–371. Blackwell, Oxford (2001)Google Scholar
  57. 57.
    Van Dijk, T.A.: The Discourse-Knowledge Interface. In: Weiss, G., Wodak, R. (eds.) Methods of Critical Discourse Analysis, pp. 95–120. Sage, London (2003)Google Scholar
  58. 58.
    Van Dijk, T.A.: Contextual Knowledge Management in Discourse Production. A CDA Perspective. In: Wodak, R., Chilton, P.A. (eds.) New Agenda in CDA, pp. 71–100. Benjamins, Amsterdam (2005)Google Scholar
  59. 59.
    Van Dijk, T.A.: Discourse and Power. Palgrave Macmillan, Basingstoke (2008)CrossRefGoogle Scholar
  60. 60.
    Van Leeuwen, T.: Moving English: The Visual Language of Film. In: Goodman, S., Graddol, D. (eds.) Redesigning English: New Texts, New Identities, pp. 81–105. Routledge, London (1996)Google Scholar
  61. 61.
    Van Leeuven, T.: Speech, Music, Sound. Macmillan, London (1999)Google Scholar
  62. 62.
    Van Leeuwen, T., Machin, D.: Global Media Discourse. Routledge, London (2007)Google Scholar
  63. 63.
    Vincent, J., Fortunati, L. (eds.): Electronic Emotion, the Mediation of Emotion via Information and Communication Technologies. Peter Lang, Oxford (2009)Google Scholar
  64. 64.
    Weiss, G., Wodak, R. (eds): Critical Discourse Analysis. Theory and Interdisciplinarity. Palgrave Macmillan, Basingstoke (2002) Google Scholar
  65. 65.
    Wenger, E.: Communities of Practice, Learning, Meaning and Identity, 2nd edn. Cambridge University Press, Cambridge (1999)Google Scholar
  66. 66.
    White, P.R.R.: Appraisal – The Language of Evaluation and Intersubjective Stance (2005), (last accessed, 20-1-2009)
  67. 67.
    White, P.R.R.: Evaluative semantics and ideological positioning in journalistic discourse. A new framework for analysis. In: Lassen, I., Strunck, J., Vestergaard, T. (eds.) Mediating Ideology in Text and Image, pp. 37–67. John Benjamins, Amsterdam (2006)CrossRefGoogle Scholar
  68. 68.
    Wierzbicka, A.: Emotions across languages and cultures: Diversity and Universals. Cambridge University Press, Cambridge (1999)CrossRefGoogle Scholar
  69. 69.
    Wodak, R.: What CDA is about – a summary of its history, important concepts and its developments. In: Wodak, R., Meyer, M. (eds.) Methods in Critical Discourse Analysis, pp. 1–13. Sage, London (2001)CrossRefGoogle Scholar
  70. 70.
    Wodak, R.: Images in/and news in a globalised world. In: Lassen, I., Strunck, J., Vestergaard, T. (eds.) Mediating Ideology in Text and Image, pp. 1–16. John Benjamins, Amsterdam (2006)CrossRefGoogle Scholar
  71. 71.
    Wodak, R., Meyer, M. (eds.): Methods in Critical Discourse Analysis. Sage, London (2001)Google Scholar
  72. 72.
    An Inconvenient Truth. A Global Warning. Paramount Classics, directed by Davis Guggenheim, U.S.A. (2006), (last accessed, 3-4-2009)
  73. 73.
    An Inconvenient Truth. A Global Warning. Paramount Classics, directed by Davis Guggenheim, U.S.A. (2006), (last accessed, 3-4-2009)

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Maria Bortoluzzi
    • 1
  1. 1.Faculty of Education, Multimedia Science and TechnologyUniversity of UdinePordenoneItaly

Personalised recommendations