Emotionally Loaded Mobile Multimedia Messaging

  • Timo Saari
  • Marko Turpeinen
  • Jari Laarni
  • Niklas Ravaja
  • Kari Kallinen
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3166)


Mobile messaging is an increasingly important way of social interaction as people use their mobile phones for communicating with each other with textual and multimedia messages. Often with these messaging systems people have the need to communicate their own emotions or facilitate a given emotion in the receiver of their message. This paper will describe an information personalization system that may facilitate emotional communication especially in mobile multimedia messaging systems, thereby making the communication “emotionally loaded”.


Psychological Effect User Profile Cognitive Style Emotional Effect Collaborative Filter 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Agre, P.E.: Designing Genres for New Media: Social, Economic, and Political Contexts. In: Jones, S.G. (ed.) Cybersociety 2.0: Revisiting Computer-Mediated Communication and Community, Sage Publications, Thousand Oaks (1998)Google Scholar
  2. 2.
    Benkler, Y.: From Consumers to Users: Shifting the Deeper Structures of Regulation. Federal Communications Law Journal 52, 561–563 (2000)Google Scholar
  3. 3.
    Billmann, D.: Representations. In: Bechtel, W., Graham, G. (eds.) A companion to cognitive science, pp. 649–659. Blackwell, Malden (1998)Google Scholar
  4. 4.
    Biocca, F., Levy, M.: Communication in the age of virtual reality. Lawrence Erlbaum, Hillsdale (1995)Google Scholar
  5. 5.
    Bödker, Kuutti, K. (ed.): Tradition and Transcendence. In: Proceedings of The Second Nordic Conference on Human-Computer Interaction, Arhus, Denmark, October 19-23, pp. 217–220 (2002)Google Scholar
  6. 6.
    Chavis, D.M., Hogge, J.H., McMillan, D.W.: Sense of community through Brunswick’s lens: a first look. Journal of Community Psychology 14 (1986)Google Scholar
  7. 7.
    Clore, G.C., Gasper, K.: Feeling is believing. Some affective influences on belief. In: Frijda, N.H., Manstead, A.S.R., Bem, S. (eds.) Emotions and beliefs: How feelings influence thoughts, pp. 10–44. Editions de la Maison des Sciences de lH́omme and Cambridge University Press, Paris/Cambridge (2000)Google Scholar
  8. 8.
    Console, L., Lombardi, G.I., Surano, V., Torre, I.: Adaptation and personalization on board cars: a framework and its applications to tourist services. In: De Bra, P., Brusilovsky, P., Conejo, R. (eds.) AH 2002. LNCS, vol. 2347, pp. 112–121. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  9. 9.
    Cuperfain, R., Clarke, T.K.: A new perspective on subliminal perception. Journal of Advertising 14, 36–41 (1985)CrossRefGoogle Scholar
  10. 10.
    Dillon, A.: Beyond usability: process, outcome and affect in human computer interactions (2001), Online
  11. 11.
    Egan, D.E.: Individual differences in human-computer interaction. In: Helander, M. (ed.) Handbook of Human-Computer Interaction, pp. 543–568. Elsevier, New York (1988)CrossRefGoogle Scholar
  12. 12.
    Erickson, T.: Designing agents as if people mattered. In: Bradshaw, J.M. (ed.) Software agents, England, pp. 79–96. AAAI Press/The MIT Press, Menlo Park, CA, Cambridge, MA, London, England (1995)Google Scholar
  13. 13.
    Eysenck, M.: Individual Differences: Normal and Abnormal. Erlbaum, New Jersey (1994)Google Scholar
  14. 14.
    Hampson, S.E., Colman, A.M. (eds.): Individual differences and personality. Longman, London (1995)Google Scholar
  15. 15.
    Isen, A. M. (2000). Positive affect and decision making. In Lewis, M. and Haviland-Jones, J. M. (Ed.), Handbook of emotions (2nd ed.) (pp. 417-435). New York: Guilford Press. Kallinen, K.: Speakers versus headphones: preference, valence, arousal and experience of presence in audio PDA news. In: Michitaka Hirose (Ed.) Human Computer Interaction INTERACT 2001, pp. 805-806, Amsterdam: IOS Press (2001) Google Scholar
  16. 16.
    Kallinen, K., Ravaja, N.: Emotion-related effects of speech rate and rising vs. falling background music melody during audio news: The moderating influence of personality. Personality and Individual Differences (in press)Google Scholar
  17. 17.
    Kihlström, J.F., Barnhardt, T.M., Tataryn, D.J.: Implicit perception. In: Bornstein, R.F., Pittmann, T.S. (eds.) Perception without awareness. Cognitive, clinical and social perspectives, Guilford, New York, pp. 17–54 (1992)Google Scholar
  18. 18.
    Krosnick, J.A., Betz, A.L., Jussim, J.L., Lynn, A.R.: Subliminal conditioning of attitudes. Personality and Social Psychology Bulletin 18, 152–162 (1992)CrossRefGoogle Scholar
  19. 19.
    Laarni, J.: Effects of color, font type and font style on user preferences. In: Stephanidis, C. (ed.) Adjunct Proceedings of HCI International 2003, Crete University Press, Heraklion (2003)Google Scholar
  20. 20.
    Laarni, J.: Searching for optimal methods of presenting dynamic text on different types of screens. In: O.W. Bertelsen, S. (2002)Google Scholar
  21. 21.
    Laarni, J., Kojo, I.: Reading financial news from PDA and laptop displays. In: Smith, M.J., Salvendy, G. (eds.) Systems, Social and Internationalization Design Aspects of Human-Computer Interaction. Proceedings of HCI International 2001, vol. 2, pp. 109–113. Lawrence Erlbaum, Hillsdale (2001)Google Scholar
  22. 22.
    Laarni, J., Kojo, I., Kärkkäinen, L.: Reading and searching information on small display screens. In: de Waard, D., Brookhuis, K., Moraal, J., Toffetti, A. (eds.) Human Factors in Transportation, Communication, Health, and the Workplace, Shake, Maastricht, November 2001, pp. 505–516 (2002), On the occasion of the Human Factors and Ergonomics Society Europe Chapter Annual Meeting in Turin, Italy (November 2001)Google Scholar
  23. 23.
    Lang, A.: Involuntary attention and physiological arousal evoked by structural features and mild emotion in TV commercials. Communication Research 17(3), 275–299 (1990)CrossRefGoogle Scholar
  24. 24.
    Lang, A., Dhillon, P., Dong, Q.: Arousal, emotion and memory for television messages. Journal of Broadcasting and Electronic Media 38, 1–15 (1995)Google Scholar
  25. 25.
    Lang, A., Newhagen, J., Reeves, B.: Negative video as structure: Emotion, attention, capacity and memory. Journal of Broadcasting and Electronic Media 40, 460–477 (1996)CrossRefGoogle Scholar
  26. 26.
    Lombard, M., Ditton, T.: Measuring presence: A literature-based approach to the development of a standardized paper-and-pencil instrument. In: Project abstract submitted to Presence 2000: The third international workshop on presence (2000)Google Scholar
  27. 27.
    Lombard, M., Reich, R., Grabe, M.E., Bracken, C., Ditton, T.: Presence and television: The role of screen size. Human Communication Research 26(1), 75–98 (2000)Google Scholar
  28. 28.
    Manovich, L.: The language of new media. The MIT Press, Cambridge (2001)Google Scholar
  29. 29.
    Ravaja, N.: Effects of a small talking facial image on autonomic activity: The moderating influence of dispositional BIS and BAS sensitivities and emotions. Biological Psychology 65, 163–183 (2004)CrossRefGoogle Scholar
  30. 30.
    Ravaja, N.: Contributions of psychophysiology to media research: Review and recommendations. Media Psychology (in press)Google Scholar
  31. 31.
    Ravaja, N., Kallinen, K.: Emotional effects of startling background music during reading news reports: The moderating influence of dispositional BIS and BAS sensitivities. Scandinavian Journal of Psychology (in press)Google Scholar
  32. 32.
    Ravaja, N., Kallinen, K., Saari, T., Keltikangas-Järvinen, L.: Suboptimal exposure to facial expressions when viewing video messages from a small screen: Effects on emotion, attention, and memory. Journal of Experimental Psychology: Applied (in press)Google Scholar
  33. 33.
    Ravaja, N., Saari, T., Kallinen, K., Laarni, J.: The Role of Mood in the Processing of Media Messages from a Small Screen: Effects on Subjective and Physiological Responses (2004) (manuscript submitted for publication)Google Scholar
  34. 34.
    Reeves, B., Nass, C.: The media equation. In: How people treat computers, television and new media like real people and places, Cambridge University Press, CSLI (1996)Google Scholar
  35. 35.
    Riding, R.J., Rayner, S.: Cognitive styles and learning strategies. Understanding style differences in learning and behavior. David Fulton Publishers, London (1998)Google Scholar
  36. 36.
    Riecken, D.: Personalized views on personalization. Communications of the ACM 43(8), 27–28 (2000)Google Scholar
  37. 37.
    Saari, T.: Knowledge creation and the production of individual autonomy. How news influences subjective reality. Reports from the department of teacher education in Tampere university. A15/1998 (1998)Google Scholar
  38. 38.
    Saari, T.: Mind-Based Media and Communications Technologies. In: How the Form of Information Influences Felt Meaning. Acta Universitatis Tamperensis, vol. 834, Tampere University Press, Tampere (2001)Google Scholar
  39. 39.
    Saari, T.: Designing Mind-Based Media and Communications Technologies. In: Proceedings of Presence 2002 Conference, Porto, Portugal (2002)Google Scholar
  40. 40.
    Saari, T.: Designing for Psychological Effects. Towards Mind-Based Media and Communications Technologies. In: Harris, D., Duffy, V., Smith, M., Stephanidis, C. (eds.) Human-Centred Computing: Cognitive, Social and Ergonomic Aspects. the Proceedings of HCI International 2003, vol. 3, pp. 557–561 (2003a)Google Scholar
  41. 41.
    Saari, T.: Mind-Based Media and Communications Technologies. A Framework for producing personalized psychological effects. In: Proceedings of Human Factors and Ergonomics 2003 -conference, Denver, Colorado, 13.-17.10.2003 (2003b)Google Scholar
  42. 42.
    Saari, T., Turpeinen, M.: Towards Psychological Customization of Information for Individuals and Social Groups. In: Karat, J., Karat, M.-C. (eds.) Personalization of User Experiences for eCommerce, Kluwer, DordrechtGoogle Scholar
  43. 43.
    Shardanand, U., Maes, P.: Social Information Filtering: Algorithms for Automating “Word of Mouth”. In: Proceedings of CHI 1995 Conference on Human Factors in Computing Systems, ACM Press, New York (1995)Google Scholar
  44. 44.
    Turpeinen, M.: Customizing news content for individuals and communities. In: Acta Polytechnica Scandinavica. Mathematics and computing series, vol. 103, Helsinki University of Technology, Espoo (2000)Google Scholar
  45. 45.
    Turpeinen, M., Saari, T.: System Architechture for Psychological Customization of Information. In: Proceedings of HICSS-37- conference, 5.-8.1. 2004, Hawaii (2004)Google Scholar
  46. 46.
    Vecchi, T., Phillips, L.H., Cornoldi, C.: Individual differences in visuo-spatial working memory. In: Denis, M., Logie, R.H., Cornoldi, C., de Vega, M., Engelkamp, J. (eds.) Imagery, language, and visuo-spatial thinking, Psychology Press, Hove (2001)Google Scholar
  47. 47.
    Weitzman, L., Wittenburg, K.: Automatic presentation of multimedia documents using relational grammars. In: proceedings of Second ACM International Conference on Multimedia, San Francisco, October 15-20, pp. 443–451 (1994)Google Scholar
  48. 48.
    Wenger, E.: Communities of Practice: Learning, Meaning, and Identity. Cambridge University Press, Cambridge (1998)CrossRefGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2004

Authors and Affiliations

  • Timo Saari
    • 1
  • Marko Turpeinen
    • 2
  • Jari Laarni
    • 3
  • Niklas Ravaja
    • 3
  • Kari Kallinen
    • 3
  1. 1.Helsinki Institute for Information Technology and Center for Knowledge and Innovation ResearchHelsinkiFinland
  2. 2.Helsinki Institute for Information TechnologyHelsinkiFinland
  3. 3.Center for Knowledge and Innovation ResearchHelsinkiFinland

Personalised recommendations