Skip to main content
SpringerLink
Log in

Movie emotion map: an interactive tool for exploring movies according to their emotional signature

  • 1198: Advances in Multimedia Interaction and Visualization
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

We present Movie Emotion Map - a novel system that enables to view and browse through a large collection of movies according to the movies’ emotional characteristics. The system enables to view both the high-level structure of the movies emotional space and the low-level details of a single movie. We create an eight-dimensional emotional signature for each movie based on Plutchik’s theory of emotions, according to its reviews obtained from IMDb. We projected glyphs representing emotional signatures of the movies on a 2D plane using dimension reduction, thus, providing a topology of emotions for easy browsing and exploring. Results from a qualitative evaluation with 18 participants indicate that users could easily browse through movies according to the visualized landscape and that the tool enabled them to search, filter and find movies based on their emotional characteristics.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Abras C, Maloney-Krichmar D, Preece J (2004) User-centered design. Bainbridge, W Encyclopedia of Human-Computer Interaction Thousand Oaks: Sage Publications 37(4):445–456

    Google Scholar 

  2. Ahlberg C, Shneiderman B (1994) “Visual information seeking using the filmfinder,” in Conference companion on Human factors in computing systems. ACM, pp. 433–434

  3. Albo Y, Lanir J, Bak P, Rafaeli S (2016) Off the radar: comparative evaluation of radial visualization solutions for composite indicators. IEEE Trans Vis Comput Graph 22(1):569–578

    Article  Google Scholar 

  4. Andjelkovic I, Parra D, O’Donovan J (2019) Moodplay: interactive music recommendation based on artists’ mood similarity. Int J Hum Comput Stud 121:142–159

    Article  Google Scholar 

  5. Aurier P, Guintcheva G (2015) “The dynamics of emotions in movie consumption: A spectator-centred approach.” International Journal of Arts Management, vol. 17, no. 2

  6. Bader N, Mokryn O, Lanir J (2017) “Exploring emotions in online movie reviews for online browsing,” in Proceedings of the 22nd international conference on intelligent user interfaces companion. ACM, pp. 35–38

  7. Braun V, Clarke V, Hayfield N, Terry G (2019) Thematic analysis. Handbook of Research Methods in Health Social Sciences:843–860

  8. Chambel T, Langlois T, Martins P, Gil N, Silva N, Duarte E (2013) Content- based search overviews and exploratory browsing of movies with movieclouds. International Journal of Advanced Media and Communication 5(1):58–79

    Article  Google Scholar 

  9. Chen Y-X (2010) Exploratory browsing: enhancing the browsing experience with media collections. Ph.D. dissertation, Citeseer

    Google Scholar 

  10. Dou W, Wang X, Skau D, Ribarsky W, and Zhou MX (2012) “LeadLine: Interactive Visual Analysis of Text Data through Event Identification and Exploration,” Proc. 2012 IEEE Conf. In Visual Analytics Science and Technology, pp. 93–102

  11. Ekman P (1992) An argument for basic emotions. Cognit Emot 6(3–4):169–200

    Article  Google Scholar 

  12. Fodor IK (2002) “A survey of dimension reduction techniques,” Lawrence Livermore National Lab., CA (US), Tech. Rep

  13. Fortuna B, Grobelnik M, Mladenic D (2005) Visualization of text document corpus. Informatica 29(4)

  14. Gil N, Silva N, Duarte E, Martins P, Langlois T, Chambel T (2012) “Going through the clouds: search overviews and browsing of movies,” in Proceeding of the 16th International Academic MindTrek Conference. ACM, pp. 158–165.

  15. Harrower M, Brewer CA (2003) Colorbrewer. Org: an online tool for selecting colour schemes for maps. Cartogr J 40(1):27–37

    Article  Google Scholar 

  16. Jorge A, Chambel T (2014) Visualizations in time for a new look at the movies. International Journal of Creative Interfaces and Computer Graphics (IJCICG) 5(2):40–61

    Article  Google Scholar 

  17. Kempter R, Sintsova V, Musat C, Pu P (2014) “Emotionwatch: visualizing fine- grained emotions in event-related tweets,” in Eighth international AAAI conference on weblogs and social media

  18. Kennedy A, Kazantseva A, Inkpen D, and Szpakowicz S (2012) “Getting emotional about news summarization,” in Canadian Conference on Artificial Intelligence. Springer, pp. 121–132

  19. Kleiman Y, Lanir J, Danon D, Felberbaum Y, Cohen-Or D. (2015). Dynamicmaps: similarity-based browsing through a massive set of images. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (pp. 995–1004).

  20. Kucher K, Paradis C, Kerren A (2018) “The state of the art in sentiment visualization,” in Computer Graphics Forum, vol. 37. Wiley Online Library, pp. 71–96.

  21. Maaten LVD, Hinton G (2008) “Visualizing data using t-sne,” Journal of machine learning research, vol. 9, no. Nov, pp. 2579–2605

  22. Martinho J, Chambel T (2009) “Colorsinmotion: interactive visualization and exploration of video spaces,” in Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era. ACM, pp. 190–197.

  23. Mohammad S (2011) “From once upon a time to happily ever after: Tracking emotions in novels and fairy tales,” in Proceedings of the 5th ACL-HLT Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities. Association for Computational Linguistics, pp. 105–114.

  24. Mohammad SM, Turney PD (2013) Crowdsourcing a word–emotion association lexicon. Comput Intell 29(3):436–465

    Article  MathSciNet  Google Scholar 

  25. Mokryn O, Bodoff D, Bader N, Albo Y, Lanir J (2020) “Sharing emotions: determining films’ evoked emotional experience from their online reviews”. Information Retrieval Journal.

  26. Munezero M, Montero CS, Mozgovoy M, Sutinen E (2015) “Emotwitter a fine-grained visualization system for identifying enduring sentiments in tweets,” in International Conference on Intelligent Text Processing and Computational Lin- guistics. Springer, pp. 78–91

  27. Munzner T (2009) A nested model for visualization design and validation. IEEE Trans Vis Comput Graph 15(6):921–928

    Article  Google Scholar 

  28. Nelson P (1970) Information and consumer behavior. J Polit Econ 78(2):311–329

    Article  Google Scholar 

  29. Pavel A, Goldman DB, Hartmann B, and Agrawala M (2015) “Sceneskim: Searching and browsing movies using synchronized captions, scripts and plot sum- maries,” in Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, pp. 181–190

  30. Plutchik R (1980) “A general psychoevolutionary theory of emotion,” in Theories of emotion. Elsevier, pp. 3–33

  31. Plutchik R (2001) The nature of emotions: human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. Am Sci 89(4):344–350

    Article  Google Scholar 

  32. Qian Y, Zhang Y, Ma X, Yu H, Peng L (2019) Ears: emotion-aware recommender system based on hybrid information fusion. Information Fusion 46:141–146

    Article  Google Scholar 

  33. Ray RD, Gross JJ (2007) “Emotion elicitation using films,” Handbook of emotion elicitation and assessment, vol. 9

  34. Roberts K, Roach MA, Johnson J, Guthrie J, and Harabagiu SM (2012) “Empatweet: Annotating and detecting emotions on twitter.” in Lrec, vol. 12.Cit- seer, pp. 3806–3813.

  35. Russell JA, Barrett LF (1999) Core affect, prototypical emotional episodes, and other things called emotion: dissecting the elephant. Journal of personality and social psychology 76(5):805

    Article  Google Scholar 

  36. Tan ES (2013) Emotion and the structure of narrative film: film as an emotion machine. Routledge

  37. Tanin E, Shneiderman B, Xie H (2007) Browsing large online data tables using generalized query previews. Inf Syst 32(3):402–423

    Article  Google Scholar 

  38. Tkalcic M, Kosir A, and Tasic J (2011) “Affective recommender systems: the role of emotions in recommender systems,” in Proc. The RecSys 2011 Workshop on Human Decision Making in Recommender Systems. Citeseer, 2011, pp. 9–13.

  39. Van Someren M, Barnard Y, Sandberg J (1994) The think aloud method: a practical approach to modelling cognitive. Citeseer

  40. Wang FY, Sallaberry A, Klein K, Takatsuka M, Roche M (2015) “Senticompass: Interactive visualization for exploring and comparing the sentiments of time-varying twitter data,” in 2015 IEEE Pacific Visualization Symposium (Paci- ficVis). IEEE, pp. 129–133.

  41. Ware C, (2000). Information visualization: perception for design. Morgan Kaufmann.

  42. Yu Y, Wang X (2015) World cup 2014 in the twitter world: a big data analysis of sentiments in us sports fans’ tweets. Comput Hum Behav 48:392–400

    Article  Google Scholar 

  43. Zhang S, Tian Q, Huang Q, Gao W, Li S (2009) “Utilizing affective analysis for efficient movie browsing,” in 2009 16th IEEE International Conference on Image Processing (ICIP). IEEE, pp. 1853–1856

  44. Zhao J, Gou L, Wang F, Zhou M (2014) “Pearl: An interactive visual analytic tool for understanding personal emotion style derived from social media,” in 2014 IEEE Conference on Visual Analytics Science and Technology (VAST). IEEE, pp. 203–212.

  45. Zheng Y, Mobasher B, Burke RD (2013) The role of emotions in context-aware recommendation. Decisions@ RecSys 2013:21–28

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Haifa, Haifa, Israel

    Miki Cohen-Kalaf, Joel Lanir & Osnat Mokryn

  2. K Health Research and Development, Tel-Aviv, Israel

    Peter Bak

Authors
  1. Miki Cohen-Kalaf
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Joel Lanir
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Peter Bak
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Osnat Mokryn
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Joel Lanir.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

ESM 1

(MP4 78,904 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cohen-Kalaf, M., Lanir, J., Bak, P. et al. Movie emotion map: an interactive tool for exploring movies according to their emotional signature. Multimed Tools Appl 81, 14663–14684 (2022). https://doi.org/10.1007/s11042-021-10803-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-10803-5

Keywords

Search

Navigation