Skip to main content
Log in

Empathy evaluation by the physical elements of the advertising

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript


Watching videos is becoming a common trend in modern times. Advertising designers have concerned that physical attributes in the video affect the viewer’s empathy and determine their purchase decisions. Therefore, the purpose of this study is to provide an advertisement guideline, that increasing viewer’s empathy by controlling the physical elements and together considering the objective biological data of the viewer’s gaze tracking. This article uses two methods for comparison accuracy. The first method is about using eye-tracking data to derive areas of interest in the video and to evaluate empathy with the image properties in the advertisement. The physical elements of the advertising pictures, such as characteristics of color, saturation, and value have been analyzed by comparing between advertising videos with and without consideration of gaze tracking for the region of interest of the video. Then the empathy in advertising has been determined by using the method of machine learning classification. The results showed that the accuracy rate was 1.8% higher than the other kinds of videos in feature value of considering the region of interest extraction by gaze tracking. Contribution: (1). The physical elements in the advertisement contribute to increase the viewer’s empathy; (2). The paper also finds that the video making by the method of extracting physical elements of some region of interest has a stronger influence on the viewer’s empathy; (3). The decision of physical elements in advertisements can increase the empathy of viewers during viewing processes, which can also improve the effectiveness of advertisements.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others


  1. Alpert AJ (1990) Hydrophilic-interaction chromatography for the separation of peptides, nucleic acids and other polar compounds. J Chromatogr A 499:177–196

    Article  Google Scholar 

  2. Argyle, M., & Cook, M. (1976). Gaze and mutual gaze.

  3. Barbee, A., Bradford, L., Bullet, D. B., Burleson, B. R., Cunningham, M. R., & Goldsmith, D. J. Department of Speech Communication.

  4. Balteș FR, Miu AC (2014) Emotions during live music performance: Links with individual differences in empathy, visual imagery, and mood. Psychomusicology Music, Mind, and Brain 24(1):58

    Article  Google Scholar 

  5. Baron-Cohen S, Campbell R, Karmiloff-Smith A, Grant J, Walker J (1995) Are children with autism blind to the mentalistic significance of the eyes? Br J Dev Psychol 13(4):379–398

    Article  Google Scholar 

  6. Bartsch, A., Kloß, A. (2019) Personalized charity advertising. Can personalized prosocial messages promote empathy, attitude change, and helping intentions toward stigmatized social groups?. International Journal of Advertising, 38(3): 345–363.

  7. Carter, C. S., Harris, J., & Porges, S. W. (2011). 13 Neural and Evolutionary Perspectives on Empathy. The social neuroscience of empathy, 169.

  8. Dafonte-Gómez, A. (2015). The key elements of viral advertising. from motivation to emotion in the most shared videos. arXiv preprint

  9. Davis MH (2018) Empathy: A social psychological approach. Routledge.

    Article  Google Scholar 

  10. Decety J, Lamm C (2006) Human empathy through the lens of social neuroscience. Sci World J 6:1146–1163

    Article  Google Scholar 

  11. Deighton, J., & Hoch, S. J. (1993) Teaching emotion with drama advertising. Advertising exposure, memory, and choice, 261–282.

  12. Eerola T, Vuoskoski JK, Kautiainen H (2016) Being moved by unfamiliar sad music is associated with high empathy. Front Psychol 7:1176

    Article  Google Scholar 

  13. Elliott R, Bohart AC, Watson JC, Greenberg LS (2011) Empathy Psychotherapy 48(1):43

    Article  Google Scholar 

  14. Emery NJ (2000) The eyes have it: the neuroethology, function and evolution of social gaze. Neurosci Biobehav Rev 24(6):581–604

    Article  Google Scholar 

  15. Escalas JE, Stern BB (2003) Sympathy and empathy: Emotional responses to advertising dramas. Journal of Consumer Research 29(4):566–578

    Article  Google Scholar 

  16. Farnsworth EA (1969) The past of promise: An historical introduction to contract. Columbia Law Rev 69(4):576–607

    Article  Google Scholar 

  17. Goworek, H., Perry, P., Kent, A., Roncha, A., & Radclyffe-Thomas, N. (2016). How TOMS’“one day without shoes” campaign brings stakeholders together and co-creates value for the brand using Instagram as a platform. Journal of Fashion Marketing and Management.

  18. Hoffman ML (2008) Empathy and prosocial behavior. Handbook of emotions 3:440–455

    Google Scholar 

  19. Hood BM, Willen JD, Driver J (1998) Adult’s eyes trigger shifts of visual attention in human infants. Psychol Sci 9(2):131–134

    Article  Google Scholar 

  20. Huang L, Lu J (2016) The impact of package color and the nutrition content labels on the perception of food healthiness and purchase intention. Journal of Food Products Marketing 22(2):191–218

    Article  Google Scholar 

  21. Keen, S. (2007). Empathy and the Novel. Oxford University Press on Demand.

  22. Kleinke CL (1986) Gaze and eye contact: a research review. Psychol Bull 100(1):78

    Article  Google Scholar 

  23. MacInnis DJ, Park CW (1991) The differential role of characteristics of music on high-and low-involvement consumers’ processing of ads. Journal of consumer Research 18(2):161–173

    Article  Google Scholar 

  24. Miu AC, Balteş FR (2012) Empathy manipulation impacts music-induced emotions: A psychophysiological study on opera. PLoS ONE 7(1):30618

    Article  Google Scholar 

  25. Morris, J. D., & Boone, M. A. (1998). The effects of music on emotional response, brand attitude, and purchase intent in an emotional advertising condition. ACR North American Advances.

  26. Park CW, Young SM (1986) Consumer response to television commercials: The impact of involvement and background music on brand attitude formation. J Mark Res 23(1):11–24

    Article  Google Scholar 

  27. Park MJ, Lee DH (2014) Effects of Storytelling in Advertising on ConsumersEmpathy. Asia Marketing Journal 15(4):103–129

    Article  Google Scholar 

  28. Patterson M, Elliott R (2002) Negotiating masculinities: Advertising and the inversion of the male gaze. Consum Mark Cult 5(3):231–249

    Article  Google Scholar 

  29. Pelphrey KA, Sasson NJ, Reznick JS, Paul G, Goldman BD, Piven J (2002) Visual scanning of faces in autism. J Autism Dev Disord 32(4):249–261

    Article  Google Scholar 

  30. Polyorat K, Alden DL, Kim ES (2007) Impact of narrative versus factual print ad copy on product evaluation: The mediating role of ad message involvement. Psychol Mark 24(6):539–554

    Article  Google Scholar 

  31. Ritossa DA, Rickard NS (2004) The relative utility of ‘pleasantness’ and ‘liking’dimensions in predicting the emotions expressed by music. Psychol Music 32(1):5–22

    Article  Google Scholar 

  32. Soh H (2019) Exploring the Response to the Anti-Smoking Advertisements: Ad Liking, Empathy, and Psychological Resistance. The Journal of the Convergence on Culture Technology 5(1):99–105

    MathSciNet  Google Scholar 

  33. Stern BB (1994) Classical and vignette television advertising dramas: Structural models, formal analysis, and consumer effects. Journal of Consumer Research 20(4):601–615

    Article  Google Scholar 

  34. Stout PA, Rust RT (1993) Emotional feelings and evaluative dimensions of advertising: are they related? J Advert 22(1):61–71

    Article  Google Scholar 

  35. Strayer, J. (1990). 10 Affective and cognitive perspectives on empathy. Empathy and its development, 218.

  36. Tavassoli NT, Lee YH (2003) The differential interaction of auditory and visual advertising elements with Chinese and English. J Mark Res 40(4):468–480

    Article  Google Scholar 

  37. Wang, H., Chignell, M., & Ishizuka, M. (2006, March). Empathic tutoring software agents using real-time eye tracking. In Proceedings of the 2006 symposium on Eye tracking research & applications (pp. 73–78).

  38. Yoo S, Whang M (2020) Vagal Tone Differences in Empathy Level Elicited by Different Emotions and a Co-Viewer. Sensors 20(11):3136

    Article  Google Scholar 

  39. Zhang J, Wen X, Whang M (2020) Recognition of Emotion According to the Physical Elements of the Video. Sensors 20(3):649

    Article  Google Scholar 

  40. Zimny GH, Weidenfeller EW (1963) Effects of music upon GSR and heart-rate. Am J Psychol 76(2):311–314

    Article  Google Scholar 

Download references


This work was supported by the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIT) (NRF-2020R1A2B5B02002770).


This work was supported by the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIT) (NRF-2020R1A2B5B02002770).

Author information

Authors and Affiliations


Corresponding author

Correspondence to Mincheol Whang.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, J., Wen, X. & Whang, M. Empathy evaluation by the physical elements of the advertising. Multimed Tools Appl 81, 2241–2257 (2022).

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: