The Effect of Emotions on Brand Recall by Gender Using Voice Emotion Response with Optimal Data Analysis

  • Wan-Chen Wang
  • Maria Helena Pestana
  • Luiz Moutinho


Purpose—To analyses the effect of emotions obtained by oral reproduction of advertising slogans established via Voice Emotion Response software on brand recall by gender; and to show the relevance for marketing communication of combining “human–computer Interaction (HCI)” with “affective computing (AC)” as part of their mission.

Design/methodology/approach—A qualitative data analysis did the review of the scientific literature retrieved from Web-of-Science Core Collection (WoSCC), using CiteSpace’ scientometric technique; the quantitative data analysis did the analysis of brand recall over a sample of Taiwan’ participants by “optimal data analysis”.

Findings—Advertising effectiveness has a positive association with emotions; brand recall varies with gender; and “HCI” connected with “AC” is an emerging area of research.

Research limitations/implications—The selection of articles obtained depend on the terms used in WoSCC, and this study used only five emotions. Still the richness of the data gives some compensation.

Practical implications—Marketers involved with brands need a body of knowledge on which to base their marketing communication intelligence gathering and strategic planning.

Originality/value—It provides exploratory research findings related to the use of automatic tools capable of mining emotions by gender in real time, which could enhance the feedback of customers toward their brands.


CiteSpace Marketing communication Optimal Data Analysis Scientometric review Panoramic visualisation 


  1. Bagozzi, R. P., & Dholakia, U. M. (2006). Antecedents and Purchase Consequences of Customer Participation in Small Group Brand Communities. International Journal of Research in Marketing, 23, 45–61.CrossRefGoogle Scholar
  2. Bagozzi, R. P., Gopinoth, M., & Nyer, P. U. (1999). The Role of Emotions in Marketing. Journal of the Academy of Marketing Science, 27(2), 184–206.CrossRefGoogle Scholar
  3. Balasubramanian, R., Sathyaprakash, B. S., & Dhurandhar, S. V. (1996). Gravitational Waves from Coalescing Binaries: Detection Strategies and Monte Carlo Estimation of Parameters. Physics Review, D53, 3033–3055. Scholar
  4. Boush, D. M. (1993). How Advertising Slogans Can Prime Evaluations of Brand Extensions. Psychology and Marketing, 10(1), 67–78.CrossRefGoogle Scholar
  5. Brandes, U. (2001). A Faster Algorithm for Betweenness Centrality. Journal of Mathematical Sociology, 25(2), 163–177.CrossRefGoogle Scholar
  6. Calvo, R. A., & D’Mello, S. (2010). Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications. IEEE Transactıons on Affectıve Computing, 1(1), 18–37.CrossRefGoogle Scholar
  7. Chen, C. (1998). Generalized Similarity Analysis and Pathfinder Network Scaling. Interacting with Computers, 10, 107–128.CrossRefGoogle Scholar
  8. Chen, C. (1999). Visualising Semantic Spaces and Author Cocitation Net-Works in Digital Libraries. Information Processing and Management, 35(3), 401–420.CrossRefGoogle Scholar
  9. Chen, C. (2006). CitespaceII: Detecting and Visualizing Emerging Trends and Transient Patterns in Scientific Literature. Journal of the American Society for Information Science and Technology, 57, 359–377.CrossRefGoogle Scholar
  10. Chen, C. (2008). An Information-Theoretic View of Visual Analytics. IEEE Computer Graphics and Applications, 28(1), 18–23.CrossRefGoogle Scholar
  11. Chen, C. (2013). The Structure and Dynamics of Scientific Knowledge. In Mapping Scientific Frontiers (pp. 163–199). London: Springer.CrossRefGoogle Scholar
  12. Chen, C., Kuljis, J., & Paul, R. J. (2001). Visualizing Latent Domain Knowledge. IEEE Transtions on Systems, Man, and Cybernetics- Parte C: Applications and Reviews, 31(4), 518–529.CrossRefGoogle Scholar
  13. Chen, C., Dubin, R., & Kim, M. C. (2014). Emerging Trends and New Developments in Regenerative Medicine: A Scientometric Update (2000–2014). Expert Opinion on Biological Therapy, 14, 1295–1317.CrossRefGoogle Scholar
  14. Chowdhry, N., Winterich, K. P., Mittal, V., & Morales, A. C. (2015). Not All Negative Emotions Lead to Concrete Construal. International Journal of Research in Marketing, 32, 428–430.CrossRefGoogle Scholar
  15. Consoli, D. (2010). A New Concept of Marketing: The Emotional Marketing. Brand Broad Research in Accounting, Negotiation, and Distribution, 1(1), 1–8.Google Scholar
  16. Cowie, R. (2001). Machine Understanding of Human Behavior. IEEE Signal Processing Magazine, 18, 32.CrossRefGoogle Scholar
  17. Davis, D. F., Golicic, S. L., & Boerstler, C. N. (2011). Benefits and Challenges of Multiple Methods Research in Marketing. Journal of the Academy of Marketing Science, 39(3), 467–479.CrossRefGoogle Scholar
  18. Dube, L., & Morgan, M. S. (1998). Capturing the Dynamics of In-process Consumption Emotions and Satisfaction in Extended Service Transactions. International Journal of Research in Marketing, 15, 309–320.CrossRefGoogle Scholar
  19. Dunning, T. (1993). Accurate Methods for the Statistics of Surprise and Coincidence. Computational Linguistics, 19(1), 61–74.Google Scholar
  20. Faseur, T., & Geuens, M. (2006). Different Positive Feelings Leading to Different Ad Evaluations. Journal of Advertising, 35(4), 129–142.CrossRefGoogle Scholar
  21. Fiske, S. T., & Taylor, S. E. (1991). Social Cognition (2nd ed.). New York: McGraw-Hill.Google Scholar
  22. Fodness, D. (1994). Measuring Tourist Motivation. Annals of Tourism Research, 21(3), 555–581.CrossRefGoogle Scholar
  23. Fragopanagos, F., & Taylor, J. G. (2005). Emotion Recognition in Human-Computer Interaction. Neural Networks, 18, 389–405.CrossRefGoogle Scholar
  24. Freeman, L. C. (1977). A Set of Measuring Centrality Based on Betweenness. Sociometry, 40, 35–41.CrossRefGoogle Scholar
  25. Frijda, N. (2007). The Laws of Emotıon. London: Routledge.Google Scholar
  26. Gao, Y., Bianchi-Berthouze, N., & Meng, H. (2012). What Does Touch Tell Us About Emotions in Touchscreen-Based Gameplay? ACM Transactions on Computer-Human Interaction (TOCHI), 19(4), article 31. Scholar
  27. Goleman, D. (1995). Emotional Intelligence. New York: Bantam Books.Google Scholar
  28. Goleman, D., Boyatzis, R., & Rhee, K. S. (1995). Clustering Competence in Emotional Intelligence: Insights from the Emotional Competence Inventory (ECI). Google Scholar
  29. Hazlett, R. L., & Hazlett, S. Y. (1999). Emotional Response to Television Commercials: Facial EMG vs. Self-Report. Journal of Advertising Research, 39(2), 7–23.Google Scholar
  30. Hudlicka, E. (2003). To Feel or Not to Feel: The Role of Affect in Human-Computer Interaction. International Journal of Human-Computer Studies, 59(1–2), 1–32.CrossRefGoogle Scholar
  31. Janssens, W., & De Pelsmacker, P. (2005). Advertising for New and Existing Brands: The Impact of Media Context and Type of Advertisement. Journal of Marketing Communications, 11(2), 113–128.CrossRefGoogle Scholar
  32. Kapoor, A., Burlesonc, W., & Picard, R. W. (2007). Automatic Prediction of Frustration. International Journal of Human-Computer Studies, 65, 724–736.CrossRefGoogle Scholar
  33. Kim, J. (2008). Emotion Recognition Based on Physiological Changes in Music Listening. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(12), 2067–2083.CrossRefGoogle Scholar
  34. Kleinberg, J. (2002). Bursty and Hierarchical Structure in Streams. In Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 91–101). New York: ACM Press.Google Scholar
  35. Luxburg, U. v. (2006). A Tutorial on Spectral Clustering. Retrieved October 10, 2008, from
  36. Luxburg, U. v., Bousquet, O., & Belkin, M. (2009). Limits of Spectral Clustering. Retrieved October 10, 2008, from
  37. Martensen, A., Gronholdt, L., Bendtsen, L., & Jensen, M. J. (2007). Application of a Model for the Effectiveness of Event Marketing. Journal of Advertising Research, 47(3), 283–301.CrossRefGoogle Scholar
  38. Morris, S. A., & Van der Veer Martens, B. (2008). Mapping Research Special-Ties. Annual Review of Information Science and Technology, 42, 213–295.CrossRefGoogle Scholar
  39. Orth, U. R., & Holancova, D. (2004). Men’s and Women’s Responses to Sex Role Portrayals in Advertisements. International Journal of Research in Marketing, 21, 77–88.CrossRefGoogle Scholar
  40. Pantic, M., & Rothkrantz, L. J. M. (2003). Towards Emotion Recognition in Human Computer Interaction. Proceedings of the IEEE, 91(9), 1370–1390.CrossRefGoogle Scholar
  41. Pham, M. T., Geuens, M., & Pelsmacker, P. D. (2013). The Influence of Ad-evoked Feelings on Brand Evaluations: Empirical Generalizations from Consumer Responses to More than 1000 TV Commercials. International Journal of Research in Marketing, 30, 383–394.CrossRefGoogle Scholar
  42. Picard, R. (1997). Affective Computing. Cambridge: The MIT Press.CrossRefGoogle Scholar
  43. Picard, R. W. (2001). Computers that Recognise and Respond to User Emotion: Theoretical and Practical Implications. IEEE Transactions on Pattern Analysis and Machine İntelligence, 23, 1175.CrossRefGoogle Scholar
  44. Reeves, B., & Nass, C. (1996). The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. Chicago/New York: Center for the Study of Language and Information/Cambridge University Press, 305 p.Google Scholar
  45. Romani, S., Grappi, S., & Dalli, D. (2012). Emotions that Drive Consumers Away from Brands: Measuring Negative Emotions Toward Brands and Their Behavioral Effects. International Journal of Research in Marketing, 29, 55–67.CrossRefGoogle Scholar
  46. Rousseeuw, P. J. (1987). Silhouettes: A Graphical Aid to the Interpretation and Validation of Cluster Analysis. Journal of Computational and Applied Mathematics, 20, 53–65.CrossRefGoogle Scholar
  47. Salton, G., Yang, C. S., & Wong, A. (1975). A Vector Space Model for Information Retrieval. Communications of the ACM, 18(11), 613–620.CrossRefGoogle Scholar
  48. Schneider, J. W. (2006). Concept Symbols Revisited: Naming Clusters by Parsing and Filtering of Noun Phrases from Citation Contexts of Concept Symbols. Scientometrics, 68(3), 573–593.CrossRefGoogle Scholar
  49. Schneider, J. W. (2009). Mapping of Cross-Reference Activity Between Jour-nals by Use of Multidimensional Unfolding: Implications for Mapping Studies. In B. Larsen & J. Leta (Eds.), Proceedings of 12th Inter-national Conference on Scientometrics and Informetrics (ISSI 2009) (pp. 443–454). Rio de Janiero: BIREME/PAHO/WHO and Federal University of Rio de Janeiro.Google Scholar
  50. Sherer, K. R. (2005). What Are Emotions? And How Can They Be Measured? Social Science Information. London/Thousand Oaks/New Delhi: SAGE Publications, 0539-0184, 44(4), 695–729. doi:
  51. Small, H. (1980). Co-citation Context Analysis and the Structure of Paradigms. Journal of Documentation, 36(3), 183–196.CrossRefGoogle Scholar
  52. Tabah, A. N. (1999). Literature Dynamics: Studies on Growth, Diffusion, and Epidemics. Annual Review of Information Science and Technology, 34, 249–286.Google Scholar
  53. Teixeira, T., Wedel, M., & Pieters, R. (2012). Emotion-Induced Engagement in Internet Video Advertisements. Journal of Marketing Research, 49(2), 144–159.CrossRefGoogle Scholar
  54. Vakratsas, D., & Ambler, T. (1999). How Advertising Works: What Do We Really Know? Journal of Marketing, 63(1), 26–43.CrossRefGoogle Scholar
  55. Wang, W. C., Chien, C. S., & Moutinho, L. (2015). Do You Really Feel Happy? Some Implications of Voice Emotion Response in Mandarin Chinese. Marketing Letters, 26(3), 391–409.CrossRefGoogle Scholar
  56. White, H. D., & Griffith, B. C. (1982). Authors as Markers of Intellectual Space—Co-citation in Studies of Science, Technology and Society. Journal of Documentation, 38(4), 255–272.CrossRefGoogle Scholar
  57. White, H. D., & McCain, K. W. (1998). Visualizing a Discipline: An Author Co-citation Analysis of Information Science, 1972–1995. Journal of the American Society for Information Science, 49(4), 327–355.Google Scholar
  58. Wierenga, B. (2011). Managerial Decision Making in Marketing: The Next Research Frontier. International Journal of Research in Marketing, 28, 89–101.CrossRefGoogle Scholar
  59. Yarnold, P. R., & Soltysik, R. C. (2005). Optimal Data Analysis. A Guidebook with Software for Windows. Washington, DC: American Psychological Association.Google Scholar
  60. Yarnold, P. R., & Soltysik, R. C. (2016). Maximizing Predictive Accuracy. Chicago: ODA Books.  10.13140/RG.2.1.1368.3286.Google Scholar
  61. Yu, P., & Sample, V. (1965). Networks of Scientific Papers. Science, 169, 510–515.Google Scholar
  62. Zeng, Z. H. (2009). A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions. IEEE Transactions on Pattern Analysis and Machine İntelligence, 31, 39.CrossRefGoogle Scholar

Copyright information

© The Author(s) 2018

Authors and Affiliations

  • Wan-Chen Wang
    • 1
  • Maria Helena Pestana
    • 2
  • Luiz Moutinho
    • 3
    • 4
  1. 1.Feng Chia UniversityTaiwanRepublic of China
  2. 2.ISCTE_IULLisbonPortugal
  3. 3.University of SuffolkSuffolk, EnglandUK
  4. 4.The University of the South PacificSuvaFiji

Personalised recommendations