Skip to main content
SpringerLink
Log in

Image Analytics in Marketing

  • Reference work entry
  • First Online:
Handbook of Market Research

Abstract

Recent technical advances and the rise of digital platforms enhanced consumers’ abilities to take and share images and led to a tremendous increase in the importance of visual communication. The abundance of visual data, together with the development of image processing tools and advanced modeling techniques, provides unique opportunities for marketing researchers, in both academia and practice, to study the relationship between consumers and firms in depth and to generate insights which can be generalized across a variety of people and contexts.

However, with the opportunity come challenges. Specifically, researchers interested in using image analytics for marketing are faced with a triple challenge: (1) To which type of research questions can image analytics add insights that cannot be obtained otherwise? (2) Which visual data should be used to answer the research questions, and (3) which method is the right one?

In this chapter, the authors provide a guidance on how to formulate a worthy research question, select the appropriate data source, and apply the right method of analysis. They first identify five relevant areas in marketing that would benefit greatly from image analytics. They then discuss different types of visual data and explain their merits and drawbacks. Finally, they describe methodological approaches to analyzing visual data and discuss issues such as feature extraction, model training, evaluation, and validation as well as application to a marketing problem.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 649.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 699.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  • Amit, E., Algom, D., & Trope, Y. (2009). Distance-dependent processing of pictures and words. Journal of Experimental Psychology: General, 138(3), 400.

    Article  Google Scholar 

  • Ang, S. H., Lee, Y. H., & Leong, S. M. (2007). The ad creativity cube: Conceptualization and initial validation. Journal of the Academy of Marketing Science, 35(2), 220–232.

    Article  Google Scholar 

  • Bengio, Y. (2012). Deep learning of representations for unsupervised and transfer learning. In I. Guyon, G. Dror, V. Lemaire, G. Taylor, & D. Silver (Eds.), Proceedings o the ICML workshop unsupervised transfer learn (pp. 17–36). Bellevue.

    Google Scholar 

  • Bengio, Y., Bergeron, A., Boulanger-Lewandowski, N., Breuel, T., Chherawala, Y., Cisse, M., & Erhan, D. (2011). Deep learners benefit more from out-of-distribution examples. In G. Gordon, D. Dunson, & D. Miroslav (Eds.), Proceedings of the 14th international conference artificial intelligence statist (pp. 164–172). Fort Lauderdale, FL.

    Google Scholar 

  • Bloch, P. H. (1995). Seeking the ideal form: Product design and consumer response. Journal of Marketing, 59(3), 16–29.

    Article  Google Scholar 

  • Burnap, A., & Hauser, J. (2018). Predicting “design gaps” in the market: Deep consumer choice models under probabilistic design constraints. arXiv preprint arXiv, 1812.11067.

    Google Scholar 

  • Burnap A., Hauser, J., & Timoshenko A. (2019). Design and evaluation of product aesthetics: A human-machine hybrid approach. Available at SSRN 3421771.

    Google Scholar 

  • Caesar, H., Bankiti, V., Lang, A. H., Vora, S., Liong, V. E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., & Beijbom, O. (2020). NuScenes: A multimodal dataset for autonomous driving. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 11621–11631).

    Google Scholar 

  • Chan, T. H., Mihm, J., & Sosa, M. E. (2018). On styles in product design: An analysis of US design patents. Management Science, 64(3), 1230–1249.

    Article  Google Scholar 

  • Cho, H., Schwarz, N., & Song, H. (2008). Images and preferences: A feelings-as-information analysis. In M. Wedel & R. Pieters (Eds.), Visual marketing: From attention to action (pp. 259–276). New York: Lawrence Erlbaum Associates.

    Google Scholar 

  • Crilly, N., Moultrie, J., & Clarkson, P. J. (2004). Seeing things: Consumer response to the visual domain in product design. Design Studies, 25(6), 547–577.

    Article  Google Scholar 

  • Dew, R., Ansari, A., & Toubia, O. (2019). Letting logos speak: Leveraging multiview representation learning for data-driven logo design. Available at SSRN 3406857.

    Google Scholar 

  • Dhar, S., Ordonez, V., & Berg, T. L. (2011, June). High level describable attributes for predicting aesthetics and interestingness. In CVPR 2011 (pp. 1657–1664). IEEE.

    Chapter  Google Scholar 

  • Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2014, January). Decaf: A deep convolutional activation feature for generic visual recognition. In International conference on machine learning (pp. 647–655).

    Google Scholar 

  • Dzyabura, D., & Peres, R. (2021). Visual elicitation of brand perception. Journal of Marketing, forthcoming.

    Google Scholar 

  • Dzyabura, D., El Kihal, S., Ibragimov, M., & Hauser J. (2020). Leveraging the power of images in managing product return rates. Available at SSRN 3209307.

    Google Scholar 

  • Eisenman, M., Frenkel, M., & Wasserman, V. (2016). Toward a theory of effective aesthetic communication. In Academy of management proceedings (Vol. 2016, p. 12822). Briarcliff Manor: Academy of Management.

    Google Scholar 

  • Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014). Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 580–587).

    Google Scholar 

  • Goodfellow, I., Bengio, Y., Courville, A., & Bengio, Y. (2016). Deep learning (Vol. 1, No. 2). Cambridge: MIT Press.

    Google Scholar 

  • Gorn, G. J., Chattopadhyay, A., Yi, T., & Dahl, D. W. (1997). Effects of color as an executional cue in advertising: They’re in the shade. Management Science, 43(10), 1387–1400.

    Article  Google Scholar 

  • Greenleaf, E., & Raghubir, P. (2008). Geometry in the marketplace. In M. Wedel & R. Pieters (Eds.), Visual marketing: From attention to action (pp. 113–143). New York: Lawrence Erlbaum Associates.

    Google Scholar 

  • Han, Y. J., Nunes, J. C., & Drèze, X. (2010). Signaling status with luxury goods: The role of brand prominence. Journal of Marketing, 74(4), 15–30.

    Article  Google Scholar 

  • Hartmann, J., Heitmann, M., Schamp, C., & Netzer, O. (2021) The Power of brand selfies. Journal of Marketing Research, 58(6), 1159–1177. https://doi.org/10.1177/00222437211037258

  • Hauser, J. R., Urban, G. L., Liberali, G., & Braun, M. (2009). Website morphing. Marketing Science, 28(2), 202–223.

    Article  Google Scholar 

  • Hauser, J. R., Liberali, G., & Urban, G. L. (2014). Website morphing 2.0: Switching costs, partial exposure, random exit, and when to morph. Management Science, 60(6), 1594–1616.

    Article  Google Scholar 

  • Heinonen, R., Luoto, R., Lindfors, P., & NygĂĄrd, C. H. (2012). Usability and feasibility of mobile phone diaries in an experimental physical exercise study. Telemedicine and e-Health, 18(2), 115–119.

    Article  Google Scholar 

  • Hektner, J. M., Schmidt, J. A., & Csikszentmihalyi, M. (2007). Experience sampling method: Measuring the quality of everyday life. Thousand Oaks: Sage Publications, Inc.

    Book  Google Scholar 

  • Hensel, D. J., Fortenberry, J. D., Harezlak, J., & Craig, D. (2012). The feasibility of cell phone based electronic diaries for STI/HIV research. BMC Medical Research Methodology, 12(75), 1–12.

    Google Scholar 

  • Hofmann, W., & Patel, P. V. (2015). Survey signal a convenient solution for experience sampling research using participants’ own smartphones. Social Science Computer Review, 33(2), 235–253.

    Article  Google Scholar 

  • Jalali, N. Y., & Papatla, P. (2016). The palette that stands out: Color compositions of online curated visual UGC that attracts higher consumer interaction. Quantitative Marketing and Economics, 14(4), 353–384.

    Article  Google Scholar 

  • Janiszewski, C. (1998). The influence of display characteristics on visual exploratory search behavior. Journal of Consumer Research, 25(3), 290–301.

    Article  Google Scholar 

  • John, D. R., Loken, B., Kim, K., & Monga, A. B. (2006). Brand concept maps: A methodology for identifying brand association networks. Journal of Marketing Research, 43(4), 549–563.

    Article  Google Scholar 

  • Keller, K. L. (2003). Brand synthesis: The multidimensionality of brand knowledge. Journal of Consumer Research, 29(4), 595–600.

    Article  Google Scholar 

  • Kireyev, P., Timoshenko, A., & Yang, C. L. (2020). Scaling human effort in idea screening and content evaluation. INSEAD Working Paper No. 2020/42/MKT, HEC Paris Research Paper No. MKG-2020-1384, Available at SSRN: https://ssrn.com/abstract=3685882 or https://doi.org/10.2139/ssrn.3685882

  • Klostermann, J., Plumeyer, A., Böger, D., & Decker, R. (2018). Extracting brand information from social networks: Integrating image, text, and social tagging data. International Journal of Research in Marketing, 35(4), 538–556.

    Article  Google Scholar 

  • Koll, O., Von Wallpach, S., & Kreuzer, M. (2010). Multi-method research on consumer–brand associations: Comparing free associations, storytelling, and collages. Psychology & Marketing, 27(6), 584–602.

    Article  Google Scholar 

  • Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017). Imagenet classification with deep convolutional neural networks. Communications of the ACM, 60(6), 84–90.

    Article  Google Scholar 

  • Labrecque, L. I. (2014). Fostering consumer–brand relationships in social media environments: The role of Parasocial interaction. Journal of Interactive Marketing, 28(2), 134–148.

    Article  Google Scholar 

  • Lehnert, K., Till, B. D., & Ospina, J. M. (2014). Advertising creativity: The role of divergence versus meaningfulness. Journal of Advertising, 43(3), 274–285.

    Article  Google Scholar 

  • Li, Y., & Xie, Y. (2020). Is a picture worth a thousand words? An empirical study of image content and social media engagement. Journal of Marketing Research, 57(1), 1–19.

    Article  Google Scholar 

  • Li, H., Simchi-Levi, D., Wu, M. X., & Zhu, W. (2019a). Estimating and exploiting the impact of photo layout in sharing economy. Available at SSRN.

    Google Scholar 

  • Li, X., Shi, M., & Wang, X. S. (2019b). Video mining: Measuring visual information using automatic methods. International Journal of Research in Marketing, 36(2), 216–231.

    Article  Google Scholar 

  • Liu, X., Burns, A. C., & Hou, Y. (2017). An investigation of brand-related user-generated content on Twitter. Journal of Advertising, 46(2), 236–247.

    Article  Google Scholar 

  • Liu, L., Dzyabura, D., & Mizik, N. (2020). Visual listening in: Extracting brand image portrayed on social media. Marketing Science, 39(4), 669–686.

    Article  Google Scholar 

  • Lovett, M. J., & Peres, R. (2018). Mobile diaries – Benchmark against metered measurements: An empirical investigation. International Journal of Research in Marketing, 35(2), 224–241.

    Article  Google Scholar 

  • Lovett, M. J., Peres, R., & Shachar, R. (2013). On brands and word of mouth. Journal of Marketing Research, 50(4), 427–444.

    Article  Google Scholar 

  • MacInnis, D. J., & Price, L. L. (1987). The role of imagery in information processing: Review and extensions. Journal of Consumer Research, 13(4), 473–491.

    Article  Google Scholar 

  • McAuley, J., & Leskovec, J. (2012, October). Image labeling on a network: Using social-network metadata for image classification. In European conference on computer vision (pp. 828–841). Berlin/Heidelberg: Springer.

    Google Scholar 

  • McQuarrie, E. F. (2008). Differentiating the pictorial element in advertising – A rhetorical perspective. In M. Wedel & R. Pieters (Eds.), Visual marketing: From attention to action (pp. 91–112). New York: Psychology Press.

    Google Scholar 

  • Meyers-Levy, J., & Zhu, R. (2008). Perhaps the store made you purchase it: Toward an understanding of structural aspects of indoor shopping environment. In M. Wedel & R. Pieters (Eds.), Visual marketing: From attention to action (pp. 193–224). New York: Psychology Press.

    Google Scholar 

  • Nanne, A. J., Antheunis, M. L., van der Lee, C. G., Postma, E. O., Wubben, S., & van Noort, G. (2020). The use of computer vision to analyze brand-related user generated image content. Journal of Interactive Marketing, 50, 156–167.

    Article  Google Scholar 

  • Orsborn, S., Cagan, J., & Boatwright, P. (2009). Quantifying aesthetic form preference in a utility function. Journal of Mechanical Design, 131(6), 061001.

    Article  Google Scholar 

  • Pavlov, E., & Mizik, N. (2019). Increasing consumer engagement with firm-generated social media content: The role of images and words. Working Paper, University of Washington.

    Google Scholar 

  • Peng, L., Cui, G., Chung, Y., & Zheng, W. (2020). The faces of success: Beauty and ugliness premiums in e-commerce platforms. Journal of Marketing, 84(4), 67–85.

    Article  Google Scholar 

  • Peracchio, L. A., & Meyers-Levy, J. (1994). How ambiguous cropped objects in ad photos can affect product evaluations. Journal of Consumer Research, 21(1), 190–204.

    Article  Google Scholar 

  • Peracchio, L. A., & Meyers-Levy, J. (2005). Using stylistic properties of ad pictures to communicate with consumers. Journal of Consumer Research, 32(1), 29–40.

    Article  Google Scholar 

  • Pieters, R., & Wedel, M. (2004). Attention capture and transfer in advertising: Brand, pictorial, and text-size effects. Journal of Marketing, 68(2), 36–50.

    Article  Google Scholar 

  • Pieters, R., Wedel, M., & Zhang, J. (2007). Optimal feature advertising design under competitive clutter. Management Science, 53(11), 1815–1828.

    Article  Google Scholar 

  • Radach, R., Lemmer, S., Vorstius, C., Heller, D., & Radach, K. (2003). Eye movements in the processing of print advertisements. In R. Radach & H. Deubel (Eds.), The mind’s eye (pp. 609–632). Amsterdam: Elsevier Science Publishers.

    Chapter  Google Scholar 

  • Raghubir, P., & Greenleaf, E. A. (2006). Ratios in proportion: What should the shape of the package be? Journal of Marketing, 70(2), 95–107.

    Article  Google Scholar 

  • Reavey, P. (Ed.). (2012). Visual methods in psychology: Using and interpreting images in qualitative research. Routledge. London.

    Google Scholar 

  • Rietveld, R., van Dolen, W., Mazloom, M., & Worring, M. (2020). What you feel, is what you like influence of message appeals on customer engagement on Instagram. Journal of Interactive Marketing, 49, 20–53.

    Article  Google Scholar 

  • Rosbergen, E., Pieters, R., & Wedel, M. (1997). Visual attention to advertising: A segment-level analysis. Journal of Consumer Research, 24(3), 305–314.

    Article  Google Scholar 

  • Rubera, G. (2015). Design innovativeness and product sales’ evolution. Marketing Science, 34(1), 98–115.

    Article  Google Scholar 

  • Sheinin, D. A., Varki, S., & Ashley, C. (2011). The differential effect of ad novelty and message usefulness on brand judgments. Journal of Advertising, 40(3), 5–18.

    Article  Google Scholar 

  • Simonyan, K., & Zisserman, A. (2015). Very deep convolutional networks for large-scale image recognition. In Proceedings of International Conference on Learning Representations (ICLR). Available at https://arxiv.org/abs/1409.1556

  • Smith, R. E., MacKenzie, S. B., Yang, X., Buchholz, L. M., & Darley, W. K. (2007). Modeling the determinants and effects of creativity in advertising. Marketing Science, 26(6), 819–833.

    Article  Google Scholar 

  • Stadlen, A. (2015). Find every photo with Flickr’s new unified search experience. Available at https://blog.flickr.net/en/2015/05/07/flickr-unified-search/

  • Toubia, O., & Netzer, O. (2017). Idea generation, creativity, and prototypicality. Marketing Science, 36(1), 1–20.

    Article  Google Scholar 

  • Van House, N., Davis, M., Ames, M., Finn, M., & Viswanathan, V. (2005). The uses of personal networked digital imaging: An empirical study of cameraphone photos and sharing. In CHI’05 extended abstracts on human factors in computing systems (pp. 1853–1856). ACM.

    Chapter  Google Scholar 

  • Venngage. (2020). 14 Visual content marketing statistics to know for 2020. Available at https://venngage.com/blog/visual-content-marketing-statistics/

  • Vilnai-Yavetz, I., & Tifferet, S. (2015). A picture is worth a thousand words: Segmenting consumers by Facebook profile images. Journal of Interactive Marketing, 32, 53–69.

    Article  Google Scholar 

  • Wedel, M., & Pieters, R. (2000). Eye fixations on advertisements and memory for brands: A model and findings. Marketing Science, 19(4), 297–312.

    Article  Google Scholar 

  • Wedel, M., & Pieters, R. (2008). A review of eye-tracking research in marketing. Review of Marketing Research, 4(2008), 123–147.

    Article  Google Scholar 

  • Wedel, M., & Pieters, R. (2014). Looking at vision (p. 2014). Abingdon: Routledge.

    Google Scholar 

  • Xiao, H., Rasul, K., & Vollgraf, R. (2017). Fashion-MNIST: A novel image dataset for benchmarking machine learning algorithms. arXiv preprint arXiv, 3.

    Google Scholar 

  • Yang, X., & Smith, R. E. (2009). Beyond attention effects: Modeling the persuasive and emotional effects of advertising creativity. Marketing Science, 28(5), 935–949.

    Article  Google Scholar 

  • Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014). How transferable are features in deep neural networks? In Advances in neural information processing systems (pp. 3320–3328). Available at https://arxiv.org/abs/1411.1792

  • Zaltman, G., & Coulter, R. H. (1995). Seeing the voice of the customer: Metaphor-based advertising research. Journal of Advertising Research, 35(4), 35–51.

    Google Scholar 

  • Zaltman, G., & Zaltman, L. H. (2008). Marketing metaphoria: What deep metaphors reveal about the minds of consumers. Boston: Harvard Business Press.

    Google Scholar 

  • Zhang, M., & Luo, L. (2019). Can User-posted photos serve as a leading indicator of restaurant survival? Evidence from Yelp. Available at SSRN 3108288.

    Google Scholar 

  • Zhang, H., Korayem, M., You, E., & Crandall, D. J. (2012). Beyond co-occurrence: Discovering and visualizing tag relationships from geo-spatial and temporal similarities. In Proceedings of the fifth ACM international conference on web search and data mining (pp. 33–42). Available at https://doi.org/10.1145/2124295.2124302

  • Zhang, S., Mehta, N., Singh, P. V., & Srinivasan, K. (2019). Can lower-quality images lead to greater demand on AirBnB? Technical report, working paper, Carnegie Mellon University.

    Google Scholar 

  • Zhang, S., Lee, D., Singh, P. V., & Srinivasan, K. (2021) “What makes a good image? Airbnb demand analytics leveraging interpretable image features”. Management Science. Forthcomming.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. New Economic School and Moscow School of Management SKOLKOVO, Moscow, Russia

    Daria Dzyabura

  2. Frankfurt School of Finance and Management, Frankfurt, Germany

    Siham El Kihal

  3. School of Business Administration, Hebrew University of Jerusalem, Jerusalem, Israel

    Renana Peres

Authors
  1. Daria Dzyabura
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Siham El Kihal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Renana Peres
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Siham El Kihal .

Editor information

Editors and Affiliations

  1. Department of Business-to-Business Marketing, Sales, and Pricing, University of Mannheim, Mannheim, Germany

    Christian Homburg

  2. Department of Marketing & Sales Research Group, Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany

    Martin Klarmann

  3. Marketing & Sales Department, University of Mannheim, Mannheim, Germany

    Arnd Vomberg

Section Editor information

  1. University of Mannheim, Mannheim, Germany

    Christian Homburg

  2. Karlsruhe Institute of Technology, Karlsruhe, Germany

    Martin Klarmann

  3. University of Groningen, Groningen, Niederlande

    Arnd Vomberg

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Dzyabura, D., El Kihal, S., Peres, R. (2022). Image Analytics in Marketing. In: Homburg, C., Klarmann, M., Vomberg, A. (eds) Handbook of Market Research. Springer, Cham. https://doi.org/10.1007/978-3-319-57413-4_38

Download citation

Publish with us

Policies and ethics

Search

Navigation