Cross channel effects of search engine advertising on brick & mortar retail sales: Meta analysis of large scale field experiments on Google.com
- 584 Downloads
We investigate the cross channel effects of search engine advertising on Google.com on sales in brick and mortar retail stores. Obtaining causal and actionable estimates in this context is challenging: Brick and mortar store sales vary widely on a weekly basis; offline media dominate the marketing budget; search advertising and demand are contemporaneously correlated; and estimates have to be credible to overcome agency issues between the online and offline marketing groups. We report on a meta-analysis of a population of 15 independent field experiments, in which 13 well-known U.S. multi-channel retailers spent over $4 Million in incremental search advertising. In test markets category keywords were maintained in positions 1-3 for 76 product categories with no search advertising on these keywords in the control markets. Outcomes measured include sales in the advertised categories, total store sales and Return on Ad Spending. We estimate the average effect of each outcome for this population of experiments using a Hierarchical Bayesian (HB) model. The estimates from the HB model provide causal evidence that increasing search engine advertising on broad keywords on Google.com had a positive effect on sales in brick and mortar stores for the advertised categories for this population of retailers. There also was a positive effect on total store sales. Hence the increase in sales in the advertised categories was incremental to the retailer net of any sales borrowed from non-advertised categories. The total store sales increase was a meaningful improvement compared to the baseline sales growth rates. The average Return on Ad Spend (ROAS) is positive, but does not breakeven on average although several retailers achieved or exceeded break-even based only on brick and mortar sales. We examine the robustness of our findings to alternative assumptions about the data specific to this set of experiments. Our estimates suggest online and offline are linked markets, that media planners should account for the offline effects in the planning and execution of search advertising campaigns, and that these effects should be adjusted by category and retailer. Extensive replication and a unique research protocol ensure that our results are general and credible.
KeywordsSearch engine advertising Cross channel impact Field experiments Bayesian meta analysis Retail marketing Advertising Retail sales Replication
JEL ClassificationM31 M37 L86 C39 C21 C11 L81
- Agarwal, A., Hosanagar, K., & Location, M.S. (2008). Location, location: An analysis of profitability of position in online advertising markets. Journal of Marketing Research, 46(6), 1057–1073.Google Scholar
- Babapulle, M.N., Joseph, L., Bélisle, P., Brophy, J.M., & Eisenberg, M.J. (2004). A hierarchical Bayesian meta-analysis of randomised clinical trials of drug-eluting stents. The Lancet, 364(9434), 583–591. https://scholar.google.com/scholar?hl=en&q=Babapulle%2C+M.N.%2C+Joseph%2C+L.%2C+Be%C2%B4lisle%2C+P.%2C+Brophy%2C+J.M.%2C+%26+Eisenberg%2C+M.J.+%282004%29.+A+hierarchical+bayesian+978+meta-analysis+of+randomised+clinical+trials+of+drugeluting+stents.+The+Lancet%2C+364%289434%29%2C+583%E2%80%93591.&btnG=&as_sdt=1%2C5&as_sdtp=.CrossRefGoogle Scholar
- Bajari, P., & Hortacsu, A. (2003). The winner’s curse, reserve prices, and endogenous entry: Empirical insights from ebay auctions. RAND Journal of Economics, 329–355.Google Scholar
- Banjo, S., & FitzGerald, D. (2014). Stores confront new world of reduced shopper traffic. Wall Street Journal, 4. https://scholar.google.com/scholar?q=Banjo%2C+S.%2C+%26+FitzGerald%2C+D.+%282014%29.+Stores+confront+new+world+of+reduced+shopper+traffic.+Wall+Street+982+Journal.&btnG=&hl=en&as_sdt=0%2C5.
- Berndt, E.R. (1991). The practice of econometrics: classic and contemporary. Addison-Wesley Reading MA.Google Scholar
- Blake, T., Nosko, C., & Tadelis, S. (2013). Consumer heterogeneity and paid search effectiveness: A large scale field experiment. NBER Working Paper, 1–26.Google Scholar
- Brucks, M. (1985). The effects of product class knowledge on information search behavior. Journal of Consumer Research, 12(1), 1–16.Google Scholar
- Brynjolfsson, E., Dick, A.A., & Smith, M.D. (2010). A nearly perfect market?. QME, 8(1), 1–33.Google Scholar
- Farley, J.U., & Lehmann, D.R. (1986). Generalizing about market response models: Meta-analysis in marketing. Lexington: Lexington Books.Google Scholar
- FitzGerald, D. (2013). Retail sales on thanksgiving, black friday rose 2.3 reports. http://online.wsj.com/news/articles/SB10001424052702304017204579230801763930942.
- Holmes, E. (2014). Why online retailers like Bonobos, Boden, Athleta mail so many catalogs. https://scholar.google.com/scholar?hl=en&q=Holmes%2C+E.+%282014%29.+Why+online+retailers+like+bonobos%2C+boden%2C+athleta+mail+so+many+catalogs.+Wall+Street+1007+Journal.&btnG=&as_sdt=1%2C5&as_sdtp=. Accessed 18 Apr 2014.
- Imbens, G.W., & Rubin, D.B. (2015). Causal inference in statistics, social, and biomedical sciences. Cambridge University Press.Google Scholar
- Lewis, R.A., & Reiley, D.H (2014). Online ads and offline sales: measuring the effect of retail advertising via a controlled experiment on Yahoo! Quantitative Marketing and Economics, 12.3, 235–266. https://scholar.google.com/scholar?q=Randall+lewis+and+david+reiley&btnG=&hl=en&as_sdt=0%2C5.
- Lieber, E., & Syverson, C. (2012). Online versus offline competition. Oxford Handbook of the Digital Economy, 189–223. https://scholar.google.com/scholar?hl=en&as_sdt=0,5&q=Lieber,+E.,+%26+Syverson,+C.+(2012).+Online+vs+offline+competition.+Oxford+Handbook+of+the+Digital+1020+Economy,+189%E2%80%93223.
- Lodish, L.M., Abraham, M., Kalmenson, S., Livelsberger, J., Lubetkin, B., Richardson, B., & Stevens, M.E. (1995). How tv advertising works: a meta-analysis of 389 real world split cable tv advertising experiments. Journal of Marketing Research, 125–139.Google Scholar
- Narayanan, S., & Kalyanam, K. (2015). Position effects in search advertising and their moderators: A regression discontinuity approach. Marketing Science, 34.3, 388–407.Google Scholar
- Ratchford, B.T., Lee, M.-S., & Talukdar, D. (2003). The impact of the internet on information search for automobiles. Journal of Marketing Research, 193–209.Google Scholar
- Sahni, N.S (2015). Effect of temporal spacing between advertising exposures: Evidence from online field experiment. Quantitative Marketing and Economics, 13.3, 203–247.Google Scholar
- Sahni, N.S (2016). Advertising spillovers: evidence from online field experiments and implications for returns on advertising. Journal of Marketing Research, 53(4), 459–478.Google Scholar
- Tellis, G.J. (1988). The price elasticity of selective demand: A meta-analysis of economic models of sales. Journal of Marketing Research (JMR) 25(4).Google Scholar