Abstract
Bayesian model averaging (BMA) is a statistical method to rigorously take model uncertainty into account. This chapter gives a coherent overview on the statistical foundations and methods of BMA and its usefulness for forecasting, but also for the identification of robust determinants. The focus is given on economic applications. We describe the BMA framework in the context of linear models. Different model and parameter priors are discussed in detail and suitable inference methods and posterior analysis tools are presented. We illustrate the use of the presented BMA framework to study potential drivers of box office revenues and to forecast these revenues. The available data set does not only contain traditional variables such as budget or genre categorization, but also variables derived from social media content which capture sentiment and volume of Twitter messages. We discuss the impact of different model specifications and describe how results are obtained using the open-source package BMS available for the R environment for statistical computing and graphics.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
This working paper was published in a slightly different version as Doppelhofer and Weeks (2009a).
- 2.
In the context of economic growth, this is in line with the model formulation in Durlauf, Kourtellos, and Tan (2008) where competing groups of explanatory variables emerging from different theories are assumed to be relevant.
- 3.
Following Lehrer and Xie (2017), this sample selection criterion was proposed by IHS film consulting and accounts for 41.4% of released movies.
References
Acemoglu, D., Johnson, S., & Robinson, J. (2001). The colonial origins of comparative development: An empirical investigation. American Economic Review, 91(5), 1369–1401.
Arias, M., Arratia, A., & Xuriguera, R. (2013). Forecasting with Twitter data. ACM Transactions on Intelligent Systems and Technology, 5(1), 8.
Arin, K. P., & Braunfels, E. (2018). The resource curse revisited: A Bayesian model averaging approach. Energy Economics, 70(100), 170–178.
Asur, S., & Huberman, B. A. (2010). Predicting the future with social media. In Proceedings of the 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (Vol. 1, pp. 492–499). Piscataway: IEEE Computer Society.
Barnard, G. A. (1963). New methods of quality control. Journal of the Royal Statistical Society, Series A, 126, 255–258.
Bates, J. M., & Granger, C. W. J. (1969). The combination of forecasts. Operational Research Quarterly, 20, 451–468.
Brock, W., & Durlauf, S. (2001). Growth empirics and reality. World Bank Economic Review, 15, 229–272.
Chipman, H. (1996). Bayesian variable selection with related predictors. Canadian Journal of Statistics, 24, 17–36.
Crespo Cuaresma, J. (2011). How different is Africa? A comment on Masanjala and Papageorgiou. Journal of Applied Econometrics, 26, 1041–1047.
Crespo Cuaresma, J., Grün, B., Hofmarcher, P., Humer, S., & Moser, M. (2016). Unveiling covariate inclusion structures in economic growth regressions using latent class analysis. European Economic Review, 81, 189–202.
Danquah, M., Moral-Benito, E., & Ouattara, B. (2014). TFP growth and its determinants: A model averaging approach. Empirical Economics, 47(1), 227–251.
Delgado, M. S., Henderson, D. J., & Parmeter. C. F. (2014). Does education matter for economic growth? Oxford Bulletin of Economics and Statistics, 76(3), 334–359.
Doppelhofer, G., & Weeks, M. (2005). Jointness of growth determinants. Cambridge: University of Cambridge.
Doppelhofer, G., & Weeks, M. (2009a). Jointness of growth determinants. Journal of Applied Econometrics, 24(2), 209–244.
Doppelhofer, G., & Weeks, M. (2009b). Jointness of growth determinants: Reply to comments by Rodney Strachan, Eduardo Ley and Mark FJ Steel. Journal of Applied Econometrics, 24(2), 252–256.
Durlauf, S. N., Kourtellos, A., & Tan, C. M. (2008). Are any growth theories robust? The Economic Journal, 118(527), 329–346.
Eicher, T. S., Henn, C., & Papageorgiou, C. (2012). Trade creation and diversion revisited: Accounting for model uncertainty and natural trading partner effects. Journal of Applied Econometrics, 27(2), 296–321.
Eicher, T. S., & Newiak, M. (2013). Intellectual property rights as development determinants. Canadian Journal of Economics, 46(1), 4–22.
Eicher, T. S., Papageorgiou, C., & Raftery, A. E. (2011). Default priors and predictive performance in Bayesian model averaging, with application to growth determinants. Journal of Applied Econometrics, 26(1), 30–55.
Feldkircher, M., Horvath, R., & Rusnak, M. (2014). Exchange market pressures during the financial crisis: A Bayesian model averaging evidence. Journal of International Money and Finance, 40, 21–41.
Fernández, C., Ley, E., & Steel, M. F. J. (2001). Model uncertainty in cross-country growth regressions. Journal of Applied Econometrics, 16(5), 563–576.
George, E. I. (2010). Dilution priors: Compensating for model space redundancy. IMS Collections Borrowing Strength: Theory Powering Applications – A Festschrift for Lawrence D. Brown, 6, 158–165.
Glass, D. H. (2013). Confirmation measures of association rule interestingness. Knowledge-Based Systems, 44, 65–77.
Grün, B., & Hofmarcher, P. (2018). Identifying groups of determinants in Bayesian model averaging using Dirichlet process clustering model priors. Salzburg: University of Salzburg.
Hannak, A., Anderson, E., Barrett, L. F., Lehmann, S., Mislove, A., & Riedewald, M. (2012). Tweetin’ in the rain: Exploring societal-scale effects of weather on mood. In Proceedings of the Sixth International AAAI Conference on Weblogs and Social Media (pp. 479–482).
Henderson, D. J., Papageorgiou, C., & Parmeter, C. F. (2011). Growth empirics without parameters. The Economic Journal, 122(559), 125–154.
Henderson, D. J., & Parmeter, C. F. (2016). Model averaging over nonparametric estimators. In G. González-Rivera, R. C. Hill, & T.-H. Lee (Eds.), Essays in honor of Aman Ullah. Advances in Econometrics (Vol. 36, pp. 539–560). Bingley: Emerald Group Publishing Limited.
Hoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999). Bayesian model averaging: A tutorial. Statistical Science, 14(4), 382–417.
Hofmarcher, P., Crespo Cuaresma, J., Grün, B., Humer, S., & Moser, M. (2018). Bivariate jointness measures in Bayesian model averaging: Solving the conundrum. Journal of Macroeconomics, 57, 150–165.
Hofmarcher, P., Kerbl, S., Grün, B., Sigmund, M., & Hornik, K. (2014). Model uncertainty and aggregated default probabilities: New evidence from Austria. Applied Economics, 46(8), 871–879.
Jetter, M., & Parmeter, C. F. (2018). Sorting through global corruption determinants: Institutions and education matter – Not culture. World Development, 109(100), 279–294.
Koop, G. (2017). Bayesian methods for empirical macroeconomics with big data. Review of Economic Analysis, 9, 33–56.
Koop, G., & Korobilis, D. (2012). Forecasting inflation using dynamic model averaging. International Economic Review, 53(3), 867–886.
Koop, G., & Tobias, J. L. (2006). Semiparametric Bayesian inference in smooth coefficient models. Journal of Econometrics, 134(1), 283–315.
Leamer, E. E. (1978). Specification searches. New York: John Wiley and Sons.
Lehrer, S., & Xie, T. (2017). Box office buzz: Does social media data steal the show from model uncertainty when forecasting for Hollywood? The Review of Economics and Statistics, 99(5), 749–755.
Lenkoski, A., Eicher, T., & Raftery, A. (2014). Two-stage Bayesian model averaging in endogenous variable models. Econometric Reviews, 33, 122–151.
Ley, E., & Steel, M. F. J. (2007). Jointness in Bayesian variable selection with applications to growth regression. Journal of Macroeconomics, 29(3), 476–493.
Ley, E., & Steel, M. F. J. (2009). On the effect of prior assumptions in Bayesian model averaging with applications to growth regression. Journal of Applied Econometrics, 24(4), 651–674.
Ley, E., & Steel, M. F. J. (2012). Mixtures of g-priors for Bayesian model averaging with economic applications. Journal of Econometrics, 171(2), 251–266.
Madigan, D., & Raftery, A. E. (1994). Model selection and accounting for model uncertainty in graphical models using Occam’s window. Journal of the American Statistical Association, 89(428), 1535–1546.
Madigan, D., & York, J. (1995). Bayesian graphical models for discrete data. International Statistical Review, 63(2), 215–232.
Malsiner-Walli, G., Hofmarcher, P., & Grün, B. (2019). Semi-parametric regression under model uncertainty: Economic applications. Oxford Bulletin of Economics and Statistics, 81(5), 1117–1143.
Masanjala, W. H., & Papageorgiou, C. (2008). Rough and lonely road to prosperity: A reexamination of the sources of growth in Africa using Bayesian model averaging. Journal of Applied Econometrics, 23, 671–682.
Moral-Benito, E. (2012). Determinants of economic growth: A Bayesian panel data approach. Review of Economics and Statistics, 94(2), 566–579.
Moral-Benito, E. (2015). Model averaging in economics: An overview. Journal of Economic Surveys, 29(1), 46–75.
Moser, M., & Hofmarcher, P. (2013). Model priors revisited: Interaction terms in BMA growth applications. Journal of Applied Econometrics, 29(2), 344–347.
R Core Team. (2019). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. Retrieved from https://www.R-project.org/.
Raftery, A., Karny, M., & Ettler, P. (2010). Online prediction under model uncertainty via dynamic model averaging: Application to a cold rolling mill. Technometrics, 52, 52–66.
Sala-i-Martin, X., Doppelhofer, G., & Miller, R. I. (2004). Determinants of long-term growth: A Bayesian averaging of classical estimates (BACE) approach. The American Economic Review, 94(4), 813–835.
Scheipl, F. (2011). spikeSlabGAM: Bayesian variable selection, model choice and regularization for generalized additive mixed models in R. Journal of Statistical Software, 43(14), 1–24.
Scheipl, F., Fahrmeir, L., & Kneib, T. (2012). Spike-and-slab priors for function selection in structured additive regression models. Journal of the American Statistical Association, 107(500), 1518–1532.
Smith, M., & Kohn, R. (1996). Nonparametric regression using Bayesian variable selection. Journal of Econometrics, 75(2), 317–343.
Steel, M. F. J. (2018). Bayesian model averaging and its use in economics. arXiv:1709.08221 [stat.AP]. Retrieved from http://arxiv.org/abs/1709.08221.
Strachan, R. W. (2009). Comment on ‘Jointness of growth determinants’ by Gernot Doppelhofer and Melvyn Weeks. Journal of Applied Econometrics, 24(2), 245–247.
Tobias, J. L., & Li, M. (2004). Returns to schooling and Bayesian model averaging: A union of two literatures. Journal of Economic Surveys, 18(2), 153–180.
Wright, J. H. (2008). Bayesian model averaging and exchange rate forecasts. Journal of Econometrics, 146(2), 329–341.
Wu, T., Chen, Y., & Han, J. (2010). Re-examination of interestingness measures in pattern mining: A unified framework. Data Mining and Knowledge Discovery, 21(3), 371–397.
Zellner, A. (1986). On assessing prior distributions and Bayesian regression analysis with g prior distributions. In P. Goel & A. Zellner (Eds.), Bayesian inference and decision techniques: Essays in honor of Bruno de Finetti (Vol. 6, pp. 233–243). New York: Elsevier.
Zeugner, S., & Feldkircher, M. (2015). Bayesian model averaging employing fixed and flexible priors: The BMS package for R. Journal of Statistical Software, 68(4), 1–37.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Hofmarcher, P., Grün, B. (2020). Bayesian Model Averaging. In: Fuleky, P. (eds) Macroeconomic Forecasting in the Era of Big Data. Advanced Studies in Theoretical and Applied Econometrics, vol 52. Springer, Cham. https://doi.org/10.1007/978-3-030-31150-6_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-31150-6_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-31149-0
Online ISBN: 978-3-030-31150-6
eBook Packages: Economics and FinanceEconomics and Finance (R0)