Abstract
We employ a statistical criterion (out-of-sample hit rate) and a financial market measure (portfolio performance) to compare the forecasting accuracy of three model selection approaches: Bayesian information criterion (BIC), model averaging, and model mixing. While the more recent approaches of model averaging and model mixing surpass the Bayesian information criterion in their out-of-sample hit rates, the predicted portfolios from these new approaches do not significantly outperform the portfolio obtained via the BIC subset selection method.
Similar content being viewed by others
References
Akaike H. (1973) Information theory and an extension of the maximum likelihood principle. In: Petrov B.N., Csaki F. (eds) 2nd International symposium on information theory. Budapest, Akademia Kiado, pp 267–281
Akaike H. (1978a) A Bayesian analysis of the minimum AIC procedure. Annals of the Institute of Statistical Mathematics 30: 9–14
Akaike H. (1978b) On the likelihood of a time series model. The Statistician 27: 217–235
Akaike H. (1979) A Bayesian extension of the minimum AIC procedure of autoregressive model fitting. Biometrika 66: 237–242
Ang A., Bekaert G. (2007) Stock return predictability: is it there? Review of Financial Studies 20: 651–707
Avramov D. (2002) Stock return predictability and model uncertainty. Journal of Financial Economics 64: 423–458
Black F. (1993) Estimating expected returns. Financial Analyst Journal 49: 36–38
Bossaerts P., Hillion P. (1999) Implementing statistical criteria to select return forecasting models: what do we Learn? Review of Financial Studies 12: 405–428
Buckland S.T., Burnham K.P., Augustin N.H. (1997) Model selection: an integral part of inference. Biometrics 53: 603–618
Burnham K.P., Anderson D.R. (2002) Model selection and multimodel inference (2nd edn). Springer, New York
Campbell J. (1987) Stock returns and the term structure. Journal of Financial Economics 18: 373–399
Chen, N. F., Roll, R., Ross, S. (1986). Economic forces and the stock market. Journal of Business, 59, 383–403
Cremers M. (2002) Stock return predictability: a Bayesian model selection perspective. Review of Financial Studies 15: 1223–1249
George E.I., McCulloch R.E. (1993) Variable selection via Gibbs sampling. Journal of the American Statistical Association 88: 881–889
Hastie T., Tibshirani R., Friedman J. (2001) The elements of statistical learning. Springer, New York
Hjort N.L., Cleaskens G. (2003) Frequentist model average estimators (with discussion). Journal of the American Statistical Association 98: 879–899
Hoeting J., Madigan D., Raftery A., Volinsky C. (1999) Bayesian model averaging. Statistical Science 14: 382–401
Leamer E. E. (1978) Specification searches: ad hoc inference with nonexperimental data. John Wiley, New York
Lo A., MacKinlay A. (1997) Maximizing the predictability in the stock and bond markets. Macro Economics Dynamics 1: 102–134
Malkiel B. G. (2004) Models of stock market predictability. Journal of Financial Research 27: 449–459
Peart S. (1996) The economics of W. S. Jevons (Routledge studies in the history of economics, 9). Springer, New York
Rachev S.T., Mittnik S., Fabozzi F.J., Focardi S.M, Jasic T. (2006) Financial econometrics: from basics to advanced modeling techniques. Wiley, New York
Schwarz G. (1978) Estimating the dimension of a model. The Annals of Statistics 6: 461–464
Tibshirani R. J. (1996) Regression shrinkage and selection via lasso. Journal of the Royal Statistical Society, Series B 58: 267–288
Yang Y. (2001) Adaptive regression by mixing. Journal of the American Statistical Association 96: 574–588
Yang Y. (2003) Regression with multiple candidate models: selecting or mixing? Statistica Sinica 13: 783–809
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Tsai, CL., Wang, H. & Zhu, N. Does a Bayesian approach generate robust forecasts? Evidence from applications in portfolio investment decisions. Ann Inst Stat Math 62, 109–116 (2010). https://doi.org/10.1007/s10463-009-0250-4
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10463-009-0250-4