A practitioner’s guide to Bayesian estimation of discrete choice dynamic programming models
This paper provides a step-by-step guide to estimating infinite horizon discrete choice dynamic programming (DDP) models using a new Bayesian estimation algorithm (Imai et al., Econometrica 77:1865–1899, 2009a) (IJC). In the conventional nested fixed point algorithm, most of the information obtained in the past iterations remains unused in the current iteration. In contrast, the IJC algorithm extensively uses the computational results obtained from the past iterations to help solve the DDP model at the current iterated parameter values. Consequently, it has the potential to significantly alleviate the computational burden of estimating DDP models. To illustrate this new estimation method, we use a simple dynamic store choice model where stores offer “frequent-buyer” type rewards programs. Our Monte Carlo results demonstrate that the IJC method is able to recover the true parameter values of this model quite precisely. We also show that the IJC method could reduce the estimation time significantly when estimating DDP models with unobserved heterogeneity, especially when the discount factor is close to 1.
KeywordsBayesian estimation Dynamic programming Discrete choice models Rewards programs
JEL ClassificationC11 C35 C61 D91 M31
- Albert, J. H., & Chib, S. (1993). Bayesian analysis of binary and polychotomous response data. Journal of the American Statistical Association, 88, 669–679.Google Scholar
- Allenby, G. M. (1994). An introduction to hierarchical Bayesian modeling. Tutorial Notes, Advanced Research Techniques Forum, American Marketing Association.Google Scholar
- Allenby, G. M., & Lenk, P. J. (1994). Modeling household purchase behavior with logistic normal regression. Journal of the American Statistical Association, 89, 1218–1231.Google Scholar
- Allenby, G. M., & Rossi, P. E. (2006). Hierarchical Bayes models: A practitioner’s guide. In R. Grover, & M. Vriens (Eds.), The handbook of marketing research. Newbury Park: Sage Publications.Google Scholar
- Brown, M., & Flinn, C. J. (2011). Family law effects on divorce, fertility and child investment. Working paper, Department of Economics, New York University.Google Scholar
- Ching, A. T., Imai, S., Ishihara, M., & Jain, N. (2009). A dynamic model of consumer learning and forgetting. Work-in-progress, Rotman School of Management, University of Toronto.Google Scholar
- Ching, A. T., Imai, S., Ishihara, M., & Jain, N. (2012). Identification of dynamic models of rewards program. Working paper, Rotman School of Management, University of Toronto.Google Scholar
- Geweke, J., Houser, D., & Keane, M. P. (2001). Simulation based inference for dynamic multinomial choice models. In B. H. Baltagi (Ed.), A companion to theoretical econometrics (pp. 466–493). London: Blackwell.Google Scholar
- Geweke, J. F., & Keane, M. P. (2000). Bayesian inference for dynamic discrete choice models without the need for dynamic programming. In R. Mariano, T. Schuermann, & M. J. Weeks (Eds.), Simulation based inference and econometrics: Methods and applications. Cambridge: Cambridge University Press.Google Scholar
- Imai, S., Jain, N., & Ching, A. (2009b). Supplement to ‘Bayesian estimation of dynamic discrete choice models’. Econometrica (Supplementary Material), 77. http://www.econometricsociety.org/ecta/Supmat/5658_proofs.pdf.
- Ishihara, M. (2011). Dynamic demand for new and used durable goods without physical depreciation. Ph.D. dissertation, Rotman School of Management, University of Toronto.Google Scholar
- Pantano, J. (2008). Essays in applied microeconomics. Ph.D. dissertation, UCLA.Google Scholar
- Roos, J. M. T., Mela, C. F., & Shachar, R. (2011). Hyper-media search and consumption. Working paper, Fuqua School of Business, Duke University.Google Scholar
- Rossi, P. E., & Allenby, G. M. (1999). Marketing models of consumer heterogeneity. Journal of Econometrics, 89, 57–78.Google Scholar
- Silverman, B. W. (1986). Density estimation for statistics and data analysis. London: Chapman and Hall.Google Scholar
- Train, K. E. (2003). Discrete choice methods with simulation. Cambridge: Cambridge University Press. Available at http://elsa.berkeley.edu/books/choice2.html.
- Walsh, B. (2004). Markov Chain Monte Carlo and Gibbs sampling. Lecture Notes for EEB 581, University of Arizona. http://nitro.biosci.arizona.edu/courses/EEB581-2004/handouts/Gibbs.pdf.
- Yang, B., & Ching, A. (2010). Dynamics of consumer adoption of financial innovation: The case of ATM cards. Working paper, Rotman School of Management, University of Toronto. Available at SSRN: http://ssrn.com/abstract=1434722.