Abstract
Bayesian methods have been widely used to estimate models with complex structures. To assess model fit and compare different models, researchers typically use model selection criteria such as Deviance Information Criteria (DIC), Watanabe-Akaike Information Criteria (WAIC) and leave-one-out cross validation (LOO-CV), the calculation of which is based on the likelihoods of the models. When models contain latent variables, the likelihood is often specified as conditional on the latent variables in popular Bayesian software (e.g., BUGS, JAGS, and Stan). Although this practice reduces computation work and does not affect model estimation, the previous literature has shown that model comparisons based on the conditional likelihood could be misleading. In contrast, marginal likelihoods can be obtained by integrating out the latent variables and be used to calculate model selection criteria. In this study, we evaluate the effect of using conditional likelihoods and marginal likelihoods in model selection for growth mixture models. Simulation results suggest that marginal likelihoods are much more reliable and should be generally used for growth mixture modeling.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bauer, D. J. & Curran, P. J. (2003). Distributional assumptions of growth mixture models: implications for overextraction of latent trajectory classes. Psychological Methods, 8(3), 338–363. https://doi.org/10.1037/1082-989X.8.3.338
Celeux, G., Forbes, F., Robert, C. P., & Titterington, D. M. (2006). Deviance information criteria for missing data models. Bayesian Analysis, 1, 651–673. https://doi.org/10.1214/06-ba122
Depaoli, S. (2013). Mixture class recovery in GMM under varying degrees of class separation: Frequentist versus Bayesian estimation. Psychological Methods, 18, 186–219. https://doi.org/10.1037/a0031609
Depaoli, S. (2014). The impact of inaccurate âinformativeâ priors for growth parameters in Bayesian growth mixture modeling. Structural Equation Modeling: A Multidisciplinary Journal, 21(2), 239–252. https://doi.org/10.1080/10705511.2014.882686
Frankfurt, S., Frazier, P., Syed, M., & Jung, K. R. (2016). Using group-based trajectory and growth mixture modeling to identify classes of change trajectories. The Counseling Psychologist, 44(5), 622–660. https://doi.org/10.1177/0011000016658097
Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., & Rubin, D. B. (2013). Bayesian data analysis. Boca Raton, FL: Chapman and Hall/CRC.
Hipp, J. R. & Bauer, D. J. (2006). Local solutions in the estimation of growth mixture models. Psychological Methods, 11(1), 36–53. https://doi.org/10.1037/1082-989X.11.1.36
Kim, S., Tong, X., & Ke, Z. (2021a). Exploring class enumeration in Bayesian growth mixture modeling based on conditional medians. Frontiers in Education. A special research topic on Advances in Mixture Modeling. https://doi.org/10.3389/feduc.2021.624149
Kim, S., Tong, X., Zhou, J., & Boichuk, J. P. (2021b). Conditional median based Bayesian growth mixture modeling for nonnormal data. Behavior Research Methods. https://doi.org/10.3758/s13428-021-01655-w
Lu, Z., Zhang, Z., & Lubke, G. (2011). Bayesian inference for growth mixture models with latent class dependent missing data. Multivariate Behavioral Research, 46, 567–597.
McDermott, P. A., Rovine, M. J., Reyes, R. S., Chao, J. L., Scruggs, R., Buek, K., & Fantuzzo, J. W. (2018). Trajectories of early education learning behaviors among children at risk: A growth mixture modeling approach. Psychology in the Schools, 55(10), 1205–1223. https://doi.org/10.1002/pits.22145
Merkle, E. C., Furr, D., & Rabe-Hesketh, S. (2019). Bayesian comparison of latent variable models: conditional versus marginal likelihoods. Psychometrika, 84(3), 802–829. https://doi.org/10.1007/s11336-019-09679-0
Plummer, M. (2017). Jags version 4.3. 0 user manual.
Ram, N. & Grimm, K. J. (2009). Growth mixture modeling: a method for identifying differences in longitudinal change among unobserved groups. International Journal of Behavioral Development, 33(6), 565–576. https://doi.org/10.1177/0165025409343765
Ren, L., Tong, X., Xu, W., Wu, Z., Zhou, X., & Hu, B. Y. (2021). Distinct patterns of organized activity participation and their associations with school readiness among Chinese preschoolers. Journal of School Psychology, 86, 100–119. https://doi.org/10.1016/j.jsp.2021.03.007
Smith, K. V. & Ehlers, A. (2020). Cognitive predictors of grief trajectories in the first months of loss: A latent growth mixture model. Journal of Consulting and Clinical Psychology, 88(2), 93–105. https://doi.org/10.1037/ccp0000438
Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & Linde, A. v. d. (2002). Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 64(4), 583–639.
Vehtari, A., Gelman, A., & Gabry, J. (2017). Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Journal of Statistics and Computing, 27, 1413–1432.
Watanabe, S. (2010). Asymptotic equivalence of Bayes cross validation and widely applicable information criterion in singular learning theory. Journal of Machine Learning Research, 11, 3571–3594.
Acknowledgements
This paper is based upon work supported by the National Science Foundation under grant no. SES-1951038. Correspondence concerning this article should be addressed to Xin Tong, Department of Psychology, University of Virginia. Email: xt8b@virginia.edu.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Tong, X., Kim, S., Ke, Z. (2022). Impact of Likelihoods on Class Enumeration in Bayesian Growth Mixture Modeling. In: Wiberg, M., Molenaar, D., González, J., Kim, JS., Hwang, H. (eds) Quantitative Psychology. IMPS 2021. Springer Proceedings in Mathematics & Statistics, vol 393. Springer, Cham. https://doi.org/10.1007/978-3-031-04572-1_9
Download citation
DOI: https://doi.org/10.1007/978-3-031-04572-1_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-04571-4
Online ISBN: 978-3-031-04572-1
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)