Abstract
This paper proposes a Monte Carlo approach for nested model comparisons. This approach allows for test of approximate equivalency in fit between nested models and customizing cutoff criteria for difference in a fit index. Different methods to account for trivial misspecification in the Monte Carlo approach are also discussed. A simulation study is conducted to compare the Monte Carlo approach with different methods of imposing trivial misspecification to chi-square difference test and change in comparative fit index (CFI) with suggested cutoffs. The simulation study shows that the Monte Carlo approach is superior to the chi-square difference test by correctly retaining the nested model with trivial misspecification. It is also superior to the change in CFI by offering higher power to detect severe misspecification.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bentler, P. M. (1995). EQS structural equations program manual. Encino, CA: Multivariate Software.
Bollen, K. A., & Stine, R. A. (1992). Bootstrapping goodness-of-fit measures in structural equation models. Sociological Methods & Research, 21, 205–229.
Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21, 230–258.
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255.
Hu, L.-T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.
Meade, A. W., Johnson, E. C., & Braddy, P. W. (2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. Journal of Applied Psychology, 93, 568–592.
Millsap, R. E. (2007). Structural equation modeling made difficult. Personality and Individual Differences, 2, 875–881.
Millsap, R. E. (September, 2010). A simulation paradigm for evaluating “approximate fit” in latent variable modeling. Paper presented at the conference “Current topics in the Theory and Application of Latent Variable Models: A Conference Honoring the Scientific Contributions of Michael W. Browne”, Ohio State University, Columbus, OH.
Millsap, R. E. (2012). A simulation paradigm for evaluating model fit. In M. C. Edwards & R. C. MacCallum (Eds.), Current issues in the theory and application of latent variable models (pp. 165–182). New York: Routledge.
Millsap, R. E. & Lee, S. (September, 2008). Approximate fit in SEM without a priori cutpoints. Paper presented at the Annual Meeting of Society of Multivariate Experimental Psychology, McGill University, Montreal, QC, Canada.
Pornprasertmanit, S., Miller, P. J., & Schoemann, A. M. (2013). simsem: simulated structural equation modeling version 0.5-0 [Computer Software]. Available at the Comprehensive R Archive Network.
Pornprasertmanit, S., Wu, W., & Little, T. D. (May, 2012). Monte Carlo approach to model fit evaluation in structural equation modeling: How to specify trivial misspecification. Poster presented at the American Psychological Society Annual Convention, Chicago, IL.
Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36.
R Development Core Team (2012). R: A language and environment for statistical computing [Computer software manual]. Retrieved from http://www.R-project.org/
Saris, W. E., Satorra, A., & van der Veld, W. M. (2009). Testing structural equation models or detection of misspecifications? Structural Equation Modeling, 16, 561–582.
Acknowledgments
Partial support for this project was provided by grant NSF 1053160 (Wei Wu & Todd D. Little, co-PIs) and by the Center for Research Methods and Data Analysis at the University of Kansas (when Todd D. Little was director). Todd D. Little is now director of the Institute for Measurement, Methodology, Analysis, and Policy at Texas Tech University. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the funding agencies.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer Science+Business Media New York
About this paper
Cite this paper
Pornprasertmanit, S., Wu, W., Little, T.D. (2013). A Monte Carlo Approach for Nested Model Comparisons in Structural Equation Modeling. In: Millsap, R.E., van der Ark, L.A., Bolt, D.M., Woods, C.M. (eds) New Developments in Quantitative Psychology. Springer Proceedings in Mathematics & Statistics, vol 66. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-9348-8_12
Download citation
DOI: https://doi.org/10.1007/978-1-4614-9348-8_12
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-9347-1
Online ISBN: 978-1-4614-9348-8
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)