Abstract
Factor analysis is an established technique for the detection of measurement bias. Multigroup factor analysis (MGFA) can detect both uniform and nonuniform bias. Restricted factor analysis (RFA) can also be used to detect measurement bias, albeit only uniform measurement bias. Latent moderated structural equations (LMS) enable the estimation of nonlinear interaction effects in structural equation modelling. By extending the RFA method with LMS, the RFA method should be suited to detect nonuniform bias as well as uniform bias. In a simulation study, the RFA/LMS method and the MGFA method are compared in detecting uniform and nonuniform measurement bias under various conditions, varying the size of uniform bias, the size of nonuniform bias, the sample size, and the ability distribution. For each condition, 100 sets of data were generated and analysed through both detection methods. The RFA/LMS and MGFA methods turned out to perform equally well. Percentages of correctly identified items as biased (true positives) generally varied between 92% and 100%, except in small sample size conditions in which the bias was nonuniform and small. For both methods, the percentages of false positives were generally higher than the nominal levels of significance.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Jak, S., Oort, F.J., Dolan, C.V.: Measurement bias and multidimensionality; an illustration of bias detection in multidimensional measurement models. Adv. Stat. Anal. (2010). doi:10.1007/s10182-010-0128-z
Kenny, D., Judd, C.M.: Estimating the nonlinear and interactive effects of latent variables. Psychol. Bull. 96, 201–210 (1984)
Klein, A.G., Moosbrugger, H.: Maximum likelihood estimation of latent interaction effects with the LMS method. Psychometrika 65, 457–474 (2000)
Klein, A.G., Muthén, B.O.: Quasi maximum likelihood estimation of structural equation models with multiple interaction and quadratic effects. Multivar. Behav. Res. 42, 647–673 (2007)
Lord, F.M.: Applications of Item Response Theory to Practical Testing Problems. Erlbaum, Hillsdale (1980)
Mellenbergh, G.J.: Item bias and item response theory. Int. J. Educ. Res. 13, 127–143 (1989)
Meredith, W.: Measurement invariance, factor analysis, and factorial invariance. Psychometrika 58, 525–543 (1993)
Millsap, R.E., Everson, H.T.: Methodology review: statistical approaches for assessing measurement bias. Appl. Psychol. Meas. 17, 297–334 (1993)
Moosbrugger, H., Schermelleh-Engel, K., Kelava, A., Klein, A.G.: Testing multiple nonlinear effects in structural equation modelling: a comparison of alternative estimation approaches. In: Teo, T., Khine, M.S. (eds.) Structural Equation Modeling in Educational Research: Concepts and Applications, pp. 103–136. Sense, Rotterdam (2009)
Muthén, B.O.: Latent variable modeling in heterogeneous populations. Psychometrika 54, 557–585 (1989)
Muthén, B.O., Muthén, L.K.: M-plus User’s Guide: Statistical Analysis with Latent Variables. Muthén & Muthén, Los Angeles (2001)
Navas-Ara, M.J., Gómez-Benito, J.: Effects of ability scale purification on the identification of DIF. Eur. J. Psychol. Assess. 18, 9–15 (2002)
Oort, F.J.: Theory of violators: assessing unidimensionality of psychological measures. In: Steyer, R., Wender, K.F., Widaman, K.F. (eds.) Psychometric Methodology, pp. 377–381. Fischer, Stuttgart (1991)
Oort, F.J.: Using restricted factor analysis to detect item bias. Methodika 6, 150–166 (1992)
Oort, F.J.: Simulation study of item bias detection with restricted factor analysis. Struct. Equ. Model. 5, 107–124 (1998)
Satorra, A., Bentler, P.M.: A scaled difference chi-square test statistic for moment structure analysis. Psychometrika 66, 507–514 (2001)
Schermelleh-Engel, K., Werner, C.S., Klein, A.G., Moosbrugger, H.: Nonlinear structural equation modeling: is partial least squares an alternative? Adv. Stat. Anal. (2010). doi:10.1007/s10182-010-0132-3
Vandenberg, R.J., Lance, C.E.: A review and synthesis of the measurement invariance literature: suggestions, practices, and recommendations for organizational research. Organ. Res. Methods 2, 4–69 (2000)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://creativecommons.org/licenses/by-nc/2.0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Barendse, M.T., Oort, F.J. & Garst, G.J.A. Using restricted factor analysis with latent moderated structures to detect uniform and nonuniform measurement bias; a simulation study. AStA Adv Stat Anal 94, 117–127 (2010). https://doi.org/10.1007/s10182-010-0126-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10182-010-0126-1