Abstract
Restricted factor analysis can be used to investigate measurement bias. A prerequisite for the detection of measurement bias through factor analysis is the correct specification of the measurement model. We applied restricted factor analysis to two subtests of a Dutch cognitive ability test. These two examples serve to illustrate the relationship between multidimensionality and measurement bias. We conclude that measurement bias implies multidimensionality, whereas multidimensionality shows up as measurement bias only if multidimensionality is not properly accounted for in the measurement model.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Ackerman, T.A.: A didactic explanation of item bias, item impact, and item validity from a multidimensional perspective. J. Educ. Meas 29, 67–91 (1992)
Barendse, M.T., Oort, F.J., Garst, G.J.A.: Using restricted factor analysis with latent moderated structures to detect uniform and nonuniform measurement bias; a simulation study. Adv. Stat. Anal (2010). doi:10.1007/s10182-010-0126-1
Browne, M.W., Cudeck, R.: Alternative ways of assessing model fit. In: Bollen, K., Long, J. (eds.) Testing Structural Equation Models, pp. 136–162. Sage, Thousand Oaks (1993)
Dudgeon, P.: NIESEM: A computer program for calculating noncentral interval estimates (and power analysis) for structural equation modeling [Computer software] (2003)
Holland, P.W., Thayer, D.T.: Differential item performance and the Mantel–Haenszel procedure. In: Wainer, H., Braun, H.I. (eds.) Test Validity, pp. 129–145. Erlbaum, Hillsdale (1988)
King-Kallimanis, B.L., Oort, F.J., Garst, G.J.A.: Using structural equation modeling to detect measurement bias and response shift in longitudinal data. Adv. Stat. Anal (2010). doi:10.1007/s10182-010-0129-y
Lord, F.M., Novick, M.R.: Statistical Theories of Mental Test Scores. Addison-Wesley, Reading (1968)
Mellenbergh, G.J.: Item bias and item response theory. J. Educ. Res. 13, 127–143 (1989)
Meredith, W.: Measurement invariance, factor analysis, and factorial invariance. Psychometrika 58, 525–543 (1993)
Millsap, R.E., Everson, H.T.: Methodology review: statistical approaches for assessing measurement bias. Appl. Psych. Meas. 17, 297–334 (1993)
Muthén, B.O.: Latent variable modeling in heterogeneous populations. Presidential address to the Psychometric Society. Psychometrika 54, 557–585 (1989)
Muthén, B.O., du Toit, S.H.C., Spisic, D.: Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes. http://www.gseis.ucla.edu/faculty/muthen/articles/Article_075.pdf (1997). Accessed June 2009
Muthén, L.K., Muthén, B.O.: Mplus User’S Guide. Muthén & Muthén, Los Angeles (1998–2006)
Oort, F.J.: Theory of violators: Assessing unidimensionality of psychological measures. In: Steyer, R., Wender, K.F., Widaman, K.F. (eds.) Psychometric Methodology, pp. 377–381. Fischer, Stuttgart (1991)
Oort, F.J.: Using restricted factor analysis to detect item bias. Methodika 6, 150–166 (1992)
Oort, F.J.: Simulation study of item bias detection with restricted factor analysis. Struct. Equ. Modeling 5, 107–124 (1998)
Oort, F.J.: Using structural equation modeling to detect response shifts and true change. Qual. Life. Res. 14, 587–598 (2005)
Saris, W.E., Satorra, S., van der Veld, W.M.: Testing structural equation models or detection of misspecification? Struct. Equ. Modeling 16, 561–582 (2009)
Satorra, A., Bentler, P.M.: A scaled difference chi-square test statistic for moment structure analysis. Psychometrika 66, 507–514 (2001)
Sörbom, D.: A general method for studying differences in factor means and factor structures between groups. J. Math. Stat. Psychol. 27, 229–239 (1974)
Spearman, C.: The sub-structure of the mind. Br. J. Psychol. 18, 249–261 (1928)
Swaminathan, H., Rogers, H.J.: Detecting differential item functioning using logistic regression procedures. J. Educ. Meas. 27, 361–370 (1990)
Vandenberg, R.J., Lance, C.E.: A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organ. Res. Methods 2, 4–69 (2000)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://creativecommons.org/licenses/by-nc/2.0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Jak, S., Oort, F.J. & Dolan, C.V. Measurement bias and multidimensionality; an illustration of bias detection in multidimensional measurement models. AStA Adv Stat Anal 94, 129–137 (2010). https://doi.org/10.1007/s10182-010-0128-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10182-010-0128-z