Equating the HBSC Family Affluence Scale across survey years: a method to account for item parameter drift using the Rasch model
To investigate the measurement invariance (MI) of the Family Affluence Scale (FAS) measured in the Health Behavior in School-aged Children (HBSC) survey, and to describe a method for equating the scale when MI is violated across survey years.
This study used a sample of 14,076 Norwegian and 17,365 Scottish adolescents from the 2002, 2006 and 2010 HBSC surveys to investigate the MI of the FAS across survey years. Violations of MI in the form of differential item functioning (DIF) due to item parameter drift (IPD) were modeled within the Rasch framework to ensure that the FAS scores from different survey years remain comparable.
The results indicate that the FAS is upwardly biased due to IPD in the computer item across survey years in the Norwegian and Scottish samples. Ignoring IPD across survey years resulted in the conclusion that family affluence is increasing quite consistently in Norway and Scotland. However, the results show that a large part of the increase in the FAS scores can be attributed to bias in the FAS because of IPD across time. The increase in the FAS was more modest in Scotland and slightly negative in Norway once the DIF in the computer item was accounted for in this study.
When the comparison of family affluence is necessary over different HBSC survey years or when the longitudinal implications of family affluence are of interest, it is necessary to account for IPD in interpretation of changes in family affluence across time.
KeywordsFamily Affluence Scale Differential item functioning (DIF) Health Behavior in School-aged Children (HBSC) Rasch model Item parameter drift (IPD)
- 6.Currie, C., Molcho, M., Boyce, W., Holstein, B., Torsheim, T., & Richter, M. (2008). Researching health inequalities in adolescents: The development of the Health Behaviour in School-Aged Children (HBSC) Family Affluence Scale. Social Science and Medicine, 66(6), 1429–1436.PubMedCrossRefGoogle Scholar
- 9.Zambon, A., Boyce, W., Cois, E., Currie, C., Lemma, P., Dalmasso, P., et al. (2006). Do welfare regimes mediate the effect of socioeconomic position on health in adolescence? A cross-national comparison in Europe, North America, and Israel. International Journal of Health Services, 36(2), 309–329.PubMedCrossRefGoogle Scholar
- 13.Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Danish Institute for Educational Research.Google Scholar
- 14.Bond, T. G., & Fox, C. M. (2001). Applying the Rasch model: Fundamental measurement in the human sciences. London: Lawrence Erlbaum Associates.Google Scholar
- 18.Makransky, G., & Glas, C. A. W. (2013). Modeling differential item functioning with group-specific item parameters: A computerized adaptive testing application. Measurement. doi: 10.1016/j.measurement.2013.06.020.
- 20.Schnohr, C. W., Makransky, G., Kreiner, S., De Clerq, B., Hofmann, F., Torsheim, T., Elgar, F., & Currie, C,. (2013). Item response drift in the Family Affluence Scale: A study on three consecutive surveys of the Health Behavior in School-aged Children (HBSC) survey. Measurement, 45(9), 3119–3126.Google Scholar
- 27.Glas, C. A. W. (1998). Detection of differential item functioning using Lagrange multiplier tests. Statistica Sinica, 8, 647–667.Google Scholar
- 28.Kalid, M. N. (2009). IRT model fit from different perspectives. Doctoral dissertation, University of Twente, The Netherlands.Google Scholar
- 29.Kalid, M. N., & Glas, C. A. W. (2013). A scale purification procedure for evaluation of differential item functioning. Manuscript submitted for publication.Google Scholar
- 30.Glas, C. A. W., & Verhelst, N. D. (1995). Testing the Rasch model. In G. H. Fischer & I. W. Molenaar (Eds.), Rasch models. Their foundations, recent developments and applications (pp. 69–96). New York: Springer.Google Scholar
- 32.Glas, C. A. W. (2010). MIRT: Multidimensional Item Response Theory. (Computer Software). University of Twente. http://www.utwente.nl/gw/omd/afdeling/Glas/.
- 34.Andrich, D., Sheridan, B., & Luo, G. (2010). Rasch models for measurement: RUMM2030. Perth: RUMM Laboratory.Google Scholar
- 36.Christensen, C. B., Kreiner, S., & Mesbah, M. (2013). Rasch model in health. New York: Wiley.Google Scholar