Abstract
Methodology for making cross-national comparisons is an area of increasing interest in social and public health related research. When studying socio-economic differences in health outcomes cross-nationally, there are several methodological issues of concern, especially when data is derived from self-reported questionnaires. Health Behaviour in School-aged Children (Currie et al. 1998) is a WHO cross-national study using school samples. HBSC provides comparable data, and thereby a unique opportunity to study associations between social indicators and health outcomes within an international perspective. In 2001/02 data was collected from a total of 162,323 children in 32 countries (Austria, Belgium, Canada, Croatia, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Greenland, Hungary, Ireland, Israel, Italy, Latvia, Lithuania, Macedonia, Malta, Netherlands, Norway, Poland, Portugal, Russia, Slovenia, Spain, Sweden, Switzerland, Ukraine, United Kingdom, USA.). Studies of social inequalities requires that a comparable measure of socio-economic position (SEP) is in use. HBSC has developed a proxy for social position measuring material wealth, the Family Affluence Scale (FAS). This paper studies FAS and whether it is comparable across population subgroups defined by country, age and gender. Initial analysis revealed that an item measuring perceived family wealth was a valid FAS item. Including this item in the FAS score will improve the reliability of FAS. Graphical log-linear Rasch models (GLLRM) showed that FAS contain differential item functioning (DIF) with respect to country, age, and gender as well as local dependency (LD) between items. During the analysis, test equating techniques where used to adjust for the test bias generated by DIF. We recommend that the equated scores are used whenever FAS is included as a variable. This study suggests that HBSC-FAS should contain five items (additional item: perceived family wealth) when analysing data from HBSC 2001/02, and furthermore that each country should adjust for the DIF or make use of the converted FAS scores provided. If using FAS as a proxy for social position at an international level, it is not advised to compare the absolute levels of FAS, but weigh the scale by ridit transformation.
Similar content being viewed by others
Notes
These examples are taken from discussions with colleagues at the Department of Social Medicine.
Abbreviations
- HBSC:
-
Health Behaviour in School-aged Children
- SEP:
-
Socio Economic Position
- FAS:
-
Family Affluence Scale
- HASC:
-
Home Affluence Scale
- DIF:
-
Differential Item Functioning
- LD:
-
Local Dependence
- GLLRM:
-
Graphical Log-Linear Rasch Models
- CLR:
-
Conditional Likelihood Ratio test
- PFW:
-
Perceived Family Wealth
- IRT:
-
Item Response Theory
References
Andersen, E. B. (1973) A goodness of fit test for the Rasch model. Psychometrika, 38, 123–140.
Batista-Foguet, J. M., Fortiana, J., Currie, C., & Villalbi, J. R. (2006) Socio-economic indexes in surveys for comparisons between countries. Social Indicators Research, 67, 315–332.
Bjorner, J. B., Damsgaard, M. T., Watt, T., & Groenvold, M. (1998a) Tests of data quality, scaling assumptions, and reliability of the Danish SF-36. Journal of Clinical Epidemioogy, 51, 1001–1011.
Bjorner, J. B., Kreiner, S., Ware, J. E., Damsgaard, M. T., & Bech, P. (1998b) Differential item functioning in the Danish translation of the SF-36. Journal of Clinical Epidemioogy, 51, 1189–1202.
Borsboom, D. (2005). Measuring the mind. United Kingdom: Cambridge University Press.
Carstairs, V., & Morris, R. (1990) Deprivation and health in Scotland. Health Bulletin (Edinburgh), 48, 162–175.
Christensen, K. B., Bjørner, J. (2003) Sas macros for Rasch based latent variable modelling. Technical report 03/13. Department of Biostatistics, University of Copenhagen.
Christensen, K. B., Bjørner, J., Kreiner, S., & Petersen, J. H. (2004). Latent regression in log linear Rasch models. Communications in Statistics, 33, 1295–1314.
Cronbach, L. J., & Meehl, P. E. (1955/2006). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302 (Reprinted in Bartholomew, D. J. (Ed.) (2006). Measurement. Vol. I (pp. 277–306). London, Sage Publications).
Currie, C. et al. (1998). Health behaviour in school-aged children: a WHO cross-national survey (HBSC), Research Protocol for the 1997/98 Survey. Research Unit in Health and Behvioural Change. 1998. Edinburgh, World Health Organisation. Ref Type: Report.
Currie, C. E., Elton, R. A., Todd, J., & Platt, S. (1997) Indicators of socioeconomic status for adolescents: the WHO Health Behaviour in School-aged Children Survey. Health Education Research, 12, 385–397.
Due, P., Holstein, B .E., Lynch, J., Diderichsen, F., Gabhain, S. N., Scheidt, P., & Currie, C. (2005) Bullying and symptoms among school-aged children: international comparative cross sectional study in 28 countries. European Journal of Public Health, 15, 128–132.
Elgar, F. J., Roberts, C., Parry-Langdon, N., & Boyce, W. (2005) Income inequality and alcohol use: a multilevel analysis of drinking and drunkenness in adolescents in 34 countries. European Journal of Public Health, 15, 245–250.
Kane, M. T. (2006) Validation (p.17–65). In R. L. Brennan (Eds.), Educational measurement, 4th edn. Westport: Praeger Publishers.
Kelderman, H. (1984) Loglinear Rasch Tests 49. Psychometrika, 49, 223–245.
Kreiner, S., & Christensen, K. B. (2002) Graphical Rasch models. In M. Mesbah, B. F. Cole, & M. T. Lee (Eds.), Statistical methods for quality of life studies. Design, measurements and analysis. Dordrecht: Kluwer Academic Publishers, pp. 187–203.
Kreiner, S., & Christensen, K. B. (2004) Analysis of local dependence and multidimensionality in graphical loglinear Rasch models. Communications in Statistics— Theory and Methods, 33, 1239–1276.
Kreiner, S., & Christensen, K. B. (2006) Validity and objectivity in health related summated scales: Analysis by graphical log-linear Rasch models. In M. von Davier, C. H. Carstensen (Eds.), Multivariate and mixture distribution Rasch models. Extensions and applications. New York: Springer Verlag.
Kreiner, S. (2007) Validity and objectivity. Reflections on the role and nature of Rasch models. Nordic Psychology, 59, 268–298.
Lien, N., Friestad, C., & Klepp, K. I. (2001) Adolescents’ proxy reports of parents’ socioeconomic status: How valid are they? Journal of Epidemiology and Community Health, 55, 731–737.
Mackenbach, J. P., & Bakker, M. J. (2002) Reducing inequalities in health: A European perspective. London: Routledge.
Rasch, G. (1966) An item analysis which takes individual differences into account. TheBritish Journal of Mathematical and Statistical Psychology, 19, 49–57.
Rosenbaum, P. R. (1989) Criterion-related construct validity. Psychometrika, 54, 625–633.
Torsheim, T., Currie, C., Boyce, W., Kalnins, I., Overpeck, M., & Haugland, S. (2004) Material deprivation and self-rated health: a multilevel study of adolescents from 22 European and North American countries. Social Science and Medicine, 59, 1–12.
Torsheim, T., Currie, C., Boyce, W., & Samdal, O. (2006) Country material distribution and adolescents’ perceived health: multilevel study of adolescents in 27 countries. Journal of Epidemiology and Community Health, 60, 156–161.
Townsend, P. (1987) Deprivation. Journal of Social Policy, 16, 125–146.
Vereecken, C. A., Inchley, J., Subramanian, S. V., Hublet, A., & Maes, L. (2005) The relative influence of individual and contextual socio-economic status on consumption of fruit and soft drinks among adolescents in Europe. European Journal of Public Health, 15, 224–232.
Wardle, J., Robb, K., & Johnson, F. (2002) Assessing socioeconomic status in adolescents: the validity of a home affluence scale. Journal of Epidemiology and Community Health, 56, 595–599.
Whitehead, M., Diderichsen, F., & Burstrom, B. (2000) Researching the impact of public policy on inequalities in health. In H. Graham (Ed.), Understanding health inequalities. London: Open University Press.
Zumbo, B. D. (2007) Validity: Foundational issues and statistical methodology. In: C. R. Rao, & S. Sinharay (Eds.), Handbook of Statistics, volume 26: Psychometrics. Amsterdam: Elsevier.
Acknowledgements
The HBSC study is an international study carried out in collaboration with WHO Europe. The international coordinator is Professor Candace Currie from the University of Edinburgh, and the international databank manager is Dr. Oddrun Samdal from Bergen University. The 2001/02 survey was conducted by personal responsibility of principal investigators (PI’s) in 35 countries. The authors are grateful for the insightful and constructive comments to earlier drafts from Ms. Kate Levin and Ms. Dorothy Currie from the University of Edinburgh, and also for constructive feedback late in the process from the PI’s.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Schnohr, C.W., Kreiner, S., Due, E.P. et al. Differential Item Functioning of a Family Affluence Scale: Validation Study on Data from HBSC 2001/02. Soc Indic Res 89, 79–95 (2008). https://doi.org/10.1007/s11205-007-9221-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11205-007-9221-4