Abstract
Objective: To investigate whether items of the Medical Outcomes Study (MOS) 36-Item Short-Form Health Status Survey (SF-36) exhibited differential item functioning (DIF) with respect to age, education, race, and gender. Methods: The data for this study come from two large national datasets, the MOS and the 1990 National Survey of Functional Health Status (NSFHS). We used logistic regression to identify items exhibiting DIF. Results: We found DIF to be most problematic for age comparisons. Items flagged for age DIF were vigorous activities, bend/kneel/stoop, bathing or dressing, limited in kind of work, health in general, get sick easier than others, expect health to get worse, felt calm and peaceful, and all four vitality items. Items flagged for education DIF include vigorous activities, health in general, health is excellent, felt calm and peaceful, and been a happy person. Vigorous activities, walk more than a mile, health in general, and expect health to get worse were identified as DIF when comparing African-Americans with whites. No items were identified for gender DIF. Conclusions: We found several consistent patterns of DIF using two national datasets with different population characteristics. In the current study, the effect of DIF rarely transferred to the scale level. Further research is needed to corroborate these results and determine qualitatively why DIF may occur for these specific items.
Similar content being viewed by others
References
JE Ware SuffixJr CD Sherbourne (1992) ArticleTitleThe MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection Med Care 30 IssueID6 473–483 Occurrence Handle1593914
JE Ware SuffixJr MS Bayliss WH Rogers M Kosinski AR Tarlov (1996) ArticleTitleDifferences in 4-year health outcomes for elderly and poor, chronically ill patients treated in HMO and fee-for-service systems. Results from the Medical Outcomes Study J Am Med Assoc 276 IssueID13 1039–1047 Occurrence Handle10.1001/jama.276.13.1039b
JW Williams SuffixJr J Barrett T Oxman E Frank W Katon M Sullivan J Cornell A Sengupta (2000) ArticleTitleTreatment of dysthymia and minor depression in primary care: A randomized controlled trial in older adults J Am Med Assoc 284 IssueID12 1519–1526 Occurrence Handle10.1001/jama.284.12.1519 Occurrence Handle1:CAS:528:DC%2BD3cXnt1Kntr8%3D
FA Lederle GR Johnson SE Wilson CW Acher DJ Ballard FN Littooy LM Messina (2003) ArticleTitleAneurysm Detection and Management Veterans Affairs Cooperative Study. Quality of life, impotence, and activity level in a randomized trial of immediate repair versus surveillance of small abdominal aortic aneurysm J Vasc Surg 38 IssueID4 745–752 Occurrence Handle10.1016/S0741-5214(03)00423-3 Occurrence Handle14560224
JM Sarmiento MB Farnell DM Nagorney DO Hodge JR Harrington (2004) ArticleTitleQuality-of-life assessment of surgical reconstruction after laparoscopic cholecystectomy-induced bile duct injuries: what happens at 5 years and beyond? Arch Surg 139 IssueID5 483–488 Occurrence Handle15136347
M Kuppermann RE Varner RL Summitt SuffixJr LA Learman C Ireland E Vittinghoff AL Stewart F Lin HE Richter J Showstack SB Hulley AE Washington InstitutionalAuthorNameMs Research Group (2004) ArticleTitleEffect of hysterectomy vs medical treatment on health-related quality of life and sexual functioning: the medicine or surgery (Ms) randomized trial J Am Med Assoc 291 IssueID12 1447–1455 Occurrence Handle10.1001/jama.291.12.1447 Occurrence Handle1:CAS:528:DC%2BD2cXis1Cjtrk%3D
M Bhandari S Sprague B Hanson JW Busse DE Dawe JK Moro GH Guyatt (2004) ArticleTitleHealth-related quality of life following operative treatment of unstable ankle fractures: A prospective observational study J Orthop Trauma 18 IssueID6 338–345 Occurrence Handle15213498
H Hemingway M Stafford S Stansfeld M Shipley M Marmot (1997) ArticleTitleIs the SF-36 a valid measure of change in population health? Results from the Whitehall II Study Brit Med J 315 IssueID7118 1273–1279 Occurrence Handle1:STN:280:DyaK1c%2FltFCqsQ%3D%3D Occurrence Handle9390054
C McHorney J Ware A Raczek (1993) ArticleTitleThe MOS 36-item short-form health survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs Med Care 31 247–263 Occurrence Handle1:STN:280:ByyC1MnisVI%3D Occurrence Handle8450681
CA McHorney JE Ware SuffixJr JF Lu CD Sherbourne (1994) ArticleTitleThe MOS 36-item Short-Form Health Survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups Med Care 32 IssueID1 40–66 Occurrence Handle1:STN:280:ByuC3cvjs1M%3D Occurrence Handle8277801
FD Wolinsky TE Stump (1996) ArticleTitleA measurement model of the Medical Outcomes Study 36-Item Short-Form Health Survey in a clinical sample of disadvantaged, older, black, and white men and women Med Care 34 IssueID6 537–548 Occurrence Handle10.1097/00005650-199606000-00004 Occurrence Handle1:STN:280:BymB2MfjsFA%3D Occurrence Handle8656720
B Gandek JE Ware SuffixJr NK Aaronson J Alonso G Apolone J Bjorner J Brazier M Bullinger S Fukuhara S Kaasa A Leplege M Sullivan (1998) ArticleTitleTests of data quality, scaling assumptions, and reliability of the SF-36 in eleven countries: Results from the IQOLA Project. International Quality of Life Assessment J Clin Epidemiol 51 IssueID11 1149–1158 Occurrence Handle1:STN:280:DyaK1M%2Fjt1ShsA%3D%3D Occurrence Handle9817132
M Kosinski SD Keller JE Ware SuffixJr HT Hatoum SX Kong (1999) ArticleTitleThe SF-36 Health Survey as a generic outcome measure in clinical trials of patients with osteoarthritis and rheumatoid arthritis: Relative validity of scales in relation to clinical measures of arthritis severity Med Care 37 IssueID5 Suppl MS23–MS39 Occurrence Handle1:STN:280:DyaK1M3ms1OksA%3D%3D Occurrence Handle10335741
I Failde I Ramos (2000) ArticleTitleValidity and reliability of the SF-36 Health Survey Questionnaire in patients with coronary artery disease J Clin Epidemiol 53 IssueID4 359–365 Occurrence Handle10.1016/S0895-4356(99)00175-4 Occurrence Handle1:STN:280:DC%2BD3c3kvFajsA%3D%3D Occurrence Handle10785566
G Apolone A Filiberti S Cifani R Ruggiata P Mosconi (1998) ArticleTitleEvaluation of the EORTC QLQ-C30 questionnaire: A comparison with SF-36 Health Survey in a cohort of Italian long-survival cancer patients Ann Oncol 9 IssueID5 549–557 Occurrence Handle10.1023/A:1008264412398 Occurrence Handle1:STN:280:DyaK1czhslekuw%3D%3D Occurrence Handle9653497
SM Skevington MS Carse AC Williams (2001) ArticleTitleValidation of the WHOQOL-100: Pain management improves quality of life for chronic pain patients Clin J Pain 17 IssueID3 264–275 Occurrence Handle10.1097/00002508-200109000-00013 Occurrence Handle1:STN:280:DC%2BD3MrktVCmsg%3D%3D Occurrence Handle11587119
JE Jacobs AR Maille RP Akkermans Weel Cvan RP Grol (2004) ArticleTitleAssessing the quality of life of adults with chronic respiratory diseases in routine primary care: Construction and first validation of the 10-Item Respiratory Illness Questionnaire-monitoring 10 (RIQ-MON10) Qual Life Res 13 IssueID6 1117–1127 Occurrence Handle10.1023/B:QURE.0000031338.88928.e9 Occurrence Handle1:STN:280:DC%2BD2czotlOgsQ%3D%3D Occurrence Handle15287278
J Rumsfeld S MaWhinney M McCarthy A Shroyer C VillaNueva M O’Brien et al. (1999) ArticleTitleHealth-related quality of life as a predictor of mortality following coronary artery bypass graft surgery J Am Med Assoc 281 IssueID14 1298–1303 Occurrence Handle10.1001/jama.281.14.1298 Occurrence Handle1:STN:280:DyaK1M3it1yhtA%3D%3D
V Fan J Curtis S Tu M McDonell S Fihn (2002) ArticleTitleUsing quality of life to predict hospitalization and mortality in patients with obstructive lung diseases Chest 122 429–436 Occurrence Handle10.1378/chest.122.2.429 Occurrence Handle12171813
EG Lowrie RB Curtin N LePain D Schatell (2003) ArticleTitleMedical outcomes study short form-36: A consistent and powerful predictor of morbidity and mortality in dialysis patients Am J Kidney Dis 41 IssueID6 1286–1292 Occurrence Handle10.1016/S0272-6386(03)00361-5 Occurrence Handle12776282
VS Fan DH Au MB McDonell SD Fihn (2004 Mar) ArticleTitleIntraindividual change in SF-36 in ambulatory clinic primary care patients predicted mortality and hospitalizations J Clin Epidemiol 57 IssueID3 277–283 Occurrence Handle10.1016/j.jclinepi.2003.08.004
D Thissen L Steinberg H Wainer (1988) Use of Item Response Theory in the Study of Group Differences in Trace Lines H Wainer J Braun (Eds) Test Validity Lawrence Erlbaum Associates Hillsdale, NJ 147–169
J Teresi P Cross R Golden (1989) ArticleTitleSome applications of latent trait analysis to the measurement of ADL J Gerontol 44 IssueID5 S196–S204 Occurrence Handle1:STN:280:BiaA28%2FjvFA%3D Occurrence Handle2768780
BB Ellis B Minsel P Becker (1989) ArticleTitleEvaluation of attitude survey translations: An investigation using item response theory Int J Psychol 24 665–684
M Stommel B Given C Given H Kalaian R Schulz R McCorkle (1993) ArticleTitleGender bias in the measurement properties of the Center for Epidemiologic Studies Depression Scale (CES-D) Psychiat Res 49 239–250 Occurrence Handle10.1016/0165-1781(93)90064-N Occurrence Handle1:STN:280:ByuB3szgslM%3D
C Huang A Church M Katigbak (1997) ArticleTitleIdentifying cultural differences in items and traits J Cross-Cult Psychol 28 IssueID2 192–218
WC Collins NS Raju JE Edwards (2000) ArticleTitleAssessing differential functioning in a satisfaction scale J Appl Psychol 85 IssueID3 451–461 Occurrence Handle10.1037/0021-9010.85.3.451 Occurrence Handle1:STN:280:DC%2BD3czlvVSguw%3D%3D Occurrence Handle10900818
CO Larson M Colangelo K Goods (1998) ArticleTitleBlack–white differences in health perceptions among the indigent J Ambul Care Manage 21 IssueID1 35–43 Occurrence Handle1:STN:280:DyaK1czlsV2qtw%3D%3D Occurrence Handle10181338
E Regidor G Barrio L Fuente Particlede la A Domingo C Rodriguez J Alonso (1999) ArticleTitleAssociation between educational level and health related quality of life in Spanish adults J␣Epidemiol Community Health 53 IssueID2 75–82 Occurrence Handle1:STN:280:DyaK1MzisVOruw%3D%3D Occurrence Handle10396467
KM Scott MI Tobias D Sarfati SJ Haslett (1999) ArticleTitleSF-36 health survey reliability, validity and norms for New Zealand Aust N Z J Public Health 23 IssueID4 401–406 Occurrence Handle1:STN:280:DyaK1Mzpt1WhsQ%3D%3D Occurrence Handle10462864
ME Jackson-Triche J Greer Sullivan KB Wells W Rogers P Camp R Mazel (2000) ArticleTitleDepression and health-related quality of life in ethnic minorities seeking care in general medical settings J Affect Disord 58 IssueID2 89–97 Occurrence Handle10.1016/S0165-0327(99)00069-5 Occurrence Handle1:STN:280:DC%2BD3c3ksFGisw%3D%3D Occurrence Handle10781698
SJ Walters JF Munro JE Brazier (2001) ArticleTitleUsing the SF-36 with older adults: A cross-sectional community-based survey Age Ageing 30 IssueID4 337–343 Occurrence Handle10.1093/ageing/30.4.337 Occurrence Handle1:STN:280:DC%2BD3MvmsVaqsw%3D%3D Occurrence Handle11509313
JB Bjorner S Kreiner JE Ware MT Damsgaard P Bech (1998) ArticleTitleDifferential item functioning in the Danish translation of the SF-36 Clin Epidemiol 51 IssueID11 1189–1202 Occurrence Handle1:STN:280:DyaK1M%2Fjt1ShtQ%3D%3D
P Moorer ThP Suurmeije M Foets IW Molenaar (2001) ArticleTitlePsychometric properties of the RAND-36 among three chronic diseases (multiple sclerosis, rheumatic diseases and COPD) in The Netherlands Qual Life Res 10 IssueID7 637–645 Occurrence Handle10.1023/A:1013131617125 Occurrence Handle1:STN:280:DC%2BD38%2Fptlygsg%3D%3D Occurrence Handle11822796
JA Fleishman WF Lawrence (2003) ArticleTitleDemographic variation in SF-12 scores: True differences or differential item functioning? Med Care 41 IssueID7 Suppl III75–III86 Occurrence Handle12865729
J Bjorner TS Kristensen (1999) ArticleTitleMulti-item scales for measuring global self-rated health: Investigation of construct validity using structural equations models Res Aging 21 IssueID3 417–439
F Wolfe DJ Hawley DL Goldenberg IJ Russell D Buskila L Neumann (2000) ArticleTitleThe assessment of functional impairment in fibromyalgia (FM): Rasch analyses of 5 functional scales and the development of the FM Health Assessment Questionnaire J Rheumatol 27 IssueID8 1989–1999 Occurrence Handle1:STN:280:DC%2BD3M%2FkvV2ltQ%3D%3D Occurrence Handle10955343
A Tarlov J Ware S Greenfield E Nelson E Perrin M Zubkoff (1989) ArticleTitleThe Medical Outcomes Study: An application of methods for monitoring the results of medical care J Am Med Assoc 262 925–930 Occurrence Handle10.1001/jama.262.7.925 Occurrence Handle1:STN:280:BiaA38bhtlQ%3D
A Stewart S Greenfield W Rogers S Berry E McGlynn J Ware (1989) ArticleTitleFunctional status and well-being of patients with chronic conditions: Results from the Medical Outcomes Study J Am Med Assoc 262 907–913 Occurrence Handle10.1001/jama.262.7.907 Occurrence Handle1:STN:280:BiaA38bht1M%3D
K Wells M Burnam W Rogers (1989) ArticleTitleThe functioning and well-being of depressed patients: Results from the Medical Outcomes Study J Am Med Assoc 262 914–919 Occurrence Handle1:STN:280:BiaA38bht1w%3D
R Kravitz S Greenfield W Rogers W Manning M Zubkoff (1992) ArticleTitleDifferences in the mix of patients among medical specialties and systems of care: Results from the Medical Outcomes Study J Am Med Assoc 267 1617–1623 Occurrence Handle10.1001/jama.267.12.1617 Occurrence Handle1:STN:280:By2C2sjltF0%3D
DA Katz CA McHorney RL Atkinson (2000) ArticleTitleImpact of obesity on health-related quality of life in patients with chronic illness J Gen Intern Med 15 IssueID11 789–796 Occurrence Handle10.1046/j.1525-1497.2000.90906.x Occurrence Handle1:STN:280:DC%2BD3M7gsVehtA%3D%3D Occurrence Handle11119171
CA McHorney M Kosinski JE Ware SuffixJr (1994) ArticleTitleComparisons of the costs and quality of norms for the SF-36 health survey collected by mail versus telephone interview: results from a national survey Med Care 32 IssueID6 551–567 Occurrence Handle1:STN:280:ByuB2cjgtFQ%3D Occurrence Handle8189774
R Hambleton H Swaminathan H Rogers (1991) Fundamentals of Item Response Theory Sage Publications Newbury Park, CA
FM Lord (1980) Applications of Item Response Theory to Practical Testing Problems Lawrence Erlbaum Associates Hillsdale, NJ
J Hattie (1984) ArticleTitleAn empirical study of various indices for determining unidimensionality Multivar Behav Res 19 49–78
G Camilli L Shephard (1994) Methods of Identifying Biased Test Items SAGE Thousand Oaks, CA
PW Holland DT Thayer (1988) Differential Item Performance and the Mantel-Haenszel Procedure H Wainer J Braun (Eds) Test Validity Lawrence Erlbaum Associates Hillsdale, NJ 129–145
R Zwick (1990) ArticleTitleWhen do item response function and Mantel–Haenszel definitions of differential item functioning coincide? J Educ Stat 15 IssueID3 185–197
C Lewis (1993) A note on the value of including the studied item in the test score when analyzing test items for DIF P Holland H Wainer (Eds) Differential Item Functioning Lawrence Erlbaum Associates Hillsdale, NJ 317–319
H Swaminathan HJ Rogers (1990) ArticleTitleDetecting differential item functioning using logistic regression procedures J Educ Meas 27 IssueID4 361–370
MD Hidalgo-Montesinos J Gómez-Benito (2003) ArticleTitleTest Purification and the evaluation of differential item functioning with multinomial logistic regression Eur J Psychol Assess 19 IssueID1 1–11
N Dorans P Holland (1993) DIF Detection and Description: Mantel-Haenszel and Standardization P Holland H Wainer (Eds) Differential Item Functioning Lawrence Erlbaum Associates Hillsdale, NJ 35–66
NJ Dorans E Kulick (1986) ArticleTitleDemonstrating the utility of the standardization approach to assessing unexpected differential item performance on the Scholastic Aptitude Test J Educ Meas 23 355–368
Dorans NJ, Schmitt AP. Constructed response and differential item functioning: A pragmatic approach. Research Report No. 91–47, Princeton, NJ, ETS 1991
N Raju B Ellis (2002) Differential Item and Test Functioning F Drasgow N Schmitt (Eds) Measuring and Analyzing Behavior in Organizations: Advances in Measurement and Data Analysis Jossey-Bass San Francisco, CA 157–188
EH Yang KM Hla CA McHorney T Havighurst MS Badr S Weber (2000) ArticleTitleSleep apnea and quality of life Sleep 23 IssueID4 535–541 Occurrence Handle1:STN:280:DC%2BD3cvpvVartQ%3D%3D Occurrence Handle10875560
AL Stewart JE Ware (1992) Measuring Functioning and Well-being: The Medical Outcomes Study Approach Duke University Press Durham, NC
WH Schuur Particlevan HAL Kiers (1994) ArticleTitleWhy factor analysis often is the incorrect model for analyzing bipolar concepts, and what model to use instead Appl Psychol Meas 18 IssueID2 97–110
M Jylha (1994) ArticleTitleSelf-rated health revisited: Exploring survey interview episodes with elderly respondents Soc Sci Med 39 IssueID7 983–990 Occurrence Handle1:STN:280:ByqD1cvisVM%3D Occurrence Handle7992130
NM Krause GM Jay (1994) ArticleTitleWhat do global self-rated health items measure? Med Care 32 IssueID9 930–942 Occurrence Handle1:STN:280:ByuA2snlt1I%3D Occurrence Handle8090045
B Shadbolt (1997) ArticleTitleSome correlates of self-rated health for Australian women Am J Public Health 87 IssueID6 951–956 Occurrence Handle1:STN:280:ByiA28jkslY%3D Occurrence Handle9224175
Ryan KE S Chiu (2001) ArticleTitleAn examination of item context effects, DIF, and gender DIF Appl Meas Educ 14 IssueID1 73–90
L Roussos W Stout (1996) ArticleTitleSimulation studies of the effects of small sample size and studied item parameters on SIBTEST and Mantel–Haenszel type I error performance J Educ Meas 3 IssueID2 215–230
W Flannery S Reise K Widaman (1995) ArticleTitleAn item response theory analysis of the general and academic scales of the Self-Description Questionnaire II J Res Pers 29 168–188 Occurrence Handle10.1006/jrpe.1995.1010
N Waller J Thompson E Wenk (2000) ArticleTitleUsing IRT to separate measurement bias from true group differences on homogeneous and heterogeneous scale: An illustration with the MMPI Psychol Meth 5 IssueID1 125–146 Occurrence Handle1:STN:280:DC%2BD3cvislWmtg%3D%3D
J Scheuneman (1987) ArticleTitleAn experimental, exploratory study of causes of bias in test items J Educ Meas 24 IssueID2 97–118
BB Ellis (1990) ArticleTitleAssessing intelligence cross-nationally: A case for differential item functioning detection Intelligence 14 IssueID1 61–78 Occurrence Handle10.1016/0160-2896(90)90014-K
N Iwata J Turner D Lloyd (2002) ArticleTitleRace/ethnicity and depressive symptoms in community-dwelling young adults: A differential item functioning analysis Psychiat Res 110 281–289 Occurrence Handle10.1016/S0165-1781(02)00102-6
MA Petersen M Groenvold JB Bjorner N Aaronson T Conroy A Cull P Fayers M Hjermstad M Sprangers M Sullivan (2003) ArticleTitleUse of differential item functioning analysis to assess the equivalence of translations of a questionnaire Qual Life Res 12 373–385 Occurrence Handle10.1023/A:1023488915557 Occurrence Handle12797710
JA Teresi RR Golden P Cross B Gurland M Kleinman D Wilder (1995) ArticleTitleItem bias in cognitive screening measures: Comparisons of elderly White, Afro-American, Hispanic and high and low education subgroups J Clin Epidemiol 48 IssueID4 473–483 Occurrence Handle10.1016/0895-4356(94)00159-N Occurrence Handle1:STN:280:ByqB3sbivV0%3D Occurrence Handle7722601
H Wainer R Lukhele (1997) ArticleTitleManaging the influence of DIF from big items: The 1988 advanced placement history test as an example Appl Meas Educ 10 IssueID3 201–215
C McHorney (2003) ArticleTitleTen recommendations for advancing patient-centered outcomes measurement for older persons Ann Intern Med 139 403–409 Occurrence Handle12965966
LA Aday R Anderson (1977) Standard measures of standard variables L.G Reeder (Eds) Health Survey Research Methods: Second Biennial Conference National Center for Health Services Research Washington, D.C. 63–66
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was completed while Dr. McHorney was at Indiana University. Dr. McHorney is now with Outcomes Research & Management, Merck & Co., Inc.
Rights and permissions
About this article
Cite this article
Perkins, A.J., Stump, T.E., Monahan, P.O. et al. Assessment of Differential Item Functioning for Demographic Comparisons in the MOS SF-36 Health Survey. Qual Life Res 15, 331–348 (2006). https://doi.org/10.1007/s11136-005-1551-6
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/s11136-005-1551-6