Health Services and Outcomes Research Methodology

, Volume 9, Issue 3, pp 145–161

A non-parametric Bayesian diagnostic for detecting differential item functioning in IRT models

  • Mark E. Glickman
  • Pradipta Seal
  • Susan V. Eisen
Article

DOI: 10.1007/s10742-009-0052-4

Cite this article as:
Glickman, M.E., Seal, P. & Eisen, S.V. Health Serv Outcomes Res Method (2009) 9: 145. doi:10.1007/s10742-009-0052-4

Abstract

Differential item functioning (DIF) in tests and multi-item surveys occurs when a lack of conditional independence exists between the response to one or more items and membership to a particular group, given equal levels of proficiency. We develop an approach to detecting DIF in the context of item response theory (IRT) models based on computing a diagnostic which is the posterior mean of a p-value. IRT models are fit in a Bayesian framework, and simulated proficiency parameters from the posterior distribution are retained. Monte Carlo estimates of the p-value diagnostic are then computed by comparing the fit of nonparametric regressions of item responses on simulated proficiency parameters and group membership. Some properties of our approach are examined through a simulation experiment. We apply our method to the analysis of responses from two separate studies to the BASIS-24, a widely used self-report mental health assessment instrument, to examine DIF between the English and Spanish-translated version of the survey.

Keywords

Bayesian modelingConditional independenceMental health outcomeModel diagnosticsPatient surveys

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  • Mark E. Glickman
    • 1
    • 2
  • Pradipta Seal
    • 3
  • Susan V. Eisen
    • 1
    • 2
  1. 1.Department of Health Policy and ManagementBoston University School of Public HealthBostonUSA
  2. 2.Center for Health Quality, Outcomes and Economics Research, a Veteran Administration Center of Excellence, Edith Nourse Rogers Memorial Hospital (152)BedfordUSA
  3. 3.Department of Mathematics and StatisticsBoston UniversityBostonUSA