Article

Quality of Life Research

, Volume 18, Issue 4, pp 461-471

Replenishing a computerized adaptive test of patient-reported daily activity functioning

  • Stephen M. HaleyAffiliated withBoston University School of Public Health Email author 
  • , Pengsheng NiAffiliated withBoston University School of Public Health
  • , Alan M. JetteAffiliated withBoston University School of Public Health
  • , Wei TaoAffiliated withACT, Inc.
  • , Richard MoedAffiliated withCREcare, LLC
  • , Doug MeyersAffiliated withMeyers Healthcare Solutions
  • , Larry H. LudlowAffiliated withDepartment of Educational Research, Measurement and Evaluation, Boston College

Rent the article at a discount

Rent now

* Final gross prices may vary according to local VAT.

Get Access

Abstract

Purpose

Computerized adaptive testing (CAT) item banks may need to be updated, but before new items can be added, they must be linked to the previous CAT. The purpose of this study was to evaluate 41 pretest items prior to including them into an operational CAT.

Methods

We recruited 6,882 patients with spine, lower extremity, upper extremity, and nonorthopedic impairments who received outpatient rehabilitation in one of 147 clinics across 13 states of the USA. Forty-one new Daily Activity (DA) items were administered along with the Activity Measure for Post-Acute Care Daily Activity CAT (DA-CAT-1) in five separate waves. We compared the scoring consistency with the full item bank, test information function (TIF), person standard errors (SEs), and content range of the DA-CAT-1 to the new CAT (DA-CAT-2) with the pretest items by real data simulations.

Results

We retained 29 of the 41 pretest items. Scores from the DA-CAT-2 were more consistent (ICC = 0.90 versus 0.96) than DA-CAT-1 when compared with the full item bank. TIF and person SEs were improved for persons with higher levels of DA functioning, and ceiling effects were reduced from 16.1% to 6.1%.

Conclusions

Item response theory and online calibration methods were valuable in improving the DA-CAT.

Keywords

Outcomes assessment Quality of life Item response theory Activities of daily living (ADL)