Replenishing a computerized adaptive test of patient-reported daily activity functioning
- Stephen M. HaleyAffiliated withBoston University School of Public Health Email author
- , Pengsheng NiAffiliated withBoston University School of Public Health
- , Alan M. JetteAffiliated withBoston University School of Public Health
- , Wei TaoAffiliated withACT, Inc.
- , Richard MoedAffiliated withCREcare, LLC
- , Doug MeyersAffiliated withMeyers Healthcare Solutions
- , Larry H. LudlowAffiliated withDepartment of Educational Research, Measurement and Evaluation, Boston College
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.Get Access
Computerized adaptive testing (CAT) item banks may need to be updated, but before new items can be added, they must be linked to the previous CAT. The purpose of this study was to evaluate 41 pretest items prior to including them into an operational CAT.
We recruited 6,882 patients with spine, lower extremity, upper extremity, and nonorthopedic impairments who received outpatient rehabilitation in one of 147 clinics across 13 states of the USA. Forty-one new Daily Activity (DA) items were administered along with the Activity Measure for Post-Acute Care Daily Activity CAT (DA-CAT-1) in five separate waves. We compared the scoring consistency with the full item bank, test information function (TIF), person standard errors (SEs), and content range of the DA-CAT-1 to the new CAT (DA-CAT-2) with the pretest items by real data simulations.
We retained 29 of the 41 pretest items. Scores from the DA-CAT-2 were more consistent (ICC = 0.90 versus 0.96) than DA-CAT-1 when compared with the full item bank. TIF and person SEs were improved for persons with higher levels of DA functioning, and ceiling effects were reduced from 16.1% to 6.1%.
Item response theory and online calibration methods were valuable in improving the DA-CAT.
KeywordsOutcomes assessment Quality of life Item response theory Activities of daily living (ADL)
- Replenishing a computerized adaptive test of patient-reported daily activity functioning
Quality of Life Research
Volume 18, Issue 4 , pp 461-471
- Cover Date
- Print ISSN
- Online ISSN
- Springer Netherlands
- Additional Links
- Outcomes assessment
- Quality of life
- Item response theory
- Activities of daily living (ADL)
- Industry Sectors
- Author Affiliations
- 1. Boston University School of Public Health, Boston, MA, USA
- 2. ACT, Inc., Iowa City, IA, USA
- 3. CREcare, LLC, Gilford, NH, USA
- 4. Meyers Healthcare Solutions, Apopka, FL, USA
- 5. Department of Educational Research, Measurement and Evaluation, Boston College, Boston, MA, USA