Quality of Life Research

, Volume 23, Issue 1, pp 217–227

Difference in method of administration did not significantly impact item response: an IRT-based analysis from the Patient-Reported Outcomes Measurement Information System (PROMIS) initiative

  • Jakob B. Bjorner
  • Matthias Rose
  • Barbara Gandek
  • Arthur A. Stone
  • Doerte U. Junghaenel
  • John E. WareJr.
Article

DOI: 10.1007/s11136-013-0451-4

Cite this article as:
Bjorner, J.B., Rose, M., Gandek, B. et al. Qual Life Res (2014) 23: 217. doi:10.1007/s11136-013-0451-4

Abstract

Purpose

To test the impact of method of administration (MOA) on the measurement characteristics of items developed in the Patient-Reported Outcomes Measurement Information System (PROMIS).

Methods

Two non-overlapping parallel 8-item forms from each of three PROMIS domains (physical function, fatigue, and depression) were completed by 923 adults (age 18–89) with chronic obstructive pulmonary disease, depression, or rheumatoid arthritis. In a randomized cross-over design, subjects answered one form by interactive voice response (IVR) technology, paper questionnaire (PQ), personal digital assistant (PDA), or personal computer (PC) on the Internet, and a second form by PC, in the same administration. Structural invariance, equivalence of item responses, and measurement precision were evaluated using confirmatory factor analysis and item response theory methods.

Results

Multigroup confirmatory factor analysis supported equivalence of factor structure across MOA. Analyses by item response theory found no differences in item location parameters and strongly supported the equivalence of scores across MOA.

Conclusions

We found no statistically or clinically significant differences in score levels in IVR, PQ, or PDA administration as compared to PC. Availability of large item response theory-calibrated PROMIS item banks allowed for innovations in study design and analysis.

Keywords

Patient-reported outcomes Quality of life Questionnaire Mode of administration Method of administration Item response theory 

Abbreviations

CAT

Computerized adaptive testing

COPD

Chronic obstructive pulmonary disease

DEP

Depression

FAT

Fatigue

IRT

Item response theory

IVR

Interactive voice response

MOA

Method of administration

PC

Personal computer

PDA

Personal digital assistant

PF

Physical functioning

PQ

Paper questionnaire

NLMIXED

SAS procedure for estimating mixed models

PRO

Patient-reported outcomes

PROMIS

Patient-Reported Outcomes Measurement Information System

WLSMV

Weighted least squares with mean and variance adjustment

Copyright information

© Springer Science+Business Media Dordrecht 2013

Authors and Affiliations

  • Jakob B. Bjorner
    • 1
    • 2
    • 3
  • Matthias Rose
    • 4
    • 5
  • Barbara Gandek
    • 5
  • Arthur A. Stone
    • 6
  • Doerte U. Junghaenel
    • 6
  • John E. WareJr.
    • 5
    • 7
  1. 1.QualityMetricLincolnUSA
  2. 2.Department of Public HealthUniversity of CopenhagenCopenhagenDenmark
  3. 3.National Research Centre for the Working EnvironmentCopenhagenDenmark
  4. 4.Department of Psychosomatic Medicine and PsychotherapyMedical Clinic, Charité, UniversitätsmedizinBerlinGermany
  5. 5.Department of Quantitative Health Sciences University of Massachusetts Medical SchoolWorcesterUSA
  6. 6.Department of Psychiatry and Behavioral Science Stony Brook UniversityStony BrookUSA
  7. 7.John Ware Research GroupWorcesterUSA