The impact of next and back buttons on time to complete and measurement reliability in computer-based surveys
To assess the impact of including next and back buttons on response burden and measurement reliability of computer-based surveys.
A sample of 807 participants (mean age of 53; 64% women, 83% non-Hispanic white; 81% some college or college graduates) from the YouGov Polimetrix panel was administered 56 items assessing performance of social/role activities and 56 items measuring satisfaction with social/role activities. Participants were randomly assigned to either (1) automatic advance to the next question with no opportunity to go back (auto/no back); (2) automatic advance to the next questions with an opportunity to go back (auto/back); (3) next button to go to the next question with no opportunity to go back (next/no back); or (4) next button to go to the next question with an opportunity to go back (next/back).
We found no difference in missing data, internal consistency reliability, and domain scores by group. Time to complete the survey was about 50% longer when respondents were required to use a next button to go on.
Given the similarity in missing data, reliability and mean scale scores with or without use of the next button, we recommend automatic advancement to the next item with the option to go back to the previous item.
- Wyatt, J. C. (2000). When to use web-based surveys. Journal of the American Medical Informatics Association, 7, 426–429.
- Schmidt, W. C. (1997). World-wide web survey research: Benefits, potential problems, and solutions. Behavior Research Methods, Instruments, & Computers, 29, 274–279.
- Christian, L. M., Parsons, N. L., & Dillman, D. A. (2009). Designing scalar questions for web surveys. Sociological Methods & Research, 37, 393–425. CrossRef
- Coons, S. J., Gwaltney, C. J., Hays, R. D., Lundy, J. J., Sloan, J. A., Revicki, D. A., et al. (2009). Recommendations on evidence needed to support measurement equivalence between electronic and paper-based patient-reported outcome (PRO) measures: ISPOR ePRO good research practices task force report. Value in Health, 12, 419–429. CrossRef
- Polimetrix, Inc. (2006). Scientific sampling for online research. Palo Alto, CA: Author.
- Cella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., Reeve, B., et al. (2007). The patient-reported outcomes measurement information system (PROMIS): Progress of an NIH roadmap cooperative group during its first two years. Medical Care, 45(Suppl. 1), S3–S11. CrossRef
- Cronbach, L. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334. CrossRef
- The impact of next and back buttons on time to complete and measurement reliability in computer-based surveys
- Open Access
- Available under Open Access This content is freely available online to anyone, anywhere at any time.
Quality of Life Research
Volume 19, Issue 8 , pp 1181-1184
- Cover Date
- Print ISSN
- Online ISSN
- Springer Netherlands
- Additional Links
- Computer-based surveys
- Social/role activities
- Industry Sectors
- Author Affiliations
- 1. UCLA Department of Medicine, 911 Broxton Avenue, Room 110, Los Angeles, CA, 90024-2801, USA
- 2. Feinberg School of Medicine, Northwestern University, 303 East Chicago Avenue, Chicago, IL, 60611-3008, USA
- 3. National Heart, Lung and Blood Institute, 6701 Rockledge Dr., MSC 7936, Bethesda, MD, 20892, USA