Journal of Business and Psychology

, Volume 27, Issue 1, pp 99–114

Detecting and Deterring Insufficient Effort Responding to Surveys

  • Jason L. Huang
  • Paul G. Curran
  • Jessica Keeney
  • Elizabeth M. Poposki
  • Richard P. DeShon
Article

DOI: 10.1007/s10869-011-9231-8

Cite this article as:
Huang, J.L., Curran, P.G., Keeney, J. et al. J Bus Psychol (2012) 27: 99. doi:10.1007/s10869-011-9231-8

Abstract

Purpose

Responses provided by unmotivated survey participants in a careless, haphazard, or random fashion can threaten the quality of data in psychological and organizational research. The purpose of this study was to summarize existing approaches to detect insufficient effort responding (IER) to low-stakes surveys and to comprehensively evaluate these approaches.

Design/Methodology/Approach

In an experiment (Study 1) and a nonexperimental survey (Study 2), 725 undergraduates responded to a personality survey online.

Findings

Study 1 examined the presentation of warnings to respondents as a means of deterrence and showed the relative effectiveness of four indices for detecting IE responses: response time, long string, psychometric antonyms, and individual reliability coefficients. Study 2 demonstrated that the detection indices measured the same underlying construct and showed the improvement of psychometric properties (item interrelatedness, facet dimensionality, and factor structure) after removing IE respondents identified by each index. Three approaches (response time, psychometric antonyms, and individual reliability) with high specificity and moderate sensitivity were recommended as candidates for future application in survey research.

Implications

The identification of effective IER indices may help researchers ensure the quality of their low-stake survey data.

Originality/value

This study is a first attempt to comprehensively evaluate IER detection methods using both experimental and nonexperimental designs. Results from both studies corroborated each other in suggesting the three more effective approaches. This study also provided convergent validity evidence regarding various indices for IER.

Keywords

Careless responding Random responding Inconsistent responding Online surveys Data screening 

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  • Jason L. Huang
    • 1
  • Paul G. Curran
    • 2
  • Jessica Keeney
    • 2
  • Elizabeth M. Poposki
    • 3
  • Richard P. DeShon
    • 2
  1. 1.Department of PsychologyWayne State UniversityDetroitUSA
  2. 2.Department of PsychologyMichigan State UniversityEast LansingUSA
  3. 3.Department of PsychologyIndiana University-Purdue University IndianapolisIndianapolisUSA