Behavior Research Methods

, Volume 46, Issue 3, pp 786–797

A latent variable model approach to estimating systematic bias in the oversampling method

  • Katherina K. Hauner
  • Richard E. Zinbarg
  • William Revelle
Article

DOI: 10.3758/s13428-013-0402-6

Cite this article as:
Hauner, K.K., Zinbarg, R.E. & Revelle, W. Behav Res (2014) 46: 786. doi:10.3758/s13428-013-0402-6

Abstract

The method of oversampling data from a preselected range of a variable’s distribution is often applied by researchers who wish to study rare outcomes without substantially increasing sample size. Despite frequent use, however, it is not known whether this method introduces statistical bias due to disproportionate representation of a particular range of data. The present study employed simulated data sets to examine how oversampling introduces systematic bias in effect size estimates (of the relationship between oversampled predictor variables and the outcome variable), as compared with estimates based on a random sample. In general, results indicated that increased oversampling was associated with a decrease in the absolute value of effect size estimates. Critically, however, the actual magnitude of this decrease in effect size estimates was nominal. This finding thus provides the first evidence that the use of the oversampling method does not systematically bias results to a degree that would typically impact results in behavioral research. Examining the effect of sample size on oversampling yielded an additional important finding: For smaller samples, the use of oversampling may be necessary to avoid spuriously inflated effect sizes, which can arise when the number of predictor variables and rare outcomes is comparable.

Keywords

Sampling statistical bias latent variable modeling

Supplementary material

13428_2013_402_MOESM1_ESM.doc (171 kb)
ESM 1(DOC 171 kb)
13428_2013_402_MOESM2_ESM.doc (2.3 mb)
ESM 2(DOC 2384 kb)

Copyright information

© Psychonomic Society, Inc. 2013

Authors and Affiliations

  • Katherina K. Hauner
    • 1
    • 2
  • Richard E. Zinbarg
    • 1
    • 3
  • William Revelle
    • 1
  1. 1.Department of PsychologyNorthwestern UniversityEvanstonUSA
  2. 2.Department of NeurologyNorthwestern UniversityChicagoUSA
  3. 3.The Family Institute at Northwestern UniversityEvanstonUSA