Behavior Research Methods, Instruments, & Computers

, Volume 35, Issue 4, pp 614–620

Validating Internet research: A test of the psychometric equivalence of Internet and in-person samples

Authors

  • Paul Meyerson
    • Department of PsychologyFordham University
    • Department of PsychologyFordham University
Article

DOI: 10.3758/BF03195541

Cite this article as:
Meyerson, P. & Tryon, W.W. Behavior Research Methods, Instruments, & Computers (2003) 35: 614. doi:10.3758/BF03195541
  • 749 Views

Abstract

This study evaluated the psychometric equivalency of Web-based research. The Sexual Boredom Scale was presented via the World-Wide Web along with five additional scales used to validate it. A subset of 533 participants that matched a previously published sample (Watt & Ewing, 1996) on age, gender, and race was identified. An 8 × 8 correlation matrix from the matched Internet sample was compared via structural equation modeling with a similar 8 × 8 correlation matrix from the previously published study. The Internet and previously published samples were psychometrically equivalent. Co-efficient alpha values calculated on the matched Internet sample yielded reliability coefficients almost identical to those for the previously published sample. Factors such as computer administration and uncontrollable administration settings did not appear to affect the results. Demographic data indicated an overrepresentation of males by about 6% and Caucasians by about 13% relative to the U.S. Census (2000). A total of 2,230 participants were obtained in about 8 months without remuneration. These results suggest that data collection on the Web is (1) reliable, (2) valid, (3) reasonably representative, (4) cost effective, and (5) efficient.

Download to read the full article text

Copyright information

© Psychonomic Society, Inc. 2003