Are Online Samples Credible? Evidence from Risk Elicitation Tests

  • John Gibson
  • David JohnsonEmail author

Economic research conducted using online markets has become increasingly common (Keith et al., Frontiers in Psychology, 2017). Researchers question the validity of online studies due to concerns regarding experimental control and incentive salience. To address these concerns, research is continually needed to determine if online markets produce economically meaningful data. We approach this issue using an online experiment exploring subjective and incentivized measures of risk preference. Existing research, using in-person experimental methods, observes subjects making risk-averse choices in incentivized lottery experiments and reports a significant correlation between subjective risk preferences and decisions made in these experiments (Dohmen et al., Journal of the European Economic Association, 2011). If data generated online are economically meaningful, online subjects should behave similarly.

Our experiment used Amazon Mechanical Turk (AMT), an online market where workers...


C99 C83 


Supplementary material

11293_2019_9625_MOESM1_ESM.docx (43 kb)
ESM 1 (DOCX 43 kb)

Copyright information

© International Atlantic Economic Society 2019

Authors and Affiliations

  1. 1.Department of Economics and Finance University of Texas El PasoTexasUSA
  2. 2.Department of Economics and FinanceUniversity of Central MissouriWarrensburgUSA

Personalised recommendations