Advertisement

The importance of being honest? Evidence that deception may not pollute social science subject pools after all

  • Max M. KrasnowEmail author
  • Rhea M. Howard
  • Adar B. Eisenbruch
Article

Abstract

Deceiving participants about the goals or content of a study is permitted in psychological research but is largely banned in economics journals and subject pools. This ban is intended to protect a public good: If experiencing deception causes participants to be suspicious in future studies, and suspicion meaningfully influences their behavior, then the entire field suffers. We report a survey of psychologists’ and economists’ attitudes toward deception (N = 568) and a large, nondeceptive multisite study in which we measured participants’ histories, suspicion levels, and behavior in four common economic tasks (N = 636). Economists reported more negative attitudes toward deceptive methods and greater support for the deception ban than did psychologists. The results of the behavioral study, however, do not support the “public good” argument for banning deception about the goals or content of a research study: Participants’ present suspicion was not clearly related to past experiences of deception, and there were no consistent behavioral differences between suspicious and credulous participants. We discuss the implications of these results for the ongoing debate regarding the acceptability of deceptive research methods.

Keywords

Research methods Deception Economics Psychology 

Notes

Acknowledgements

We thank Nina Cohodes and the staff of the Harvard Decision Science Laboratory for coordinating the economics pool data collection at Harvard, Gary Charness for coordinating the use of the Experimental and Behavioral Economics Laboratory and the corresponding subject pool at UCSB, Patrick Mair for statistical consultation, and Alena A. Egner, Erin Mernoff, Carolyn Killea, Sierra Fan, Nwanneka Okwelogu, and KeeHup Yong for additional research assistance.

Open Practices Statement

The data for the experiments reported here are available online (https://osf.io/f3kzr), the materials are available by request to the corresponding author, and none of the experiments were preregistered.

Author Contributions

M.M.K. conceived of the experimental study and designed it with R.M.H. R.M.H. wrote code for the data acquisition. R.M.H. collected data at Harvard University and on Amazon Mechanical Turk; A.B.E. collected data at the University of California, Santa Barbara. R.M.H. and M.M.K. conceived and designed the survey study. M.M.K. and A.B.E. conducted the data analysis. All the authors wrote the manuscript and approved of the final version for publication.

Supplementary material

13428_2019_1309_MOESM1_ESM.docx (229 kb)
ESM 1 (DOCX 228 kb)

References

  1. Alberti, F., & Güth, W. (2013). Studying deception without deceiving participants: An experiment of deception experiments. Journal of Economic Behavior and Organization, 93, 196–204.  https://doi.org/10.1016/j.jebo.2013.04.001 CrossRefGoogle Scholar
  2. Barrera, D., & Simpson, B. (2012). Much ado about deception: Consequences of deceiving research participants in the social sciences. Sociological Methods and Research, 41, 383–413.  https://doi.org/10.1177/0049124112452526 CrossRefGoogle Scholar
  3. Bonetti, S. (1998). Experimental economics and deception. Journal of Economic Psychology, 19, 377–395.  https://doi.org/10.1016/S0167-4870(98)00012-9 CrossRefGoogle Scholar
  4. Bröder, A. (1998). Deception can be acceptable. American Psychologist, 53, 805–806.  https://doi.org/10.1037/h0092168 CrossRefGoogle Scholar
  5. Buhrmester, M. D., Talaifar, S., & Gosling, S. D. (2018). An evaluation of Amazon’s Mechanical Turk, its rapid rise, and its effective use. Perspectives on Psychological Science, 13, 149–154.  https://doi.org/10.1177/1745691617706516 CrossRefGoogle Scholar
  6. Christensen, L. (1988). Deception in psychological research: When is its use justified? Personality and Social Psychology Bulletin, 14, 664–675.  https://doi.org/10.1177/0146167288144002 CrossRefGoogle Scholar
  7. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum.Google Scholar
  8. Colson, G., Corrigan, J. R., Grebitus, C., Loureiro, M. L., & Rousu, M. C. (2016). Which deceptive practices, if any, should be allowed in experimental economics research? Results from surveys of applied experimental economists and students. American Journal of Agricultural Economics, 98, 610–621.  https://doi.org/10.1093/ajae/aav067 CrossRefGoogle Scholar
  9. Cook, K. S., & Yamagishi, T. (2008). A defense of deception on scientific grounds. Social Psychology Quarterly, 71, 215–221.CrossRefGoogle Scholar
  10. Davis, D. D., & Holt, C. A. (1993). Experimental economics. Princeton, NJ: Princeton University Press.Google Scholar
  11. Delton, A. W., Cosmides, L., Guemo, M., Robertson, T. E., & Tooby, J. (2012). The psychosemantics of free riding: dissecting the architecture of a moral concept. Journal of Personality and Social Psychology, 102, 1252–1270.  https://doi.org/10.1037/a0027026 CrossRefPubMedPubMedCentralGoogle Scholar
  12. Delton, A. W., Nemirow, J., Robertson, T. E., Cimino, A., & Cosmides, L. (2013). Merely opting out of a public good is moralized: An error management approach to cooperation. Journal of Personality and Social Psychology, 105, 621–638.  https://doi.org/10.1037/a0033495 CrossRefPubMedGoogle Scholar
  13. Delton, A. W., & Robertson, T. E. (2016). How the mind makes welfare tradeoffs: Evolution, computation, and emotion. Current Opinion in Psychology, 7, 12–16.  https://doi.org/10.1016/j.copsyc.2015.06.006 CrossRefGoogle Scholar
  14. Epley, N., & Huff, C. (1998). Suspicion, affective response, and educational benefit as a result of deception in psychology research. Personality and Social Psychology Bulletin, 24, 759–768.CrossRefGoogle Scholar
  15. Fehr, E., & Gachter, S. (2000). Cooperation and punishment in public goods games. American Economic Review, 90, 980–994.CrossRefGoogle Scholar
  16. Frank, R. H., Gilovich, T., & Regan, D. T. (1993). Does studying economics inhibit cooperation? Journal of Economic Perspectives, 7, 159–171.  https://doi.org/10.2307/2138205 CrossRefGoogle Scholar
  17. Gachter, S. (2009). Improvements and future challenges for the research infrastructure in the field “experimental economics” (SSRN Scholarly Paper No. ID 1445359). Retrieved from Social Science Research Network website: https://papers.ssrn.com/abstract=1445359
  18. Gerlach, P., Teodorescu, K., & Hertwig, R. (2019). The truth about lies: A meta-analysis on dishonest behavior. Psychological Bulletin, 145, 1–44.  https://doi.org/10.1037/bul0000174 CrossRefPubMedGoogle Scholar
  19. Gu, J., Zhong, C.-B., & Page-Gould, E. (2013). Listen to your heart: When false somatic feedback shapes moral behavior. Journal of Experimental Psychology. General, 142, 307–312.  https://doi.org/10.1037/a0029549 CrossRefPubMedGoogle Scholar
  20. Hendriks, A. (2012). SoPHIE-Software platform for human interaction experiments (Working paper). University of Osnabrück, Osnabrück, Austria.Google Scholar
  21. Henrich, J., Boyd, R., Bowles, S., Camerer, C., Fehr, E., Gintis, H., … Tracer, D. (2005). “Economic man” in cross-cultural perspective: Behavioral experiments in 15 small-scale societies. Behavioral and Brain Sciences, 28, 795–815.  https://doi.org/10.1017/S0140525X05000142 CrossRefPubMedGoogle Scholar
  22. Hertwig, R., & Ortmann, A. (2001). Experimental practices in economics: A methodological challenge for psychologists? Behavioral and Brain Sciences, 24, 383–403.CrossRefGoogle Scholar
  23. Hertwig, R., & Ortmann, A. (2008). Deception in experiments: Revisiting the arguments in its defense. Ethics and Behavior, 18, 59–92.  https://doi.org/10.1080/10508420701712990 CrossRefGoogle Scholar
  24. Jamison, J., Karlan, D., & Schechter, L. (2008). To deceive or not to deceive: The effect of deception on behavior in future laboratory experiments. Journal of Economic Behavior and Organization, 68, 477–488.  https://doi.org/10.1016/j.jebo.2008.09.002 CrossRefGoogle Scholar
  25. Johnson, N. D., & Mislin, A. A. (2011). Trust games: A meta-analysis. Journal of Economic Psychology, 32, 865–889.CrossRefGoogle Scholar
  26. Kilduff, G. J., Galinsky, A. D., Gallo, E., & Reade, J. J. (2015). Whatever it takes to win: Rivalry increases unethical behavior. Academy of Management Journal, 59, 1508–1534.  https://doi.org/10.5465/amj.2014.0545 CrossRefGoogle Scholar
  27. Krawczyk, M. (2013). Delineating deception in experimental economics: Researchers’ and subjects’ views (Faculty of Economic Sciences Working Paper, University of Warsaw). Retrieved from http://www.wne.uw.edu.pl/files/4013/9636/8542/WNE_WP96_2013.pdf
  28. Krawczyk, M. (2015). “Trust me, I am an economist”: A note on suspiciousness in laboratory experiments. Journal of Behavioral and Experimental Economics, 55, 103–107.CrossRefGoogle Scholar
  29. Ledyard, J. O. (1995). Public goods: A survey of experimental research. In J. Kagel & A. Roth (Eds.), Handbook of experimental economics (pp. 111–194). Princeton, NJ: Princeton University Press.Google Scholar
  30. McDaniel, T., & Starmer, C. (1998). Experimental economics and deception: A comment. Journal of Economic Psychology, 19, 403–409.CrossRefGoogle Scholar
  31. Morey, R. D., & Rouder, J. N. (2011). Bayes factor approaches for testing interval null hypotheses. Psychological Methods, 16, 406–419.  https://doi.org/10.1037/a0024377 CrossRefGoogle Scholar
  32. Nicks, S. D., Korn, J. H., & Mainieri, T. (1997). The rise and fall of deception in social psychology and personality research, 1921 to 1994. Ethics and Behavior, 7, 69–77.  https://doi.org/10.1207/s15327019eb0701_6 CrossRefPubMedGoogle Scholar
  33. Ortmann, A., & Hertwig, R. (2002). The costs of deception: Evidence from psychology. Experimental Economics, 5, 111–131.CrossRefGoogle Scholar
  34. Stang, D. J. (1976). Ineffective deception in conformity research: Some causes and consequences. European Journal of Social Psychology, 6, 353–367.CrossRefGoogle Scholar
  35. Vedel, A. (2016). Big Five personality group differences across academic majors: A systematic review. Personality and Individual Differences, 92, 1–10.  https://doi.org/10.1016/j.paid.2015.12.011 CrossRefGoogle Scholar
  36. Wilson, B. J. (2014). The meaning of deceive in experimental economic science. In The Oxford handbook of professional economic ethics. New York, NY: Oxford University Press.Google Scholar
  37. Wilson, R. K., & Isaac, R. M. (2007). Political economy and experiments. Political Economist, 14, 1–7.Google Scholar

Copyright information

© The Psychonomic Society, Inc. 2019

Authors and Affiliations

  • Max M. Krasnow
    • 1
    Email author
  • Rhea M. Howard
    • 1
  • Adar B. Eisenbruch
    • 1
  1. 1.Department of PsychologyHarvard UniversityCambridgeUSA

Personalised recommendations