Skip to main content
Log in

Publication prejudices: An experimental study of confirmatory bias in the peer review system

Cognitive Therapy and Research Aims and scope Submit manuscript

Abstract

Confirmatory bias is the tendency to emphasize and believe experiences which support one's views and to ignore or discredit those which do not. The effects of this tendency have been repeatedly documented in clinical research. However, its ramifications for the behavior of scientists have yet to be adequately explored. For example, although publication is a critical element in determining the contribution and impact of scientific findings, little research attention has been devoted to the variables operative in journal review policies. In the present study, 75 journal reviewers were asked to referee manuscripts which described identical experimental procedures but which reported positive, negative, mixed, or no results. In addition to showing poor interrater agreement, reviewers were strongly biased against manuscripts which reported results contrary to their theoretical perspective. The implications of these findings for epistemology and the peer review system are briefly addressed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

References

  • Adams, J. A.Human memory. New York: McGraw-Hill, 1967.

    Google Scholar 

  • American Psychological Association.Standards for educational and psychological tests and manuals. Washington, D.C.: American Psychological Association, 1966.

    Google Scholar 

  • Bacon, F.Novum organum. New York: Bobbs-Merrill, 1960. (Originally published, 1621.)

    Google Scholar 

  • Beck, A. T.Cognitive therapy and the emotional disorders. New York: International Universities Press, 1976.

    Google Scholar 

  • Caplow, T., & McGee, R. J.The academic marketplace. New York: Basic Books, 1958.

    Google Scholar 

  • Cole, J. R., & Cole, S.Social stratification in science. Chicago: University of Chicago Press, 1973.

    Google Scholar 

  • Deci, E. L. Effects of externally mediated rewards on intrinsic motivation.Journal of Personality and Social Psychology 1971,18 105–115.

    Google Scholar 

  • Deci, E. L. Intrinsic motivation, extrinsic reinforcement, and inequity.Journal of Personality and Social Psychology 1972,22 113–130.

    Google Scholar 

  • Dixon, B.What is science for? New York: Harper & Row, 1973.

    Google Scholar 

  • Hagstrom, W. O.The scientific community. New York: Basic Books, 1965.

    Google Scholar 

  • Kintsch, W.Learning, memory, and conceptual processes. New York: Wiley, 1970.

    Google Scholar 

  • Lakatos, I., & Musgrave, A. (Eds.),Criticism and the growth of knowledge. London: Cambridge University Press, 1970.

    Google Scholar 

  • Lepper, M. R., Greene, D., & Nisbett, R. E. Undermining children's intrinsic interest with extrinsic reward: A test of the “overjustification” hypothesis.Journal of Personality and Social Psychology 1973,28 129–137.

    Google Scholar 

  • Levine, F. M., & Fasnacht, G. Token rewards may lead to token learning.American Psychologist 1974,29 814–820.

    Google Scholar 

  • Mahoney, M. J.Cognition and behavior modification. Cambridge, Massachusetts: Ballinger, 1974.

    Google Scholar 

  • Mahoney, M. J.Scientist as subject: The psychological imperative. Cambridge, Massachusetts: Ballinger, 1976.

    Google Scholar 

  • Mahoney, M. J., & DeMonbreun, B. G. Confirmatory bias in scientists and non-scientists.Cognitive Therapy and Research, 1977 (in press).

  • Mahoney, M. J., Kazdin, A. E., & Kenigsberg, M.Getting published: The effects of self-citation and institutional affiliation. Unpublished manuscript, Pennsylvania State University, 1975.

  • Mahoney, M. J., & Kimper, T. P. From ethics to logic: A survey of scientists. In M. J. Mahoney,Scientist as subject. Cambridge, Massachusetts: Ballinger, 1976. Pp. 187–193.

    Google Scholar 

  • Merton, R. K.Social theory and social structure. New York: Free Press, 1968.

    Google Scholar 

  • Neisser, V.Cognitive psychology. New York: Appleton-Century-Crofts, 1967.

    Google Scholar 

  • Norman, D. A.Memory and attention. New York: Wiley, 1969.

    Google Scholar 

  • Popper, K. R.Objective knowledge: An evaluative approach. London: Oxford University Press, 1972.

    Google Scholar 

  • Raimy, V.Misunderstandings of the self. San Francisco: Jossey-Bass, 1975.

    Google Scholar 

  • Weimer, W. B.Psychology and the conceptual foundations of science. Hillsdale, New Jersey; Lawrence Erlbaum Associates, 1977.

    Google Scholar 

  • Ziman, J.Public knowledge: The social dimension of science. London: Cambridge University Press, 1968.

    Google Scholar 

  • Zuckerman, H. Stratification in American science.Sociological Inquiry 1970,40 235–257.

    Google Scholar 

  • Zuckerman, H., & Merton, R. K. Patterns of evaluation in science: Institutionalization, structure and functions of the referee system.Minerva 1971,9 66–100.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Mahoney, M.J. Publication prejudices: An experimental study of confirmatory bias in the peer review system. Cogn Ther Res 1, 161–175 (1977). https://doi.org/10.1007/BF01173636

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01173636

Keywords

Navigation