Skip to main content
Log in

Biases in the production and reception of collective knowledge: the case of hindsight bias in Wikipedia

  • Original Article
  • Published:
Psychological Research Aims and scope Submit manuscript

Abstract

The Web 2.0 enabled collaboration at an unprecedented level. In one of the flagships of mass collaboration—Wikipedia—a large number of authors socially negotiate the world’s largest compendium of knowledge. Several guidelines in Wikipedia restrict contributions to verifiable information from reliable sources to ensure recognized knowledge. Much psychological research demonstrates, however, that individual information processing is biased. This poses the question whether individual biases translate to Wikipedia articles or whether they are prevented by its guidelines. The present research makes use of hindsight bias to examine this question. To this end, we analyzed foresight and hindsight versions of Wikipedia articles regarding a broad variety of events (Study 1). We found the majority of articles not to contain traces of hindsight bias—contrary to prior individual research. However, for a particular category of events—disasters—we found robust evidence for hindsight bias. In a lab experiment (Study 2), we then examined whether individuals’ hindsight bias is translated into articles under controlled conditions and tested whether collaborative writing—as present in Wikipedia—affects the resultant bias (vs. individual writing). Finally, we investigated the impact of biased Wikipedia articles on readers (Study 3). As predicted, biased articles elicited a hindsight bias in readers, who had not known of the event previously. Moreover, biased articles also affected individuals who knew about the event already, and who had already developed a hindsight bias: biased articles further increased their hindsight.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Adler, B. T., Alfaro, L., de Mola-Velasco, S. M., Rosso, P., & West, A. G. (2011). Wikipedia vandalism detection: Combining natural language, metadata, and reputation features. In A. Gelbukh (Ed.), Computational linguistics and intelligent text processing (pp. 277–288). Berlin: Springer.

    Chapter  Google Scholar 

  • Ash, I. K. (2009). Surprise, memory, and retrospective judgment making: Testing cognitive reconstruction theories of the hindsight bias effect. Journal of Experimental Psychology. Learning, Memory, and Cognition, 35, 916–933.

    Article  PubMed  Google Scholar 

  • Barron, B., Martin, C. K., Mertl, V., & Yassine, M. (2016). Citizen science: Connecting to nature through networks. In U. Cress, J. Moskaliuk, & H. Jeong (Eds.), Mass collaboration and education. Cham: Springer International Publishing.

    Google Scholar 

  • Bauer, D. J., Sterba, S. K., & Hallfors, D. D. (2008). Evaluating group-based interventions when control participants are ungrouped. Multivariate Behavioral Research, 43, 210–236.

    Article  PubMed  PubMed Central  Google Scholar 

  • Bellomi, F., & Bonato, R. (2005). Network analysis for Wikipedia. In Proceedings of the first international Wikimedia conference Wikimania. Retrieved from http://www.uvm.edu/~pdodds/files/papers/others/2009/bellomi2009a.pdf. Accessed 10 Apr 2017.

  • Blank, H., Fischer, V., & Erdfelder, E. (2003). Hindsight bias in political elections. Memory, 11, 491–504.

    Article  PubMed  Google Scholar 

  • Blank, H., & Nestler, S. (2006). Perceiving events as both inevitable and unforeseeable in hindsight: The Leipzig candidacy for the Olympics. British Journal of Social Psychology, 45, 149–160.

    Article  PubMed  Google Scholar 

  • Blank, H., & Nestler, S. (2007). Cognitive process models of hindsight bias. Social Cognition, 25, 132–146.

    Article  Google Scholar 

  • Blank, H., Nestler, S., von Collani, G., & Fischer, V. (2008). How many hindsight biases are there? Cognition, 106, 1408–1440.

    Article  PubMed  Google Scholar 

  • Bukszar, E., & Conolly, T. (1988). Hindsight bias and strategic choice: Some problems in learning from experience. Academy of Management Journal, 31, 628–641.

    Google Scholar 

  • Callahan, E. S., & Herring, S. C. (2011). Cultural bias in Wikipedia content on famous persons. Journal of the American Society for Information Science and Technology, 62, 1899–1915.

    Article  Google Scholar 

  • Carli, L. L. (1999). Cognitive reconstruction, hindsight, and reactions to victims and perpetrators. Personality and Social Psychology Bulletin, 25, 966–979.

    Article  Google Scholar 

  • Chen, S., Shechter, D., & Chaiken, S. (1996). Getting at the truth or getting along: accuracy- versus impression-motivated heuristic and systematic processing. Journal of Personality and Social Psychology, 71, 262–275.

    Article  Google Scholar 

  • Choi, I., Koo, M., & Choi, J. A. (2007). Individual differences in analytic versus holistic thinking. Personality and Social Psychology Bulletin, 33, 691–705.

    Article  PubMed  Google Scholar 

  • Christensen-Szalanski, J. J. J., & Willham, C. F. (1991). The hindsight bias: A meta-analysis. Organizational Behavior and Human Decision Processes, 48, 147–168.

    Article  Google Scholar 

  • Cress, U., Jeong, H., & Moskaliuk, J. (2016). Mass collaboration as an emerging paradigm for education? Theories, cases, and research methods. In U. Cress, J. Moskaliuk, & H. Jeong (Eds.), Mass collaboration and education. Cham: Springer International Publishing.

    Chapter  Google Scholar 

  • Cress, U., & Kimmerle, J. (2008). A systemic and cognitive view on collaborative knowledge building with wikis. International Journal of Computer-Supported Collaborative Learning, 3, 105–122.

    Article  Google Scholar 

  • Fallis, D. (2008). Toward an epistemology of Wikipedia. Journal of the American Society for Information Science and Technology, 59, 1662–1674.

    Article  Google Scholar 

  • Ferron, M., & Massa, P. (2011). Collective memory building in Wikipedia: The case of North African uprisings. In Proceedings of the Wikisym. Retrieved from http://www.slideshare.net/phauly/collective-memory-building-in-wikipedia-the-case-of-north-african-uprisings. Accessed 10 Apr 2017.

  • Fields, D. A., Kafai, Y. B., & Giang, M. T. (2016). Coding by choice: A transitional analysis of social participation patterns and programming contributions in the online Scratch community. In U. Cress, J. Moskaliuk, & H. Jeong (Eds.), Mass collaboration and education. Cham: Springer International Publishing. (in press).

    Google Scholar 

  • Fischer, I., & Budescu, D. V. (1995). Desirability and hindsight biases in predicting results of a multi-party election. In J.-P. Caverni, M. Bar-Hillel, F. H. Barron, & H. Jungermann (Eds.), Contributions to decision making (Vol. 1, pp. 193–211). Amsterdam: Elsevier.

    Google Scholar 

  • Fischhoff, B. (1975). Hindsight ≠ foresight: The effect of outcome knowledge on judgment under uncertainty. Journal of Experimental Psychology: Human Perception and Performance, 1, 288–299.

    Google Scholar 

  • Fischhoff, B. (1977). Perceived informativeness of facts. Journal of Experimental Psychology: Human Perception and Performance, 3, 349–358.

    Google Scholar 

  • Forte, A., & Bruckman, A. (2008). Scaling consensus: Increasing decentralization in Wikipedia governance. In Proceedings of the 41st annual Hawaii international conference on system sciences (HICSS’08). Washington, DC: IEEE.

  • Giles, J. (2005). Internet encyclopaedias go head to head. Nature, 438, 900–901.

    Article  PubMed  Google Scholar 

  • Gowers, T., & Nielsen, M. (2009). Massively collaborative mathematics. Nature, 461, 879.

    Article  PubMed  Google Scholar 

  • Guilbault, R. L., Bryant, F. B., Brockway, J. H., & Posavac, E. J. (2004). A meta-analysis of research on hindsight bias. Basic and Applied Social Psychology, 26, 103–117.

    Article  Google Scholar 

  • Hayes, J. R. (1989). Writing research: The analysis of a very complex task. In D. Klahr, Kotovsky, K. (Eds.), Complex information processing: The impact of Herbert A. Simon (pp. 209–234). Lawrence Erlbaum: Hillsdale, New Jersey.

  • Harley, E. M. (2007). Hindsight bias in legal decision making. Social Cognition, 25, 48–63.

    Article  Google Scholar 

  • Hastie, R., Schkade, D. A., & Payne, J. W. (1999). Juror judgments in civil cases: Hindsight effects on judgments of liability for punitive damages. Law and Human Behavior, 23, 597–614.

    Article  Google Scholar 

  • Hawkins, S. A., & Hastie, R. (1990). Hindsight: Biased judgment of past events after the outcomes are known. Psychological Bulletin, 107, 311–327.

    Article  Google Scholar 

  • Hecht, B., & Gergle, D. (2009). Measuring self-focus bias in community-maintained knowledge repositories. In Proceedings of the 4th international conference on communities and technologies (pp. 11–20). New York: ACM.

  • Hecht, B., & Gergle, D. (2010). The tower of Babel meets web 2.0: user-generated content and its applications in a multilingual context. In CHI ‘10 Proceedings of the SIGCHI conference on human factors in computing systems (pp. 291–300). New York: ACM.

  • Isenberg, D. J. (1986). Group polarization: a critical review and meta-analysis. Journal of Personality and Social Psychology, 50, 1141–1151.

    Article  Google Scholar 

  • Jennings, M. M., Lowe, D. J., & Reckers, P. M. J. (1998). Causality as an influence on hindsight bias: An empirical examination of judges’ evaluation of professional audit judgment. Journal of Accounting and Public Policy, 17, 143–167.

    Article  Google Scholar 

  • Keegan, B., Gergle, D., & Contractor, N. (2011). Hot off the wiki: Dynamics, practices, and structures in Wikipedia’s coverage of the Tōhoku catastrophes. In Proceedings of the 7th international symposium on wikis and open collaboration (WikiSym’11) (pp. 105–113). New York: ACM Press.

  • Kittur, A., & Kraut, R. E. (2008). Harnessing the wisdom of crowds in Wikipedia: Quality through coordination. In Proceedings of the 2008 ACM conference on computer supported cooperative work (pp. 37–46). New York: ACM Press.

  • Küfner, A. C. P., Nestler, S., Back, M. D., & Egloff, B. (2010). Tell me a story and I will tell you who you are! Lens model analyses of personality and creative writing. Journal of Research in Personality, 44, 427–435.

    Article  Google Scholar 

  • Kunda, Z. (1990). The case for motivated reasoning. Psychological Bulletin, 108, 480–498.

    Article  PubMed  Google Scholar 

  • LaBine, S. J., & LaBine, G. (1996). Determinations of negligence and the hindsight bias. Law and Human Behavior, 20, 501–516.

    Article  Google Scholar 

  • Leary, M. R. (1982). Hindsight distortion and the 1980 presidential election. Personality and Social Psychology Bulletin, 8, 257–263.

    Article  Google Scholar 

  • Louie, T. A. (2005). Hindsight bias and outcome-consistent thoughts when observing and making service provider decisions. Organizational Behavior and Human Decision Processes, 98, 88–95.

    Article  Google Scholar 

  • Magnus, P. D. (2009). On trusting Wikipedia. Episteme, 6, 74–90.

    Article  Google Scholar 

  • Mark, M. M., & Mellor, S. (1991). Effect of self-relevance of an event on hindsight bias: The foreseeability of a layoff. Journal of Applied Psychology, 76, 569–577.

    Article  Google Scholar 

  • Massa, P., & Scrinzi, F. (2012). Manypedia: Comparing language points of view of Wikipedia communities. In Proceedings of the 8th international symposium on wikis and open collaboration (WikiSym‘12), Linz, Austria. Retrieved from http://www.gnuband.org/files/papers/manypedia_006_wikisym_2012_cameraready.pdf. Accessed 10 Apr 2017.

  • McNamara, D. S., & Kintsch, W. (1996). Learning from one text: Effects of prior knowledge and text coherence. Discourse Processes, 22, 247–287.

    Article  Google Scholar 

  • McNamara, D. S., Kintsch, E., Songer, N. B., & Kintsch, W. (1996). Are good texts always better? Text coherence, background knowledge, and levels of understanding in learning from text. Cognition and Instruction, 14, 1–43.

    Article  Google Scholar 

  • Merz, M. & Döring, N. (2010). Aktive Beteiligung an Wikipedia aus sozial-kognitiver Perspektive. [Active participation in Wikipedia from a social-cognitive perspective]. Retrieved from http://purl.org/merz/20100926. Accessed 27 Nov 2012.

  • Musch, J. (2003). Personality differences in hindsight bias. Memory, 11, 473–489.

    Article  PubMed  Google Scholar 

  • Nestler, S., Blank, H., & Egloff, B. (2010). Hindsight ≠ hindsight: Experimentally induced dissociations between hindsight components. Journal of Experimental Psychology. Learning, Memory, and Cognition, 36, 1399–1413.

    Article  PubMed  Google Scholar 

  • Nestler, S., Blank, H., & von Collani, G. (2008). Hindsight bias doesn’t always come easy: Causal models, cognitive effort and creeping determinism. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, 1043–1054.

    PubMed  Google Scholar 

  • Nestler, S., & Egloff, B. (2009). Increased or reversed? The effect of surprise on hindsight bias depends on the hindsight component. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35, 1539–1544.

    PubMed  Google Scholar 

  • Nestler, S., Leckelt, M., Back, M. D., von der Beck, I., Cress, U., & Oeberst, A. (2017). Produktion von naturwissenschaftlichen Informationen im Internet am Beispiel von Wikipedia. Psychologische Rundschau.

  • Oeberst, A., Halatchliyski, I., Kimmerle, J., & Cress, U. (2014a). Knowledge construction in Wikipedia: A systemic-constructivist analysis. Journal of the Learning Sciences, 23, 149–176.

    Article  Google Scholar 

  • Oeberst, A., von der Beck, I., & Nestler, S. (2014b). Reading about explanations enhances perceptions of inevitability and foreseeability. A cross-cultural study with Wikipedia articles. Cognitive Processing, 15, 343–349.

    Article  PubMed  Google Scholar 

  • Oeberst, A., Cress, U., Back, M., & Nestler, S. (2016). Individual versus collaborative information processing: The case of biases in Wikipedia. In U. Cress, J. Moskaliuk, & H. Jeong (Eds.), Mass collaboration and education (pp. 165–185). Cham, Switzerland: Springer International Publishing.

    Chapter  Google Scholar 

  • Olick, J. K. (1999). Collective memory: The two cultures. Sociological Theory, 7, 333–348.

    Article  Google Scholar 

  • Pennington, N., & Hastie, R. (1988). Explanation-based decision making: The effects of memory structure on judgment. Journal of Experimental Psychology: Learning, Memory, and Cognition, 14, 521–533.

    Google Scholar 

  • Pentzold, C. (2009). Fixing the floating gap: The online encyclopaedia Wikipedia as a global memory place. Memory Studies, 2, 255–272.

    Article  Google Scholar 

  • Pezzo, M. V. (2003). Surprise, defense, or making sense: What removes the hindsight bias? Memory, 11, 421–441.

    Article  PubMed  Google Scholar 

  • Pohl, R. F. (2017). Cognitive illusions: Intriguing phenomena in thinking, judgment, and memory. London: Routledge.

    Google Scholar 

  • Pohl, R. F., Bender, M., & Lachmann, G. (2002). Hindsight bias around the world. Experimental Psychology, 49, 270–282.

    Article  PubMed  Google Scholar 

  • Pohl, R. F., & Erdfelder, E. (2017). Hindsight bias. In R. F. Pohl (Ed.), Cognitive illusions: Intriguing phenomena in thinking, judgment, and memory (2nd ed., pp. 424–445). London: Routledge.

    Google Scholar 

  • Pohl, R. F., & Hell, W. (1996). No reduction in hindsight bias after complete information and repeated testing. Organizational Behavior and Human Decision Processes, 67, 49–58.

    Article  Google Scholar 

  • Postmes, T., Spears, R., & Cihangir, S. (2001). Quality of decision making and group norms. Journal of Personality and Social Psychology, 80, 918–930.

    Article  PubMed  Google Scholar 

  • Potthast, M., Stein, B., & Gerling, R. (2008). Automatic Vandalism Detection in Wikipedia. In C. Macdonald et al (Eds.), Advances in information retrieval. 30th European conference on IR research (ECIR 08), Lecture notes in computer science (vol. 4956, pp. 663–668). Berlin: Springer.

  • Powell, J. L. (1988). A test of the knew-it-all-along effect in the 1984 presidential statewide elections. Journal of Applied Social Psychology, 18, 760–773.

    Article  Google Scholar 

  • Rachlinski, J. J. (1998). A positive psychological theory of judging in hindsight. University of Chicago Law Review, 65, 571–625.

    Article  Google Scholar 

  • Robinson, M. D., Cassidy, D. M., Boyd, R. L., & Fetterman, A. K. (2015). The politics of time: conservatives differentially reference the past and liberals differentially reference the future. Journal of Applied Social Psychology, 45, 391–399.

    Article  Google Scholar 

  • Rodriguez, A. J., Holleran, Sh E, & Mehl, M. R. (2010). Reading between the lines: the lay assessment of sublinical depression from written self-descriptions. Journal of Personality, 78, 575–597.

    Article  PubMed  Google Scholar 

  • Roese, N. J., & Olson, J. M. (1996). Counterfactuals, causal attributions, and the hindsight bias: A conceptual integration. Journal of Experimental Social Psychology, 32, 197–227.

    Article  Google Scholar 

  • Roese, N. J., & Vohs, K. D. (2012). Hindsight bias. Perspectives in Psychological Science, 7, 411–426.

    Article  Google Scholar 

  • Royal, C., & Kapila, D. (2009). What’s on Wikipedia, and what’s not…?: Assessing completeness of information. Social Science Computer Review, 27, 138–148.

    Article  Google Scholar 

  • Schkade, D. A., & Kilbourne, L. M. (1991). Expectation-outcome consistency and hindsight bias. Organizational Behavior and Human Decision Processes, 49, 105–123.

    Article  Google Scholar 

  • Schultheiss, O. C. (2013). Are implicit motives revealed in mere words? Testing the marker-word hypothesis with computer-based text analysis. Frontiers in Psychology, 4, 748.

    PubMed  PubMed Central  Google Scholar 

  • Schulz-Hardt, S., Frey, D., Lüthgens, C., & Moscovici, S. (2000). Biased information search in group decision making. Journal of Personality and Social Psychology, 78, 655–669.

    Article  PubMed  Google Scholar 

  • Schulz-Hardt, S., Jochims, M., & Frey, D. (2002). Productive conflict in group decision making: Genuine and contrived dissent as strategies to counteract biased information seeking. Organizational Behavior and Human Decision Processes, 88, 563–586.

    Article  Google Scholar 

  • Smith, A. C., & Greene, E. (2005). Conduct and its consequences: Attempts at debiasing jury judgments. Law and Human Behavior, 29, 505–526.

    Article  PubMed  Google Scholar 

  • Stahlberg, D., Eller, F., Maass, A., & Frey, D. (1995). We knew it all along: Hindsight bias in groups. Organizational Behavior and Human Decision Processes, 63, 46–58.

    Article  Google Scholar 

  • Sterba, S. K. (2017). Partially nested designs in psychotherapy trials: A review of modeling developments. Psychotherapy Research. doi:10.1080/10503307.2015.1114688.

  • Tausczik, Y. R., & Pennebaker, J. W. (2010). The psychological meaning of words: LIWC and computerized text analysis methods. Journal of Language and Social Psychology, 29, 24–54.

    Article  Google Scholar 

  • Tesser, A. (1978). Self-generated attitude change. In L. Berkowitz (Ed.), Advances in experimental social psychology, 11 (pp. 289–338). New York: Academic Press.

    Google Scholar 

  • The Express Tribune (2011). IAEA warned Japan over nuclear quake risk: Wikileaks. Published on March 17, 2011. Retrieved from http://www.telegraph.co.uk/news/worldnews/wikileaks/8384059/Japan-earthquake-Japan-warned-over-nuclear-plants-WikiLeaks-cables-show.html. Accessed 10 Apr 2017.

  • The Telegraph (2011). Japan earthquake: Japan warned over nuclear plants, WikiLeaks cables show. Published on March 15, 2011. Retrieved from http://tribune.com.pk/story/133824/iaea-warned-japan-over-nuclear-quake-risk/. Accessed 10 Apr 2017.

  • Verplanken, B., & Pieters, R. G. M. (1988). Individual differences in the reverse of hindsight bias: I never thought something like Chernobyl would happen. Did I? Journal of Behavioral Decision Making, 1, 131–147.

    Article  Google Scholar 

  • Viégas, F. B., Wattenberg, M., & Dave, K. (2004). Studying cooperation and conflict between authors with history flow visualizations. In Proceedings of the SIGCHI conference on human factors in computing systems. New York: ACM Press.

  • Viégas, F. B., Wattenberg, M., Kriss, J., & van Ham, F. (2007). Talk before you type: Coordination in Wikipedia. In Proceedings of the 40th annual Hawaii international conference on system sciences (HICSS’07). Washington, DC: IEEE.

  • Wilson, A. M., & Likens, G. E. (2015). Content volatility of scientific topics in Wikipedia: A cautionary tale. PloS One, 10(8), e0134454.

    Article  PubMed  PubMed Central  Google Scholar 

  • Yama, H., Manktelow, K. I., Mercier, H., van der Henst, J. B., Soo Do, K., Kawasaki, Y., et al. (2010). A cross-cultural study of hindsight bias and conditional probabilistic reasoning. Thinking & Reasoning, 16, 346–371.

    Article  Google Scholar 

  • Yopchik, J. E., & Kim, N. S. (2012). Hindsight bias and causal reasoning: A minimalist approach. Cognitive Processing, 13, 63–72.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Aileen Oeberst.

Ethics declarations

Funding

This research was funded by the German Research Foundation (Grant Numbers OE 604/1-1 and NE 1485/5-1).

Conflict of interest

All authors declare that they have no conflicts of interest.

Ethical standards

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Oeberst, A., von der Beck, I., D. Back, M. et al. Biases in the production and reception of collective knowledge: the case of hindsight bias in Wikipedia. Psychological Research 82, 1010–1026 (2018). https://doi.org/10.1007/s00426-017-0865-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00426-017-0865-7

Navigation