Abstract
The Web 2.0 enabled collaboration at an unprecedented level. In one of the flagships of mass collaboration—Wikipedia—a large number of authors socially negotiate the world’s largest compendium of knowledge. Several guidelines in Wikipedia restrict contributions to verifiable information from reliable sources to ensure recognized knowledge. Much psychological research demonstrates, however, that individual information processing is biased. This poses the question whether individual biases translate to Wikipedia articles or whether they are prevented by its guidelines. The present research makes use of hindsight bias to examine this question. To this end, we analyzed foresight and hindsight versions of Wikipedia articles regarding a broad variety of events (Study 1). We found the majority of articles not to contain traces of hindsight bias—contrary to prior individual research. However, for a particular category of events—disasters—we found robust evidence for hindsight bias. In a lab experiment (Study 2), we then examined whether individuals’ hindsight bias is translated into articles under controlled conditions and tested whether collaborative writing—as present in Wikipedia—affects the resultant bias (vs. individual writing). Finally, we investigated the impact of biased Wikipedia articles on readers (Study 3). As predicted, biased articles elicited a hindsight bias in readers, who had not known of the event previously. Moreover, biased articles also affected individuals who knew about the event already, and who had already developed a hindsight bias: biased articles further increased their hindsight.
Similar content being viewed by others
References
Adler, B. T., Alfaro, L., de Mola-Velasco, S. M., Rosso, P., & West, A. G. (2011). Wikipedia vandalism detection: Combining natural language, metadata, and reputation features. In A. Gelbukh (Ed.), Computational linguistics and intelligent text processing (pp. 277–288). Berlin: Springer.
Ash, I. K. (2009). Surprise, memory, and retrospective judgment making: Testing cognitive reconstruction theories of the hindsight bias effect. Journal of Experimental Psychology. Learning, Memory, and Cognition, 35, 916–933.
Barron, B., Martin, C. K., Mertl, V., & Yassine, M. (2016). Citizen science: Connecting to nature through networks. In U. Cress, J. Moskaliuk, & H. Jeong (Eds.), Mass collaboration and education. Cham: Springer International Publishing.
Bauer, D. J., Sterba, S. K., & Hallfors, D. D. (2008). Evaluating group-based interventions when control participants are ungrouped. Multivariate Behavioral Research, 43, 210–236.
Bellomi, F., & Bonato, R. (2005). Network analysis for Wikipedia. In Proceedings of the first international Wikimedia conference Wikimania. Retrieved from http://www.uvm.edu/~pdodds/files/papers/others/2009/bellomi2009a.pdf. Accessed 10 Apr 2017.
Blank, H., Fischer, V., & Erdfelder, E. (2003). Hindsight bias in political elections. Memory, 11, 491–504.
Blank, H., & Nestler, S. (2006). Perceiving events as both inevitable and unforeseeable in hindsight: The Leipzig candidacy for the Olympics. British Journal of Social Psychology, 45, 149–160.
Blank, H., & Nestler, S. (2007). Cognitive process models of hindsight bias. Social Cognition, 25, 132–146.
Blank, H., Nestler, S., von Collani, G., & Fischer, V. (2008). How many hindsight biases are there? Cognition, 106, 1408–1440.
Bukszar, E., & Conolly, T. (1988). Hindsight bias and strategic choice: Some problems in learning from experience. Academy of Management Journal, 31, 628–641.
Callahan, E. S., & Herring, S. C. (2011). Cultural bias in Wikipedia content on famous persons. Journal of the American Society for Information Science and Technology, 62, 1899–1915.
Carli, L. L. (1999). Cognitive reconstruction, hindsight, and reactions to victims and perpetrators. Personality and Social Psychology Bulletin, 25, 966–979.
Chen, S., Shechter, D., & Chaiken, S. (1996). Getting at the truth or getting along: accuracy- versus impression-motivated heuristic and systematic processing. Journal of Personality and Social Psychology, 71, 262–275.
Choi, I., Koo, M., & Choi, J. A. (2007). Individual differences in analytic versus holistic thinking. Personality and Social Psychology Bulletin, 33, 691–705.
Christensen-Szalanski, J. J. J., & Willham, C. F. (1991). The hindsight bias: A meta-analysis. Organizational Behavior and Human Decision Processes, 48, 147–168.
Cress, U., Jeong, H., & Moskaliuk, J. (2016). Mass collaboration as an emerging paradigm for education? Theories, cases, and research methods. In U. Cress, J. Moskaliuk, & H. Jeong (Eds.), Mass collaboration and education. Cham: Springer International Publishing.
Cress, U., & Kimmerle, J. (2008). A systemic and cognitive view on collaborative knowledge building with wikis. International Journal of Computer-Supported Collaborative Learning, 3, 105–122.
Fallis, D. (2008). Toward an epistemology of Wikipedia. Journal of the American Society for Information Science and Technology, 59, 1662–1674.
Ferron, M., & Massa, P. (2011). Collective memory building in Wikipedia: The case of North African uprisings. In Proceedings of the Wikisym. Retrieved from http://www.slideshare.net/phauly/collective-memory-building-in-wikipedia-the-case-of-north-african-uprisings. Accessed 10 Apr 2017.
Fields, D. A., Kafai, Y. B., & Giang, M. T. (2016). Coding by choice: A transitional analysis of social participation patterns and programming contributions in the online Scratch community. In U. Cress, J. Moskaliuk, & H. Jeong (Eds.), Mass collaboration and education. Cham: Springer International Publishing. (in press).
Fischer, I., & Budescu, D. V. (1995). Desirability and hindsight biases in predicting results of a multi-party election. In J.-P. Caverni, M. Bar-Hillel, F. H. Barron, & H. Jungermann (Eds.), Contributions to decision making (Vol. 1, pp. 193–211). Amsterdam: Elsevier.
Fischhoff, B. (1975). Hindsight ≠ foresight: The effect of outcome knowledge on judgment under uncertainty. Journal of Experimental Psychology: Human Perception and Performance, 1, 288–299.
Fischhoff, B. (1977). Perceived informativeness of facts. Journal of Experimental Psychology: Human Perception and Performance, 3, 349–358.
Forte, A., & Bruckman, A. (2008). Scaling consensus: Increasing decentralization in Wikipedia governance. In Proceedings of the 41st annual Hawaii international conference on system sciences (HICSS’08). Washington, DC: IEEE.
Giles, J. (2005). Internet encyclopaedias go head to head. Nature, 438, 900–901.
Gowers, T., & Nielsen, M. (2009). Massively collaborative mathematics. Nature, 461, 879.
Guilbault, R. L., Bryant, F. B., Brockway, J. H., & Posavac, E. J. (2004). A meta-analysis of research on hindsight bias. Basic and Applied Social Psychology, 26, 103–117.
Hayes, J. R. (1989). Writing research: The analysis of a very complex task. In D. Klahr, Kotovsky, K. (Eds.), Complex information processing: The impact of Herbert A. Simon (pp. 209–234). Lawrence Erlbaum: Hillsdale, New Jersey.
Harley, E. M. (2007). Hindsight bias in legal decision making. Social Cognition, 25, 48–63.
Hastie, R., Schkade, D. A., & Payne, J. W. (1999). Juror judgments in civil cases: Hindsight effects on judgments of liability for punitive damages. Law and Human Behavior, 23, 597–614.
Hawkins, S. A., & Hastie, R. (1990). Hindsight: Biased judgment of past events after the outcomes are known. Psychological Bulletin, 107, 311–327.
Hecht, B., & Gergle, D. (2009). Measuring self-focus bias in community-maintained knowledge repositories. In Proceedings of the 4th international conference on communities and technologies (pp. 11–20). New York: ACM.
Hecht, B., & Gergle, D. (2010). The tower of Babel meets web 2.0: user-generated content and its applications in a multilingual context. In CHI ‘10 Proceedings of the SIGCHI conference on human factors in computing systems (pp. 291–300). New York: ACM.
Isenberg, D. J. (1986). Group polarization: a critical review and meta-analysis. Journal of Personality and Social Psychology, 50, 1141–1151.
Jennings, M. M., Lowe, D. J., & Reckers, P. M. J. (1998). Causality as an influence on hindsight bias: An empirical examination of judges’ evaluation of professional audit judgment. Journal of Accounting and Public Policy, 17, 143–167.
Keegan, B., Gergle, D., & Contractor, N. (2011). Hot off the wiki: Dynamics, practices, and structures in Wikipedia’s coverage of the Tōhoku catastrophes. In Proceedings of the 7th international symposium on wikis and open collaboration (WikiSym’11) (pp. 105–113). New York: ACM Press.
Kittur, A., & Kraut, R. E. (2008). Harnessing the wisdom of crowds in Wikipedia: Quality through coordination. In Proceedings of the 2008 ACM conference on computer supported cooperative work (pp. 37–46). New York: ACM Press.
Küfner, A. C. P., Nestler, S., Back, M. D., & Egloff, B. (2010). Tell me a story and I will tell you who you are! Lens model analyses of personality and creative writing. Journal of Research in Personality, 44, 427–435.
Kunda, Z. (1990). The case for motivated reasoning. Psychological Bulletin, 108, 480–498.
LaBine, S. J., & LaBine, G. (1996). Determinations of negligence and the hindsight bias. Law and Human Behavior, 20, 501–516.
Leary, M. R. (1982). Hindsight distortion and the 1980 presidential election. Personality and Social Psychology Bulletin, 8, 257–263.
Louie, T. A. (2005). Hindsight bias and outcome-consistent thoughts when observing and making service provider decisions. Organizational Behavior and Human Decision Processes, 98, 88–95.
Magnus, P. D. (2009). On trusting Wikipedia. Episteme, 6, 74–90.
Mark, M. M., & Mellor, S. (1991). Effect of self-relevance of an event on hindsight bias: The foreseeability of a layoff. Journal of Applied Psychology, 76, 569–577.
Massa, P., & Scrinzi, F. (2012). Manypedia: Comparing language points of view of Wikipedia communities. In Proceedings of the 8th international symposium on wikis and open collaboration (WikiSym‘12), Linz, Austria. Retrieved from http://www.gnuband.org/files/papers/manypedia_006_wikisym_2012_cameraready.pdf. Accessed 10 Apr 2017.
McNamara, D. S., & Kintsch, W. (1996). Learning from one text: Effects of prior knowledge and text coherence. Discourse Processes, 22, 247–287.
McNamara, D. S., Kintsch, E., Songer, N. B., & Kintsch, W. (1996). Are good texts always better? Text coherence, background knowledge, and levels of understanding in learning from text. Cognition and Instruction, 14, 1–43.
Merz, M. & Döring, N. (2010). Aktive Beteiligung an Wikipedia aus sozial-kognitiver Perspektive. [Active participation in Wikipedia from a social-cognitive perspective]. Retrieved from http://purl.org/merz/20100926. Accessed 27 Nov 2012.
Musch, J. (2003). Personality differences in hindsight bias. Memory, 11, 473–489.
Nestler, S., Blank, H., & Egloff, B. (2010). Hindsight ≠ hindsight: Experimentally induced dissociations between hindsight components. Journal of Experimental Psychology. Learning, Memory, and Cognition, 36, 1399–1413.
Nestler, S., Blank, H., & von Collani, G. (2008). Hindsight bias doesn’t always come easy: Causal models, cognitive effort and creeping determinism. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, 1043–1054.
Nestler, S., & Egloff, B. (2009). Increased or reversed? The effect of surprise on hindsight bias depends on the hindsight component. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35, 1539–1544.
Nestler, S., Leckelt, M., Back, M. D., von der Beck, I., Cress, U., & Oeberst, A. (2017). Produktion von naturwissenschaftlichen Informationen im Internet am Beispiel von Wikipedia. Psychologische Rundschau.
Oeberst, A., Halatchliyski, I., Kimmerle, J., & Cress, U. (2014a). Knowledge construction in Wikipedia: A systemic-constructivist analysis. Journal of the Learning Sciences, 23, 149–176.
Oeberst, A., von der Beck, I., & Nestler, S. (2014b). Reading about explanations enhances perceptions of inevitability and foreseeability. A cross-cultural study with Wikipedia articles. Cognitive Processing, 15, 343–349.
Oeberst, A., Cress, U., Back, M., & Nestler, S. (2016). Individual versus collaborative information processing: The case of biases in Wikipedia. In U. Cress, J. Moskaliuk, & H. Jeong (Eds.), Mass collaboration and education (pp. 165–185). Cham, Switzerland: Springer International Publishing.
Olick, J. K. (1999). Collective memory: The two cultures. Sociological Theory, 7, 333–348.
Pennington, N., & Hastie, R. (1988). Explanation-based decision making: The effects of memory structure on judgment. Journal of Experimental Psychology: Learning, Memory, and Cognition, 14, 521–533.
Pentzold, C. (2009). Fixing the floating gap: The online encyclopaedia Wikipedia as a global memory place. Memory Studies, 2, 255–272.
Pezzo, M. V. (2003). Surprise, defense, or making sense: What removes the hindsight bias? Memory, 11, 421–441.
Pohl, R. F. (2017). Cognitive illusions: Intriguing phenomena in thinking, judgment, and memory. London: Routledge.
Pohl, R. F., Bender, M., & Lachmann, G. (2002). Hindsight bias around the world. Experimental Psychology, 49, 270–282.
Pohl, R. F., & Erdfelder, E. (2017). Hindsight bias. In R. F. Pohl (Ed.), Cognitive illusions: Intriguing phenomena in thinking, judgment, and memory (2nd ed., pp. 424–445). London: Routledge.
Pohl, R. F., & Hell, W. (1996). No reduction in hindsight bias after complete information and repeated testing. Organizational Behavior and Human Decision Processes, 67, 49–58.
Postmes, T., Spears, R., & Cihangir, S. (2001). Quality of decision making and group norms. Journal of Personality and Social Psychology, 80, 918–930.
Potthast, M., Stein, B., & Gerling, R. (2008). Automatic Vandalism Detection in Wikipedia. In C. Macdonald et al (Eds.), Advances in information retrieval. 30th European conference on IR research (ECIR 08), Lecture notes in computer science (vol. 4956, pp. 663–668). Berlin: Springer.
Powell, J. L. (1988). A test of the knew-it-all-along effect in the 1984 presidential statewide elections. Journal of Applied Social Psychology, 18, 760–773.
Rachlinski, J. J. (1998). A positive psychological theory of judging in hindsight. University of Chicago Law Review, 65, 571–625.
Robinson, M. D., Cassidy, D. M., Boyd, R. L., & Fetterman, A. K. (2015). The politics of time: conservatives differentially reference the past and liberals differentially reference the future. Journal of Applied Social Psychology, 45, 391–399.
Rodriguez, A. J., Holleran, Sh E, & Mehl, M. R. (2010). Reading between the lines: the lay assessment of sublinical depression from written self-descriptions. Journal of Personality, 78, 575–597.
Roese, N. J., & Olson, J. M. (1996). Counterfactuals, causal attributions, and the hindsight bias: A conceptual integration. Journal of Experimental Social Psychology, 32, 197–227.
Roese, N. J., & Vohs, K. D. (2012). Hindsight bias. Perspectives in Psychological Science, 7, 411–426.
Royal, C., & Kapila, D. (2009). What’s on Wikipedia, and what’s not…?: Assessing completeness of information. Social Science Computer Review, 27, 138–148.
Schkade, D. A., & Kilbourne, L. M. (1991). Expectation-outcome consistency and hindsight bias. Organizational Behavior and Human Decision Processes, 49, 105–123.
Schultheiss, O. C. (2013). Are implicit motives revealed in mere words? Testing the marker-word hypothesis with computer-based text analysis. Frontiers in Psychology, 4, 748.
Schulz-Hardt, S., Frey, D., Lüthgens, C., & Moscovici, S. (2000). Biased information search in group decision making. Journal of Personality and Social Psychology, 78, 655–669.
Schulz-Hardt, S., Jochims, M., & Frey, D. (2002). Productive conflict in group decision making: Genuine and contrived dissent as strategies to counteract biased information seeking. Organizational Behavior and Human Decision Processes, 88, 563–586.
Smith, A. C., & Greene, E. (2005). Conduct and its consequences: Attempts at debiasing jury judgments. Law and Human Behavior, 29, 505–526.
Stahlberg, D., Eller, F., Maass, A., & Frey, D. (1995). We knew it all along: Hindsight bias in groups. Organizational Behavior and Human Decision Processes, 63, 46–58.
Sterba, S. K. (2017). Partially nested designs in psychotherapy trials: A review of modeling developments. Psychotherapy Research. doi:10.1080/10503307.2015.1114688.
Tausczik, Y. R., & Pennebaker, J. W. (2010). The psychological meaning of words: LIWC and computerized text analysis methods. Journal of Language and Social Psychology, 29, 24–54.
Tesser, A. (1978). Self-generated attitude change. In L. Berkowitz (Ed.), Advances in experimental social psychology, 11 (pp. 289–338). New York: Academic Press.
The Express Tribune (2011). IAEA warned Japan over nuclear quake risk: Wikileaks. Published on March 17, 2011. Retrieved from http://www.telegraph.co.uk/news/worldnews/wikileaks/8384059/Japan-earthquake-Japan-warned-over-nuclear-plants-WikiLeaks-cables-show.html. Accessed 10 Apr 2017.
The Telegraph (2011). Japan earthquake: Japan warned over nuclear plants, WikiLeaks cables show. Published on March 15, 2011. Retrieved from http://tribune.com.pk/story/133824/iaea-warned-japan-over-nuclear-quake-risk/. Accessed 10 Apr 2017.
Verplanken, B., & Pieters, R. G. M. (1988). Individual differences in the reverse of hindsight bias: I never thought something like Chernobyl would happen. Did I? Journal of Behavioral Decision Making, 1, 131–147.
Viégas, F. B., Wattenberg, M., & Dave, K. (2004). Studying cooperation and conflict between authors with history flow visualizations. In Proceedings of the SIGCHI conference on human factors in computing systems. New York: ACM Press.
Viégas, F. B., Wattenberg, M., Kriss, J., & van Ham, F. (2007). Talk before you type: Coordination in Wikipedia. In Proceedings of the 40th annual Hawaii international conference on system sciences (HICSS’07). Washington, DC: IEEE.
Wilson, A. M., & Likens, G. E. (2015). Content volatility of scientific topics in Wikipedia: A cautionary tale. PloS One, 10(8), e0134454.
Yama, H., Manktelow, K. I., Mercier, H., van der Henst, J. B., Soo Do, K., Kawasaki, Y., et al. (2010). A cross-cultural study of hindsight bias and conditional probabilistic reasoning. Thinking & Reasoning, 16, 346–371.
Yopchik, J. E., & Kim, N. S. (2012). Hindsight bias and causal reasoning: A minimalist approach. Cognitive Processing, 13, 63–72.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Funding
This research was funded by the German Research Foundation (Grant Numbers OE 604/1-1 and NE 1485/5-1).
Conflict of interest
All authors declare that they have no conflicts of interest.
Ethical standards
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Rights and permissions
About this article
Cite this article
Oeberst, A., von der Beck, I., D. Back, M. et al. Biases in the production and reception of collective knowledge: the case of hindsight bias in Wikipedia. Psychological Research 82, 1010–1026 (2018). https://doi.org/10.1007/s00426-017-0865-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00426-017-0865-7