Advertisement

Psychological Research

, Volume 82, Issue 5, pp 1010–1026 | Cite as

Biases in the production and reception of collective knowledge: the case of hindsight bias in Wikipedia

  • Aileen Oeberst
  • Ina von der Beck
  • Mitja D. Back
  • Ulrike Cress
  • Steffen Nestler
Original Article

Abstract

The Web 2.0 enabled collaboration at an unprecedented level. In one of the flagships of mass collaboration—Wikipedia—a large number of authors socially negotiate the world’s largest compendium of knowledge. Several guidelines in Wikipedia restrict contributions to verifiable information from reliable sources to ensure recognized knowledge. Much psychological research demonstrates, however, that individual information processing is biased. This poses the question whether individual biases translate to Wikipedia articles or whether they are prevented by its guidelines. The present research makes use of hindsight bias to examine this question. To this end, we analyzed foresight and hindsight versions of Wikipedia articles regarding a broad variety of events (Study 1). We found the majority of articles not to contain traces of hindsight bias—contrary to prior individual research. However, for a particular category of events—disasters—we found robust evidence for hindsight bias. In a lab experiment (Study 2), we then examined whether individuals’ hindsight bias is translated into articles under controlled conditions and tested whether collaborative writing—as present in Wikipedia—affects the resultant bias (vs. individual writing). Finally, we investigated the impact of biased Wikipedia articles on readers (Study 3). As predicted, biased articles elicited a hindsight bias in readers, who had not known of the event previously. Moreover, biased articles also affected individuals who knew about the event already, and who had already developed a hindsight bias: biased articles further increased their hindsight.

Notes

Compliance with ethical standards

Funding

This research was funded by the German Research Foundation (Grant Numbers OE 604/1-1 and NE 1485/5-1).

Conflict of interest

All authors declare that they have no conflicts of interest.

Ethical standards

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed consent

Informed consent was obtained from all individual participants included in the study.

References

  1. Adler, B. T., Alfaro, L., de Mola-Velasco, S. M., Rosso, P., & West, A. G. (2011). Wikipedia vandalism detection: Combining natural language, metadata, and reputation features. In A. Gelbukh (Ed.), Computational linguistics and intelligent text processing (pp. 277–288). Berlin: Springer.CrossRefGoogle Scholar
  2. Ash, I. K. (2009). Surprise, memory, and retrospective judgment making: Testing cognitive reconstruction theories of the hindsight bias effect. Journal of Experimental Psychology. Learning, Memory, and Cognition, 35, 916–933.CrossRefPubMedGoogle Scholar
  3. Barron, B., Martin, C. K., Mertl, V., & Yassine, M. (2016). Citizen science: Connecting to nature through networks. In U. Cress, J. Moskaliuk, & H. Jeong (Eds.), Mass collaboration and education. Cham: Springer International Publishing.Google Scholar
  4. Bauer, D. J., Sterba, S. K., & Hallfors, D. D. (2008). Evaluating group-based interventions when control participants are ungrouped. Multivariate Behavioral Research, 43, 210–236.CrossRefPubMedPubMedCentralGoogle Scholar
  5. Bellomi, F., & Bonato, R. (2005). Network analysis for Wikipedia. In Proceedings of the first international Wikimedia conference Wikimania. Retrieved from http://www.uvm.edu/~pdodds/files/papers/others/2009/bellomi2009a.pdf. Accessed 10 Apr 2017.
  6. Blank, H., Fischer, V., & Erdfelder, E. (2003). Hindsight bias in political elections. Memory, 11, 491–504.CrossRefPubMedGoogle Scholar
  7. Blank, H., & Nestler, S. (2006). Perceiving events as both inevitable and unforeseeable in hindsight: The Leipzig candidacy for the Olympics. British Journal of Social Psychology, 45, 149–160.CrossRefPubMedGoogle Scholar
  8. Blank, H., & Nestler, S. (2007). Cognitive process models of hindsight bias. Social Cognition, 25, 132–146.CrossRefGoogle Scholar
  9. Blank, H., Nestler, S., von Collani, G., & Fischer, V. (2008). How many hindsight biases are there? Cognition, 106, 1408–1440.CrossRefPubMedGoogle Scholar
  10. Bukszar, E., & Conolly, T. (1988). Hindsight bias and strategic choice: Some problems in learning from experience. Academy of Management Journal, 31, 628–641.Google Scholar
  11. Callahan, E. S., & Herring, S. C. (2011). Cultural bias in Wikipedia content on famous persons. Journal of the American Society for Information Science and Technology, 62, 1899–1915.CrossRefGoogle Scholar
  12. Carli, L. L. (1999). Cognitive reconstruction, hindsight, and reactions to victims and perpetrators. Personality and Social Psychology Bulletin, 25, 966–979.CrossRefGoogle Scholar
  13. Chen, S., Shechter, D., & Chaiken, S. (1996). Getting at the truth or getting along: accuracy- versus impression-motivated heuristic and systematic processing. Journal of Personality and Social Psychology, 71, 262–275.CrossRefGoogle Scholar
  14. Choi, I., Koo, M., & Choi, J. A. (2007). Individual differences in analytic versus holistic thinking. Personality and Social Psychology Bulletin, 33, 691–705.CrossRefPubMedGoogle Scholar
  15. Christensen-Szalanski, J. J. J., & Willham, C. F. (1991). The hindsight bias: A meta-analysis. Organizational Behavior and Human Decision Processes, 48, 147–168.CrossRefGoogle Scholar
  16. Cress, U., Jeong, H., & Moskaliuk, J. (2016). Mass collaboration as an emerging paradigm for education? Theories, cases, and research methods. In U. Cress, J. Moskaliuk, & H. Jeong (Eds.), Mass collaboration and education. Cham: Springer International Publishing.CrossRefGoogle Scholar
  17. Cress, U., & Kimmerle, J. (2008). A systemic and cognitive view on collaborative knowledge building with wikis. International Journal of Computer-Supported Collaborative Learning, 3, 105–122.CrossRefGoogle Scholar
  18. Fallis, D. (2008). Toward an epistemology of Wikipedia. Journal of the American Society for Information Science and Technology, 59, 1662–1674.CrossRefGoogle Scholar
  19. Ferron, M., & Massa, P. (2011). Collective memory building in Wikipedia: The case of North African uprisings. In Proceedings of the Wikisym. Retrieved from http://www.slideshare.net/phauly/collective-memory-building-in-wikipedia-the-case-of-north-african-uprisings. Accessed 10 Apr 2017.
  20. Fields, D. A., Kafai, Y. B., & Giang, M. T. (2016). Coding by choice: A transitional analysis of social participation patterns and programming contributions in the online Scratch community. In U. Cress, J. Moskaliuk, & H. Jeong (Eds.), Mass collaboration and education. Cham: Springer International Publishing. (in press).Google Scholar
  21. Fischer, I., & Budescu, D. V. (1995). Desirability and hindsight biases in predicting results of a multi-party election. In J.-P. Caverni, M. Bar-Hillel, F. H. Barron, & H. Jungermann (Eds.), Contributions to decision making (Vol. 1, pp. 193–211). Amsterdam: Elsevier.Google Scholar
  22. Fischhoff, B. (1975). Hindsight ≠ foresight: The effect of outcome knowledge on judgment under uncertainty. Journal of Experimental Psychology: Human Perception and Performance, 1, 288–299.Google Scholar
  23. Fischhoff, B. (1977). Perceived informativeness of facts. Journal of Experimental Psychology: Human Perception and Performance, 3, 349–358.Google Scholar
  24. Forte, A., & Bruckman, A. (2008). Scaling consensus: Increasing decentralization in Wikipedia governance. In Proceedings of the 41st annual Hawaii international conference on system sciences (HICSS’08). Washington, DC: IEEE.Google Scholar
  25. Giles, J. (2005). Internet encyclopaedias go head to head. Nature, 438, 900–901.CrossRefPubMedGoogle Scholar
  26. Gowers, T., & Nielsen, M. (2009). Massively collaborative mathematics. Nature, 461, 879.CrossRefPubMedGoogle Scholar
  27. Guilbault, R. L., Bryant, F. B., Brockway, J. H., & Posavac, E. J. (2004). A meta-analysis of research on hindsight bias. Basic and Applied Social Psychology, 26, 103–117.CrossRefGoogle Scholar
  28. Hayes, J. R. (1989). Writing research: The analysis of a very complex task. In D. Klahr, Kotovsky, K. (Eds.), Complex information processing: The impact of Herbert A. Simon (pp. 209–234). Lawrence Erlbaum: Hillsdale, New Jersey.Google Scholar
  29. Harley, E. M. (2007). Hindsight bias in legal decision making. Social Cognition, 25, 48–63.CrossRefGoogle Scholar
  30. Hastie, R., Schkade, D. A., & Payne, J. W. (1999). Juror judgments in civil cases: Hindsight effects on judgments of liability for punitive damages. Law and Human Behavior, 23, 597–614.CrossRefGoogle Scholar
  31. Hawkins, S. A., & Hastie, R. (1990). Hindsight: Biased judgment of past events after the outcomes are known. Psychological Bulletin, 107, 311–327.CrossRefGoogle Scholar
  32. Hecht, B., & Gergle, D. (2009). Measuring self-focus bias in community-maintained knowledge repositories. In Proceedings of the 4th international conference on communities and technologies (pp. 11–20). New York: ACM.Google Scholar
  33. Hecht, B., & Gergle, D. (2010). The tower of Babel meets web 2.0: user-generated content and its applications in a multilingual context. In CHI ‘10 Proceedings of the SIGCHI conference on human factors in computing systems (pp. 291–300). New York: ACM.Google Scholar
  34. Isenberg, D. J. (1986). Group polarization: a critical review and meta-analysis. Journal of Personality and Social Psychology, 50, 1141–1151.CrossRefGoogle Scholar
  35. Jennings, M. M., Lowe, D. J., & Reckers, P. M. J. (1998). Causality as an influence on hindsight bias: An empirical examination of judges’ evaluation of professional audit judgment. Journal of Accounting and Public Policy, 17, 143–167.CrossRefGoogle Scholar
  36. Keegan, B., Gergle, D., & Contractor, N. (2011). Hot off the wiki: Dynamics, practices, and structures in Wikipedia’s coverage of the Tōhoku catastrophes. In Proceedings of the 7th international symposium on wikis and open collaboration (WikiSym’11) (pp. 105–113). New York: ACM Press.Google Scholar
  37. Kittur, A., & Kraut, R. E. (2008). Harnessing the wisdom of crowds in Wikipedia: Quality through coordination. In Proceedings of the 2008 ACM conference on computer supported cooperative work (pp. 37–46). New York: ACM Press.Google Scholar
  38. Küfner, A. C. P., Nestler, S., Back, M. D., & Egloff, B. (2010). Tell me a story and I will tell you who you are! Lens model analyses of personality and creative writing. Journal of Research in Personality, 44, 427–435.CrossRefGoogle Scholar
  39. Kunda, Z. (1990). The case for motivated reasoning. Psychological Bulletin, 108, 480–498.CrossRefPubMedGoogle Scholar
  40. LaBine, S. J., & LaBine, G. (1996). Determinations of negligence and the hindsight bias. Law and Human Behavior, 20, 501–516.CrossRefGoogle Scholar
  41. Leary, M. R. (1982). Hindsight distortion and the 1980 presidential election. Personality and Social Psychology Bulletin, 8, 257–263.CrossRefGoogle Scholar
  42. Louie, T. A. (2005). Hindsight bias and outcome-consistent thoughts when observing and making service provider decisions. Organizational Behavior and Human Decision Processes, 98, 88–95.CrossRefGoogle Scholar
  43. Magnus, P. D. (2009). On trusting Wikipedia. Episteme, 6, 74–90.CrossRefGoogle Scholar
  44. Mark, M. M., & Mellor, S. (1991). Effect of self-relevance of an event on hindsight bias: The foreseeability of a layoff. Journal of Applied Psychology, 76, 569–577.CrossRefGoogle Scholar
  45. Massa, P., & Scrinzi, F. (2012). Manypedia: Comparing language points of view of Wikipedia communities. In Proceedings of the 8th international symposium on wikis and open collaboration (WikiSym‘12), Linz, Austria. Retrieved from http://www.gnuband.org/files/papers/manypedia_006_wikisym_2012_cameraready.pdf. Accessed 10 Apr 2017.
  46. McNamara, D. S., & Kintsch, W. (1996). Learning from one text: Effects of prior knowledge and text coherence. Discourse Processes, 22, 247–287.CrossRefGoogle Scholar
  47. McNamara, D. S., Kintsch, E., Songer, N. B., & Kintsch, W. (1996). Are good texts always better? Text coherence, background knowledge, and levels of understanding in learning from text. Cognition and Instruction, 14, 1–43.CrossRefGoogle Scholar
  48. Merz, M. & Döring, N. (2010). Aktive Beteiligung an Wikipedia aus sozial-kognitiver Perspektive. [Active participation in Wikipedia from a social-cognitive perspective]. Retrieved from http://purl.org/merz/20100926. Accessed 27 Nov 2012.
  49. Musch, J. (2003). Personality differences in hindsight bias. Memory, 11, 473–489.CrossRefPubMedGoogle Scholar
  50. Nestler, S., Blank, H., & Egloff, B. (2010). Hindsight ≠ hindsight: Experimentally induced dissociations between hindsight components. Journal of Experimental Psychology. Learning, Memory, and Cognition, 36, 1399–1413.CrossRefPubMedGoogle Scholar
  51. Nestler, S., Blank, H., & von Collani, G. (2008). Hindsight bias doesn’t always come easy: Causal models, cognitive effort and creeping determinism. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, 1043–1054.PubMedGoogle Scholar
  52. Nestler, S., & Egloff, B. (2009). Increased or reversed? The effect of surprise on hindsight bias depends on the hindsight component. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35, 1539–1544.PubMedGoogle Scholar
  53. Nestler, S., Leckelt, M., Back, M. D., von der Beck, I., Cress, U., & Oeberst, A. (2017). Produktion von naturwissenschaftlichen Informationen im Internet am Beispiel von Wikipedia. Psychologische Rundschau.Google Scholar
  54. Oeberst, A., Halatchliyski, I., Kimmerle, J., & Cress, U. (2014a). Knowledge construction in Wikipedia: A systemic-constructivist analysis. Journal of the Learning Sciences, 23, 149–176.CrossRefGoogle Scholar
  55. Oeberst, A., von der Beck, I., & Nestler, S. (2014b). Reading about explanations enhances perceptions of inevitability and foreseeability. A cross-cultural study with Wikipedia articles. Cognitive Processing, 15, 343–349.CrossRefPubMedGoogle Scholar
  56. Oeberst, A., Cress, U., Back, M., & Nestler, S. (2016). Individual versus collaborative information processing: The case of biases in Wikipedia. In U. Cress, J. Moskaliuk, & H. Jeong (Eds.), Mass collaboration and education (pp. 165–185). Cham, Switzerland: Springer International Publishing.CrossRefGoogle Scholar
  57. Olick, J. K. (1999). Collective memory: The two cultures. Sociological Theory, 7, 333–348.CrossRefGoogle Scholar
  58. Pennington, N., & Hastie, R. (1988). Explanation-based decision making: The effects of memory structure on judgment. Journal of Experimental Psychology: Learning, Memory, and Cognition, 14, 521–533.Google Scholar
  59. Pentzold, C. (2009). Fixing the floating gap: The online encyclopaedia Wikipedia as a global memory place. Memory Studies, 2, 255–272.CrossRefGoogle Scholar
  60. Pezzo, M. V. (2003). Surprise, defense, or making sense: What removes the hindsight bias? Memory, 11, 421–441.CrossRefPubMedGoogle Scholar
  61. Pohl, R. F. (2017). Cognitive illusions: Intriguing phenomena in thinking, judgment, and memory. London: Routledge.Google Scholar
  62. Pohl, R. F., Bender, M., & Lachmann, G. (2002). Hindsight bias around the world. Experimental Psychology, 49, 270–282.CrossRefPubMedGoogle Scholar
  63. Pohl, R. F., & Erdfelder, E. (2017). Hindsight bias. In R. F. Pohl (Ed.), Cognitive illusions: Intriguing phenomena in thinking, judgment, and memory (2nd ed., pp. 424–445). London: Routledge.Google Scholar
  64. Pohl, R. F., & Hell, W. (1996). No reduction in hindsight bias after complete information and repeated testing. Organizational Behavior and Human Decision Processes, 67, 49–58.CrossRefGoogle Scholar
  65. Postmes, T., Spears, R., & Cihangir, S. (2001). Quality of decision making and group norms. Journal of Personality and Social Psychology, 80, 918–930.CrossRefPubMedGoogle Scholar
  66. Potthast, M., Stein, B., & Gerling, R. (2008). Automatic Vandalism Detection in Wikipedia. In C. Macdonald et al (Eds.), Advances in information retrieval. 30th European conference on IR research (ECIR 08), Lecture notes in computer science (vol. 4956, pp. 663–668). Berlin: Springer.Google Scholar
  67. Powell, J. L. (1988). A test of the knew-it-all-along effect in the 1984 presidential statewide elections. Journal of Applied Social Psychology, 18, 760–773.CrossRefGoogle Scholar
  68. Rachlinski, J. J. (1998). A positive psychological theory of judging in hindsight. University of Chicago Law Review, 65, 571–625.CrossRefGoogle Scholar
  69. Robinson, M. D., Cassidy, D. M., Boyd, R. L., & Fetterman, A. K. (2015). The politics of time: conservatives differentially reference the past and liberals differentially reference the future. Journal of Applied Social Psychology, 45, 391–399.CrossRefGoogle Scholar
  70. Rodriguez, A. J., Holleran, Sh E, & Mehl, M. R. (2010). Reading between the lines: the lay assessment of sublinical depression from written self-descriptions. Journal of Personality, 78, 575–597.CrossRefPubMedGoogle Scholar
  71. Roese, N. J., & Olson, J. M. (1996). Counterfactuals, causal attributions, and the hindsight bias: A conceptual integration. Journal of Experimental Social Psychology, 32, 197–227.CrossRefGoogle Scholar
  72. Roese, N. J., & Vohs, K. D. (2012). Hindsight bias. Perspectives in Psychological Science, 7, 411–426.CrossRefGoogle Scholar
  73. Royal, C., & Kapila, D. (2009). What’s on Wikipedia, and what’s not…?: Assessing completeness of information. Social Science Computer Review, 27, 138–148.CrossRefGoogle Scholar
  74. Schkade, D. A., & Kilbourne, L. M. (1991). Expectation-outcome consistency and hindsight bias. Organizational Behavior and Human Decision Processes, 49, 105–123.CrossRefGoogle Scholar
  75. Schultheiss, O. C. (2013). Are implicit motives revealed in mere words? Testing the marker-word hypothesis with computer-based text analysis. Frontiers in Psychology, 4, 748.PubMedPubMedCentralGoogle Scholar
  76. Schulz-Hardt, S., Frey, D., Lüthgens, C., & Moscovici, S. (2000). Biased information search in group decision making. Journal of Personality and Social Psychology, 78, 655–669.CrossRefPubMedGoogle Scholar
  77. Schulz-Hardt, S., Jochims, M., & Frey, D. (2002). Productive conflict in group decision making: Genuine and contrived dissent as strategies to counteract biased information seeking. Organizational Behavior and Human Decision Processes, 88, 563–586.CrossRefGoogle Scholar
  78. Smith, A. C., & Greene, E. (2005). Conduct and its consequences: Attempts at debiasing jury judgments. Law and Human Behavior, 29, 505–526.CrossRefPubMedGoogle Scholar
  79. Stahlberg, D., Eller, F., Maass, A., & Frey, D. (1995). We knew it all along: Hindsight bias in groups. Organizational Behavior and Human Decision Processes, 63, 46–58.CrossRefGoogle Scholar
  80. Sterba, S. K. (2017). Partially nested designs in psychotherapy trials: A review of modeling developments. Psychotherapy Research. doi: 10.1080/10503307.2015.1114688.
  81. Tausczik, Y. R., & Pennebaker, J. W. (2010). The psychological meaning of words: LIWC and computerized text analysis methods. Journal of Language and Social Psychology, 29, 24–54.CrossRefGoogle Scholar
  82. Tesser, A. (1978). Self-generated attitude change. In L. Berkowitz (Ed.), Advances in experimental social psychology, 11 (pp. 289–338). New York: Academic Press.Google Scholar
  83. The Express Tribune (2011). IAEA warned Japan over nuclear quake risk: Wikileaks. Published on March 17, 2011. Retrieved from http://www.telegraph.co.uk/news/worldnews/wikileaks/8384059/Japan-earthquake-Japan-warned-over-nuclear-plants-WikiLeaks-cables-show.html. Accessed 10 Apr 2017.
  84. The Telegraph (2011). Japan earthquake: Japan warned over nuclear plants, WikiLeaks cables show. Published on March 15, 2011. Retrieved from http://tribune.com.pk/story/133824/iaea-warned-japan-over-nuclear-quake-risk/. Accessed 10 Apr 2017.
  85. Verplanken, B., & Pieters, R. G. M. (1988). Individual differences in the reverse of hindsight bias: I never thought something like Chernobyl would happen. Did I? Journal of Behavioral Decision Making, 1, 131–147.CrossRefGoogle Scholar
  86. Viégas, F. B., Wattenberg, M., & Dave, K. (2004). Studying cooperation and conflict between authors with history flow visualizations. In Proceedings of the SIGCHI conference on human factors in computing systems. New York: ACM Press.Google Scholar
  87. Viégas, F. B., Wattenberg, M., Kriss, J., & van Ham, F. (2007). Talk before you type: Coordination in Wikipedia. In Proceedings of the 40th annual Hawaii international conference on system sciences (HICSS’07). Washington, DC: IEEE.Google Scholar
  88. Wilson, A. M., & Likens, G. E. (2015). Content volatility of scientific topics in Wikipedia: A cautionary tale. PloS One, 10(8), e0134454.CrossRefPubMedPubMedCentralGoogle Scholar
  89. Yama, H., Manktelow, K. I., Mercier, H., van der Henst, J. B., Soo Do, K., Kawasaki, Y., et al. (2010). A cross-cultural study of hindsight bias and conditional probabilistic reasoning. Thinking & Reasoning, 16, 346–371.CrossRefGoogle Scholar
  90. Yopchik, J. E., & Kim, N. S. (2012). Hindsight bias and causal reasoning: A minimalist approach. Cognitive Processing, 13, 63–72.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2017

Authors and Affiliations

  • Aileen Oeberst
    • 1
    • 2
  • Ina von der Beck
    • 2
  • Mitja D. Back
    • 3
  • Ulrike Cress
    • 2
  • Steffen Nestler
    • 4
  1. 1.University of MainzMainzGermany
  2. 2.Leibniz-Institut für WissensmedienTübingenGermany
  3. 3.University of MünsterMünsterGermany
  4. 4.University of LeipzigLeipzigGermany

Personalised recommendations