Biases in the production and reception of collective knowledge: the case of hindsight bias in Wikipedia
- 1.3k Downloads
The Web 2.0 enabled collaboration at an unprecedented level. In one of the flagships of mass collaboration—Wikipedia—a large number of authors socially negotiate the world’s largest compendium of knowledge. Several guidelines in Wikipedia restrict contributions to verifiable information from reliable sources to ensure recognized knowledge. Much psychological research demonstrates, however, that individual information processing is biased. This poses the question whether individual biases translate to Wikipedia articles or whether they are prevented by its guidelines. The present research makes use of hindsight bias to examine this question. To this end, we analyzed foresight and hindsight versions of Wikipedia articles regarding a broad variety of events (Study 1). We found the majority of articles not to contain traces of hindsight bias—contrary to prior individual research. However, for a particular category of events—disasters—we found robust evidence for hindsight bias. In a lab experiment (Study 2), we then examined whether individuals’ hindsight bias is translated into articles under controlled conditions and tested whether collaborative writing—as present in Wikipedia—affects the resultant bias (vs. individual writing). Finally, we investigated the impact of biased Wikipedia articles on readers (Study 3). As predicted, biased articles elicited a hindsight bias in readers, who had not known of the event previously. Moreover, biased articles also affected individuals who knew about the event already, and who had already developed a hindsight bias: biased articles further increased their hindsight.
Compliance with ethical standards
This research was funded by the German Research Foundation (Grant Numbers OE 604/1-1 and NE 1485/5-1).
Conflict of interest
All authors declare that they have no conflicts of interest.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants included in the study.
- Adler, B. T., Alfaro, L., de Mola-Velasco, S. M., Rosso, P., & West, A. G. (2011). Wikipedia vandalism detection: Combining natural language, metadata, and reputation features. In A. Gelbukh (Ed.), Computational linguistics and intelligent text processing (pp. 277–288). Berlin: Springer.CrossRefGoogle Scholar
- Barron, B., Martin, C. K., Mertl, V., & Yassine, M. (2016). Citizen science: Connecting to nature through networks. In U. Cress, J. Moskaliuk, & H. Jeong (Eds.), Mass collaboration and education. Cham: Springer International Publishing.Google Scholar
- Bellomi, F., & Bonato, R. (2005). Network analysis for Wikipedia. In Proceedings of the first international Wikimedia conference Wikimania. Retrieved from http://www.uvm.edu/~pdodds/files/papers/others/2009/bellomi2009a.pdf. Accessed 10 Apr 2017.
- Bukszar, E., & Conolly, T. (1988). Hindsight bias and strategic choice: Some problems in learning from experience. Academy of Management Journal, 31, 628–641.Google Scholar
- Ferron, M., & Massa, P. (2011). Collective memory building in Wikipedia: The case of North African uprisings. In Proceedings of the Wikisym. Retrieved from http://www.slideshare.net/phauly/collective-memory-building-in-wikipedia-the-case-of-north-african-uprisings. Accessed 10 Apr 2017.
- Fields, D. A., Kafai, Y. B., & Giang, M. T. (2016). Coding by choice: A transitional analysis of social participation patterns and programming contributions in the online Scratch community. In U. Cress, J. Moskaliuk, & H. Jeong (Eds.), Mass collaboration and education. Cham: Springer International Publishing. (in press).Google Scholar
- Fischer, I., & Budescu, D. V. (1995). Desirability and hindsight biases in predicting results of a multi-party election. In J.-P. Caverni, M. Bar-Hillel, F. H. Barron, & H. Jungermann (Eds.), Contributions to decision making (Vol. 1, pp. 193–211). Amsterdam: Elsevier.Google Scholar
- Fischhoff, B. (1975). Hindsight ≠ foresight: The effect of outcome knowledge on judgment under uncertainty. Journal of Experimental Psychology: Human Perception and Performance, 1, 288–299.Google Scholar
- Fischhoff, B. (1977). Perceived informativeness of facts. Journal of Experimental Psychology: Human Perception and Performance, 3, 349–358.Google Scholar
- Forte, A., & Bruckman, A. (2008). Scaling consensus: Increasing decentralization in Wikipedia governance. In Proceedings of the 41st annual Hawaii international conference on system sciences (HICSS’08). Washington, DC: IEEE.Google Scholar
- Hayes, J. R. (1989). Writing research: The analysis of a very complex task. In D. Klahr, Kotovsky, K. (Eds.), Complex information processing: The impact of Herbert A. Simon (pp. 209–234). Lawrence Erlbaum: Hillsdale, New Jersey.Google Scholar
- Hecht, B., & Gergle, D. (2009). Measuring self-focus bias in community-maintained knowledge repositories. In Proceedings of the 4th international conference on communities and technologies (pp. 11–20). New York: ACM.Google Scholar
- Hecht, B., & Gergle, D. (2010). The tower of Babel meets web 2.0: user-generated content and its applications in a multilingual context. In CHI ‘10 Proceedings of the SIGCHI conference on human factors in computing systems (pp. 291–300). New York: ACM.Google Scholar
- Keegan, B., Gergle, D., & Contractor, N. (2011). Hot off the wiki: Dynamics, practices, and structures in Wikipedia’s coverage of the Tōhoku catastrophes. In Proceedings of the 7th international symposium on wikis and open collaboration (WikiSym’11) (pp. 105–113). New York: ACM Press.Google Scholar
- Kittur, A., & Kraut, R. E. (2008). Harnessing the wisdom of crowds in Wikipedia: Quality through coordination. In Proceedings of the 2008 ACM conference on computer supported cooperative work (pp. 37–46). New York: ACM Press.Google Scholar
- Massa, P., & Scrinzi, F. (2012). Manypedia: Comparing language points of view of Wikipedia communities. In Proceedings of the 8th international symposium on wikis and open collaboration (WikiSym‘12), Linz, Austria. Retrieved from http://www.gnuband.org/files/papers/manypedia_006_wikisym_2012_cameraready.pdf. Accessed 10 Apr 2017.
- Merz, M. & Döring, N. (2010). Aktive Beteiligung an Wikipedia aus sozial-kognitiver Perspektive. [Active participation in Wikipedia from a social-cognitive perspective]. Retrieved from http://purl.org/merz/20100926. Accessed 27 Nov 2012.
- Nestler, S., Leckelt, M., Back, M. D., von der Beck, I., Cress, U., & Oeberst, A. (2017). Produktion von naturwissenschaftlichen Informationen im Internet am Beispiel von Wikipedia. Psychologische Rundschau.Google Scholar
- Oeberst, A., Cress, U., Back, M., & Nestler, S. (2016). Individual versus collaborative information processing: The case of biases in Wikipedia. In U. Cress, J. Moskaliuk, & H. Jeong (Eds.), Mass collaboration and education (pp. 165–185). Cham, Switzerland: Springer International Publishing.CrossRefGoogle Scholar
- Pennington, N., & Hastie, R. (1988). Explanation-based decision making: The effects of memory structure on judgment. Journal of Experimental Psychology: Learning, Memory, and Cognition, 14, 521–533.Google Scholar
- Pohl, R. F. (2017). Cognitive illusions: Intriguing phenomena in thinking, judgment, and memory. London: Routledge.Google Scholar
- Pohl, R. F., & Erdfelder, E. (2017). Hindsight bias. In R. F. Pohl (Ed.), Cognitive illusions: Intriguing phenomena in thinking, judgment, and memory (2nd ed., pp. 424–445). London: Routledge.Google Scholar
- Potthast, M., Stein, B., & Gerling, R. (2008). Automatic Vandalism Detection in Wikipedia. In C. Macdonald et al (Eds.), Advances in information retrieval. 30th European conference on IR research (ECIR 08), Lecture notes in computer science (vol. 4956, pp. 663–668). Berlin: Springer.Google Scholar
- Sterba, S. K. (2017). Partially nested designs in psychotherapy trials: A review of modeling developments. Psychotherapy Research. doi: 10.1080/10503307.2015.1114688.
- Tesser, A. (1978). Self-generated attitude change. In L. Berkowitz (Ed.), Advances in experimental social psychology, 11 (pp. 289–338). New York: Academic Press.Google Scholar
- The Express Tribune (2011). IAEA warned Japan over nuclear quake risk: Wikileaks. Published on March 17, 2011. Retrieved from http://www.telegraph.co.uk/news/worldnews/wikileaks/8384059/Japan-earthquake-Japan-warned-over-nuclear-plants-WikiLeaks-cables-show.html. Accessed 10 Apr 2017.
- The Telegraph (2011). Japan earthquake: Japan warned over nuclear plants, WikiLeaks cables show. Published on March 15, 2011. Retrieved from http://tribune.com.pk/story/133824/iaea-warned-japan-over-nuclear-quake-risk/. Accessed 10 Apr 2017.
- Viégas, F. B., Wattenberg, M., & Dave, K. (2004). Studying cooperation and conflict between authors with history flow visualizations. In Proceedings of the SIGCHI conference on human factors in computing systems. New York: ACM Press.Google Scholar
- Viégas, F. B., Wattenberg, M., Kriss, J., & van Ham, F. (2007). Talk before you type: Coordination in Wikipedia. In Proceedings of the 40th annual Hawaii international conference on system sciences (HICSS’07). Washington, DC: IEEE.Google Scholar