Advertisement

Team diversity, polarization, and productivity in online peer production

  • Jürgen LernerEmail author
  • Alessandro Lomi
Original Article
  • 154 Downloads

Abstract

We define network-based indicators to characterize diversity of Wikipedia teams and contributing users. A team of Wikipedia users is diverse to the extent that its members edit different articles. An individual user has diverse interests to the extent that she contributes to articles that are not normally co-edited by the same users, i. e., if she contributes to an atypical combination of articles. For both indicators, we propose a model-based normalization by comparing observed and expected values computed on a reference random graph model that preserves expected degrees of users and articles. Using data on all articles of the English-language edition of Wikipedia, we show that diverse teams tend to produce high-quality (or “featured”) articles. In contrast, teams of users that individually have diverse interests tend to produce articles of lower quality. These findings are robust with respect to several alternative explanations for article quality. We also show that the proposed model-based normalization of network indicators outperforms an ad hoc normalization via more conventional cosine similarity measures. Finally, we analyze the interplay between team diversity and polarization sustained by adherence to behavioral norms predicted by balance theory. Results suggest that diversity can mitigate the—otherwise negative—effect of polarization on team productivity.

Keywords

Online peer production Team diversity Team productivity Polarization Balance theory Wikipedia Relational event models 

Notes

Acknowledgements

This work has been supported by Deutsche Forschungsgemeinschaft (DFG Grant Nr. LE 2237/2-1) and Swiss National Science Foundation (FNS Project Nr. 100018_150126 and 100018_165764/1).

References

  1. Adler BT, de Alfaro L (2007) A content-driven reputation system for the Wikipedia. In: Proceedings of the 16th international conference on WWW. ACM, pp 261–270Google Scholar
  2. Akerlof GA, Dickens WT (1982) The economic consequences of cognitive dissonance. Am Econ Rev 72(3):307–319Google Scholar
  3. Ancona DG, Caldwell DF (1992) Demography and design: predictors of new product team performance. Organ. Sci. 3(3):321–341CrossRefGoogle Scholar
  4. Arazy O, Nov O, Patterson R, Yeo L (2011) Information quality in Wikipedia: the effects of group composition and task conflict. J. Manag. Inf. Syst. 27(4):71–98CrossRefGoogle Scholar
  5. Arazy O, Morgan W, Patterson R (2006) Wisdom of the crowds: decentralized knowledge construction in Wikipedia. In: Proceedings of the 16th workshop information technologies and systems, pp 79–84Google Scholar
  6. Baraniak K, Sydow M, Szejda J, Czerniawska D (2016) Studying the role of diversity in open collaboration network: experiments on Wikipedia. In: International conference and school on network science. Springer, pp 97–110Google Scholar
  7. Barbosa S, Cosley D, Sharma A, Cesar Jr RM (2016) Averaging gone wrong: using time-aware analyses to better understand behavior. In: Proceedings of the 25th international conference on WWW. ACM, pp 829–841Google Scholar
  8. Blumenstock JE (2008) Size matters: word count as a measure of quality on Wikipedia. In: Proceedings of the 17th international conference on WWW. ACM, pp 1095–1096Google Scholar
  9. Blyth CR (1972) On Simpson’s paradox and the sure-thing principle. J Am Stat Assoc 67(338):364–366MathSciNetCrossRefGoogle Scholar
  10. Borgan Ø, Goldstein L, Langholz B (1995) Methods for the analysis of sampled cohort data in the Cox proportional hazards model. Ann Stat 23:1749–1778MathSciNetCrossRefGoogle Scholar
  11. Brandes U, Kenis P, Lerner J, van Raaij D (2009) Network analysis of collaboration structure in Wikipedia. In: Proceedings of the 18th international conference on WWW. ACM, pp 731–740Google Scholar
  12. Bromham L, Dinnage R, Hua X (2016) Interdisciplinary research has consistently lower funding success. Nature 534(7609):684CrossRefGoogle Scholar
  13. Caldarelli G, Capocci A, De Los Rios P, Munoz MA (2002) Scale-free networks from varying vertex intrinsic fitness. Phys. Rev. Lett. 89(25):258702CrossRefGoogle Scholar
  14. Carroll RJ, Pederson S (1993) On robustness in the logistic regression model. J R Stat Soc Ser B (Methodol) 55:693–706MathSciNetzbMATHGoogle Scholar
  15. Cartwright D, Harary F (1956) Structural balance: a generalization of Heider’s theory. Psychol Rev 63(5):277–293CrossRefGoogle Scholar
  16. Conaldi G, Lomi A (2013) The dual network structure of organizational problem solving: a case study on open source software development. Soc Netw 35(2):237–250CrossRefGoogle Scholar
  17. De Masi G, Iori G, Caldarelli G (2006) Fitness model for the Italian interbank money market. Phys Rev E 74(6):066112CrossRefGoogle Scholar
  18. Esteban JM, Ray D (1994) On the measurement of polarization. Econometrica 62(4):819–851CrossRefGoogle Scholar
  19. Festinger L (1962) A theory of cognitive dissonance, vol 2. Stanford University Press, StanfordGoogle Scholar
  20. Flöck F, Acosta M (2014) Wikiwho: precise and efficient attribution of authorship of revisioned content. In: Proceedings of the 23rd international conference on WWW. ACM, pp 843–854Google Scholar
  21. Flöck F, Vrandečić D, Simperl E (2011) Towards a diversity-minded Wikipedia. In: Proceedings of the 3rd international web science conference. ACM, p 5Google Scholar
  22. Franzoni C, Sauermann H (2014) Crowd science: the organization of scientific research in open collaborative projects. Res Policy 43(1):1–20CrossRefGoogle Scholar
  23. Friedkin NE, Proskurnikov AV, Tempo R, Parsegov SE (2016) Network science on belief system dynamics under logic constraints. Science 354(6310):321–326MathSciNetCrossRefGoogle Scholar
  24. Goldberg A, Hannan MT, Kovács B (2016) What does it mean to span cultural boundaries? Variety and atypicality in cultural consumption. Am Sociol Rev 81(2):215–241CrossRefGoogle Scholar
  25. Heider F (1946) Attitudes and cognitive organization. J Psychol 21:107–112CrossRefGoogle Scholar
  26. Hong L, Page SE (2004) Groups of diverse problem solvers can outperform groups of high-ability problem solvers. Proc Natl Acad Sci USA 101(46):16385–16389CrossRefGoogle Scholar
  27. Horwitz SK, Horwitz IB (2007) The effects of team diversity on team outcomes: a meta-analytic review of team demography. J Manag 33(6):987–1015Google Scholar
  28. Hsu G (2006) Jacks of all trades and masters of none: audiences’ reactions to spanning genres in feature film production. Adm Sci Q 51(3):420–450CrossRefGoogle Scholar
  29. Javanmardi S, Lopes C, Baldi P (2010) Modeling user reputation in wikis. Stat Anal Data Min 3(2):126–139MathSciNetGoogle Scholar
  30. Jehn KA, Northcraft GB, Neale MA (1999) Why differences make a difference: a field study of diversity, conflict and performance in workgroups. Adm Sci Q 44(4):741–763CrossRefGoogle Scholar
  31. Joshi A, Roh H (2009) The role of context in work team diversity research: a meta-analytic review. Acad Manag J 52(3):599–627CrossRefGoogle Scholar
  32. Kittur A, Chi EH, Suh B (2009) What’s in Wikipedia? Mapping topics and conflict using socially annotated category structure. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, pp 1509–1512Google Scholar
  33. Kittur A, Chi E, Pendleton BA, Suh B, Mytkowicz T (2007) Power of the few vs. wisdom of the crowd: Wikipedia and the rise of the bourgeoisie. In: Proceedings of the 25th annual ACM conference on human factors in computing systems. ACMGoogle Scholar
  34. Kittur A, Kraut RE (2008) Harnessing the wisdom of crowds in Wikipedia: quality through coordination. In: Proceedings of the 2008 ACM conference on computer supported cooperative work. ACM, New York, pp 37–46Google Scholar
  35. Kovács B, Hannan MT (2010) The consequences of category spanning depend on contrast. In: Hsu G, Kocak O, Negro G (eds) Categories in markets: origins and evolution. Emerald Group Publishing Limited, Bingley, pp 175–201CrossRefGoogle Scholar
  36. Lam SK, Karim J, Riedl J (2010) The effects of group composition on decision quality in a social production community. In: Proceedings of the 16th ACM international conference on Supporting group work. ACM, pp 55–64Google Scholar
  37. Lee GK, Cole RE (2003) From a firm-based to a community-based model of knowledge creation: the case of the linux kernel development. Organ Sci 14(6):633–649CrossRefGoogle Scholar
  38. Lerner J, Lomi A (2017) The third man: Hierarchy formation in Wikipedia. Appl Netw Sci 2(1):24CrossRefGoogle Scholar
  39. Lerner J, Lomi A (2018b) The free encyclopedia that anyone can dispute: an analysis of the micro-structural dynamics of positive and negative relations in the production of contentious Wikipedia articles. Soc Netw.  https://doi.org/10.1016/j.socnet.2018.12.003 CrossRefGoogle Scholar
  40. Lerner J, Lomi A (2018c) Knowledge categorization affects popularity and quality of Wikipedia articles. PloS ONE 13(1):e0190674CrossRefGoogle Scholar
  41. Lerner J, Tirole J (2001) The open source movement: key research questions. Eur Econ Rev 45(4):819–826CrossRefGoogle Scholar
  42. Lerner J, Lomi A (2018a) Diverse teams tend to do good work in Wikipedia (but jacks of all trades don’t). In: Proceedings of the 2018 international conference on advances in social network analysis and mining (ASONAM 2018). IEEE Computer Society, pp 214–221Google Scholar
  43. Lerner J, Lomi A (2019) The network structure of successful collaboration in Wikipedia. In: Proceedings of the 52nd Hawaii international conference on system sciences (HICSS 2019). IEEE Computer Society, pp 2622–2631Google Scholar
  44. Liu J, Ram S (2011) Who does what: collaboration patterns in the Wikipedia and their impact on article quality. ACM Trans Manag Inf Syst (TMIS) 2(2):11Google Scholar
  45. Lord CG, Ross L, Lepper MR (1979) Biased assimilation and attitude polarization: the effects of prior theories on subsequently considered evidence. J Personal Soc Psychol 37(11):2098CrossRefGoogle Scholar
  46. Maniu S, Cautis B, Abdessalem T (2011) Building a signed network from interactions in Wikipedia. In: Proceedings of the databases and social networks. ACM, pp 19–24Google Scholar
  47. Mannix E, Neale MA (2005) What differences make a difference? The promise and reality of diverse teams in organizations. Psychol Sci Pub Interest 6(2):31–55CrossRefGoogle Scholar
  48. McPherson JM, Ranger-Moore JR (1991) Evolution on a dancing landscape: organizations and networks in dynamic blau space. Soc Forces 70(1):19–42CrossRefGoogle Scholar
  49. Phillips DJ, Turco CJ, Zuckerman EW (2013) Betrayal as market barrier: identity-based limits to diversification among high-status corporate law firms. Am J Sociol 118(4):1023–1054CrossRefGoogle Scholar
  50. Ransbotham S, Kane GC (2011) Membership turnover and collaboration success in online communities: explaining rises and falls from grace in Wikipedia. MIS Q 35(3):613–627CrossRefGoogle Scholar
  51. Ren Y, Chen J, Riedl J (2015) The impact and evolution of group diversity in online open collaboration. Manag Sci 62(6):1668–1686CrossRefGoogle Scholar
  52. Robert LP, Romero DM (2017) The influence of diversity and experience on the effects of crowd size. J Assoc Inf Sci Technol 68(2):321–332CrossRefGoogle Scholar
  53. Saperstein AM (2004) ’The enemy of my enemy is my friend’ is the enemy: dealing with the war-provoking rules of intent. Confl Manag Peace Sci 21(4):287–296CrossRefGoogle Scholar
  54. Shi F, Teplitskiy M, Duede E, Evans J (2017) The wisdom of polarized crowds. arXiv:1712.06414
  55. Simpson EH (1951) The interpretation of interaction in contingency tables. J R Stat Soc Ser B (Methodolog) 13:238–241MathSciNetzbMATHGoogle Scholar
  56. Sydow M, Baraniak K, Teisseyre P (2017) Diversity of editors and teams versus quality of cooperative work: experiments on Wikipedia. J Intell Inf Syst 48(3):601–632CrossRefGoogle Scholar
  57. Szejda J, Sydow M, Czerniawska D (2014) Does a ’renaissance man’ create good Wikipedia articles? In: Proceedings of the international conference on knowledge discovery and information retrieval (KDIR-2014), pp 425–430Google Scholar
  58. Tsvetkova M, García-Gavilanes R, Floridi L, Yasseri T (2017) Even good bots fight: the case of Wikipedia. PloS ONE 12(2):e0171774CrossRefGoogle Scholar
  59. Uzzi B, Mukherjee S, Stringer M, Jones B (2013) Atypical combinations and scientific impact. Science 342(6157):468–472CrossRefGoogle Scholar
  60. von Hippel E, von Krogh G (2003) Open source software and the “private-collective” innovation model: issues for organization science. Organ Sci 14(2):209–223CrossRefGoogle Scholar
  61. von Hippel E, von Krogh G (2006) Free revealing and the private-collective model for innovation incentives. R&D Manag 36(3):295–306CrossRefGoogle Scholar
  62. Wuchty S, Jones BF, Uzzi B (2007) The increasing dominance of teams in production of knowledge. Science 316(5827):1036–1039CrossRefGoogle Scholar
  63. Wu G, Harrigan M, Cunningham P (2011) Characterizing Wikipedia pages using edit network motif profiles. In: Proceedings of the 3rd international workshop search and mining user-generated contents, Glasgow, Scotland, UK. ACM, New York, pp 45–52Google Scholar
  64. Zuckerman EW (1999) The categorical imperative: securities analysts and the illegitimacy discount. Am J Sociol 104(5):1398–1438CrossRefGoogle Scholar
  65. Zuckerman EW, Kim TY, Ukanwa K, Von Rittmann J (2003) Robust identities or nonentities? Typecasting in the feature-film labor market. Am J Sociol 108(5):1018–1074CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Austria, part of Springer Nature 2019

Authors and Affiliations

  1. 1.University of KonstanzKonstanzGermany
  2. 2.University of LuganoLuganoSwitzerland
  3. 3.University of Exeter Business SchoolExeterUK

Personalised recommendations