Advertisement

Why Do People Give Up FLOSSing? A Study of Contributor Disengagement in Open Source

  • Courtney MillerEmail author
  • David Gray WidderEmail author
  • Christian KästnerEmail author
  • Bogdan VasilescuEmail author
Conference paper
Part of the IFIP Advances in Information and Communication Technology book series (IFIPAICT, volume 556)

Abstract

Established contributors are the backbone of many free/libre open source software (FLOSS) projects. Previous research has shown that it is critically important for projects to retain contributors and it has also revealed the motivations behind why contributors choose to participate in FLOSS in the first place. However, there has been limited research done on the reasons why established contributors disengage, and factors (on an individual and project level) that predict their disengagement. In this paper, we conduct a mixed-methods empirical study, combining surveys and survival modeling, to identify the reasons and predictive factors behind established contributor disengagement. We find that different groups of established contributors tend to disengage for different reasons; however, overall contributors most commonly cite some kind of transition (e.g., switching jobs or leaving academia). We also find that factors such as the popularity of the projects a contributor works on, whether they have experienced a transition, when they work, and how much they work are all factors that can be used to predict their disengagement from open source.

Notes

Acknowledgements

This work was supported through CMU’s REU in SE, NSF (1318808, 1552944, 1717022, and 1717415), and AFRL and DARPA (FA8750-16-2-0042). We thank our survey participants, and colleagues at CMU, especially Jim Herbsleb, Chris Bogart, Marat Valiev, and Sophie Rosas-Smith.

References

  1. 1.
    Bannai, A., Tamakoshi, A.: The association between long working hours and health: a systematic review of epidemiological evidence. Scand. J. Work Environ. Health 40, 5–18 (2014)CrossRefGoogle Scholar
  2. 2.
    Barcomb, A., Kaufmann, A., Riehle, D., Stol, K.-J., Fitzgerald, B.: Uncovering the periphery: a qualitative survey of episodic volunteering in free/libre and open source software communities. IEEE Trans. Softw. Eng. (2018)Google Scholar
  3. 3.
    Bardach, E., Patashnik, E.M.: A Practical Guide for Policy Analysis: The Eightfold Path to More Effective Problem Solving. CQ Press, Washington D.C. (2015)Google Scholar
  4. 4.
    Binnewies, C., Sonnentag, S., Mojza, E.J.: Recovery during the weekend and fluctuations in weekly job performance: a week-level study examining intra-individual relationships. J. Occup. Org. Psychol. 83(2), 419–441 (2010)CrossRefGoogle Scholar
  5. 5.
    Bonaccorsi, A., Rossi, C.: Comparing motivations of individual programmers and firms to take part in the open source movement: from community to business. Knowl. Technol. Policy 18(4), 40–64 (2006)CrossRefGoogle Scholar
  6. 6.
    Burton, J.P., Holtom, B.C., Sablynski, C.J., Mitchell, T.R., Lee, T.W.: The buffering effects of job embeddedness on negative shocks. J. Vocat. Behav. 76(1), 42–51 (2010)CrossRefGoogle Scholar
  7. 7.
    Canfora, G., Di Penta, M., Oliveto, R., Panichella, S.: Who is going to mentor newcomers in open source projects? In: Proceedings of International Symposium Foundations of Software Engineering (FSE), p. 44. ACM Press, New York (2012)Google Scholar
  8. 8.
    Claes, M., Mäntylä, M.V., Kuutila, M., Adams, B.: Do programmers work at night or during the weekend? In: ICSE, pp. 705–715. ACM (2018)Google Scholar
  9. 9.
    Coelho, J., Valente, M.T.: Why modern open source projects fail. In: ESEC/FSE, pp. 186–196. ACM (2017)Google Scholar
  10. 10.
    Cohen, P., West, S.G., Aiken, L.S.: Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences. Psychology Press, London (2014)CrossRefGoogle Scholar
  11. 11.
    Constantinou, E., Mens, T.: An empirical comparison of developer retention in the RubyGems and NPM software ecosystems. Innov. Syst. Softw. Eng. 13(2–3), 101–115 (2017)CrossRefGoogle Scholar
  12. 12.
    Constantinou, E., Mens, T.: Socio-technical evolution of the Ruby ecosystem in GitHub. In: SANER, pp. 34–44. IEEE (2017)Google Scholar
  13. 13.
    Cox, D.R.: Analysis of Survival Data. Routledge, Abingdon (2018)CrossRefGoogle Scholar
  14. 14.
    Creswell, J.W., Clark, V.L.P.: Designing and Conducting Mixed Methods Research. Wiley, Hoboken (2007)Google Scholar
  15. 15.
    Crowston, K., Annabi, H., Howison, J., Masango, C.: Effective work practices for software engineering: free/libre open source software development. In: Proceedings of the 2004 ACM Workshop on Interdisciplinary Software Engineering Research, pp. 18–26. ACM (2004)Google Scholar
  16. 16.
    Dabbish, L., Stuart, C., Tsay, J., Herbsleb, J.: Social coding in GitHub: transparency and collaboration in an open software repository. In: Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, pp. 1277–1286. ACM (2012)Google Scholar
  17. 17.
    Eyolfson, J., Tan, L., Lam, P.: Do time of day and developer experience affect commit bugginess? In: Proceedings of the 8th Working Conference on Mining Software Repositories, pp. 153–162. ACM (2011)Google Scholar
  18. 18.
    Fagerholm, F., Guinea, A.S., Borenstein, J., Münch, J.: Onboarding in open source projects. IEEE Softw. 31(6), 54–61 (2014)CrossRefGoogle Scholar
  19. 19.
    Fang, Y., Neufeld, D.: Understanding sustained participation in open source software projects. J. Manag. Inf. Syst. 25(4), 9–50 (2009)CrossRefGoogle Scholar
  20. 20.
    Feldman, D.C., Ng, T.W.H.: Careers: mobility, embeddedness, and success. J. Manag. 33(3), 350–377 (2007)Google Scholar
  21. 21.
    Foucault, M., Palyart, M., Blanc, X., Murphy, G.C., Falleri, J.-R.: Impact of developer turnover on quality in open-source software. In: ESEC/FSE, pp. 829–841. ACM (2015)Google Scholar
  22. 22.
    Fucci, D., Scanniello, G., Romano, S., Juristo, N.: Need for sleep: the impact of a night of sleep deprivation on novice developers’ performance. IEEE Trans. Softw. Eng. (2018)Google Scholar
  23. 23.
    Gelman, A., Hill, J.: Data Analysis Using Regression and Multilevel/Hierarchical Models. Cambridge University Press, Cambridge (2006)CrossRefGoogle Scholar
  24. 24.
    Ghosh, R.A., Glott, R., Krieger, B., Robles, G.: Free/libre and open source software: survey and study - part 4: survey of developers. Technical report, International Institute of Informatics, University of Maastricht, Maastricht (2002)Google Scholar
  25. 25.
    Gidron, B.: Predictors of retention and turnover among service volunteer workers. J. Soc. Serv. Res. 8(1), 1–16 (1985)CrossRefGoogle Scholar
  26. 26.
    Gousios, G.: The GHTorent dataset and tool suite. In: MSR, pp. 233–236. IEEE (2013)Google Scholar
  27. 27.
    Gousios, G., Zaidman, A., Storey, M.-A., Van Deursen, A.: Work practices and challenges in pull-based development: the integrator’s perspective. In: ICSE, pp. 358–368. IEEE (2015)Google Scholar
  28. 28.
    Grambsch, P.M., Therneau, T.M.: Proportional hazards tests and diagnostics based on weighted residuals. Biometrika 81(3), 515–526 (1994)MathSciNetCrossRefGoogle Scholar
  29. 29.
    Guzman, E., Azócar, D., Li, Y.: Sentiment analysis of commit comments in GitHub: an empirical study. In: Proceedings of the 11th Working Conference on Mining Software Repositories, pp. 352–355. ACM (2014)Google Scholar
  30. 30.
    Hannebauer, C., Gruhn, V.: On the relationship between newcomer motivations and contribution barriers in open source projects. In: Proceedings of International Symposium on Open Collaboration, OpenSym 2017, pp. 2:1–2:10. ACM, New York (2017)Google Scholar
  31. 31.
    Hom, P.W., Lee, T.W., Shaw, J.D., Hausknecht, J.P.: One hundred years of employee turnover theory and research. J. Appl. Psychol. 102(3), 530 (2017)CrossRefGoogle Scholar
  32. 32.
    Homscheid, D., Schaarschmidt, M.: Between organization and community: investigating turnover intention factors of firm-sponsored open source software developers. In: Proceedings of Conference Web Science (WebSci), pp. 336–337. ACM, New York (2016)Google Scholar
  33. 33.
    Izquierdo-Cortazar, D., et al.: Using software archaeology to measure knowledge loss in software projects due to developer turnover. In: HICSS, pp. 1–10. IEEE (2009)Google Scholar
  34. 34.
    Jamison, I.B.: Turnover and retention among volunteers in human service agencies. Rev. Publ. Pers. Adm. 23(2), 114–132 (2003)Google Scholar
  35. 35.
    Kim, H., Kao, D.: A meta-analysis of turnover intention predictors among us child welfare workers. Child. Youth Serv. Rev. 47, 214–223 (2014)CrossRefGoogle Scholar
  36. 36.
    Kuutila, M., Mäntylä, M.V., Claes, M., Elovainio, M.: Reviewing literature on time pressure in software engineering and related professions: computer assisted interdisciplinary literature review. In: 2017 IEEE/ACM 2nd International Workshop on Emotion Awareness in Software Engineering (SEmotion), pp. 54–59. IEEE (2017)Google Scholar
  37. 37.
    Lakhani, K., Wolf, R.G.: Why hackers do what they do: understanding motivation and effort in free/open source software projects. Technical report, MIT Sloan Working Paper (2003)Google Scholar
  38. 38.
    Lee, T.W., Mitchell, T.R.: An alternative approach: the unfolding model of voluntary employee turnover. Acad. Manag. Rev. 19(1), 51–89 (1994)CrossRefGoogle Scholar
  39. 39.
    Lin, B., Robles, G., Serebrenik, A.: Developer turnover in global, industrial open source projects: insights from applying survival analysis. In: 2017 IEEE 12th International Conference on Global Software Engineering (ICGSE), pp. 66–75. IEEE (2017)Google Scholar
  40. 40.
    Midha, V., Palvia, P.: Retention and quality in open source software projects. In: AMCIS 2007 Proceedings, p. 25 (2007)Google Scholar
  41. 41.
    Miller, L.E., Powell, G.N., Seltzer, J.: Determinants of turnover among volunteers. Hum. Relat. 43(9), 901–917 (1990)CrossRefGoogle Scholar
  42. 42.
    Miller Jr., R.G.: Survival Analysis, vol. 66. Wiley, Hoboken (2011)Google Scholar
  43. 43.
    Qiu, H.S., Nolte, A., Brown, A., Serebrenik, A., Vasilescu, B.: Going farther together: the impact of social capital on sustained participation in open source. In: International Conference on Software Engineering, ICSE. IEEE (2019)Google Scholar
  44. 44.
    Roberts, J.A., Hann, I.-H., Slaughter, S.A.: Understanding the motivations, participation, and performance of open source software developers: a longitudinal study of the Apache projects. Manag. Sci. 52(7), 984–999 (2006)CrossRefGoogle Scholar
  45. 45.
    Rodriguez, A., Tanaka, F., Kamei, Y.: Empirical study on the relationship between developer’s working habits and efficiency. In: Proceedings of Conference on Mining Software Repositories (MSR) (2018)Google Scholar
  46. 46.
    Schilling, A., Laumer, S., Weitzel, T.: Who will remain? An evaluation of actual person-job and person-team fit to predict developer retention in FLOSS projects. In: HICCS, pp. 3446–3455. IEEE (2012)Google Scholar
  47. 47.
    Schreier, M.: Qualitative Content Analysis in Practice. Sage Publications, Thousand Oaks (2012)Google Scholar
  48. 48.
    Shah, S.K.: Motivation, governance, and the viability of hybrid forms in open source software development. Manag. Sci. 52(7), 1000–1014 (2006)CrossRefGoogle Scholar
  49. 49.
    Sharma, P.N., Hulland, J., Daniel, S.: Examining turnover in open source software projects using logistic hierarchical linear modeling approach. In: Hammouda, I., Lundell, B., Mikkonen, T., Scacchi, W. (eds.) OSS 2012. IAICT, vol. 378, pp. 331–337. Springer, Heidelberg (2012).  https://doi.org/10.1007/978-3-642-33442-9_30CrossRefGoogle Scholar
  50. 50.
    Skoglund, A.G.: Do not forget about your volunteers: a qualitative analysis of factors influencing volunteer turnover. Health Soc. Work 31(3), 217 (2006)CrossRefGoogle Scholar
  51. 51.
    Sonnentag, S., Binnewies, C., Mojza, E.J.: Staying well and engaged when demands are high: the role of psychological detachment. J. Appl. Psychol. 95(5), 965 (2010)CrossRefGoogle Scholar
  52. 52.
    Steinmacher, I., Conte, T., Gerosa, M.A.: Redmiles, D.: Social barriers faced by newcomers placing their first contribution in open source software projects. In: Proceedings of Conference on Computer Supported Cooperative Work (CSCW), pp. 1379–1392. ACM, New York (2015)Google Scholar
  53. 53.
    Valiev, M., Vasilescu, B., Herbsleb, J.: Ecosystem-level determinants of sustained activity in open-source projects: a case study of the PyPI ecosystem. In: ESEC/FSE. ACM (2018)Google Scholar
  54. 54.
    Von Krogh, G., Haefliger, S., Spaeth, S., Wallin, M.W.: Carrots and rainbows: motivation and social practice in open source software development. MIS Q. 36(2), 649–676 (2012)CrossRefGoogle Scholar
  55. 55.
    West, J., Gallagher, S.: Challenges of open innovation: the paradox of firm investment in open-source software. R&D Manag. 36(3), 319–331 (2006)CrossRefGoogle Scholar
  56. 56.
    Yu, Y., Benlian, A., Hess, T.: An empirical study of volunteer members’ perceived turnover in open source software projects. In: Proceedings of Hawaii International Conference on System Sciences (HICSS), pp. 3396–3405. IEEE (2012)Google Scholar
  57. 57.
    Zhou, M., Mockus, A.: Developer fluency: achieving true mastery in software projects. In: ESEC/FSE, pp. 137–146. ACM (2010)Google Scholar
  58. 58.
    Zhou, M., Mockus, A., Ma, X., Lu, Z., Mei, H.: Inflow and retention in OSS communities with commercial involvement: a case study of three hybrid projects. ACM Trans. Softw. Eng. Methodol. (TOSEM) 25(2), 13 (2016)CrossRefGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2019

Authors and Affiliations

  1. 1.New College of FloridaSarasotaUSA
  2. 2.Carnegie Mellon UniversityPittsburghUSA

Personalised recommendations