Crowdsourcing pp 143-161 | Cite as

Towards a Game Theoretical Model for Software Crowdsourcing Processes

  • Wenjun WuEmail author
  • Wei-Tek Tsai
  • Zhenghui Hu
  • Yuchuan Wu
Part of the Progress in IS book series (PROIS)


Recently software crowdsourcing has become an emerging development paradigm in software ecosystems. This paper first introduces a software crowdsourcing framework in the context of software ecosystems. The framework includes a game-theoretical model for peer software production to describe the competitive nature of software crowdsourcing. The analysis of this model indicates that if the only reward is the prize, only superior developers will participate in the software crowdsourcing. This explains the phenomenon that while software crowdsourcing is open for anyone to compete, but only few will engage in competition. This is validated by a large historical data collected from a popular software crowdsourcing website over a 10-years period. Further, we perform a case study on a NASA software crowdsourcing project to take a closer examination at how community developers participate in different types of tasks through the software crowdsourcing process.


Reputation System Global Software Development Contest Success Function Reputation Mechanism Component Implementation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



This work was supported by National High-Tech R&D Program of China (Grant No. 2013AA01A210) and the State Key Laboratory of Software Development Environment (Grant No. SKLSDE-2013ZX-03).


  1. 1.
    Lakhani, K., Garvin, D.A., Eric, L.: Topcoder (a): developing software through crowdsourcing (15 January 2010). Harvard Business School General Management Unit Case No. 610-032 (2010)Google Scholar
  2. 2.
    uTest, (2013). Accessed 12 Jan 2013
  3. 3.
    Bosch, J.: From software product lines to software ecosystems. In: Proceedings of the 13th International Software Product Line Conference, SPLC’09, pp. 111–119. Carnegie Mellon University, Pittsburgh (2009)Google Scholar
  4. 4.
    Jansen, S., Finkelstein, A., Brinkkemper, S.: A sense of community:a research agenda for software ecosystems. In: Presented at the 31st International Conference on Software Engineering—Companion Volume, ICSE-Companion 2009, pp. 187–190. IEEE (2009)Google Scholar
  5. 5.
    AppStori: (2012). Accessed 10 Jun 2012
  6. 6.
    Herbsleb, J.D., Moitra, D.: Global software development. Softw. IEEE 18(2), 16–20 (2001)Google Scholar
  7. 7.
    Hars, A., Ou, S.: Working for free? Motivations of participating in open source projects. In: Proceedings of the 34th Annual Hawaii International Conference on System Sciences, January 2001, 9 pp. (2001)Google Scholar
  8. 8.
    Crowston, K., Wei, K., Howison, J., Wiggins, A.: Free/libre open-source software development: what we know and what we do not know. ACM Comput. Surv. 44(2):7:1–7:35 (2008)Google Scholar
  9. 9.
    Šmite, D., Wohlin, C., Gorschek, T., Feldt, R.: Empirical evidence in global software engineering: a systematic review. Empir. Softw. Eng. 15(1):91–118 (2010)Google Scholar
  10. 10.
    Ramasubbu, N., Cataldo, M., Balan, R.K., Herbsleb, J.D.: Configuring global software teams: a multi-company analysis of project productivity, quality, and profits. In: Proceedings of the 33rd International Conference on Software Engineering, ICSE’11, pp. 261–270. ACM, New York (2011)Google Scholar
  11. 11.
    Scacchi, Walt, Feller, J., Fitzgerald, B., Hissam, S., Lakhani, K.: Understanding free/open source software development processes. Softw. Process: Improv. Pract. 11(2), 95–105 (2006)Google Scholar
  12. 12.
    Archak, N.: Money, glory and cheap talk: analyzing strategic behavior of contestants in simultaneous crowdsourcing contests on In: Proceedings of the 19th International Conference on World Wide Web, WWW’10, pp. 21–30. ACM, New York (2010)
  13. 13.
    Bacon, D.F., Chen, Y., Parkes, D., Rao, M.: A market-based approach to software evolution. In: Proceedings of the 24th ACM SIGPLAN Conference Companion on Object Oriented Programming Systems Languages and Applications, OOPSLA’09, pp. 973–980. ACM, New York (2009)Google Scholar
  14. 14.
    DiPalantino, D., Vojnovic, M.: Crowdsourcing and all-pay auctions. In: Proceedings of the 10th ACM Conference on Electronic Commerce, EC’09, pp. 119–128. ACM, New York (2009)Google Scholar
  15. 15.
    Towne, W.B., Herbsleb, J., MllerBirn, C.: The vista ecosystem: current statusand future directions. Technical report, Institute for Software Research, Pittsburgh, PA (2010)Google Scholar
  16. 16.
    Ye, Y., Kishida, K.: Toward an understanding of the motivation open source software developers. In: Proceedings of the 25th International Conference on Software Engineering, ICSE’03, pp. 419–429. IEEE Computer Society, Washington (2003)Google Scholar
  17. 17.
    Mason, W., Watts, D.J.: Financial incentives and the “performance of crowds”. In: Proceedings of the ACM SIGKDD Workshop on Human Computation, HCOMP’09, pp. 77–85. ACM, New York (2009)Google Scholar
  18. 18.
    Bled Electronic Commerce, Jsang, A., Ismail, R. The beta reputation system. In: Proceedings of the 15th Bled Electronic Commerce Conference (2002)Google Scholar
  19. 19.
    Elo, A.: The Rating of Chessplayers, Past and Present. Arco Publishing, New York (1978)Google Scholar
  20. 20.
    Herbrich, R., Graepel, T.: Trueskilltm: a bayesian skill rating system. Technical report (2006)Google Scholar
  21. 21.
    TopCoder Inc., Algorithm competition rating system. Technical report (2008)Google Scholar
  22. 22.
    Wenjun, W., Tsai, W.-T., Li, W.: An evaluation framework for software crowdsourcing. Front. Comput. Sci. 7(5), 694–709 (2013)Google Scholar
  23. 23.
    Corchn, L.C.: The theory of contests: a survey. Rev. Econ. Des. 11(2):69–100 (2007)Google Scholar
  24. 24.
    Nag, S., Heffan, I., Saenz-Otero, A., Lydon, M.: Spheres zero robotics software development: lessons on crowdsourcing and collaborative competition. In: 2012 IEEE Aerospace Conference, March, 2012, pp. 1–17 (2012)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2015

Authors and Affiliations

  • Wenjun Wu
    • 1
    Email author
  • Wei-Tek Tsai
    • 2
  • Zhenghui Hu
    • 1
  • Yuchuan Wu
    • 1
  1. 1.School of Computer Science and EngineeringBeihang UniversityBeijingChina
  2. 2.School of Computing Informatics and Decision Systems EngineeringArizona State UniversityTempeUSA

Personalised recommendations