Incentive Mechanisms for Crowdsourcing Platforms

  • Aikaterini KatmadaEmail author
  • Anna SatsiouEmail author
  • Ioannis Kompatsiaris
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9934)


Crowdsourcing emerged with the development of Web 2.0 technologies as a distributed online practice that harnesses the collective aptitudes and skills of the crowd in order to reach specific goals. The success of crowdsourcing systems is influenced by the users’ levels of participation and interactions on the platform. Therefore, there is a need for the incorporation of appropriate incentive mechanisms that would lead to sustained user engagement and quality contributions. Accordingly, the aim of the particular paper is threefold: first, to provide an overview of user motives and incentives, second, to present the corresponding incentive mechanisms used to trigger these motives, alongside with some indicative examples of successful crowdsourcing platforms that incorporate these incentive mechanisms, and third, to provide recommendations on their careful design in order to cater to the context and goal of the platform.


Crowdsourcing Incentive mechanisms Reputation Gamification 



This work has been supported by the EU HORIZON 2020 project PROFIT (contract no: 687895).


  1. 1.
    Zhao, Y., Zhu, Q.: Evaluation on crowdsourcing research: current status and future direction. Inf. Syst. Front. 16(3), 417–434 (2014)CrossRefGoogle Scholar
  2. 2.
    Rouse, A.C.: A preliminary taxonomy of crowdsourcing. In: ACIS 2010 Proceedings 76, pp. 1–10 (2010)Google Scholar
  3. 3.
    Howe, J.: Crowdsourcing: A Definition (2006). Accessed 26 Feb 2016
  4. 4.
    Estelles-Arolas, E., Gonzalez-Ladron-De-Guevara, F.: Towards an integrated crowdsourcing definition. J. Inf. Sci. 38, 189–200 (2012)CrossRefGoogle Scholar
  5. 5.
    Brabham, D.C.: Moving the crowd at threadless. Inf. Commun. Soc. 13, 1122–1145 (2010)CrossRefGoogle Scholar
  6. 6.
    Brabham, D.C.: Moving the crowd at iStockphoto: The composition of the crowd and motivations for participation in a crowdsourcing application. First Monday. 13 (2008)Google Scholar
  7. 7.
    Gao, H., Barbier, G., Goolsby, R.: Harnessing the crowdsourcing power of social media for disaster relief. IEEE Intell. Syst. 26, 10–14 (2011)CrossRefGoogle Scholar
  8. 8.
  9. 9.
    Leimeister, J.M., Huber, M., Bretschneider, U., Krcmar, H.: Leveraging crowdsourcing: activation-supporting components for IT-based ideas competition. J. Manage. Inf. Syst. 26(1), 197–224 (2009)CrossRefGoogle Scholar
  10. 10.
    Chandler, D., Kapelner, A.: Breaking monotony with meaning: motivation in crowdsourcing markets. J. Econ. Behav. Organ. 90, 123–133 (2013)CrossRefGoogle Scholar
  11. 11.
    Hossain, M.: Users’ motivation to participate in online crowdsourcing platforms. In: 2012 International Conference on Innovation Management and Technology Research (ICIMTR), pp. 310–315. IEEE (2012)Google Scholar
  12. 12.
    Movshovitz-Attias, D., Movshovitz-Attias, Y., Steenkiste, P., Faloutsos, C.: Analysis of the reputation system and user contributions on a question answering website: Stackoverflow. In: 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), pp. 886–893. IEEE (2013)Google Scholar
  13. 13.
    Allahbakhsh, M., Ignjatovic, A., Benatallah, B., Beheshti, S., Bertino, E., Foo, N.: Reputation management in crowdsourcing systems. In: 2012 8th International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom), pp. 664–671. IEEE (2012)Google Scholar
  14. 14.
    Prandi, C., Salomoni, P. and Mirri, S.: Gamification in Crowdsourcing Applications (2015)Google Scholar
  15. 15.
    Morschheuser, B., Hamari, J., Koivisto, J.: Gamification in crowdsourcing: a review. In: Proceedings of the 49th Annual Hawaii International Conference on System Sciences (HICSS), Hawaii, USA (2016)Google Scholar
  16. 16.
    Ryan, R.M., Deci, E.L.: Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemp. Educ. Psychol. 25(1), 54–67 (2000)CrossRefGoogle Scholar
  17. 17.
    Rani, R., Kumar-Lenka, S.: Motivation and work motivation: concepts, theories & researches. Int. J Res. IT Manage. 8(2), 12–22 (2012)Google Scholar
  18. 18.
    Quinn, A.J., Bederson, B.B.: Human computation: a survey and taxonomy of a growing field. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM (2011)Google Scholar
  19. 19.
    Maslow, A.H.: A theory of human motivation. Originally Published Psychol. Rev. 50, 370–396 (1943)CrossRefGoogle Scholar
  20. 20.
    Wang, Z.: Anonymity, social image, and the competition for volunteers: a case study of the online market for reviews. BE J. Econ. Anal. Policy 10(1) (2010). doi: 10.2202/1935-1682.2523, ISSN (Online) 1935-1682
  21. 21.
    Joyce, E., Kraut, R.E.: Predicting continued participation in newsgroups. J. Computer-Mediated Commun. 11, 723–747 (2006)CrossRefGoogle Scholar
  22. 22.
    Harper, Y.C.F.M., Konstan, J., Li, S.X.: Social comparisons and contributions to online communities: a field experiment on MovieLens. Am. Econ. Rev. 100, 1358–1398 (2010)Google Scholar
  23. 23.
    Lerner, J., Tirole, J.: Some simple economics of open source. J. Ind. Econ. 50(2), 197–234 (2002)CrossRefGoogle Scholar
  24. 24.
    Aiello, L.M., Petkos, G., Martin, C., Corney, D., Papadopoulos, S., Skraba, R., Goker, A., Kompatsiaris, I., Jaimes, A.: Sensing trending topics in Twitter. IEEE Trans. Multimedia 15(6), 1268–1282 (2013)CrossRefGoogle Scholar
  25. 25.
    Vavilis, S., Petković, M., Zannone, N.: A reference model for reputation systems. Decis. Support Syst. 61, 147–154 (2014)CrossRefGoogle Scholar
  26. 26.
    Hendrikx, F., Bubendorfer, K., Chard, R.: Reputation systems: a survey and taxonomy. J. Parallel Distrib. Comput. 75, 184–197 (2015)CrossRefGoogle Scholar
  27. 27.
    Archak, N.: Money, glory and cheap talk: analyzing strategic behavior of contestants in simultaneous crowdsourcing contests on In: Proceedings of the 19th International Conference on World Wide Web, pp. 21–30. ACM (2010)Google Scholar
  28. 28.
    Dellarocas, C.: Designing reputation systems for the social web. Boston U. School of Management Research Paper (2010)Google Scholar
  29. 29.
    Deterding, S., et al.: From game design elements to gamefulness: defining gamification. In: Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments. ACM (2011)Google Scholar
  30. 30.
    Huang, W.H.Y., Soman, D.: Gamification of Education. Research Report Series. Behavioural Economics in Action (2013)Google Scholar
  31. 31.
    Singh, S.P.: Gamification: A strategic tool for organizational effectiveness. Int. J. Manage. 1(1), 108–113 (2012)Google Scholar
  32. 32.
    Suh, A., Wagner, C., Liu, L.: The effects of game dynamics on user engagement in gamified systems. In: 2015 48th Hawaii International Conference on System Sciences (HICSS), pp. 672–681. IEEE (2015)Google Scholar
  33. 33.
    Rego, I.D.M.S.: Mobile Language Learning: How Gamification Improves the Experience. In: Handbook of Mobile Teaching and Learning, p. 705 (2015)Google Scholar
  34. 34.
    Exton, G., Murray, L.: Motivation: a proposed taxonomy using gamification (2014)Google Scholar
  35. 35.
    Cramer, H., Rost, M., Holmquist, L.E.: Performing a check-in: emerging practices, norms and ‘conflicts’ in location-sharing using foursquare. In: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, pp. 57–66. ACM (2011)Google Scholar
  36. 36.
    Lindqvist, J., Cranshaw, J., Wiese, J., Hong, J., Zimmerman, J.: May. I’m the mayor of my house: examining why people use foursquare-a social-driven location sharing application. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2409–2418. ACM (2011)Google Scholar
  37. 37.
    Massung, E., Coyle, D., Cater, K.F., Jay, M., Preist, C.: Using crowdsourcing to support pro-environmental community activism. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 371–380. ACM (2013)Google Scholar
  38. 38.
    Von Ahn, L.: Games with a purpose. Computer 39(6), 92–94 (2006)CrossRefGoogle Scholar
  39. 39.
    Cooper, S., Khatib, F., Treuille, A., Barbero, J., Lee, J., Beenen, M., Leaver-Fay, A., Baker, D., Popović, Z.: Predicting protein structures with a multiplayer online game. Nature 466(7307), 756–760 (2010)CrossRefGoogle Scholar
  40. 40.
    Kawrykow, A., Roumanis, G., Kam, A., Kwak, D., Leung, C., Wu, C., Zarour, E., Sarmenta, L., Blanchette, M., Waldispühl, J.: Phylo: a citizen science approach for improving multiple sequence alignment. PLoS ONE 7(3), e31362 (2012)CrossRefGoogle Scholar
  41. 41.
    Greenhill, A., Holmes, K., Lintott, C., Simmons, B., Masters, K., Cox, J., Graham, G.: Playing with science: gamised aspects of gamification found on the Online Citizen Science Project-Zooniverse (2014)Google Scholar
  42. 42.
    Forte, A., Bruckman, A.: Why do people write for Wikipedia? incentives to contribute to open–content publishing. In: Proceedings of GROUP 5, pp. 6–9 (2005)Google Scholar
  43. 43.
    Mason, W., Watts, D.J.: Financial incentives and the performance of crowds. ACM SigKDD Explor. Newsl. 11(2), 100–108 (2010)CrossRefGoogle Scholar
  44. 44.
    Lakhani, K.R.: (A). Harvard Business School Case, 608, p. 170 (2008)Google Scholar
  45. 45.
    Jøsang, A., Ismail, R., Boyd, C.: A survey of trust and reputation systems for online service provision. Decis. Support Syst. 43(2), 618–644 (2007)CrossRefGoogle Scholar
  46. 46.
    Satsiou, A., Tassiulas, L.: Reputation-based resource allocation in P2P systems of rational users. IEEE Trans. Parallel Distrib. Syst. 21(4), 466–479 (2010)CrossRefGoogle Scholar
  47. 47.
    Robertson, M.: Can’t play, won’t play (2010). Accessed 01 Mar 2016
  48. 48.
    Burke, M., Marlow, C., Lento, T.: Feed me: motivating newcomer contribution in social network sites. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 945–954. ACM (2009)Google Scholar
  49. 49.
    Schenk, E., Guittard, C.: Towards a characterization of crowdsourcing practices. J. Innovation Econ. Manage. 1, 93–107 (2011)CrossRefGoogle Scholar
  50. 50.
    Rogstadius, J., Kostakos, V., Kittur, A., Smus, B., Laredo, J., Vukovic, M.: An assessment of intrinsic and extrinsic motivation on task performance in crowdsourcing markets. ICWSM 11, 17–21 (2011)Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.CERTH-ITIThessalonikiGreece

Personalised recommendations