Skip to main content
SpringerLink
Log in

The Economic Anatomy of Paid Crowdsourcing Platforms

  • Conference paper
  • First Online:
Software Business (ICSOB 2021)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 434))

Included in the following conference series:

  • 1016 Accesses

Abstract

The discovery and dissemination of crowdsourcing have led to the emergence of platforms that offer the infrastructure for implementing crowdsourcing projects on a commercial basis. In this study, we investigate the economic structures of such paid crowdsourcing platforms. We develop an integrated Crowdsourcing Platform Economic Design framework based on existing studies on crowdsourcing and platform design. The framework incorporates a wide range of mechanisms available for the economic structure of paid crowdsourcing platforms grouped into three areas: Search and Matching, Pricing and Rewarding, and Control and Assembling. We further use the resulting framework to systematically compare and classify the economic structures of 45 paid crowdsourcing platforms. As a result, we provide a taxonomy of paid crowdsourcing platforms based on the economic mechanisms and their usage dependencies. The presented study of paid crowdsourcing platforms complements and extends the existing literature on crowdsourcing and platform economy; it also creates an appropriate basis for further research in these directions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    The framework is shown already with traces and mechanisms usage frequencies discussed in Sect. 5.

References

  1. Bakos, Y., Katsamakas, E.: Design and ownership of two-sided networks: implications for internet platforms. J. Manag. Inf. Syst. 25(2), 171–202 (2008)

    Article  Google Scholar 

  2. Baskerville, R., Baiyere, A., Gergor, S., Hevner, A., Rossi, M.: Design science research contributions: finding a balance between artifact and theory. J. Assoc. Inf. Syst. 19(5), 358–376 (2018)

    Google Scholar 

  3. Baumann, C., Gewald, H.: What motivates crowdsourcing contributors? A cross-platform comparative analysis, p. 14 (2018)

    Google Scholar 

  4. Brousseau, E., Penard, T.: The economics of digital business models: a framework for analyzing the economics of platforms. Rev. Netw. Econ. 6(2), 81–114 (2007)

    Google Scholar 

  5. Chandler, D., Horton, J.: Labor allocation in paid crowdsourcing: experimental evidence on positioning, nudges and prices. In: Association for the Advancement of Artificial Intelligence Workshop, pp. 14–19 (2011)

    Google Scholar 

  6. Chen, D.L.: The economics of crowdsourcing: a theory of disaggregated labor markets (2017)

    Google Scholar 

  7. Cullen, Z., Farronato, C.: Outsourcing tasks online: matching supply and demand on peer-to-peer internet platforms. Manag. Sci. 67, 3985–4003 (2020)

    Article  Google Scholar 

  8. Daniel, F., Kucherbaev, P., Cappiello, C., Benatallah, B., Allahbakhsh, M.: Quality control in crowdsourcing: a survey of quality attributes, assessment techniques and assurance actions. ACM Comput. Surv. 51(1), 1–40 (2018)

    Article  Google Scholar 

  9. Difallah, D.E., Catasta, M., Demartini, G., Ipeirotis, P.G., Cudré-Mauroux, P.: The dynamics of micro-task crowdsourcing: the case of Amazon MTurk. In: Proceedings of the 24th International Conference on World Wide Web, pp. 238–247 (2015)

    Google Scholar 

  10. Gadiraju, U., Demartini, G., Kawase, R., Dietze, S.: Human beyond the machine: challenges and opportunities of microtask crowdsourcing. IEEE Intell. Syst. 30(4), 81–85 (2015)

    Article  Google Scholar 

  11. Ghazawneh, A., Henfridsson, O.: A paradigmatic analysis of digital application marketplaces. J. Inf. Technol. 30(3), 198–208 (2015)

    Article  Google Scholar 

  12. Ghezzi, A., Gabelloni, D., Martini, A., Natalicchio, A.: Crowdsourcing: a review and suggestions for future research: crowdsourcing. Int. J. Manag. Rev. 20(2), 343–363 (2018)

    Article  Google Scholar 

  13. Hauser, D., Paolacci, G., Chandler, J.: Common concerns with MTurk as a participant pool: evidence and solutions (2019)

    Google Scholar 

  14. Horton, J.J., Chilton, L.B.: The labor economics of paid crowdsourcing. In: 11th ACM Conference on Electronic Commerce, EC 2910, p. 209 (2010)

    Google Scholar 

  15. Hosseini, M., Shahri, A., Phalp, K., Taylor, J., Ali, R.: Crowdsourcing: a taxonomy and systematic mapping study. Comput. Sci. Rev. 17, 43–69 (2015)

    Article  MathSciNet  Google Scholar 

  16. Howcroft, D., Bergvall-Kåreborn, B.: A typology of crowdwork platforms. Work Employ Soc. 33(1), 21–38 (2019)

    Article  Google Scholar 

  17. Howe, J.: The rise of crowdsourcing. Wired, 5 (2006). http://www.wired.com/wired/archive/14.06/crowds.html

  18. Iveroth, E., Westelius, A., Petri, C.J., Olve, N.G., Cöster, M., Nilsson, F.: How to differentiate by price: Proposal for a five-dimensional model. Eur. Manag. J. 31(2), 109–123 (2013)

    Article  Google Scholar 

  19. Jiang, Z.Z., Huang, Y.: The role of feedback in dynamic crowdsourcing contests: a structural empirical analysis (2016)

    Google Scholar 

  20. Kitchenham, B., Pearl Brereton, O., Budgen, D., Turner, M., Bailey, J., Linkman, S.: Systematic literature reviews in software engineering - a systematic literature review. Inf. Softw. Technol. 51(1), 7–15 (2009)

    Article  Google Scholar 

  21. Laatikainen, G., Ojala, A., Mazhelis, O.: Cloud services pricing models. In: Herzwurm, G., Margaria, T. (eds.) ICSOB 2013. LNBIP, vol. 150, pp. 117–129. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39336-5_12

    Chapter  Google Scholar 

  22. Mourelatos, E., Frarakis, N., Tzagarakis, M.: A study on the evolution of crowdsourcing websites. Eur. J. Soc. Sci. Educ. Res. 11(1), 29 (2017)

    Article  Google Scholar 

  23. Neto, F.R.A., Santos, C.A.: Understanding crowdsourcing projects: a systematic review of tendencies, workflow, and quality management. Inf. Process. Manag. 54(4), 490–506 (2018)

    Article  Google Scholar 

  24. Rowe, F.: What literature review is not: diversity, boundaries and recommendations. Eur. J. Inf. Syst. 23(3), 241–255 (2014)

    Article  Google Scholar 

  25. Schreieck, M., Hein, A., Wiesche, M., Krcmar, H.: The challenge of governing digital platform ecosystems. In: Linnhoff-Popien, C., Schneider, R., Zaddach, M. (eds.) Digital Marketplaces Unleashed, pp. 527–538. Springer, Heidelberg (2018). https://doi.org/10.1007/978-3-662-49275-8_47

    Chapter  Google Scholar 

  26. Stanoevska-Slabeva, K., Schmid, B.: A typology of online communities and community supporting platforms. In: Proceedings of the 34th Annual Hawaii International Conference on System Sciences, p. 10 (2001)

    Google Scholar 

  27. Strausz, R.: A theory of crowdfunding: a mechanism design approach with demand uncertainty and moral hazard. Am. Econ. Rev. 107(6), 1430–1476 (2017)

    Article  Google Scholar 

  28. Vakharia, D., Lease, M.: Beyond mechanical turk: an analysis of paid crowd work platforms, p. 18 (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. CERGE-EI, Prague, Czech Republic

    Egor Iankov

  2. LUT University, Lappeenranta, Finland

    Andrey Saltan

  3. HSE University, St. Petersburg, Russia

    Egor Iankov & Andrey Saltan

Authors
  1. Egor Iankov
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Andrey Saltan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andrey Saltan .

Editor information

Editors and Affiliations

  1. Free University of Bozen-Bolzano, Bolzano, Italy

    Xiaofeng Wang

  2. University of Oslo, Oslo, Norway

    Antonio Martini

  3. University of South Eastern Norway, Bø, Norway

    Anh Nguyen-Duc

  4. University of Oslo and SINTEF, Oslo, Norway

    Viktoria Stray

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Iankov, E., Saltan, A. (2021). The Economic Anatomy of Paid Crowdsourcing Platforms. In: Wang, X., Martini, A., Nguyen-Duc, A., Stray, V. (eds) Software Business. ICSOB 2021. Lecture Notes in Business Information Processing, vol 434. Springer, Cham. https://doi.org/10.1007/978-3-030-91983-2_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-91983-2_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-91982-5

  • Online ISBN: 978-3-030-91983-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation