Skip to main content
SpringerLink
Log in

Designing Reputation Mechanisms for Online Labor Platforms: An Empirical Study

  • Conference paper
  • First Online:
Towards Digital and Sustainable Organisations (ItAIS 2022)

Part of the book series: Lecture Notes in Information Systems and Organisation ((LNISO,volume 65))

Included in the following conference series:

  • 35 Accesses

Abstract

Reputation mechanisms are commonly used on digital platforms to reduce information asymmetry, increase trust, and facilitate transactions between users. Despite extensive research on the design challenges of such mechanisms, the specificities of online labor platforms, like the evolution of skills or the heterogenous context in which transactions take place, are not fully addressed in the current literature. Thus, this work aims at determining how to design suitable reputation mechanisms for online labor platforms. The research follows the Action Design Research approach and is conducted in cooperation with the providers of the online labor platform “Scrambl.”. First, a synthesizing analysis of design features of state-of-the-art reputation mechanisms of a sample of 21 existing online labor platforms is conducted. Second, a systematic literature review is performed along with ten semi-structured interviews with potential users of Scrambl. to identify and evaluate relevant design requirements. Seven design requirements emerge from this work, which may serve as a guideline for researchers and practitioners in the labor market industry to design adequate reputation mechanisms.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Zhang, T., Agarwal, R., & Lucas, H. C. (2011). The value of it-enabled retailer learning: Personalized product recommendations and customer store loyalty in electronic markets. MIS Quarterly, 35(4), 859–881.

    Article  Google Scholar 

  2. Hou, J., & Blodgett, J. (2010). Market structure and quality uncertainty: A theoretical framework for online auction research. Electronic Markets, 20(1), 21–32.

    Article  Google Scholar 

  3. Sutherland, W., & Jarrahi, M. H. (2018). The sharing economy and digital platforms: A review and research agenda. International Journal of Information Management, 43, 328–341.

    Article  Google Scholar 

  4. Bolton, G. E., Greiner, B., & Ockenfels, A. (2013). Engineering trust: Reciprocity in the production of reputation information. Management Science, 59(2), 265–285.

    Article  Google Scholar 

  5. Tadelis, S. (2016). The economics of reputation and feedback systems in E-commerce marketplaces. IEEE Internet Computing, 20(1), 12–19.

    Article  Google Scholar 

  6. Moreno, A., & Terwiesch, C. (2014). Doing business with strangers: Reputation in online service marketplaces. Information Systems Research, 25(4), 865–886.

    Article  Google Scholar 

  7. Steur, A. J., & Seiter, M. (2021). Properties of feedback mechanisms on digital platforms: An exploratory study. Journal of Business Economics, 91(4), 479–526.

    Article  Google Scholar 

  8. Fradkin, A., Grewal, E., & Holtz, D. (2021). Reciprocity and unveiling in two-sided reputation systems: Evidence from an experiment on Airbnb. Marketing Science, 40(6), 1013–1029.

    Article  Google Scholar 

  9. Ba, S., & Pavlou, P. A. (2002). Evidence of the effect of trust building technology in electronic markets: Price premiums and buyer behavior. Management Information Systems Quarterly, 26(3), 243–268.

    Article  Google Scholar 

  10. Bajari, P., & Hortaçsu, A. (2003). The winner’s curse, reserve prices, and endogenous entry: Empirical insights from eBay auctions. The Rand Journal of Economics, 34(2), 329–355.

    Article  Google Scholar 

  11. Bolton, G. E., Katok, E., & Ockenfels, A. (2004). How effective are electronic reputation mechanisms? An experimental investigation. Management Science, 50(11), 1587–1602.

    Article  Google Scholar 

  12. Melnik, M. I., & Alm, J. (2002). Does a seller’s eCommerce reputation matter? Evidence from eBay auctions. The Journal of Industrial Economics, 50(3), 337–349.

    Article  Google Scholar 

  13. Thompson, S., & Haynes, M. (2017). The value of online seller reputation: Evidence from a price comparison site: The value of online seller reputation. Managerial and Decision Economics, 38(3), 302–313.

    Article  Google Scholar 

  14. Scully-Russ, E., & Torraco, R. (2020). The changing nature and organization of work: An integrative review of the literature. Human Resource Development Review, 19(1), 66–93.

    Article  Google Scholar 

  15. Kokkodis, M. (2021). Dynamic, multidimensional, and skillset-specific reputation systems for online work. Information Systems Research, 32(3), 688–712.

    Article  Google Scholar 

  16. Bolton, G. E., Kusterer, D. J., & Mans, J. (2019). Inflated reputations: Uncertainty, leniency, and moral wiggle room in trader feedback systems. Management Science, 65(11), 5371–5391.

    Article  Google Scholar 

  17. Filippas, A., Horton, J. J., & Golden, J. M. (2019). Reputation inflation (NBER Working Paper No. 25857). National Bureau of Economic Research.

    Google Scholar 

  18. Ye, S., Gao, G., & Viswanathan, S. (2014). Strategic behavior in online reputation systems: Evidence from revoking on eBay. MIS Quarterly, 38(4), 1033–1056.

    Article  Google Scholar 

  19. Mullarkey, M. T., & Hevner, A. R. (2019). An elaborated action design research process model. European Journal of Information Systems, 28(1), 6–20.

    Article  Google Scholar 

  20. Sein, M. K., Henfridsson, O., Purao, S., Rossi, M., & Lindgren, R. (2011). Action design research. MIS Quarterly, 35(1), 37–56.

    Article  Google Scholar 

  21. Kokkodis, M., & Ipeirotis, P. G. (2016). Reputation transferability in online labor markets. Management Science, 62(6), 1687–1706.

    Article  Google Scholar 

  22. Yoganarasimhan, H. (2013). The value of reputation in an online freelance marketplace. Marketing Science, 32(6), 860–891.

    Article  Google Scholar 

  23. Jøsang, A., Ismail, R., & Boyd, C. (2007). A survey of trust and reputation systems for online service provision. Decision Support Systems, 43(2), 618–644.

    Article  Google Scholar 

  24. Rice, S. C. (2012). Reputation and uncertainty in online markets: An experimental study. In-formation Systems Research, 23(2), 436–452.

    Article  Google Scholar 

  25. Keser, C., & Späth, M. (2021). The value of bad ratings: An experiment on the impact of distortions in reputation systems. Journal of Behavioral and Experimental Economics, 95, 1–11.

    Article  Google Scholar 

  26. Resnick, P., Zeckhauser, R., Friedman, E., & Kuwabara, K. (2000). Reputation systems. Communications of the ACM, 43(12), 45–48.

    Article  Google Scholar 

  27. Dellarocas, C. (2005). Reputation mechanism design in online trading environments with pure moral hazard. Information Systems Research, 16(2), 209–230.

    Article  Google Scholar 

  28. Lafky, J. (2014). Why do people rate? Theory and evidence on online ratings. Games and Economic Behavior, 87, 554–570.

    Article  Google Scholar 

  29. Resnick, P., & Zeckhauser, R. (2002). Trust among strangers in internet transactions: Empirical analysis of eBay’ s reputation system. In M. R. Baye (Ed.), The economics of the internet and E-commerce (Vol. 11, pp. 127–157). Emerald Group Publishing Limited.

    Chapter  Google Scholar 

  30. Dellarocas, C. (2000). Immunizing online reputation reporting systems against unfair ratings and discriminatory behavior. In Proceedings of the 2nd ACM conference on electronic commerce (pp. 150–157).

    Google Scholar 

  31. Dellarocas, C., & Wood, C. A. (2008). The sound of silence in online feedback: Estimating trading risks in the presence of reporting bias. Management Science, 54(3), 460–476.

    Article  Google Scholar 

  32. Luca, M., & Zervas, G. (2016). Fake it till you make it: Reputation, competition, and yelp review fraud. Management Science, 62(12), 3412–3427.

    Article  Google Scholar 

  33. Chanson, M., Bogner, A., Bilgeri, D., Fleisch, E., & Wortmann, F. (2019). Blockchain for the IoT: Privacy-preserving protection of sensor data. Journal of the Association for Information Systems, 20(9), 1274–1309.

    Google Scholar 

  34. Sänger, J., Richthammer, C., & Pernul, G. (2015). Reusable components for online reputation systems. Journal of Trust Management, 2(5), 1–21.

    Google Scholar 

  35. Snyder, H. (2019). Literature review as a research methodology: An overview and guidelines. Journal of Business Research, 104, 333–339.

    Article  Google Scholar 

  36. Engel, C., & Ebel, P. (2019). Data-driven service innovation: A systematic literature review and development of a research agenda. In Proceedings of the 27th European Conference on Information Systems (ECIS), Stockholm & Uppsala, June 8–14.

    Google Scholar 

  37. Schryen, G. (2015). Writing qualitative IS literature reviews—Guidelines for synthesis, interpretation, and guidance of research. Communications of the Association for Information Systems, 37(12), 286–325.

    Google Scholar 

  38. Recker, J. (2021). Scientific research in information systems: A beginner’s guide (2nd ed.). Springer Nature Switzerland AG.

    Book  Google Scholar 

  39. Bortz, J., & Döring, N. (2006). Forschungsmethoden und Evaluation: für Human- und Sozialwissenschaftler. 4. überarb. Aufl. Springer Medizin Verlag.

    Google Scholar 

  40. Webster, J., & Watson, R. T. (2002). Analyzing the past to prepare for the future: Writing a literature review. MIS Quarterly, 26(2), xiii–xxiii.

    Google Scholar 

  41. Bogner, A., Littig, B., & Menz, W. (2014). Interviews mit Experten: Eine praxisorientierte Einführung. Springer Fachmedien.

    Book  Google Scholar 

  42. Dellarocas, C. (2010). Online reputation systems: How to design one that does what you need. MIT Sloan Management Review, 51(3), 33–38.

    Google Scholar 

  43. Lin, I.-C., Wu, H.-J., Li, S.-F., & Cheng, C.-Y. (2015). A fair reputation system for use in online auctions. Journal of Business Research, 68(4), 878–882.

    Article  Google Scholar 

  44. Lumeau, M., Masclet, D., & Penard, T. (2015). Reputation and social (dis)approval in feedback mechanisms: An experimental study. Journal of Economic Behavior and Organization, 112, 127–140.

    Article  Google Scholar 

  45. Pavlou, P. A., & Gefen, D. (2004). Building effective online marketplaces with institution-based trust. Information Systems Research, 15(1), 37–59.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Information Management, University of St. Gallen, St. Gallen, Switzerland

    Alexandre Bagnoud, Lena-Marie Pätzmann & Andrea Back

Authors
  1. Alexandre Bagnoud
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lena-Marie Pätzmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Andrea Back
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Social and Political Sciences, University of Milan, Milano, Italy

    Alessandra Lazazzara

  2. Department of Law, Economics and Sociology, Magna Græcia University of Catanzaro, Catanzaro, Italy

    Rocco Reina

  3. Department of Management and Business Administration, University "G. d'Annunzio", Pescara, Italy

    Stefano Za

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bagnoud, A., Pätzmann, LM., Back, A. (2024). Designing Reputation Mechanisms for Online Labor Platforms: An Empirical Study. In: Lazazzara, A., Reina, R., Za, S. (eds) Towards Digital and Sustainable Organisations. ItAIS 2022. Lecture Notes in Information Systems and Organisation, vol 65. Springer, Cham. https://doi.org/10.1007/978-3-031-52880-4_11

Download citation

Publish with us

Policies and ethics

Search

Navigation