Skip to main content
SpringerLink
Log in

Designing AI Tools to Address Power Imbalances in Digital Labor Platforms

  • Chapter
  • First Online:
Torn Many Ways

Part of the book series: Human–Computer Interaction Series ((HCIS))

Abstract

The artificial intelligence industry has been essential in creating new jobs for the deployment of real-world solutions. As a result, the implementation of these new jobs involves the execution of multiple human intelligence micro-tasks, such as data labeling tasks for training machine learning models. The workers who perform those tasks, also known as crowd workers, usually are independent workers within crowdsourcing platforms. These platforms are subject to the free market, where the forces of supply and demand produce various power dynamics among stakeholders. As a result, disassociation between stakeholders often generates unbalanced power dynamics where workers are paid below minimum wage and are intimidated to keep their reputation or face termination. Within this chapter, we introduce computational techniques to audit the workplace conditions of crowd workers and design tools to address these power imbalances, as a positive and more efficient alternative for the labor conditions of crowd workers. This chapter develops these objectives through the design and evaluation of three tools in digital labor platforms: “Invisible Labor Tracker,” “Reputation Agent,” and “CultureFit,” which we describe below. We will demonstrate the sustainability of systems that point to a future where AI can be used to audit and address power imbalances in the workplace.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.mturk.com/.

  2. 2.

    https://toloka.ai.

Bibliography

  • Baer, T., & Kamalnath, V. (2017). Controlling machine-learning algorithms and their biases. McKinsey Insights.

    Google Scholar 

  • Benyon, D., & Macaulay, C. (2002). Scenarios and the hci-se design problem. Interacting with Computers, 14(4), 397–405.

    Article  Google Scholar 

  • Borromeo, R., Laurent, T., Toyama, M., & Amer-Yahia, S. (2017). Fairness and transparency in crowdsourcing. International Conference on Extending Database Technology (EDBT).

    Google Scholar 

  • Cockton, G. (2004). Value-centred hci. Proceedings of the third Nordic conference on Human-computer interaction, 149–160.

    Google Scholar 

  • Daly, T. M., & Nataraajan, R. (2015). Swapping bricks for clicks: Crowdsourcing longitudinal data on amazon turk. Journal of Business Research, 68(12), 2603–2609.

    Article  Google Scholar 

  • Dellarocas, C. (2010). Online reputation systems: How to design one that does what you need. MIT Sloan management review, 51(3), 33.

    Google Scholar 

  • Difallah, D., Filatova, E., & Ipeirotis, P. (2018). Demographics and dynamics of mechanical turk workers. Proceedings of the eleventh ACM international conference on web search and data mining, 135–143.

    Google Scholar 

  • Eitel-Porter, R. (2021). Beyond the promise: Implementing ethical ai. AI and Ethics, 1(1), 73–80.

    Article  Google Scholar 

  • Gira, M., Zhang, R., & Lee, K. (2022). Debiasing pre-trained language models via efficient fine- tuning. In: Proceedings of the Second Workshop on Language Technology for Equality, Diversity and Inclusion, (pp. 59–69).

    Google Scholar 

  • Gray, M. L., & Suri, S. (2019). Ghost work: How to stop silicon valley from building a new global underclass. Eamon Dolan Books.

    Google Scholar 

  • Hall, E. T., & Hall, E. T. (1989). The dance of life: The other dimension of time. Anchor.

    Google Scholar 

  • Hochschild, A. R. (2016). Invisible labor: Hidden work in the contemporary world. Univ of California Press.

    Google Scholar 

  • Jagdale, R. S., Shirsat, V. S., & Deshmukh, S. N. (2019). Sentiment analysis on product reviews using machine learning techniques. In Cognitive informatics and soft computing (pp. 639–647). Springer.

    Google Scholar 

  • Jobin, A., Ienca, M., & Vayena, E. (2019). The global landscape of ai ethics guidelines. Nature Machine Intelligence, 1(9), 389–399.

    Article  Google Scholar 

  • Kaufman, C. F., Lane, P. M., & Lindquist, J. D. (1991). Exploring more than 24 hours a day: A preliminary investigation of polychronic time use. Journal of Consumer Research, 18(3), 392–401.

    Article  Google Scholar 

  • Kennedy, R., Clifford, S., Burleigh, T., Waggoner, P. D., Jewell, R., & Winter, N. J. (2020). The shape of and solutions to the mturk quality crisis. Political Science Research and Methods, 8(4), 614–629.

    Article  Google Scholar 

  • Krapivsky, P. L., & Redner, S. (2010). Wealth distributions in asset exchange models. arXiv preprint arXiv:1006.4595.

  • Lehdonvirta, V., Hjorth, I., Barnard, H., & Graham, M. (2021). Global earnings disparities in re- mote platform work: Liabilities of origin? In Work and labour relations in global platform capitalism. Edward Elgar Publishing.

    Google Scholar 

  • Mattarelli, E., Bertolotti, F., & Incerti, V. (2015). The interplay between organizational poly- chronicity, multitasking behaviors and organizational identification: A mixed-methods study in knowledge intensive organizations. International Journal of Human-Computer Studies, 79, 6–19.

    Article  Google Scholar 

  • McCrickard, D. S., Czerwinski, M., & Bartram, L. (2003). Introduction: Design and evaluation of notification user interfaces. International Journal of Human-Computer Studies, 58(5), 509–514.

    Article  Google Scholar 

  • Moon, S., Park, Y., & Kim, Y. S. (2014). The impact of text product reviews on sales. European Journal of Marketing.

    Google Scholar 

  • Nardon, L., & Steers, R. M. (2006). Navigating the culture theory jungle: Divergence and con- vergence in models of national culture. Vlerick Leuven Gent Management School, the Autonomous Management School of Ghent University and Katholieke Universiteit Leuven: Vlerick Leuven Gent Working Paper Series, 38.

    Google Scholar 

  • Nardon, L., & Steers, R. M. (2009). The culture theory jungle: Divergence and convergence in models of national culture. Cambridge Handbook of Culture, Organizations, and Work, 3–22.

    Google Scholar 

  • Pelaez, A., Quiroz, A., & Parashar, M. (2016). Dynamic adaptation of policies using machine learning. In 2016 16th IEEE/ACM International symposium on cluster, cloud and grid computing (CCGrid), (pp. 501–510).

    Google Scholar 

  • Pike, A., Rodriguez-Pose, A., & Tomaney, J. (2014). Local and regional development in the global north and south. Progress in Development Studies, 14(1), 21–30.

    Article  Google Scholar 

  • Rosson, M. B., & Carroll, J. M. (2002). Usability engineering: Scenario-based development of human- computer interaction. Morgan Kaufmann.

    Google Scholar 

  • Sahami Shirazi, A., Henze, N., Dingler, T., Pielot, M., Weber, D., & Schmidt, A. (2014). Large- scale assessment of mobile notifications. In Proceedings of the SIGCHI conference on Human factors in computing systems, (pp. 3055–3064).

    Google Scholar 

  • Salminen, J., Jung, S.-g., & Jansen, B. J. (2021). Suggestions for online user studies. International Conference on Human-Computer Interaction, 127–146.

    Google Scholar 

  • Savage, S., Chiang, C. W., Saito, S., Toxtli, C., & Bigham, J. (2020). Becoming the super turker: Increasing wages via a strategy from high earning workers. Proceedings of the Web Conference, 2020, 1241–1252.

    Google Scholar 

  • Schiller, Z., & Davis, C. (2017). Taxes and the on-demand economy. Institute on Taxation & Economic Policy.

    Google Scholar 

  • Stevens, J. L., Jones, C. L. E., & Breazeale, M. (2021). Redacted: The impact of negative online review censorship. Journal of Product & Brand Management.

    Google Scholar 

  • Sundararajan, A. (2017). The sharing economy: The end of employment and the rise of crowd-based capitalism. MIT press.

    Google Scholar 

  • Toxtli, C., Monroy-Herna´ndez, A., & Cranshaw, J. (2018). Understanding chatbot-mediated task management. In: Proceedings of the 2018 CHI conference on human factors in computing systems (pp. 1–6).

    Google Scholar 

  • Vakharia, D., & Lease, M. (2015). Beyond mechanical turk: An analysis of paid crowd work platforms. Proceedings of the iConference.

    Google Scholar 

  • Wright, A. P., Wang, Z. J., Park, H., Guo, G., Sperrle, F., El-Assady, M., Endert, A., Keim, D., & Chau, D. H. (2020). A comparative analysis of industry human-ai interaction guide- lines. arXiv preprint arXiv:2010.11761.

  • Zhang, J., Oh, Y. J., Lange, P., Yu, Z., Fukuoka, Y., et al. (2020). Artificial intelligence chatbot behavior change model for designing artificial intelligence chatbots to promote physical activity and a healthy diet. Journal of Medical Internet Research, 22(9), e22845.

    Article  Google Scholar 

Download references

Acknowledgements

This work was partially supported by NSF grant FW-Htf-19541

Author information

Authors and Affiliations

  1. Clemson University, Clemson, USA

    Carlos Toxtli

  2. Northeastern University, Boston, USA

    Saiph Savage

Authors
  1. Carlos Toxtli
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Saiph Savage
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Carlos Toxtli .

Editor information

Editors and Affiliations

  1. Department of Information Systems, University of Siegen, Siegen, Germany

    Max Krüger

  2. Department of Information Systems, University of Siegen, Siegen, Nordrhein-Westfalen, Germany

    Debora De Castro Leal

  3. Department of Information Systems, University of Siegen, Siegen, Germany

    David Randall

  4. Department of Information Systems, University of Siegen, Siegen, Germany

    Peter Tolmie

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Toxtli, C., Savage, S. (2023). Designing AI Tools to Address Power Imbalances in Digital Labor Platforms. In: Krüger, M., De Castro Leal, D., Randall, D., Tolmie, P. (eds) Torn Many Ways. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-031-31642-5_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-31642-5_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-31641-8

  • Online ISBN: 978-3-031-31642-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation