Skip to main content

Evaluation of Model Variations

  • Chapter
  • First Online:
Dynamic Quality Management for Cloud Labor Services

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 192))

  • 453 Accesses

Abstract

The model variations developed in Chap. 6 have been evaluated in two separate case studies. While the DVM for multi-labeling was applied to a medical coding business scenario, the model extension for non-deterministic tasks was applied to a product research scenario. In order to investigate the managerial implications of the models from the different perspectives of the basic cloud labor scenario, industry partners from all three sides have been included: A requester, a cloud labor platform and a workforce provider. Section 9.1 covers the medical coding case study while Sect. 9.2 addresses the product research scenario.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.buw.de/en/startseite.html

  2. 2.

    http://www.semfinder.com/en/home.html

  3. 3.

    http://www-935.ibm.com/services/de/gbs/consulting/, last accessed on April 2, 2013 (German).

  4. 4.

    http://www.semfinder.com/en

  5. 5.

    http://www.lumrix.de/

  6. 6.

    Preliminary experiments have been conducted that indicate that a comparable worker performance can be achieved on the MTurk platform. However, it had been challenging to find enough German speaking participants who are willing to work on the diagnosis scenario. Even after increasing the payment drastically, only about a dozen workers contributed to the experiment.

  7. 7.

    http://www.bitworxx.com/

  8. 8.

    The term EAN is still commonly used and has therefore been used for the case study as well.

  9. 9.

    http://www.inline-info.de/index.php?lang=en, last accessed on November 1, 2013.

  10. 10.

    That results in \(7\cdot 5=35\) individual votes.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Robert Kern .

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Kern, R. (2014). Evaluation of Model Variations. In: Dynamic Quality Management for Cloud Labor Services. Lecture Notes in Business Information Processing, vol 192. Springer, Cham. https://doi.org/10.1007/978-3-319-09776-3_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-09776-3_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-09775-6

  • Online ISBN: 978-3-319-09776-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics