Abstract
The model variations developed in Chap. 6 have been evaluated in two separate case studies. While the DVM for multi-labeling was applied to a medical coding business scenario, the model extension for non-deterministic tasks was applied to a product research scenario. In order to investigate the managerial implications of the models from the different perspectives of the basic cloud labor scenario, industry partners from all three sides have been included: A requester, a cloud labor platform and a workforce provider. Section 9.1 covers the medical coding case study while Sect. 9.2 addresses the product research scenario.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
http://www-935.ibm.com/services/de/gbs/consulting/, last accessed on April 2, 2013 (German).
- 4.
- 5.
- 6.
Preliminary experiments have been conducted that indicate that a comparable worker performance can be achieved on the MTurk platform. However, it had been challenging to find enough German speaking participants who are willing to work on the diagnosis scenario. Even after increasing the payment drastically, only about a dozen workers contributed to the experiment.
- 7.
- 8.
The term EAN is still commonly used and has therefore been used for the case study as well.
- 9.
http://www.inline-info.de/index.php?lang=en, last accessed on November 1, 2013.
- 10.
That results in \(7\cdot 5=35\) individual votes.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Kern, R. (2014). Evaluation of Model Variations. In: Dynamic Quality Management for Cloud Labor Services. Lecture Notes in Business Information Processing, vol 192. Springer, Cham. https://doi.org/10.1007/978-3-319-09776-3_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-09776-3_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-09775-6
Online ISBN: 978-3-319-09776-3
eBook Packages: Computer ScienceComputer Science (R0)