Toolkit Development

  • Robert Kern
Part of the Lecture Notes in Business Information Processing book series (LNBIP, volume 192)


This chapter introduces a software toolkit that has been developed as a technical foundation for evaluating the QM mechanisms described in the previous chapters. The toolkit allows for performing experiments on top of commercial cloud labor platforms, either based on live experiments or simulations. It specifically supports the CSP/DVM model introduced in Chap. 5 as well as the DVM for multi-labeling introduced in Chap. 6. The chapter is structured as follows: Sect. 7.1 describes the toolkit architecture. Afterwards, Sect. 7.2 explains how real-time experiments can be conducted with the tool whereas Sect. 7.3 addresses the concept of the simulation mode.

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  1. 1.Karlsruhe Service Research InstituteKarlsruhe Institute of TechnologyKarlsruheGermany

Personalised recommendations