Skill Ontology-Based Model for Quality Assurance in Crowdsourcing

  • Kinda El Maarry
  • Wolf-Tilo Balke
  • Hyunsouk Cho
  • Seung-won Hwang
  • Yukino Baba
Conference paper

DOI: 10.1007/978-3-662-43984-5_29

Part of the Lecture Notes in Computer Science book series (LNCS, volume 8505)
Cite this paper as:
Maarry K.E., Balke WT., Cho H., Hwang S., Baba Y. (2014) Skill Ontology-Based Model for Quality Assurance in Crowdsourcing. In: Han WS., Lee M., Muliantara A., Sanjaya N., Thalheim B., Zhou S. (eds) Database Systems for Advanced Applications. DASFAA 2014. Lecture Notes in Computer Science, vol 8505. Springer, Berlin, Heidelberg

Abstract

Crowdsourcing continues to gain more momentum as its potential becomes more recognized. Nevertheless, the associated quality aspect remains a valid concern, which introduces uncertainty in the results obtained from the crowd. We identify the different aspects that dynamically affect the overall quality of a crowdsourcing task. Accordingly, we propose a skill ontology-based model that caters for these aspects, as a management technique to be adopted by crowdsourcing platforms. The model maintains a dynamically evolving ontology of skills, with libraries of standardized and personalized assessments for awarding workers skills. Aligning a worker’s set of skills to that required by a task, boosts the ultimate resulting quality. We visualize the model’s components and workflow, and consider how to guard it against malicious or unqualified workers, whose responses introduce this uncertainty and degrade the overall quality.

Keywords

Crowdsourcing Quality assurance Skill ontology Uncertain data 

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  • Kinda El Maarry
    • 1
  • Wolf-Tilo Balke
    • 1
  • Hyunsouk Cho
    • 2
  • Seung-won Hwang
    • 2
  • Yukino Baba
    • 3
  1. 1.Institut für InformationssystemeTU BraunschweigBrunswickGermany
  2. 2.Department of Computer Science and EngineeringPOSTECHPohang-siKorea
  3. 3.The University of TokyoTokyoJapan

Personalised recommendations