Abstract
Crowdsourcing as a new popular technology is being considered as an efficient way to accomplish many tasks in people’s lives. Quality control for crowdsoucing consequentially becomes an essential topic to ensure the task’s final performance. In this paper, we introduced a crowdsourcing platform for professional dictionary compilation (PDCCP), which involves words translation and audition and features a large-scale non-computing automatic crowdsourcing task type. Especially for this kind, we proposed a Quality Testing Method working appropriately in PDCCP. Basically, in the quality testing part of the original translation crowdsroucing task, we used another crowdsourcing task to complete the audition process and returned the audition results as translation task results and also feedbacks of task attendants’ submitted results quality. To further improve the quality contorl method in PDCCP and take advantage of the Quality Testing Method’s feedback, we explored two task distribution strategies, which are static strategy and competency strategy, and we also expeirmented how these strategies might influnece the task’s quality and efficiency.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Howe, J.: The rise of crowdsourcing. Wired Magazine 14(6), 1–4 (2006)
Brabham, D.C.: Crowdsourcing as a model for problem solving an introduction and cases. Convergence: The International Journal of Research into New Media Technologies 14(1), 75–90 (2008)
Walter, S.D.: Gold Standard Test Encyclopedia of Biostatistics
Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society 39(1), 1–38 (1977)
Ipeirotis, P.G., Provost, F., Wang, J.: Quality management on amazon mechanical turk. In: Proceedings of the ACM SIGKDD Workshop on Human Computation, pp. 64–67. ACM (2010)
Zhang, Z., Pang, J., Xie, X.: Research on crowdsourcing strategy of quality control and evaluation algorithm. Chinese Journal of Computers 36(8), 1636–1649 (2013)
Howe, J.: The rise of crowdsourcing. Wired Magazine 14(6), 1–4 (2006)
Brabham, D.C.: Crowdsourcing as a model for problem solving an introduction and cases. Convergence: the International Journal of Research into New Media Technologies 14(1), 75–90 (2008)
Doan, A., Ramakrishnan, R., Halevy, A.Y.: Crowdsourcing systems on the world-wide web. Communications of the ACM 54(4), 86–96 (2011)
Franklin, M.J., Kossmann, D., Kraska, T., et al.: CrowdDB: answering queries with crowdsourcing. In: Proceedings of the 2011 ACM SIGMOD International Conference on Management of Data, pp. 61–72. ACM (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Feng, S., Li, X., Ou, H. (2015). Quality Control Method in Crowdsourcing Platform for Professional Dictionary Compilation Process (PDCCP). In: Cao, J., Wen, L., Liu, X. (eds) Process-Aware Systems. PAS 2014. Communications in Computer and Information Science, vol 495. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-46170-9_7
Download citation
DOI: https://doi.org/10.1007/978-3-662-46170-9_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-46169-3
Online ISBN: 978-3-662-46170-9
eBook Packages: Computer ScienceComputer Science (R0)