QoS-Based Task Scheduling in Crowdsourcing Environments
Crowdsourcing has emerged as an important paradigm in human-problem solving techniques on the Web. One application of crowdsourcing is to outsource certain tasks to the crowd that are difficult to implement as solutions based on software services only. Another benefit of crowdsourcing is the on-demand allocation of a flexible workforce. Businesses may outsource certain tasks to the crowd based on workload variations. The paper addresses the monitoring of crowd members’ characteristics and the effective use of monitored data to improve the quality of work. Here we propose the extensions of standards such as Web Service Level Agreement (WSLA) to settle quality guarantees between crowd consumers and the crowdsourcing platform. Based on negotiated agreements, we provide a skill-based crowd scheduling algorithm. We evaluate our approach through simulations.
Keywordscrowdsourcing skill monitoring scheduling QoS agreements
Unable to display preview. Download preview PDF.
- 1.Agichtein, E., Castillo, C., Donato, D., Gionis, A., Mishne, G.: Finding high-quality content in social media. In: WSDM 2008, pp. 183–194. ACM (2008)Google Scholar
- 2.Agrawal, A., et al.: WS-BPEL Extension for People (BPEL4People) (2007) Google Scholar
- 3.Amazon Mechnical Turk (May 2011), http://www.mturk.com
- 4.Brabham, D.: Crowdsourcing as a model for problem solving: An introduction and cases. Convergence 14(1), 75 (2008)Google Scholar
- 9.Ernst, A.T., Jiang, H., Krishnamoorthy, M., Sier, D.: Staff scheduling and rostering: A review of applications, methods and models. European Journal of Operational Research 153(1), 3–27 (2004), timetabling and RosteringGoogle Scholar
- 10.Ford, M., et al.: Web Services Human Task (WS-HumanTask), Version 1.0. (2007) Google Scholar
- 11.Howe, J.: The rise of crowdsourcing (June 2006), http://www.wired.com/
- 12.Ipeirotis, P.G.: Analyzing the Amazon Mechanical Turk Marketplace. SSRN eLibrary 17(2), 16–21 (2010)Google Scholar
- 14.Khazankin, R., Schall, D., Dustdar, S.: Adaptive request prioritization in dynamic service-oriented systems. In: Proceedings of the 8th International Conference on Services Computing (to appear, 2011) Google Scholar
- 17.LiveOps (May 2011), https://www.livework.com/
- 21.Vukovic, M.: Crowdsourcing for Enterprises. In: Proceedings of the 2009 Congress on Services, pp. 686–692. IEEE (2009) Google Scholar
- 22.Yahoo! Answers (May 2011), http://answers.yahoo.com/