Skip to main content

Constructing Crowdsourced Workflows

  • Chapter
  • First Online:
Handbook of Human Computation
  • 3323 Accesses

Abstract

Building an informed crowdsourced workflow can help improve the quality of crowdsourcing results by allowing workers to collaborate and build on each others’ work. This topic has been widely adopted and studied.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Bernstein MS, Little G, Miller RC, Hartmann B, Ackerman MS, Karger DR, Crowell D, Panovich K (2010) Soylent: a word processor with a crowd inside. In: UIST, New York, pp 313–322

    Google Scholar 

  • Chilton L, Little G, Edge D, Weld DS, Landay JA (2013) Cascade: Crowdsourcing taxonomy creation In: CHI, Paris

    Google Scholar 

  • Dai P, Lin CH, Mausam, Weld DS (2013) POMDP-based control of workflows for crowdsourcing. Artif Intell 202:52-85

    Article  Google Scholar 

  • Dai P, Mausam, Weld DS (2010) Decision-theoretic control of crowd-sourced workflows. In: AAAI, Atlanta

    Google Scholar 

  • Dai P, Mausam, Weld DS (2011) Artificial intelligence for artificial artificial intelligence. In: AAAI, San Francisco

    Google Scholar 

  • Donmez P, Carbonell JG, Schneider J (2010) A probabilistic framework to learn from multiple annotators with time-varying accuracy. In: SIAM international conference on data mining (SDM), Columbus, pp 826–837

    Google Scholar 

  • Kulkarni A, Can M, Hartmann B (2012) Collaboratively crowdsourcing workflows with turkomatic. In: Proceedings of CSCW, Seattle

    Google Scholar 

  • Lasecki WS, Murray KI, White S, Miller RC, Bigham JP (2011) Real-time crowd control of existing interfaces. In: Proceedings of UIST, Santa Barbara

    Google Scholar 

  • Liem B, Zhang H, Chen Y (2011) An iterative dual pathway structure for speech-to-text transcription. In: HCOMP, San Francisco

    Google Scholar 

  • Lin CH, Mausam, Weld DS (2012a) Crowdsourcing control: moving beyond multiple choice. In: UAI, Toronto

    Google Scholar 

  • Lin CH, Mausam, Weld DS (2012b) Dynamically switching between synergistic workflows for crowdsourcing. In: AAAI, Toronto

    Google Scholar 

  • Little G, Chilton LB, Goldman M, Miller RC (2009) Turkit: tools for iterative tasks on mechanical turk. In: KDD workshop on human computation, Paris, pp 29–30

    Google Scholar 

  • Little G, Chilton LB, Goldman M, Miller RC (2010) Turkit: human computation algorithms on mechanical turk. In: UIST, New York, pp 57–66

    Google Scholar 

  • Michelucci PE (2000) A quantum model of recognition. Dissertation, Indiana University

    Google Scholar 

  • Noronha J, Hysen E, Zhang H, Gajos KZ (2011) Platemate: crowdsourcing nutrition analysis from food photographs. In: UIST, Santa Barbara

    Google Scholar 

  • Rzeszotarski J, Chi E, Paratosh P, Dai P (2013) And now for something completely different: introducing micro-breaks into crowdsourcing workflows. In: HCOMP WiP track

    Google Scholar 

  • Zhang H, Law E, Miller R, Gajos K, Parkes DC, Horvitz E (2012) Human computation tasks with global constraints. In: CHI, Austin, pp 217–226

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Peng Dai .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

Dai, P. (2013). Constructing Crowdsourced Workflows. In: Michelucci, P. (eds) Handbook of Human Computation. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8806-4_49

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-8806-4_49

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-8805-7

  • Online ISBN: 978-1-4614-8806-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics