Human Computation in Citizen Science

  • Chris LintottEmail author
  • Jason Reed


The increasing volume and variety of scientific data sets has produced a need for serious engagement with human computation. These citizen science efforts, which include disciplines as diverse as astronomy and zoology, are reviewed with a particular focus on Galaxy Zoo and the Zooniverse platform that grew from it. The key advantages of this approach—scalability, serendipity and the ability to inform machine learning—are demonstrated and the likely motivations of citizen scientists discussed. As datasets continue to grow in size, we argue that an increased focus on efficiency will be needed, but such an approach needs to carefully account for the likely effect on both motivation and on opportunities for learning.


Citizen Science Interstellar Dust Mars Global Surveyor Serendipitous Discovery Citizen Science Project 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. Anderson DP (2004) BOINC: a system for public-resource computing and storage. In: 5th IEEE/ACM international workshop on Grid computing, Pittsburgh, 8 Nov 2004, pp 1–7Google Scholar
  2. Anderson D, Cobb J, Korpela E, Lebofsky M, Werthimer D (2002) SETI@home: an experiment in public-resource computing. Commun ACM 45(11):56CrossRefGoogle Scholar
  3. Bamford S et al (2009) Galaxy Zoo: the dependence of morphology and colour on environment. MNRAS 393:1324Google Scholar
  4. Banerji M et al (2010) Galaxy Zoo: reproducing galaxy morphologies via machine learning. Mon Not R Astron Soc 406:342Google Scholar
  5. Barlow NG et al (2000) LPSC XXXI, Abstract #1475Google Scholar
  6. Bloom J et al (2012) Automating discovery and classification of transients and variable stars in the synoptic survey era. Publ Astron Soc Pac124:1175Google Scholar
  7. Cardamone C et al (2009) Galaxy Zoo Green Peas: discovery of a class of compact extremely star-forming galaxies, Mon Not R Astron Soc 399:1191Google Scholar
  8. Fischer D et al (2012) Planet Hunters: the first two planet candidates identified by the public using the Kepler public archive data. Mon Not R Astron Soc 419:2900Google Scholar
  9. Fortson L et al (2012) Galaxy Zoo: morphological classification and citizen science. In: Way MJ, Scargle JD, Ali K, Srivastava AN (eds) Advances in machine learning and data mining for astronomy. Chapman & Hall, Boca Raton, FLGoogle Scholar
  10. Ji W et al (2013) Planet Hunters. V. A confirmed Jupiter-size planet in the habitable zone and 42 planet candidates from the Kepler archive data. Submitt Astrophys J. Accessible at arXiv/1301.1644Google Scholar
  11. Kamar E, Hacker S, Horvitz E Combining human and machine intelligence in large-scale crowdsourcing. In: Proceedings of the 11th international conference on autonomous agents and multiagent systems, vol 1. p 467Google Scholar
  12. Kanefsky B, Barlow NG, Gulick VC (2001) Can distributed volunteers accomplish massive data analysis tasks? Presented at 32nd annual Lunar & planetary science conference, Abstract #1272Google Scholar
  13. Keel W et al (2012) The Galaxy Zoo survey for giant AGN-ionized clouds: past and present black hole accretion events. Mon Not R Astron Soc 420:878Google Scholar
  14. Keel W et al (2013) Galaxy Zoo: a catalog of overlapping Galaxy Pairs for dust studies. Publ Astron Soc Pac 125:2Google Scholar
  15. Khatib F et al (2011a) Algorithm discovery by protein folding game players. PNAS. doi  10.1073/pnas.1115898108
  16. Khatib F et al (2011b) Crystal structure of a monomeric retroviral protease solved by protein folding game players. Nat Struct Mol Biol 18:1175Google Scholar
  17. Knipsel B et al (2010) Pulsar discovery by global volunteer computing. Science 329:1305CrossRefGoogle Scholar
  18. Land K et al (2008) Galaxy Zoo: the large-scale spin statistics of spiral galaxies in the Sloan digital sky survey. MNRAS 388:1686Google Scholar
  19. Lintott C et al (2008) Mon Not R Astron Soc 389:1179Google Scholar
  20. Lintott C et al (2009) Mon Not R Astron Soc 339:129Google Scholar
  21. Massey N, Aina T, Allen M, Christensen C, Frame D, Goodman D, Kettleborough J, Martin A, Pascoe S, Stainforth D (2006) Data access and analysis with distributed federated data servers in Adv Geosci 8:49–56CrossRefGoogle Scholar
  22. Mendez BJH (2008) In: Garmany C, Gibbs MG, Moody JW, (eds) ASP conference series, vol 389. EPO and a changing world: creating linkages and expanding partnerships. Astron Soc Pac, San Francisco, p 219Google Scholar
  23. Popovic Z (2008) CASP8 results, Foldit Blog, 17 Dec 2008
  24. Raddick J et al (2013) Galaxy Zoo: motivations of citizen science volunteers. Astron Educ Rev (in press)
  25. Raman S, Baker D, Qian B, Walker RC (2008) Advances in Rosetta protein structure prediction on massively parallel systems. J Res Dev 52(1–2):7Google Scholar
  26. Schwamb et al (2012) Planet Hunters: assessing the Kepler inventory of short-period planets. Astrophys J 754:129Google Scholar
  27. Schwamb et al (2013) Planet Hunters: a transiting circumbinary planet in a quadruple star system. Astrophys J 768:127Google Scholar
  28. Simpson R et al (2012) The milky way project first data release: a bubblier galactic disc. Mon Not R Astron Soc 424:2442CrossRefGoogle Scholar
  29. Simpson E, Roberts S, Psorakis I, Smith A (2013) Dynamic Bayesian combination of multiple imperfect classifiers. Stud Comput Intell 474:1–35CrossRefGoogle Scholar
  30. Smith A et al (2010) Galaxy Zoo supernovae. Mon Not R Astron Soc 412:1309Google Scholar
  31. von Ahn L, Maurer B, McMillen C, Abraham D, Blum M (2008) reCAPTCHA: human-based character recognition via web security measures. Science 321(5895):1465MathSciNetCrossRefzbMATHGoogle Scholar
  32. Waterhouse T (2013) Pay by the bit: an information-theoretic metric for collective human judgment. In: Proceeding CSCW, ACM, New York, pp 623–638Google Scholar
  33. Willett et al (2013) MNRAS, 435, 2835Google Scholar
  34. York, D et al (2000) Astron J 120:1579Google Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  1. 1.University of OxfordOxfordUK
  2. 2.Adler PlanetariumChicagoUSA

Personalised recommendations