Skip to main content
Log in

Play for Me: Image Segmentation via Seamless Playsourcing

  • Case study
  • Published:
The Computer Games Journal

Abstract

Crowdsourcing, the process of gathering financial support or services from an online community, has become extremely popular throughout the last decade. Playsourcing is a particular form of crowdsourcing that requires embedding human intelligence-based tasks in computer games. We present a general framework for embedding tasks such as edge detection into computer games. Our proposed framework is based on Gestalt principles, and is a seamless and invisible means of embedding into existing computer games, which could make such tasks by the player more popular. A case study is presented in order to demonstrate the general principle as well as the potential of this approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  • Aamoth, D. (2014). ‘Here’s how much time people spend playing video games. Time Magazine. Available from: www.time.com/120476/nielsen-video-games

  • Betts, T. (2011). Pattern recognition: Gameplay as negotiating procedural form. In Think design play: The fifth international conference of the digital research association, Hilversum, Netherlands, September 2011 (pp. 14–17). Citeseer.

  • Blake, A., & Zisserman, A. (1987). Visual reconstruction. Cambridge: MIT press.

    Google Scholar 

  • Coburn, C. (2014). Play to cure: Genes in space. The Lancet Oncology, 15(7), 688.

    Article  Google Scholar 

  • Cooper, S., Khatib, F., Treuille, A., Barbero, J., Lee, J., Beenen, M., et al. (2010). Predicting protein structures with a multiplayer online game. Nature, 466(7307), 756–760.

    Article  Google Scholar 

  • Cremers, D., Rousson, M., & Deriche, R. (2007). A review of statistical approaches to level set segmentation: Integrating color, texture, motion and shape. International Journal of Computer Vision, 72(2), 195–215.

    Article  Google Scholar 

  • Deng, J., Krause, J., & Fei-Fei, L. (2013). Fine-grained crowdsourcing for fine-grained recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 580–587).

  • Deng, J., Krause, J., Stark, M., & Fei-Fei, L. (2016). Leveraging the wisdom of the crowd for fine-grained recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38(4), 666–676.

    Article  Google Scholar 

  • Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From game design elements to gamefulness: Defining gamification. In Proceedings of the 15th international academic MindTrek conference: Envisioning future media environments (pp. 9–15). ACM.

  • Donath, A., & Kondermann, D. (2013). Is crowdsourcing for optical flow ground truth generation feasible? In International conference on computer vision systems (pp. 193–202).

  • Eiben, C., Siegel, J., Bale, J., Cooper, S., Khatib, F., Shen, B., et al. (2012). Increased dielsalderase activity through backbone remodeling guided by foldit players. Nature Biotechnology, 30(2), 190–192.

    Article  Google Scholar 

  • Entertainment Software Association (ESA). (2016, December 12). Essential facts about the computer and video game industry. ESA. http://essentialfacts.theesa.com/.

  • Fails, J., & Olsen, D. (2003) Interactive machine learning. In Proceedings of the 8th international conference on intelligent user interfaces (pp. 39–45). ACM.

  • Grady, L. (2006). Random walks for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(11), 1768–1783.

    Article  Google Scholar 

  • Gurari, D., Theriault, D., Sameki, M., Isenberg, B., Pham, T., Purwada, A., Solski, P., Walker, M., Zhang, C., & Wong, J. (2015). How to collect segmentations for biomedical images? A benchmark evaluating the performance of experts, crowdsourced non-experts, and algorithms. In 2015 IEEE winter conference on applications of computer vision (pp. 1169–1176). IEEE.

  • Khatib, F., DiMaio, F., Cooper, S., Kazmierczyk, S., Gilski, M., Krzywda, S., et al. (2011). Crystal structure of a monomeric retroviral protease solved by protein folding game players. Nature Structural and Molecular Biology, 18(10), 1175–1177.

    Article  Google Scholar 

  • Krause, M., Takhtamysheva, A., Wittstock, M., & Malaka, R. (2010). Frontiers of a paradigm: Exploring human computation with digital games. In Proceedings of the ACM SIGKDD workshop on human computation (pp. 22–25). ACM.

  • Lafourcade, M., Joubert, A., & Le Brun, N. (2015). Games with a purpose (GWAPS). New York: Wiley.

    Book  Google Scholar 

  • Law, E., & Von Ahn, L. (2009). Input-agreement: A new mechanism for collecting data using human computation games. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 1197–1206). ACM.

  • Maier-Hein, L., Mersmann, S., Kondermann, D., Bodenstedt, S., Sanchez, A., Stock, C., Kenngott, H., Eisenmann, M., & Speidel, S. (2014a). Can masses of non-experts train highly accurate image classifiers? In International conference on medical image computing and computer-assisted intervention (pp. 438–445).

  • Maier-Hein, L., Mersmann, S., Kondermann, D., Stock, C., Kenngott, H., Sanchez, A., Wagner, M., Preukschas, A., Wekerle, A., & Helfert, S. (2014b). Crowdsourcing for reference correspondence generation in endoscopic images. In International conference on medical image computing and computer-assisted intervention (pp. 349–356).

  • Menze, B., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., et al. (2015). The multimodal brain tumor image segmentation benchmark (BRATs). IEEE Transactions on Medical Imaging, 34(10), 1993–2024.

    Article  Google Scholar 

  • Peng, B., Zhang, L., & Zhang, D. (2013). A survey of graph theoretical approaches to image segmentation. Pattern Recognition, 46(3), 1020–1038.

    Article  Google Scholar 

  • Poggio, T., Torre, V., & Koch, C. (1985). Computational vision and regularization theory. Nature, 317(6035), 314–319.

    Article  Google Scholar 

  • Ranard, B., Ha, Y., Meisel, Z., Asch, D., Hill, S., Becker, L., et al. (2014). Crowdsourcing—Harnessing the masses to advance health and medicine, a systematic review. Journal of General Internal Medicine, 29(1), 187–203.

    Article  Google Scholar 

  • Russell, B., Torralba, A., Murphy, K., & Freeman, W. (2008). Labelme: A database and web-based tool for image annotation. International Journal of Computer Vision, 77(1–3), 157–173.

    Article  Google Scholar 

  • Sha’asua, A., & Ullman, S. (1988). Structural saliency: The detection of globally salient structures using a locally connected network. In Computer vision. Second international conference (pp. 321–327).

  • Souvenir, R., Hajja, A., & Spurlock, S. (2012). Gamesourcing to acquire labeled human pose estimation data. In 2012 IEEE computer society conference on computer vision and pattern recognition workshops (pp. 1–6). IEEE.

  • Suinesiaputra, A., Cowan, B. R., Al-Agamy, A. O., AlAttar, M. A., Ayache, N., Fahmy, A. S., et al. (2014). A collaborative resource to build consensus for automated left ventricular segmentation of cardiac MR images. Medical Image Analysis, 18(1), 50–62.

    Article  Google Scholar 

  • Szeliski, R. (2011). Computer vision: Algorithms and applications. London: Springer. doi:10.1007/978-1-84882-935-0.

    Book  MATH  Google Scholar 

  • Von Ahn, L., & Dabbish, L. (2008). Designing games with a purpose. Communications of the ACM, 51(8), 58–67.

    Google Scholar 

  • Wah, C. (2006). Crowdsourcing and its applications in computer vision. San Diego: University of California.

    Google Scholar 

  • Wertheimer, M. (1923). Untersuchungen zur lehre von der gestalt. Psychological Research, 4(1), 301–350.

    Article  Google Scholar 

  • Zichermann, G., & Cunningham, C. (2011). Gamification by design: Implementing game mechanics in web and mobile apps. Sebastopol: O’Reilly Media, Inc.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maximilian Baust.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hennersperger, C., Baust, M. Play for Me: Image Segmentation via Seamless Playsourcing. Comput Game J 6, 1–16 (2017). https://doi.org/10.1007/s40869-016-0030-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40869-016-0030-3

Keywords

Navigation