Abstract
Crowdsourcing, the process of gathering financial support or services from an online community, has become extremely popular throughout the last decade. Playsourcing is a particular form of crowdsourcing that requires embedding human intelligence-based tasks in computer games. We present a general framework for embedding tasks such as edge detection into computer games. Our proposed framework is based on Gestalt principles, and is a seamless and invisible means of embedding into existing computer games, which could make such tasks by the player more popular. A case study is presented in order to demonstrate the general principle as well as the potential of this approach.
Similar content being viewed by others
References
Aamoth, D. (2014). ‘Here’s how much time people spend playing video games. Time Magazine. Available from: www.time.com/120476/nielsen-video-games
Betts, T. (2011). Pattern recognition: Gameplay as negotiating procedural form. In Think design play: The fifth international conference of the digital research association, Hilversum, Netherlands, September 2011 (pp. 14–17). Citeseer.
Blake, A., & Zisserman, A. (1987). Visual reconstruction. Cambridge: MIT press.
Coburn, C. (2014). Play to cure: Genes in space. The Lancet Oncology, 15(7), 688.
Cooper, S., Khatib, F., Treuille, A., Barbero, J., Lee, J., Beenen, M., et al. (2010). Predicting protein structures with a multiplayer online game. Nature, 466(7307), 756–760.
Cremers, D., Rousson, M., & Deriche, R. (2007). A review of statistical approaches to level set segmentation: Integrating color, texture, motion and shape. International Journal of Computer Vision, 72(2), 195–215.
Deng, J., Krause, J., & Fei-Fei, L. (2013). Fine-grained crowdsourcing for fine-grained recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 580–587).
Deng, J., Krause, J., Stark, M., & Fei-Fei, L. (2016). Leveraging the wisdom of the crowd for fine-grained recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38(4), 666–676.
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From game design elements to gamefulness: Defining gamification. In Proceedings of the 15th international academic MindTrek conference: Envisioning future media environments (pp. 9–15). ACM.
Donath, A., & Kondermann, D. (2013). Is crowdsourcing for optical flow ground truth generation feasible? In International conference on computer vision systems (pp. 193–202).
Eiben, C., Siegel, J., Bale, J., Cooper, S., Khatib, F., Shen, B., et al. (2012). Increased dielsalderase activity through backbone remodeling guided by foldit players. Nature Biotechnology, 30(2), 190–192.
Entertainment Software Association (ESA). (2016, December 12). Essential facts about the computer and video game industry. ESA. http://essentialfacts.theesa.com/.
Fails, J., & Olsen, D. (2003) Interactive machine learning. In Proceedings of the 8th international conference on intelligent user interfaces (pp. 39–45). ACM.
Grady, L. (2006). Random walks for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(11), 1768–1783.
Gurari, D., Theriault, D., Sameki, M., Isenberg, B., Pham, T., Purwada, A., Solski, P., Walker, M., Zhang, C., & Wong, J. (2015). How to collect segmentations for biomedical images? A benchmark evaluating the performance of experts, crowdsourced non-experts, and algorithms. In 2015 IEEE winter conference on applications of computer vision (pp. 1169–1176). IEEE.
Khatib, F., DiMaio, F., Cooper, S., Kazmierczyk, S., Gilski, M., Krzywda, S., et al. (2011). Crystal structure of a monomeric retroviral protease solved by protein folding game players. Nature Structural and Molecular Biology, 18(10), 1175–1177.
Krause, M., Takhtamysheva, A., Wittstock, M., & Malaka, R. (2010). Frontiers of a paradigm: Exploring human computation with digital games. In Proceedings of the ACM SIGKDD workshop on human computation (pp. 22–25). ACM.
Lafourcade, M., Joubert, A., & Le Brun, N. (2015). Games with a purpose (GWAPS). New York: Wiley.
Law, E., & Von Ahn, L. (2009). Input-agreement: A new mechanism for collecting data using human computation games. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 1197–1206). ACM.
Maier-Hein, L., Mersmann, S., Kondermann, D., Bodenstedt, S., Sanchez, A., Stock, C., Kenngott, H., Eisenmann, M., & Speidel, S. (2014a). Can masses of non-experts train highly accurate image classifiers? In International conference on medical image computing and computer-assisted intervention (pp. 438–445).
Maier-Hein, L., Mersmann, S., Kondermann, D., Stock, C., Kenngott, H., Sanchez, A., Wagner, M., Preukschas, A., Wekerle, A., & Helfert, S. (2014b). Crowdsourcing for reference correspondence generation in endoscopic images. In International conference on medical image computing and computer-assisted intervention (pp. 349–356).
Menze, B., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., et al. (2015). The multimodal brain tumor image segmentation benchmark (BRATs). IEEE Transactions on Medical Imaging, 34(10), 1993–2024.
Peng, B., Zhang, L., & Zhang, D. (2013). A survey of graph theoretical approaches to image segmentation. Pattern Recognition, 46(3), 1020–1038.
Poggio, T., Torre, V., & Koch, C. (1985). Computational vision and regularization theory. Nature, 317(6035), 314–319.
Ranard, B., Ha, Y., Meisel, Z., Asch, D., Hill, S., Becker, L., et al. (2014). Crowdsourcing—Harnessing the masses to advance health and medicine, a systematic review. Journal of General Internal Medicine, 29(1), 187–203.
Russell, B., Torralba, A., Murphy, K., & Freeman, W. (2008). Labelme: A database and web-based tool for image annotation. International Journal of Computer Vision, 77(1–3), 157–173.
Sha’asua, A., & Ullman, S. (1988). Structural saliency: The detection of globally salient structures using a locally connected network. In Computer vision. Second international conference (pp. 321–327).
Souvenir, R., Hajja, A., & Spurlock, S. (2012). Gamesourcing to acquire labeled human pose estimation data. In 2012 IEEE computer society conference on computer vision and pattern recognition workshops (pp. 1–6). IEEE.
Suinesiaputra, A., Cowan, B. R., Al-Agamy, A. O., AlAttar, M. A., Ayache, N., Fahmy, A. S., et al. (2014). A collaborative resource to build consensus for automated left ventricular segmentation of cardiac MR images. Medical Image Analysis, 18(1), 50–62.
Szeliski, R. (2011). Computer vision: Algorithms and applications. London: Springer. doi:10.1007/978-1-84882-935-0.
Von Ahn, L., & Dabbish, L. (2008). Designing games with a purpose. Communications of the ACM, 51(8), 58–67.
Wah, C. (2006). Crowdsourcing and its applications in computer vision. San Diego: University of California.
Wertheimer, M. (1923). Untersuchungen zur lehre von der gestalt. Psychological Research, 4(1), 301–350.
Zichermann, G., & Cunningham, C. (2011). Gamification by design: Implementing game mechanics in web and mobile apps. Sebastopol: O’Reilly Media, Inc.
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Hennersperger, C., Baust, M. Play for Me: Image Segmentation via Seamless Playsourcing. Comput Game J 6, 1–16 (2017). https://doi.org/10.1007/s40869-016-0030-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40869-016-0030-3