Abstract
The goal of this study is to understand the mechanism of gamification in crowdsourcing by investigating the ways of giving rewards. Perceived reward diversity is proposed as a construct to induce fun experience from participants based on previous studies about gamified crowdsourcing. With respect to system manipulation, explicating the anticipated level of rewards before task phase is conducted. The effect of explication on task outcome and psychological outcome is compared with control group. As a result, both perceived reward diversity and explicating the anticipated level of rewards significantly affect both quality and quantity of submitted answers, as well as feeling of fun during the task phase. The limitation and implication of the study is stated in the end.
Chapter PDF
Similar content being viewed by others
References
Amabile, T.M.: Social psychology of creativity: A consensual assessment technique. Journal of Personality and Social Psychology 43, 997–1013 (1982)
Amory, A., Naicker, K., Vincent, J., Adams, C.: The use of computer games as an educational tool: Identification of appropriate game types and game elements. British Journal of Educational Technology 30(4), 311–321 (1999)
Banker, R.D., Lee, S., Potter, G., Srinivasan, D.: Contextual analysis of performance impacts of outcome-based incentive compensation. Academy of Management Journal 39(4), 920–948 (1996)
Boudreau, K.J., Lakhani, K.R.: How to manage outside innovation. MIT Sloan Management Review 50(4), 69–76 (2009)
Caplin, A., Leahy, J.: Psychological expected utility theory and anticipatory feelings. The Quarterly Journal of Economics 116(1), 55–79 (2001)
Deterding, S., Dixon, D., Khaled, R., Nacke, L.: From game design elements to gamefulness: Defining gamification. In: Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments, pp. 9–15 (2011)
Deterding, S., Sicart, M., Nacke, L., O’Hara, K., Dixon, D.: Gamification. using game-design elements in non-gaming contexts. In: Proceedings of the 2011, Annual Conference Extended Abstracts on Human Factors in Computing Systems, Part 2, pp. 2425–2428 (2011)
Eisenhardt, K.M.: Building theories from case study research. Academy of Management Review 14(4), 532–550 (1989)
Eisenhardt, K.M., Graebner, M.E.: Theory building from cases: Opportunities and challenges. Academy of Management Journal 50(1), 25–32 (2007)
Federoff, M.A.: Heuristics and Usability Guidelines for the Creation and Evaluation of Fun in Video Games (2002)
Festinger, L.: A theory of cognitive dissonance. Stanford University Press (1962)
Greenwald, A.G., Ronis, D.L.: Twenty years of cognitive dissonance: Case study of the evolution of a theory. Psychological Review 85(1), 53 (1978)
Hoonhout, J.: Development of a Rating Scale to Determine the Enjoyability of User Interactions with Consumer Devices (2002)
Horton, J.J., Chilton, L.B.: The labor economics of paid crowdsourcing. In: Proceedings of the 11th ACM Conference on Electronic Commerce, pp. 209–218 (2010)
Horton, J.J., Chilton, L.B.: The labor economics of paid crowdsourcing. In: Proceedings of the 11th ACM Conference on Electronic Commerce, pp. 209–218 (2010)
Komarov, S., Reinecke, K., Gajos, K.Z.: Crowdsourcing performance evaluations of user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 207–216 (2013)
Koster, R.: Theory of fun for game design. O’Reilly Media, Inc. (2010)
Lavy, V.: Using performance-based pay to improve the quality of teachers. The Future of Children 17(1), 87–109 (2007)
Leimeister, J.M., Huber, M., Bretschneider, U., Krcmar, H.: Leveraging crowdsourcing: Activation-supporting components for IT-based ideas competition. Journal of Management Information Systems 26(1), 197–224 (2009)
Malone, T.W.: Heuristics for designing enjoyable user interfaces: Lessons from computer games. In: Proceedings of the 1982 Conference on Human Factors in Computing Systems, pp. 63–68 (1982)
Martin, A.L., Wiemeyer, J.: Technology-mediated experience of space while playing digital sports games. International Journal of Computer Science in Sport 11, 135–146 (2012); (Special Edition 1: Serious Games-Theory, Technology & Practice)
Mehrabian, A., Russell, J.A.: An approach to environmental psychology. The MIT Press (1974)
Mueller, F., Agamanolis, S., Picard, R.: Exertion interfaces: Sports over a distance for social bonding and fun. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 561–568 (2003)
Oleson, D., Sorokin, A., Laughlin, G.P., Hester, V., Le, J., Biewald, L.: Programmatic gold: Targeted and scalable quality assurance in crowdsourcing. Human Computation 11, 11 (2011)
Pearce, J.L.: Job attitude and motivation differences between volunteers and employees from comparable organizations. Journal of Applied Psychology 68(4), 646 (1983)
Poetz, M.K., Schreier, M.: The value of crowdsourcing: Can users really compete with professionals in generating new product ideas? Journal of Product Innovation Management 29(2), 245–256 (2012)
Röber, N., Huber, C., Hartmann, K., Feustel, M., Masuch, M.: Interactive audiobooks: Combining narratives with game elements. In: Göbel, S., Malkewitz, R., Iurgel, I. (eds.) TIDSE 2006. LNCS, vol. 4326, pp. 358–369. Springer, Heidelberg (2006)
Ross, J., Irani, L., Silberman, M., Zaldivar, A., Tomlinson, B.: Who are the crowdworkers?: Shifting demographics in mechanical turk. In: CHI 2010, Extended Abstracts on Human Factors in Computing Systems, pp. 2863–2872 (2010)
Scollan, R.: Designing a pleasurable interface: Emotion in human-computer interaction. Interaction Design and Information Architecture. University of Baltimore, MD (2007)
Vallerand, R.J.: Toward a hierarchical model of intrinsic and extrinsic motivation. Advances in Experimental Social Psychology 29, 271–360 (1997)
Zheng, H., Li, D., Hou, W.: Task design, motivation, and participation in crowdsourcing contests. International Journal of Electronic Commerce 15(4), 57–88 (2011)
Zichermann, G., Cunningham, C.: Gamification by design: Implementing game mechanics in web and mobile apps. O’Reilly Media, Inc. (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Choi, J., Choi, H., So, W., Lee, J., You, J. (2014). A Study about Designing Reward for Gamified Crowdsourcing System. In: Marcus, A. (eds) Design, User Experience, and Usability. User Experience Design for Diverse Interaction Platforms and Environments. DUXU 2014. Lecture Notes in Computer Science, vol 8518. Springer, Cham. https://doi.org/10.1007/978-3-319-07626-3_64
Download citation
DOI: https://doi.org/10.1007/978-3-319-07626-3_64
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07625-6
Online ISBN: 978-3-319-07626-3
eBook Packages: Computer ScienceComputer Science (R0)