Gamification of Online Surveys: Design Process, Case Study, and Evaluation

  • Johannes Harms
  • Stefan Biegler
  • Christoph Wimmer
  • Karin Kappel
  • Thomas Grechenig
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9296)


Online surveys are an important means of data collection in marketing and research, but conventional survey designs are often perceived as dull and unengaging, resulting in negative respondent behavior. Gamification has been proposed to make online surveys more pleasant to fill and, consequently, to improve the quality of survey results. This work applied gamification to an existing survey targeted at teenagers and young adults. The gamified survey was evaluated in a study with 60 participants regarding the psychological and behavioral outcomes of gamification. Results indicate that gamification successfully increased the users’ perceived fun, the average time spent, as well as their willingness to use and recommend the survey, without introducing a strong bias in survey results, albeit with a lower overall response rate.


Gamification Online surveys Questionnaires Evaluation 


  1. 1.
    Aparicio, A.F., Vela, F.L.G., Sánchez, J.L.G., Montes, J.L.I.: Analysis and application of gamification. In: Proceedings of the 13th International Conference on Interacción Persona-Ordenador, INTERACCION 2012, pp. 17:1–17:2. ACM, New York (2012)Google Scholar
  2. 2.
    Bargas-Avila, J., Brenzikofer, O., Roth, S., Tuch, A., Orsini, S., Opwis, K.: Simple but crucial user interfaces in the world wide web: introducing 20 guidelines for usable web form design. In: Matrai, R. (ed.) User Interfaces. InTech, Croatia (2010)Google Scholar
  3. 3.
    Becker, P.: Formulare als “Fließband” der Verwaltung? Zur Rationalisierung und Standardisierung von Kommunikationsbeziehungen. In: Collin, P., Lutterbeck, K.G. (eds.) Eine intelligente Maschine? Handlungsorientierungen moderner Verwaltung (19/20. Jh.). Nomos, Baden-Baden (2009)Google Scholar
  4. 4.
    Brooke, J.: SUS-a quick and dirty usability scale. Usability Eval. Ind. 189, 194 (1996)zbMATHGoogle Scholar
  5. 5.
    Buxton, B.: Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann Pub, Burlington (2007)Google Scholar
  6. 6.
    Cechanowicz, J., Gutwin, C., Brownell, B., Goodfellow, L.: Effects of gamification on participation and data quality in a real-world market research domain. In: Gamification 2013: Proceedings of the First International Conference on Gameful Design, Research, and Applications, pp. 66–73. ACM, Stratford (2013)Google Scholar
  7. 7.
    Deterding, S., Dixon, D., Khaled, R., Nacke, L.: From game design elements to gamefulness: defining “gamification”. In: Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments, MindTrek 2011, pp. 9–15. ACM, New York (2011)Google Scholar
  8. 8.
    Dolnicar, S., Grün, B., Yanamandram, V.: Dynamic, interactive survey questions can increase survey data quality. J. Travel Tourism Mark. 30(7), 690–699 (2013)CrossRefGoogle Scholar
  9. 9.
    Guin, T.D.-L., Baker, R., Mechling, J., Ruyle, E.: Myths and realities of respondent engagement in online surveys. Int. J. Mark. Res. 54(5), 1–21 (2012)Google Scholar
  10. 10.
    Eisermann, F.: Zu den Anfängen des gedruckten Formulars (Gastbeitrag). In: Formulare. Von der Wiege bis zu Bahre…: Formulare im Corporate Design. Stiebner Verlag GmbH (2007)Google Scholar
  11. 11.
    Hamari, J., Koivisto, J., Sarsa, H.: Does gamification work? – a literature review of empirical studies on gamification. In: Proceedings of the 47th Hawaii International Conference on System Sciences (2014)Google Scholar
  12. 12.
    Harms, J.: Research goals for evolving the ‘form’ user interface metaphor towards more interactivity. In: Holzinger, A., Ziefle, M., Hitz, M., Debevc, M. (eds.) SouthCHI 2013. LNCS, vol. 7946, pp. 819–822. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  13. 13.
    Harms, J., Wimmer, C., Kappel, K., Grechenig, T.: Gamification of online surveys: conceptual foundations and a design process based on the MDA framework. In: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational. pp. 565–568. ACM (2014)Google Scholar
  14. 14.
    Hsu, S.H., Chang, J.W., Lee, C.C.: Designing attractive gamification features for collaborative storytelling websites. Cyberpsychol. Behav. Soc. Netw. 16(6), 428–435 (2013)CrossRefGoogle Scholar
  15. 15.
    Hunicke, R., LeBlanc, M., Zubek, R.: MDA: a formal approach to game design and game research. In: Proceedings of the AAAI-04 Workshop on Challenges in Game AI, pp. 1–5 (2004)Google Scholar
  16. 16.
    Jarrett, C., Gaffney, G.: Forms that Work: Designing Web Forms for Usability. Morgan Kaufmann, Burlington (2008)Google Scholar
  17. 17.
    Kaminska, O., McCutcheon, A.L., Billiet, J.: Satisficing among reluctant respondents in a cross-national context. Public Opin. Q. 74(5), 956–984 (2010)CrossRefGoogle Scholar
  18. 18.
    Korhonen, H., Montola, M., Arrasvuori, J.: Understanding playful user experience through digital games. In: International Conference on Designing Pleasurable Products and Interfaces, pp. 274–285 (2009)Google Scholar
  19. 19.
    Lewis, C., Wardrip-Fruin, N., Whitehead, J.: Motivational game design patterns of ’ville games. In: Proceedings of the International Conference on the Foundations of Digital Games, FDG 2012, pp. 172–179. ACM, New York (2012)Google Scholar
  20. 20.
    Mavletova, A.: Web surveys among children and adolescents: Is there a gamification effect? Social Science Computer Review (2014)Google Scholar
  21. 21.
    Mayhew, D.J.: The Usability Engineering Lifecycle: A Practitioner’s Handbook for User Interface Design. Morgan Kaufmann, Burlington (1999)CrossRefzbMATHGoogle Scholar
  22. 22.
    Nielsen, J.: Usability Engineering. Morgan Kaufmann, Burlington (1993)Google Scholar
  23. 23.
    Puleston, J.: Online research–game on!: a look at how gaming techniques can transform your online research. In: Proceedings of the 6th ASC (Association for Survey Computing) International Conference Shifting the Boundaries of Research, pp. 20–50 (2011)Google Scholar
  24. 24.
    Reeves, B., Read, J.L.: Total Engagement: Using Games and Virtual Worlds to Change the Way People Work and Businesses Compete. Harvard Business Review Press, Watertown (2009)Google Scholar
  25. 25.
    Sweetser, P., Wyeth, P.: Gameflow: a model for evaluating player enjoyment in games. Comput. Entertainment 3(3), 1–24 (2005)CrossRefGoogle Scholar
  26. 26.
    Werbach, K., Hunter, D.: For the Win: How Game Thinking Can Revolutionize Your Business. Wharton Digital Press, Philadelphia (2012)Google Scholar
  27. 27.
    Wlaschits, B.: Gamifizierung von elektronischen Umfrageformularen: Design und Experten-Evaluierung. Master’s thesis, supervised by Thomas Grechenig and Johannes Harms (2014)Google Scholar
  28. 28.
    Wroblewski, L.: Web Form Design. Filling the Blanks. Louis Rosenfeld, Brooklyn (2008)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2015

Authors and Affiliations

  • Johannes Harms
    • 1
  • Stefan Biegler
    • 1
  • Christoph Wimmer
    • 1
  • Karin Kappel
    • 1
  • Thomas Grechenig
    • 1
  1. 1.INSO Research GroupVienna University of TechnologyViennaAustria

Personalised recommendations