Gamification of Software Testing - An MLR

  • Mika V. Mäntylä
  • Kari Smolander
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10027)


This paper presents an initial multi-vocal literature review that extracts ideas for gamification of software testing. We surveyed the type of testing, system under test, role of individuals, gamification elements, challenges and drawbacks, support constructs and tools, and empirical evidence from academic sources and grey literature. Ideas were given to both automated unit-testing, and end-user related testing done by exploratory testers and beta testers. The most frequent gamification elements were points (13 sources), awards (4), stories (4), badges (3), rankings (3), levels (3) and time-pressure (3).


Gamification Testing Multi-vocal literature Grey literature 


  1. 1.
    Pedreira, O., García, F., Brisaboa, N., Piattini, M.: Gamification in software engineering – a systematic mapping. Inf. Softw. Technol. 57, 157–168 (2015)CrossRefGoogle Scholar
  2. 2.
    Buenen, M., Walgude, A.: World Quality Report 2015–2016. Capgemini, Sogeti und HP (2015)Google Scholar
  3. 3.
    Garousi, V., Felderer, M., Mäntylä, M.V.: The need for multivocal literature reviews in software engineering: complementing systematic literature reviews with grey literature, p. 26. ACM (2016)Google Scholar
  4. 4.
    Mäntylä, M.V., Smolander, K.: Spreadsheet of sources: Gamification of Software Testing - an MLR [Internet]. Figshare. doi: 10.6084/m9.figshare.3756600
  5. 5.
    Mäntylä, M.V., Itkonen, J., Iivonen, J.: Who tested my software? Testing as an organizationally cross-cutting activity. Softw. Qual. J. 20, 145–172 (2012)CrossRefGoogle Scholar
  6. 6.
    Prechelt, L., Schmeisky, H., Zieris, F.: Quality experience: a grounded theory of successful agile projects without dedicated testers, pp. 1017–1027. ACM (2016)Google Scholar
  7. 7.
    Hamari, J., Koivisto, J., Sarsa, H.: Does gamification work? – A literature review of empirical studies on gamification, pp. 3025–3034. IEEE (2014)Google Scholar
  8. 8.
    Aranda, J., Venolia, G.: The secret life of bugs: going past the errors and omissions in software repositories, pp. 298–308. IEEE Computer Society (2009)Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.University of OuluOuluFinland
  2. 2.Aalto UniversityEspooFinland

Personalised recommendations