Skip to main content
SpringerLink
Log in

Game for aNy heuristic evaluation (G4NHE): a generalization of the G4H gamification considering different sets of usability heuristics

  • Long Paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

Abstract

Many initiatives have promoted collaborative heuristic evaluation to avoid discrepancies between evaluator’s ratings. This paper presents G4NHE (Game for aNy heuristic evaluation), a card game proposed to increase the engagement of different evaluators in an evaluation process based on heuristic evaluation. G4NHE is a generalization of previous work (the G4H gamification) to be applied to different usability heuristics. G4H was designed to support Nielsen’s heuristics only. The main goal of G4NHE is to provide an engaging and ludic way to consolidate collaborative heuristic evaluation. It can also be used by students and professionals to coordinate the tasks of heuristic evaluations. Several usability heuristics were analyzed to identify the common characteristics and how these characteristics demand changes in the rules of original G4H generic gamification named G4NHE. G4NHE can be used as complementary material to HCI courses. This paper presents the steps used to create G4NHE and a guide to enable any HCI professional or student to use G4NHE gamification with any usability heuristic. As a result, this work enables gamification non-specialists to create a gamification based on G4H (a gamification built for Nielsen’s heuristics) to any usability heuristic. G4NHE still needs to be fully evaluated, but the expectations are that it can take advantage of the engagement, ludic teaching, and participation satisfaction already present in G4H by using any usability heuristic.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. https://www.mercadolivre.com.br/.

  2. https://www.flaticon.com/packs/emoji-3.

References

  1. Nielsen, J.: Usability Engineering. Morgan Kaufmann, San Francisco, CA (1993)

    Book  MATH  Google Scholar 

  2. Nielsen, J.: Finding usability problems through heuristic evaluation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 373–380. ACM, Monterey, California, USA (1992)

    Chapter  Google Scholar 

  3. Barbosa, S.D.J., Silva, B.S.: Interação humano-computador. Elsevier, Rio de Janeiro, Brazil (2010). (in Portuguese)

    Google Scholar 

  4. Nielsen, J.: 10 Usability heuristics for user interface design. Nielsen Norman Group: UX Training, Consulting, & Research. https://www.nngroup.com/articles/ten-usability-heuristics/ (1995). Accessed 22 Mar 2018

  5. Korhonen, H., Koivisto, E.M.I.: Playability heuristics for mobile games. In: Proceedings of the 8th Conference on Human–Computer Interaction with Mobile Devices and Services, pp. 9–16. ACM, Helsinki, Finland (2006)

  6. Inostroza, R., Rusu, C., Roncagliolo, S., Rusu, V., Collazos, C.A.: Developing SMASH: a set of SMArtphone’s uSability heuristics. Comput. Stand. Interface 43, 40–52 (2015). https://doi.org/10.1016/j.csi.2015.08.007

    Article  Google Scholar 

  7. Petrie, H., Buykx, L.: Collaborative heuristic evaluation: improving the effectiveness of heuristic evaluation. In: Proceedings of UPA 2010 International Conference. Munich, Germany (2010)

  8. Herr, S., Baumgartner, N., Gross, T.: Evaluating severity rating scales for heuristic evaluation. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 3069–3075. ACM, San Jose, California, USA (2016)

  9. Jucá, P.M., Monteiro, I.T., de Souza Filho, J.C.: Game for heuristic evaluation (G4H): a serious game for collaborative evaluation of systems. In: Kurosu, M. (eds) Human-Computer Interaction. User Interface Design, Development and Multimodality. HCI 2017. Lecture Notes in Computer Science, pp. 341–352. Springer, Cham (2017)

  10. Deterding, S., Dixon, D., Khaled, R., Nacke, L.: From game design elements to gamefulness: defining “Gamification”. In: Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments, pp. 9–15. ACM, Tampere, Finland (2011)

  11. O’Donovan, S., Gain, J., Marais, P.: A case study in the gamification of a university-level games development course. In: Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference, pp. 242-251. ACM, East London, South Africa (2013)

  12. Buckley, P., Doyle, E.: Gamification and student motivation. Interact. Learn. Environ. 24(6), 1162–1175 (2016). https://doi.org/10.1080/10494820.2014.964263

    Article  Google Scholar 

  13. Seixas, L.R., Gomes, A.S., de Melo Filho, I.J.: Effectiveness of gamification in the engagement of students. Comput. Hum. Behav. 58, 48–63 (2016). https://doi.org/10.1016/j.chb.2015.11.021

    Article  Google Scholar 

  14. Kuo, M.-S., Chuang, T.-Y.: How gamification motivates visits and engagement for online academic dissemination—An empirical study. Comput. Hum. Behav. 55, 16–27 (2016). https://doi.org/10.1016/j.chb.2015.08.025

    Article  Google Scholar 

  15. Nielsen, J.: Enhancing the explanatory power of usability heuristics. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 152–158. ACM, Boston, Massachusetts, USA (1994)

  16. Nielsen, J.: Severity ratings for usability problems. Nielsen Norman Group: UX Training, Consulting, & Research. https://www.nngroup.com/articles/how-to-rate-the-severity-of-usability-problems/ (1995). Accessed 26 Apr 2018

  17. Tondello, G.F.: An introduction to gamification in human-computer interaction. XRDS Crossroads ACM Mag. Stud. Quant. Comput. 23(1), 15–17 (2016). https://doi.org/10.1145/2983457

    Google Scholar 

  18. Werbach, K., Hunter, D.: For the Win: How Game Thinking Can Revolutionize Your Business. Wharton Digital Press, Philadelphia (2012)

    Google Scholar 

  19. Ferreira, B., Rivero, L., Lopes, A., Marques, A.B., Conte, T.: Apoiando o Ensino de Qualidade de Software: Um Serious Game para o Ensino de Usabilidade. In: VII Fórum de Educação em Engenharia de Software, pp. 12-21. Brazilian Computer Society, Maceió, Brasil (2014) (in Portuguese)

  20. Queiroz, W., Beltrão, R., Fernandes, M., Bonifácio, B., Fernandes, P.: MACteaching: Um Jogo para o Ensino do Método de Avaliação de Comunicabilidade. In: Companion Proceedings of the 14th Brazilian Symposium on Human Factors in Computing Systems—Posters and Demos, pp. 70–71. Brazilian Computer Society, Salvador, Brazil (2015) (in Portuguese)

  21. Souza, C.S.: The Semiotic Engineering of Human–Computer Interaction. MIT Press, Cambridge, MA (2005)

    Book  Google Scholar 

  22. Sommariva, L., Benitti, F.B.V., Dalcin, F.S.: UsabilityGame: jogo simulador para apoio ao ensino de usabilidade. In: Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction, pp. 61–65. Brazilian Computer Society, Porto de Galinhas, Brazil (2011) (in Portuguese)

  23. Mayhew, D.J.: The Usability Engineering Lifecycle: A Practitioner’s Handbook for User Interface Design. Morgan Kaufmann, San Francisco, CA (1999)

    Book  Google Scholar 

  24. Díaz, J., Rusu, C., Pow-Sang, J.A., Roncagliolo, S.: A cultural-oriented usability heuristics proposal. In: Proceedings of the 2013 Chilean Conference on Human–Computer Interaction, pp. 82–87. ACM, Temuco, Chile (2013)

  25. Bertini, E., Gabrielli, S., Kimani, S., Catarci, T., Santucci, G.: Appropriating and assessing heuristics for mobile computing. In: Proceedings of the working conference on Advanced visual interfaces, pp. 119–126. ACM, Venezia Italy (2006)

  26. Singh, A., Wesson, J.: Evaluation criteria for assessing the usability of ERP systems. In: Proceedings of the 2009 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists, pp. 87–95. ACM, Vanderbijlpark, Emfuleni, South Africa (2009)

  27. Alsumait, A., Al-Osaimi, A.: Usability heuristics evaluation for child e-learning applications. In: Proceedings of the 11th International Conference on Information Integration and Web-based Applications & Services, pp. 425–430. ACM, Kuala Lumpur, Malaysia (2009)

  28. Rusu, C., Roncagliolo, S., Tapia, G., Hayvar, D., Rusu, V., Gorgan, D.: Usability heuristics for grid computing applications. In: Proceedings of the Fourth International Conference on Advances in Computer–Human Interactions, pp. 53–58. IARIA, Le Gosier, Guadeloupe, France (2011)

  29. Pinelle, D., Wong, N., Stach, T., Gutwin, C.: Usability heuristics for networked multiplayer games. In: Proceedings of the ACM 2009 International Conference on Supporting Group Work, pp. 169–178. ACM, Sanibel Island, Florida, USA (2009)

  30. Zhang, J., Johnson, T.R., Patel, V.L., Paige, D.L., Kubose, T.: Using usability heuristics to evaluate patient safety of medical devices. J. Biomed. Inform. 36(1–2), 23–30 (2003). https://doi.org/10.1016/S1532-0464(03)00060-1

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Quixadá Campus, Federal University of Ceará, Quixadá, Ceará, Brazil

    José Cezar de Souza Filho, Ingrid Teixeira Monteiro & Paulyne Matthews Jucá

Authors
  1. José Cezar de Souza Filho
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ingrid Teixeira Monteiro
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Paulyne Matthews Jucá
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to José Cezar de Souza Filho.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

de Souza Filho, J.C., Monteiro, I.T. & Jucá, P.M. Game for aNy heuristic evaluation (G4NHE): a generalization of the G4H gamification considering different sets of usability heuristics. Univ Access Inf Soc 18, 489–505 (2019). https://doi.org/10.1007/s10209-019-00674-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-019-00674-x

Keywords

Search

Navigation