Mobile Application Usability Heuristics: Decoupling Context-of-Use

  • Ger JoyceEmail author
  • Mariana Lilley
  • Trevor Barker
  • Amanda Jefferies
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10288)


Context-of-use is a vital consideration when evaluating the usability of mobile applications. Thus, when defining sets of heuristics for the usability evaluation of mobile applications, a common practice has been to include one or more heuristics that consider context-of-use. Yet, most evaluations are conducted within usability labs. Consequently, the aim of this research is to question the utility of attempting to include inherently complex areas of context-of-use within limited sets of mobile application usability heuristics. To address this, a mapping study uncovered six sets of heuristics that can be applied to mobile application usability evaluations. A within-subjects empirical test with six Human-Computer Interaction practitioners evaluated a well-known travel mobile application using three sets of the mapped heuristics. The study found that the common practice of including context-of-use within mobile application usability heuristics is an ineffective approach.


Mobile usability Context-of-use Heuristic evaluation 


  1. 1.
    Nielsen, J., Molich, R.: Heuristic evaluation of user interfaces. In: SIGCHI Conference on Human Factors in Computing Systems, pp. 249–256 (1990)Google Scholar
  2. 2.
    Maguire, M.: Methods to support human-centred design. Int. J. Hum. Comput. Stud. 55(4), 587–634 (2001)CrossRefzbMATHGoogle Scholar
  3. 3.
    Bernhaupt, R., Mihalic, K., Obrist, M.: Usability evaluation methods for mobile applications. In: Lumsden, J. (ed.) Handbook of Research on User Interface Design and Evaluation for Mobile Technology. IGI Global (2008)Google Scholar
  4. 4.
    Nielsen, J.: Heuristic evaluation. In: Nielsen, J., Mack, R.L. (eds.) Usability Inspection Methods. Wiley, New York (1994)CrossRefGoogle Scholar
  5. 5.
    Lima Salgado, A., Freire, A.P.: Heuristic evaluation of mobile usability: a mapping study. In: Kurosu, M. (ed.) HCI 2014. LNCS, vol. 8512, pp. 178–188. Springer, Cham (2014). doi: 10.1007/978-3-319-07227-2_18 Google Scholar
  6. 6.
    Rogers, Y., Sharp, H., Preece, J.: Interaction Design: Beyond Human-Computer Interaction. Wiley, New York (2011)Google Scholar
  7. 7.
    Maguire, M.: Context of use within usability activities. Int. J. Hum Comput Stud. 55(4), 453–483 (2001)CrossRefzbMATHGoogle Scholar
  8. 8.
    Wigelius, H., Väätäjä, H.: Dimensions of context affecting user experience in mobile work. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5727, pp. 604–617. Springer, Heidelberg (2009). doi: 10.1007/978-3-642-03658-3_65 CrossRefGoogle Scholar
  9. 9.
    Tsiaousis, A.S.: Ad hoc context of use in mobile usability evaluation. Int. J. Comput. Syst. 2(6), 253–256 (2015)Google Scholar
  10. 10.
    Savio, N., Braiterman, J.: Design sketch: the context of mobile interaction. In: Mobile HCI, pp. 284–286 (2007)Google Scholar
  11. 11.
    Eshet, E., Bouwman, H.: Addressing the context of use in mobile computing: a survey on the state of the practice. Interact. Comput. (2014).
  12. 12.
    Gould, J.D., Lewis, C.: Designing for usability: key principles and what designers think. Commun. ACM 28, 300–311 (1985)CrossRefGoogle Scholar
  13. 13.
    Gerhardt-Powals, J.: Cognitive engineering principles for enhancing human-computer performance. Int. J. Hum.-Comput. Interact. 8, 189–211 (1996)CrossRefGoogle Scholar
  14. 14.
    Hollingsed, T., Novick, D.G.: Usability inspection methods after 15 years of research and practice. In: 25th Annual ACM International Conference on Design of Communication (SIGDOC 2007), El Paso, Texas, USA, 22–24 October 2007Google Scholar
  15. 15.
    Albion, P.R.: Heuristic evaluation of educational multimedia: from theory to practice. In: Proceedings ASCILITE 1999, Proceedings of the 16th Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education: Responding to Diversity, pp. 9–15. Australasian Society for Computers in Learning in Tertiary Education (ASCILITE) (1999)Google Scholar
  16. 16.
    Baker, K., Greenberg, S., Gutwin, C.: Heuristic evaluation of groupware based on the mechanics of collaboration. In: Little, M.R., Nigay, L. (eds.) EHCI 2001. LNCS, vol. 2254, pp. 123–139. Springer, Heidelberg (2001). doi: 10.1007/3-540-45348-2_14 CrossRefGoogle Scholar
  17. 17.
    Mankoff, J., Dey, A.K., Hsieh, G., Kientz, J., Lederer, S., Ames, M.: Heuristic evaluation of ambient displays. In: Proceedings of SIGCHI Conference Human Factors Computing Systems, pp. 169–176 (2003)Google Scholar
  18. 18.
    Magoulas, G.D., Chen, S.Y., Papanikolaou, K.A.: Integrating layered and heuristic evaluation for adaptive learning environments. In: Second Workshop on Empirical Evaluation of Adaptive Systems, held at the 9th International Conference on User Modeling UM 2003, Pittsburgh, pp. 5–14 (2003)Google Scholar
  19. 19.
    Desurvire, H., Caplan, M., Toth, J.: Using heuristics to evaluate the playability of games. In: CHI 2004 Extended Abstracts on Human Factors in Computing Systems, pp. 1509–1512 (2004)Google Scholar
  20. 20.
    Graham, M.J., Kubose, T.K., Jordan, D., Zhang, J., Johnson, T.R., Patel, V.L.: Heuristic evaluation of infusion pumps: implications for patient safety in Intensive Care Units. Int. J. Med. Inform. 73, 771–779 (2004)CrossRefGoogle Scholar
  21. 21.
    Zhou, A.T., Blustein, J., Zincir-Heywood, N.: Improving intrusion detection systems through heuristic evaluation. In: Canadian Conference on Electrical and Computer Engineering, vol. 3, pp. 1641–1644 (2004)Google Scholar
  22. 22.
    Sutcliffe, A., Gault, B.: Heuristic evaluation of virtual reality applications. Interact. Comput. 16, 831–849 (2004)CrossRefGoogle Scholar
  23. 23.
    Chen, S.Y., Macredie, R.D.: The assessment of usability of electronic shopping: a heuristic evaluation. Int. J. Inf. Manage. 25, 516–532 (2005)CrossRefGoogle Scholar
  24. 24.
    Alsumait, A.A., Al-Osaimi, A.: Usability heuristics evaluation for child e-learning applications. J. Softw. 5, 425–430 (2010)CrossRefGoogle Scholar
  25. 25.
    Kirmani, S., Rajasekaran, S.: Heuristic evaluation quality score (HEQS): a measure of heuristic evaluation skills. J. Usability Stud. 2(2), 61–75 (2007)Google Scholar
  26. 26.
    Wilson, C.: User Interface Inspection Methods: A User-Centered Design Method. Morgan Kaufmann, USA (2013)Google Scholar
  27. 27.
    Law, E., Hvannberg, E.: Analysis of strategies for improving and estimating the effectiveness of heuristic evaluation. In: Proceedings of the 3rd Nordic Conference on Human-Computer Interaction (Nordi CHI 2004), Tampere, Finland, 23–27 October 2004
Google Scholar
  28. 28.
    Ketola, P., Röykkee, M.: The three facets of usability in mobile handsets. In: CHI 2001 Workshop: Mobile Communications: Understanding Users, Adoption & Design (2001)Google Scholar
  29. 29.
    Beck, E., Christiansen, M., Kjeldskov, J., Kolbe, N., Stage, J.: Experimental evaluation of techniques for usability testing of mobile systems in a laboratory setting. In: New Directions in Interaction: Information Environments, Media and Technology Conference (Ozchi 2003), Brisbane, Australia (2003)Google Scholar
  30. 30.
    Al-Razgan, Muna S., Al-Khalifa, Hend S., Al-Shahrani, Mona D.: Heuristics for evaluating the usability of mobile launchers for elderly people. In: Marcus, A. (ed.) DUXU 2014. LNCS, vol. 8517, pp. 415–424. Springer, Cham (2014). doi: 10.1007/978-3-319-07668-3_40 CrossRefGoogle Scholar
  31. 31.
    Dey, A.K.: Understanding and using context. Pers. Ubiquit. Comput. J. 1(5), 4–7 (2001)CrossRefGoogle Scholar
  32. 32.
    Bentley, F., Barrett, E.: Building Mobile Experiences. MIT Press, Cambridge (2012)Google Scholar
  33. 33.
    Po, S., Howard, S., Vetere, F., Skov, M.B.: Heuristic evaluation and mobile usability: bridging the realism gap. In: Brewster, S., Dunlop, M. (eds.) Mobile HCI 2004. LNCS, vol. 3160, pp. 591–592. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  34. 34.
    Weiss, S.: Handheld Usability. Wiley, Hoboken (2003)Google Scholar
  35. 35.
    Ji, Y., Park, J., Lee, C., Yun, M.: A usability checklist for the usability evaluation of mobile phone user interface. Int. J. Hum.-Comput. Interact. 20(3), 207–231 (2006)CrossRefGoogle Scholar
  36. 36.
    Bertini, E., Gabrielli, S., Kimani, S.: Appropriating and assessing heuristics for mobile computing. In: Proceedings of Working conference on Advanced Visual Interfaces (AVI 2006), Venezia, Italy, 23–26 May 2006Google Scholar
  37. 37.
    Joyce, G., Lilley, M.: Towards the development of usability heuristics for native smartphone mobile applications. In: Marcus, A. (ed.) DUXU 2014. LNCS, vol. 8517, pp. 465–474. Springer, Cham (2014). doi: 10.1007/978-3-319-07668-3_45 CrossRefGoogle Scholar
  38. 38.
    Inostroza, R., Rusu, C., Roncagliolo, S., Rusu, V., Collazos, C.: Developing SMASH: A set of SMArtphone’s uSability Heuristics. Comput. Stand. Interfaces 43, 40–52 (2016)CrossRefGoogle Scholar
  39. 39.
    Sauro, J.: Rating the severity of usability problems (2013).
  40. 40.
    Nielsen, J.:. Finding usability problems through heuristic evaluation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 1992), Monterey, California (1992)Google Scholar
  41. 41.
    Tan, C.-H., Silva, A., Lee, R., Wang, K., Nah, F.F.-H.: HCI testing in laboratory or field settings. In: Nah, F.F.-H.F.-H., Tan, C.-H. (eds.) HCIBGO 2016. LNCS, vol. 9752, pp. 110–116. Springer, Cham (2016). doi: 10.1007/978-3-319-39399-5_11 CrossRefGoogle Scholar
  42. 42.
    Kjeldskov, J., Skov, M.B.: Was it worth the hassle? Ten years of mobile HCI research discussions on lab and field evaluations, pp. 43–52. ACM (2014)Google Scholar
  43. 43.
    Joyce, G., Lilley, M., Barker, T., Jefferies, A.: Evaluating the impact of changing contexts on mobile application usability within agile environments. In: Future Technologies Conference (FTC), pp. 476–480. IEEE (2016)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Ger Joyce
    • 1
    Email author
  • Mariana Lilley
    • 1
  • Trevor Barker
    • 1
  • Amanda Jefferies
    • 1
  1. 1.School of Computer ScienceUniversity of Hertfordshire College LaneHatfieldUK

Personalised recommendations