Scenarios in the Heuristic Evaluation of Mobile Devices: Emphasizing the Context of Use

  • Jari Varsaluoma
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5619)


Varying contexts of use make the usability studies of mobile devices difficult. The existing evaluation methods, such as Heuristic Evaluation (HE), must be redesigned in order to create more awareness of the mobile context. Through the reworking of existing heuristics and use of written use scenarios, there have already been some promising results. In this study the context of use of mobile devices was examined with written scenarios. The main target was to improve the reliability of HE by increasing the number of right predictions and reducing the number of false positives produced by the evaluators. The results seem to differ from those of a previously conducted study as the scenarios did not improve the HE regarding the numbers of false positives or accurate predictions. There is a need for more research regarding the possible benefits of different scenarios and other factors that affect the outcomes of HE.


Heuristic evaluation scenario context of use mobile device false positive 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bertini, E., Gabrielli, S., Kimani, S.: Appropriating and Assessing Heuristics for Mobile Computing. In: Proceedings of the working conference on Advanced visual interfaces, pp. 119–126. ACM Press, New York (2006)CrossRefGoogle Scholar
  2. 2.
    Rosenbaum, S., Rohn, A.J., Humburg, J.: A Toolkit for Strategic Usability: Results from Workshops, Panels, and Surveys. In: Proceedings of SIGCHI Conference on Human Factors in Computing Systems, pp. 337–344. ACM Press, New York (2000)CrossRefGoogle Scholar
  3. 3.
    Nielsen, J., Mack, R.L.: Usability inspection methods. John Wiley & Sons, Inc., Chichester (1994)CrossRefGoogle Scholar
  4. 4.
    Law, E.L., Hvannberg, E.T.: Complementarity and convergence of heuristic evaluation and usability test: A case study of UNIVERSAL brokerage platform. In: Proceedings of the Second Nordic Conference on Human-Computer Interaction, pp. 71–80. ACM Press, New York (2002)CrossRefGoogle Scholar
  5. 5.
    Po, S., Howard, S., Vetere, F., Skov, B.M.: Heuristic Evaluation and Mobile Usability: Bridging the Realism Gap. In: MobileHCI 2004, pp. 49–60. Springer, Heidelberg (2004)Google Scholar
  6. 6.
    Cockton, G., Woolrych, A.: Understanding Inspection Methods: Lessons from an Assessment of Heuristic Evaluation. In: Joint Proceedings of HCI 2001 and IHM 2001: People and Computers XV, pp. 171–192 (2001)Google Scholar
  7. 7.
    Hvannberg, E.T., Law, E.L., Lárusdóttir, M.K.: Heuristic evaluation: Comparing ways of finding and reporting usability problems. Interacting with Computers 19(2), 225–240 (2007)CrossRefGoogle Scholar
  8. 8.
    Law, E.L., Hvannberg, E.T.: Analysis of Strategies for Improving and Estimating the Effectiveness of Heuristic Evaluation. In: Proceedings of the third Nordic conference on Human-computer interaction. ACM International Conference Proceeding Series, vol. 82, pp. 241–250. ACM Press, New York (2004)CrossRefGoogle Scholar
  9. 9.
    Tavris, C., Wade, C.: Psychology in perspective. Prentice-Hall, Inc., Englewood Cliffs (2001)Google Scholar
  10. 10.
    Hertzum, M., Jacobsen, N.E.: The evaluator effect: A chilling fact about usability evaluation methods. International Journal of Human-Computer Interaction 13(4), 421–443 (2001)CrossRefGoogle Scholar
  11. 11.
    Nielsen, J.: Finding usability problems through heuristic evaluation. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 373–380. ACM Press, New York (1992)Google Scholar
  12. 12.
    Chattratichart, J., Lindgaard, G.: A comparative evaluation of heuristic-based usability inspection methods. In: CHI 2008 extended abstracts on Human factors in computing systems, pp. 2213–2220. ACM Press, New York (2008)Google Scholar
  13. 13.
    Dey, A.K.: Providing Architectural Support for Building Context-Aware Applications. Georgia Institute of Technology (2000)Google Scholar
  14. 14.
  15. 15.
    Nielsen, J.: Usability Engineering. Academic Press, London (1993)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Jari Varsaluoma
    • 1
  1. 1.Tampere University of Technology, Human-Centered TechnologyTampereFinland

Personalised recommendations