Skip to main content

The Development of a Hybrid Approach to Usability Assessment: Leveraging a Heuristic Guidance Framework for End User Feedback

  • Conference paper
  • First Online:
Advances in Usability, User Experience and Assistive Technology (AHFE 2018)

Abstract

The implementation of complex user interfaces within Navy operational and training domains is often challenging. As with other domains, development teams seek a balance between meeting the functional needs of communities while striving for good usability for end users. To increase the usability of interfaces, our team is developing a hybrid survey-based approach that yields benefits from expert led heuristic assessments and domain relevant feedback from end users. The resulting system is a survey containing 200 items assessing the usability of nine heuristic categories. This paper will provide background on the existing methods considered and the resulting survey framework. Further, the preliminary findings on the benefits of this hybrid approach from initial validation studies will be discussed, focusing on the ability of the system to provide developers with valuable quantitative information as well as specific qualitative information meant for fixing, adjusting and enhancing system functions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 299.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 379.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Atkinson, B.F.W., Bennett, T.O., Bahr, G.S., Nelson, M.M.W.: Development of a multiple heuristics evaluation table (MHET) to support software development and usability analysis. In: Universal Acess in Human Computer Interaction. Coping with Diversity, pp. 563–572. Springer, Heidelberg

    Google Scholar 

  2. Wheeler Atkinson, B.F., Kaste, K.P.: The importance of usability analysis in functional design: State-of-the-practice vs. state-of-the-possible. Accepted for publication in the NAVAIR Journal (2014)

    Google Scholar 

  3. Wheeler Atkinson, B.F., Tindall, M.J., Kaste, K.P.: Data analysis for survey development: a comparison of hierarchical cluster analysis and confirmatory factor analysis. Poster extended abstract submitted to the Human Factors & Ergonomics Society Annual Conference (2015)

    Google Scholar 

  4. Bangor, A., Kortum, P.T., Miller, J.T.: An empirical evaluation of the system usability scale. Int. J. Hum. Comput. Interact. 24(6), 574–594 (2008)

    Article  Google Scholar 

  5. Chisnell, D., Redish, G.: AARP Audience-Centered Heuristics: Older Adults (2004)

    Google Scholar 

  6. Hancock, P.A., Pepe, A.A., Murphy, L.L.: Hedonomics: the power of positive and pleasurable ergonomics. Ergon. Des. 13(1), 8–14 (2005)

    Google Scholar 

  7. Hix, D., Hartson, H.R.: Developing User Interfaces: Ensuring Usability Through Product & Process. John Wiley & Sons, Inc., New Jersey (1993)

    Google Scholar 

  8. Hornbæk, K.: Current practice in measuring usability: challenges to usability studies and research. Int. J. Hum. Comput. Stud. 64(2), 79–102 (2006)

    Article  Google Scholar 

  9. Leavitt, M.O., Shneiderman, B.: Research-based web design & usability guidelines. US Department of Health and Human Services (2006)

    Google Scholar 

  10. Lewis, J.R.: Psychometric evaluation of the PSSUQ using data from five years of usability studies. Int. J. Hum. Comput. Interact. 14(3–4), 463–488 (2002)

    Article  Google Scholar 

  11. Nielson, J.: Usability Engineering. Academic Press, San Diego (1993)

    Google Scholar 

  12. Nielsen, J.: Usability Engineering. Elsevier, New York (1994)

    Google Scholar 

  13. Nielsen, J.: Finding usability problems through heuristic evaluation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 373–380. ACM, June 1992

    Google Scholar 

  14. Nielsen, J., Molich, R.: Heuristic evaluation of user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 249–256. ACM, March 1990

    Google Scholar 

  15. Ravden, S., Johnson, G.: Evaluating Usability of Human-Computer Interfaces: A Practical Method. Halsted Press, New York (1989)

    Google Scholar 

  16. Shneiderman, B.: Designing the User Interface: Strategies for Effective Human-Computer Interaction. Addison Wesley Longman, Reading (1998)

    Google Scholar 

  17. Shneiderman, S.B., Plaisant, C.: Designing the user Interface, 4th edn. Pearson Addison Wesley, USA (2005)

    Google Scholar 

  18. Tognazzini, B.: First Principles of Interaction Design. Interaction design Solutions for the Real World, AskTog (2003)

    Google Scholar 

  19. UW Computing & Communications: Graphics and web design based on Edward Tufte’s principles. Retrieved October 4, 2006, from the University of Washington, UW Computer (1999). Training Web site: http://www.washington.edu/computing/training/560/zz-tufte.html

  20. Zabed Ahmed, S.M.: A comparison of usability techniques for evaluating information retrieval system interfaces. Perform. Meas. Metrics 9(1), 48–58 (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Beth F. Wheeler Atkinson .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer International Publishing AG, part of Springer Nature (outside the USA)

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wheeler Atkinson, B.F., Tindall, M.J., Anania, E.C. (2019). The Development of a Hybrid Approach to Usability Assessment: Leveraging a Heuristic Guidance Framework for End User Feedback. In: Ahram, T., Falcão, C. (eds) Advances in Usability, User Experience and Assistive Technology. AHFE 2018. Advances in Intelligent Systems and Computing, vol 794. Springer, Cham. https://doi.org/10.1007/978-3-319-94947-5_48

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-94947-5_48

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-94946-8

  • Online ISBN: 978-3-319-94947-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics