Abstract
This chapter introduces methods and considerations for evaluating the usability of medical devices. It divides evaluation methods broadly into usability inspection methods and usability testing methods. Inspection methods are similar to editing a user interface or conducting a design review. Usability testing methods ask real potential users to conduct real tasks with a device or with a prototype. Along the way, researchers keep track of participants’ success rate, error rate, time on task, and other human-product performance measures. This chapter discusses exactly how and when to use each method, and provides guidance on how to get the most out of your activities.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Brooke, J. (1996). SUS: A “quick and dirty usability”. Usability Evaluation in Industry, 189.
Brooke, J. (2013). SUS: A retrospective. Journal of Usability Studies, 8(2), 29–40.
Faulkner, L. (2003). Beyond the five-user assumption: Benefits of increased sample sizes in usability testing. Behavior Research Methods, Instruments, & Computers, 35(3), 379–383.
Gao, M. (2019). Multi-cultural usability assessment with system usability scale. Doctoral dissertation, Rice University.
Gould, J. D., & Lewis, C. (1985). Designing for usability: Key principles and what designers think. Communications of the ACM, 28(3), 300–311.
Hildebrand, E. A., Branaghan, R. J., Wu, Q., Jolly, J., Garland, T. B., Taggart, M., et al. (2010, September). Exploring human factors in endoscope reprocessing. In Proceedings of the human factors and ergonomics society annual meeting (Vol. 54, No. 12, pp. 894–898). Sage, CA/Los Angeles, CA: SAGE Publications.
Hudson, W. (2001, May/June). How many users does it take to change a website? SIGCHI Bulletin.
Jaccard, C. R. (1956). Objectives and philosophy of public affairs education (No. 761-2016-51596, pp. 12–18).
Kortum, P. (2016). Usability assessment: How to measure the usability of products, services, and systems. USA: Human Factors and Ergonomics Society.
Macefield, R. (2009). How to specify the participant group size for usability studies: A practitioner’s guide. Journal of Usability Studies, 5(1), 34–45.
Nielsen, J. (1994). Heuristic evaluation, w: J. Nielsen and R. L. Mack (Eds.), Usability inspection methods.
Nielsen, J., & Landauer, T. K. (1993). A mathematical model of the finding of usability problems. In Proceedings of the INTERACT’93 and CHI’93 conference on Human factors in computing systems (pp. 206–213).
Nielsen, J., & Molich, R. (1990). Heuristic evaluation of user interfaces. In: Proceedings of ACM CHI’90 (pp. 249–256).
Perfetti, C. (2001, June). Eight is not enough. Retrieved August 23, 2020 from https://articles.uie.com/eight_is_not_enough/.
Polson, P. G., Lewis, C., Rieman, J., & Wharton, C. (1992). Cognitive walkthroughs: A method for theory-based evaluation of user interfaces. International Journal of Man-Machine Studies, 36(5), 741–773.
Rubin, J., & Chisnell, D. (2008). Handbook of usability testing: How to plan, design, and conduct effective tests. Indianapolis, IN: Wiley.
Sharfina, Z., & Santoso, H. B. (2016, October). An Indonesian adaptation of the system usability scale (SUS). In 2016 International Conference on Advanced Computer Science and Information Systems (ICACSIS) (pp. 145–148). Washington, DC: IEEE.
Shneiderman, B. (1998). Designing the user interface (3rd ed.). Boston: Addison-Wesley.
Spool, J., & Schroeder, W. (2001). Testing web sites: Five users is nowhere near enough in CHI 20 Extended Abstracts (pp. 285–286). New York: ACM Press.
U.S. Food and Drug Administration. (2016). Applying human factors and usability engineering to medical devices: Guidance for industry and Food and Drug Administration staff. Washington, DC: U.S. Department of Health and Human Services Food and Drug Administration, Center for Devices and Radiological Health, Office of Device Evaluation.
Van Der Sluis, P. C., Ruurda, J. P., van der Horst, S., Goense, L., & van Hillegersberg, R. (2018). Learning curve for robot-assisted minimally invasive thoracoscopic esophagectomy: Results from 312 cases. The Annals of Thoracic Surgery, 106(1), 264–271.
Virzi, R. A. (1992). Refining the test phase of usability evaluation: How many subjects is enough? Human Factors, 34(4), 457–468.
Wiklund, P. E., Michael, E., Kendler, J., & Strochlic, A. Y. (2011). Usability testing of medical devices. Boca Raton, FL: CRC Press.
Wharton, C., Rieman, J., Lewis, C., & Polson, P. (1994). The cognitive walkthrough method: A practitioner’s guide. In Usability inspection methods (pp. 105–140).
Zhang, J., Johnson, T. R., Patel, V. L., Paige, D. L., & Kubose, T. (2003). Using usability heuristics to evaluate patient safety of medical devices. Journal of Biomedical Informatics, 36(1–2), 23–30.
Zorn, K. C., Gautam, G., Shalhav, A. L., Clayman, R. V., Ahlering, T. E., Albala, D. M., et al. (2009). Training, credentialing, proctoring and medicolegal risks of robotic urological surgery: Recommendations of the society of urologic robotic surgeons. The Journal of Urology, 182(3), 1126–1132.
Author information
Authors and Affiliations
Resources
Resources
-
Kortum, P. (2016). Usability assessment: How to measure the usability of products, services, and systems. USA: Human Factors and Ergonomics Society.
-
Nielsen, J. (1994, April). Usability inspection methods. In Conference companion on human factors in computing systems (pp. 413–414).
-
Rubin, J., & Chisnell, D. (2008). Handbook of usability testing: How to plan, design and conduct effective tests. Indianapolis, IN: Wiley.
-
Wiklund, M. E., & Wilcox, S. B. (2005). Designing usability into medical products. Boca Raton, FL: CRC Press.
-
Wiklund, M., Kendler, J., & Strochlic, A. Y. (2015). Usability testing of medical devices. Boca Raton, FL: CRC Press.
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Branaghan, R.J., O’Brian, J.S., Hildebrand, E.A., Foster, L.B. (2021). Usability Evaluation. In: Humanizing Healthcare – Human Factors for Medical Device Design. Springer, Cham. https://doi.org/10.1007/978-3-030-64433-8_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-64433-8_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-64432-1
Online ISBN: 978-3-030-64433-8
eBook Packages: EngineeringEngineering (R0)