Abstract
In this paper we present our experience in designing and applying an evaluation protocol for assessing usability of a clinical decision support (CDS) system. The protocol is based on component-based usability testing, cognitive interviewing, and a rigorous coding scheme cross-referenced to a component library. We applied this protocol to evaluate alternate designs of a CDS interface for a nursing plan of care tool. The protocol allowed us to aggregate and analyze usability data at various granularity levels, supporting both validation of existing components and providing guidance for targeted redesign.
Chapter PDF
Similar content being viewed by others
References
Belden, J., Grayson, R., Barnes, J.: Defining and testing EMR usability: Principles and proposed methods of EMR usability evaluation and rating. Healthcare Information and Management Systems Society, HIMSS (2009)
Haggstrom, D.A., Saleem, J.J., Russ, A.L., Jones, J., Russell, S.A., Chumbler, N.R.: Lessons learned from usability testing of the VA’s personal health record. Journal of the American Medical Informatics Association: JAMIA 18(suppl. 1), i13–i17 (2011)
Hori, M., Kihara, Y., Kato, T.: Investigation of indirect oral operation method for think aloud usability testing. Human Centered Design, 38–46 (2011)
Cho, I., Staggers, N., Park, I.: Nurses’ responses to differing amounts and information content in a diagnostic computer-based decision support application. Computers Informatics Nursing 28(2), 95–102 (2010)
Brinkman, W.-P., Haakma, R., Bouwhuis, D.G.: Component-Specific Usability Testing. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans 38(5), 1143–1155 (2008)
Keenan, G., Yakel, E., Yao, Y.: Maintaining a Consistent Big Picture: Meaningful Use of a Web-based POC EHR System. International Journal of Nursing Knowledge (2012)
NANDA International, Nursing diagnoses: Definition and classification
Moorhead S, M.M.I., Johnson, M.: Outcomes Project. Nursing outcomes classification (NOC). Mosby (2004)
Dochterman, B.G., JM: Nursing interventions classification (NIC). Mosby (2004)
Zhang, B., Wright, A.: Health care costs in the last week of life: associations with end-of-life conversations. Archives of Internal Medicine (2009)
Beatty, P., Willis, G.: Research synthesis: The practice of cognitive interviewing. Public Opinion Quarterly (2007)
Patton, M.: Qualitative research & evaluation methods (2001)
Hsieh, H., Shannon, S.: Three approaches to qualitative content analysis. Qualitative Health Research (2005)
Armstrong, D., Gosling, A., Weinman, J., Marteau, T.: The place of inter-rater reliability in qualitative research: an empirical study. Sociology (1997)
Morae usability testing software from TechSmith, http://www.techsmith.com/morae.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Febretti, A., Lopez, K.D., Stifter, J., Johnson, A.E., Keenan, G.M., Wilkie, D.J. (2013). A Component-Based Evaluation Protocol for Clinical Decision Support Interfaces. In: Marcus, A. (eds) Design, User Experience, and Usability. Design Philosophy, Methods, and Tools. DUXU 2013. Lecture Notes in Computer Science, vol 8012. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39229-0_26
Download citation
DOI: https://doi.org/10.1007/978-3-642-39229-0_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39228-3
Online ISBN: 978-3-642-39229-0
eBook Packages: Computer ScienceComputer Science (R0)