International Journal on Digital Libraries

, Volume 4, Issue 2, pp 108–123 | Cite as

Usability inspection of digital libraries: a case study

  • H. Rex Hartson
  • Priya Shivakumar
  • Manuel A. Pérez-Quiñones
Regular contribution

Abstract

This paper reports a case study about lessons learned and usability issues encountered in a usability inspection of a digital library system called the Networked Computer Science Technical Reference Library (NCSTRL). Using a co-discovery technique with a team of three expert usability inspectors (the authors), we performed a usability inspection driven by a broad set of anticipated user tasks. We found many good design features in NCSTRL, but the primary result of a usability inspection is a list of usability problems as candidates for fixing. The resulting problems are organized by usability problem type and by system functionality, with emphasis on the details of problems specific to digital library functions. The resulting usability problem list was used to illustrate a cost/importance analysis technique that trades off importance to fix against cost to fix. The problems are sorted by the ratio of importance to cost, producing a priority ranking for resolution.

Keywords

Usability Inspection Digital library Usability problems Cost-importance analysis 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Andre T, Hartson HR, Belz S, McCreary F (2001) The user action framework: a reliable foundation for usability engineering support tools. Int J Hum–Comput Stud 54(1):107–136Google Scholar
  2. 2.
    Bergmark D (2002) Models and tools for generating digital libraries: collection synthesis. In: Proceedings of the second ACM/IEEE–CS joint conference on digital libraries (JCDL ’02). ACM Press, New York, pp 253–262Google Scholar
  3. 3.
    Chen S-S, Choo C-Y (2002) A DL server with OAI capabilities: LOVE. In: Proceedings of the second ACM/IEEE–CS joint conference on digital libraries (JCDL ’02). ACM Press, New York, p 388 (poster)Google Scholar
  4. 4.
    Davis JR, Lagoze C (2000) NCSTRL: design and deployment of a globally distributed digital library. J Am Soc Inf Sci 51(3):273–280Google Scholar
  5. 5.
    Dillon A (2002) Technologies of information: HCI and the digital library. In: Carroll J (ed) Human–computer interaction in the new millennium. ACM Press/Addison-Wesley, New York, pp 457–474Google Scholar
  6. 6.
    Dorward J, Reinke D, Recker M (2002) Preserving, securing, and assessing digital libraries: an evaluation model for a digital library services tool. In: Proceedings of the second ACM/IEEE–CS joint conference on digital libraries (JCDL ’02). ACM Press, New York, pp 322–323Google Scholar
  7. 7.
    France RA (2001) Personal communicationGoogle Scholar
  8. 8.
    Futrelle J, Chen S-S, Chang KC (2001) A CIS framework for NSDL. In: Proceedings of the first ACM/IEEE–CS joint conference on digital libraries (JCDL ’01). ACM Press, New York, pp 124–125Google Scholar
  9. 9.
    Geisler G, Giersch S, McArthur D, McClelland M (2002) Creating virtual collections in digital libraries: benefits and implementation issues. In: Proceedings of the second ACM/IEEE–CS joint conference on digital libraries (JCDL ’02). ACM Press, New York, pp 210–218Google Scholar
  10. 10.
    Glover EJ, Lawrence S, Gordon MD, Birmingham WP, Giles CL (2001) Web search – your way. Commun ACM 44(12):97–102Google Scholar
  11. 11.
    Gupta A, Ludsher B, Moore RW (2002) Ontology services for curriculum development in NSDL. In: Proceedings of the second ACM/IEEE–CS joint conference on digital libraries (JCDL ’02). ACM Press, New York, pp 219–220Google Scholar
  12. 12.
    Hackman GS, Biers DW (1992) Team usability testing: are two heads better than one? In: Proceedings of the Human Factors Society 36th annual meeting. Human Factors and Ergonomics Society, Atlanta, GA, pp 1205–1209Google Scholar
  13. 13.
    Hartson HR (2003) Cognitive, physical, sensory, and functional affordances in interaction design. Accepted for publication in Behav Inf Technol 22(5):315–338Google Scholar
  14. 14.
    Hartson HR, Castillo JC (1998) Remote evaluation for post-deployment usability improvement. In: Proceedings of AVI’98 (advanced visual interfaces). ACM, L’Aquila, Italy, pp 22–29Google Scholar
  15. 15.
    Hartson HR, Hix D (2003) Developing user interfaces – ensuring usability through product and process: short course in the usability engineering process. Unpublished Tutorial NotesGoogle Scholar
  16. 16.
    Hartson HR, Shivakumar P (2002) Usability inspection report of NCSTRL (TR-02-08). Virginia Tech, Blacksburg, VAGoogle Scholar
  17. 17.
    Hix D, Hartson HR (1993) Developing user interfaces: ensuring usability through product & process. Wiley, New YorkGoogle Scholar
  18. 18.
    Janee G, Frew J (2002) Digital libraries for spatial data: the ADEPT digital library architecture. In: Proceedings of the second ACM/IEEE–CS joint conference on digital libraries (JCDL ’02). ACM Press, New York, pp 342–350Google Scholar
  19. 19.
    Klaus C, Andrew K (2001) An atmospheric visualization collection for the NSDL. In: Proceedings of the first ACM/IEEE–CS joint conference on digital libraries (JCDL ’01). ACM Press, New York, p 463Google Scholar
  20. 20.
    Lagoze C, Van de Sompel H (2001) The Open Archives Initiative: building a low-barrier interoperability framework. In: Proceedings of the first ACM/IEEE–CS joint conference on digital libraries (JCDL ’01). ACM Press, New York, pp 54–62Google Scholar
  21. 21.
    Lagoze C, Hoehn W, Millman D, Arms W, Gan S, Hillmann D, Ingram C, Krafft D, Marisa R, Phipps J, Saylor J, Terizzi C, Allan J, Guzman-Lara S, Kalt T (2002) Core services in the architecture of the national digital library for science education (NSDL). In: Proceedings of the second ACM/IEEE–CS joint conference on Digital libraries, Portland, Oregon, USA, pp 201–209Google Scholar
  22. 22.
    Lagoze C, Terizzi C, Hoehn W, Millman D, Allan J, Guzman-Lara S, Kalt T, Arms W, Gan S, Hillman D, Ingram C, Krafft D, Marisa R, Phipps J, Saylor J (2002) Core services in the architecture of the National Science Digital Library (NSDL). In: Proceedings of the second ACM/IEEE–CS joint conference on digital libraries (JCDL ’02). ACM Press, New York, pp 201–209Google Scholar
  23. 23.
    Laleuf JR, Spalter AM (2001) A component repository for learning objects: a progress report. In: Proceedings of the first ACM/IEEE–CS joint conference on digital libraries (JCDL ’01). ACM Press, New York, pp 33–40Google Scholar
  24. 24.
    Landauer TK (1995) The trouble with computers: usefulness, usability, and productivity. MIT Press, Cambridge, MAGoogle Scholar
  25. 25.
    Laurel B, Oren T, Don A (1990) Issues in multimedia interface design: media integration and interface agents. In: Proceedings of the CHI conference on human factors in computing systems. ACM Press, New York, pp 133–139Google Scholar
  26. 26.
    Mayhew DJ (1999) The usability engineering lifecycle. Morgan Kaufmann, San FranciscoGoogle Scholar
  27. 27.
    Nanard M, Nanard J (2001) Cumulating and sharing end users’ knowledge to improve video indexing in a video digital library. In: Proceedings of the first ACM/IEEE–CS joint conference on digital libraries (JCDL ’01). ACM Press, New York, pp 282–289Google Scholar
  28. 28.
    Nielsen J (1993) Usability engineering. Academic, Boston, MAGoogle Scholar
  29. 29.
    Nielsen J, Mack RL (eds) (1994) Usability inspection methods. Wiley, New YorkGoogle Scholar
  30. 30.
    Pomerantz J, Lankes RD (2002) Integrating expertise into the NSDL: putting a human face on the digital library. In: Proceedings of the second ACM/IEEE–CS joint conference on digital libraries (JCDL ’02). ACM Press, New York, p 405Google Scholar
  31. 31.
    Powell AL, French JC (2000) Growth and server availability of the NCSTRL digital library. In: Proceedings of the fifth ACM conference on digital libraries. ACM Press, New York, pp 264–265Google Scholar
  32. 32.
    Theng YL (1999) Lostness and digital libraries. In: Proceedings of the fourth ACM conference on digital libraries. ACM Press, New York, pp 250–251Google Scholar
  33. 33.
    Van House NA (1995) User needs assessment and evaluation for the UC Berkeley electronic environmental library project. In: Proceedings of Digital Libraries ’95: the second international conference on the theory and practice of digital libraries, pp 71–76. URL: http://www.csdl.tamu.edu/DL95/papers/vanhouse/vanhouse.htmlGoogle Scholar
  34. 34.
    Van House NA, Butler MH, Ogle V, Schiff L (1996) User-centered iterative design for digital libraries. D-lib Magazine. Retrieved 17 January 2003 from the World Wide Web: http://www.dlib.org/dlib/february96/02vanhouse.htmlGoogle Scholar
  35. 35.
    Yaron D, Milton DJ, Freeland R (2001) Linked active content: a service for digital libraries for education. In: Proceedings of the first ACM/IEEE–CS joint conference on digital libraries (JCDL ’01). ACM Press, New York, pp 25–32Google Scholar

Copyright information

© Springer-Verlag 2004

Authors and Affiliations

  • H. Rex Hartson
    • 1
  • Priya Shivakumar
    • 1
  • Manuel A. Pérez-Quiñones
    • 1
  1. 1.Department of Computer Science – 0106Virginia TechBlacksburgUSA

Personalised recommendations