A Study on the Evaluation Model for University Libraries in Digital Environments

  • Byeong Heui Kwak
  • Woochun Jun
  • Le Gruenwald
  • Suk-Ki Hong
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2458)


Advanced information technology has changed our society in various aspects. University libraries are also changing with the adoption of advanced information technology. Specifically, digital technology including the Internet has changed traditional university libraries in their operations as well as infrastructures. Traditional university libraries have stored and distributed scholarly information in printed media. However, most of current university libraries are hybrid libraries, which are dependent on digital media as well as printed media, and are based on both network facilities and physical facilities. The evaluation metrics developed for traditional university libraries are no longer adequate to evaluate current university libraries. This paper presents an evaluation of hybrid libraries. Based on the opinions of library experts and the previous works on the evaluation of both traditional and digital libraries, an initial evaluation model was developed, which consists of 8 categories, 33 items, and 84 indicators. The Delphi method was then applied to develop a valid evaluation model for university libraries. A survey was conducted 3 times for 50 balanced subjects among library-related professors, researchers, and senior university librarians. Based on the surveys’ results, the categories, items, and indicators were modified to derive the new evaluation model, which consists of 7 evaluation categories, 35 items, and 92 indicators. The content validity of this model was confirmed through the survey results of 184 university librarians.


Hybrid Library Digital Library Delphi Method 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Ziglio, E. (1996) The Delphi Method and Its Contribution to Decision-Making, In M. Adler and E. Ziglio (Eds.), Grazing into the Oracle: The Delphi Method and Its Application to Social Policy and Public Health. London: Jessica Kingsley Pub.Google Scholar
  2. [2]
    Sutton, Stuart A. (1996), Future Service Models and the Convergence of Functions: The Reference Librarian as Technician, Author and Consultant, In Kathleen Low [ed.]. Roles of Reference Librarians: Today and Tomorrow. New York: The Haworth Press.Google Scholar
  3. [3]
    Oppenheim, Charles and Smithson, Daniel (1999), What is the hybrid library?, Journal of Information Science, 25(2), 99.Google Scholar
  4. [4]
    Rusbridge, Chris (1998), Towards the Hybrid Library, D-Lib Magazine,
  5. [5]
    Ojiro, K. (2000) Designing and Building TDL (Titech Digital Library): Seeking a Digital Library, Journal of College and University Libraries, No.58, 1–15.Google Scholar
  6. [6]
    Jung, Jin Taek (1997), Measuring User Success in the Digital Library Environment, Ph. D. Dissertation, Drexel University, USA.Google Scholar
  7. [7]
    Lancaster F. W. (1997), Evaluation in the Context of the Digital Library, In Toward a World Library: 19th International Essen Symposium. ed. by Ahmed H. Helal, Joachim W. Weiss. Essen: Essen Univ. Library.Google Scholar
  8. [8]
    Graduate School of Library and Information Science Keio Univ., (1999) Electronic Information Services and Their Evaluation Frames in University Libraries, School of Library and Information Science Keio Univ.Google Scholar
  9. [9]
    Marchionini, Gary (2000), Evaluating Digital Libraries: A Longitudinal and Multifaceted View, Library Trends, 49(2), 304~333.Google Scholar
  10. [10]
    Saracevic, Tefko (2000), Digital Library Evaluation: Toward an Evaluation of Concept, Library Trends, 49(2), 350~369.Google Scholar
  11. [11]
    Borgman, Christine L. et al. (2000), Evaluating Digital Libraries for Teaching and Learning in Undergraduate Education: A Case Study of the Alexandria Digital Earth Prototype (ADEPT), Library Trends, 49(2), 228~250.Google Scholar
  12. [12]
    Buttenfield, B. (1999), Usability Evaluation of Digital Libraries, In Digital Libraries: Philosophies, Technical Design Considerations, and Example Scenarios. ed. by David Stern. New York: Haworth Press.Google Scholar
  13. [13]
    Mead, June P. and Gay, Geri. Concept Mapping: An Innovative Approach to Digital Library Design and Evaluation.
  14. [14]
    Dillon, Andrew. Evaluating on Time: A Framework for the Expert Evaluation of Digital Library Interface Usability.
  15. [15]
    Lilly, Erica B (2001). Evaluation the Virtual Library Collection, In Library Evaluation: A Casebook and Can-Do Guide. ed. by Danny P. Wallace, Connie Van Fleet. Englewood: Libraries Unlimited, Inc., 165~182.Google Scholar
  16. [16]
    International Organization for Standardization, ISO 11620 (1998): Information and Documentation— Library Performance Indicators, Geneve: ISO.Google Scholar
  17. [17]
    Association of College & Research Libraries (1989), Standards for University Libraries: Evaluation of Performance, College and Research Libraries News, 50(8), 679–691.Google Scholar
  18. [18]
    Association of College & Research Libraries, Standards for College Libraries 2000 Edition,
  19. [19]
    Fujiwara Hideyuki et al., (1993), Self-Evaluation of Library Services and Practices at Japanese University Libraries, Journal of College and University Libraries, No. 42, 66–73.Google Scholar
  20. [20]
    Japan Association of Private University Libraries (1999), A Guideline to Self-Inspection Evaluation Method, Tokyo: JAPUL.Google Scholar
  21. [21]
    Brophy, P. and Wynne, P. M. (1997), Management Information System and Performance Measurement for the Electronic Library: eLib Supporting Study (MIEL2) Final Report. Preston: Univ. of Central Lancashire.Google Scholar
  22. [22]
    Brophy, Peter et al. (2000), EQUINOX: Library Performance Measurement and Quality Management System: Performance Indicators for Electronic Library Services.
  23. [23]
    Saracevic, Tefko (2000), Digital Library Evaluation: Toward an Evaluation of Concept, Library Trends, 49(2), 350~369.Google Scholar
  24. [24]
    Crawford, John (2000), Evaluation of Library and Information. London: Aslib.Google Scholar
  25. [25]
    Kwak, Byeong Heui (2002), A Study on Developing Evaluation Indicators of University Libraries in Digital Environment, Ph.D. Dissertation, Chung-ang University, Seoul, Korea.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Byeong Heui Kwak
    • 1
  • Woochun Jun
    • 2
  • Le Gruenwald
    • 3
  • Suk-Ki Hong
    • 4
  1. 1.University librarySeoul National University of EducationKorea
  2. 2.Dept. of Computer EducationSeoul National University of EducationSeoulKorea
  3. 3.School of Computer ScienceUniversity of OklahomaNormanUSA
  4. 4.Dept. of Business AdministrationKonKuk UniversityChungjuKorea

Personalised recommendations