Abstract
Evaluation is a central digital library practice. It provides important data for managing digital libraries and informing strategic decision-making. Digital library evaluation and management are organizational as well as technical practices. What evaluation models can account for these organizational factors, in practice as well as in theory? To address these questions, this paper integrates two models, one from the organizational literature (Porter’s value chain), and one from the evaluation literature (evaluation logic models), into a generic, flexible and extensible evaluation model that supports the goal-oriented evaluation and management of digital libraries in specific sociotechnical contexts. A case study is provided.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Reeves, T.C., Apedoe, X., Woo, Y.H.: Evaluating Digital Libraries: A User- Friendly Guide. National Science Digital Library, Boulder (2005)
Khoo, M., MacArthur, D., Zia, L.: An agency perspective on digital library evaluation. In: Papatheodorou, C., Tsakonas, G. (eds.) Evaluation of Digital Libraries, pp. 41–59. Chandos Publishing, Oxford (2009)
Bishop, A.P., Van House, N.A., Buttenfield, B.P. (eds.): Digital Library Use. Social Practice in Design and Evaluation. The MIT Press, Cambridge (2003)
Khoo, M.: A Sociotechnical Framework for Evaluating a Large-Scale Distributed Educational Digital Library. In: Gonzalo, J., Thanos, C., Verdejo, M.F., Carrasco, R.C. (eds.) ECDL 2006. LNCS, vol. 4172, pp. 449–452. Springer, Heidelberg (2006)
Borgman, C.: Designing digital libraries for usability. In: Bishop, A.P., Van House, N.A., Buttenfield, B.P. (eds.) Digital Library Use, pp. 85–118. The MIT Press, Cambridge (2003)
Chowdhury, G., McMenemy, D., Poulter, A.: Large-Scale Impact of Digital Library Services: Findings from a Major Evaluation of SCRAN. In: Gonzalo, J., Thanos, C., Verdejo, M.F., Carrasco, R.C. (eds.) ECDL 2006. LNCS, vol. 4172, pp. 256–266. Springer, Heidelberg (2006)
Blandford, A., Adams, A., Attfield, S., Buchanan, G., Gow, J., Makri, S., et al.: The PRET A Rapporter framework: Evaluating digital libraries from the perspective of information work. Information Processing and Management 44(1), 4–21 (2008)
Jeng, J.: Usability assessment of academic digital libraries: Effectiveness, efficiency, satisfaction, and learnability. In: LIBRI, vol. 52(2-3), pp. 96–121 (2005a)
Borgman, C.L., Bates, M.J., Bates, M.V., Efthimiadis, E.N., Gilliland-Swetland, A.J., Kafai, Y.B., et al.: Social aspects of digital libraries. Graduate School of Education & Information Studies, University of California, Los Angeles, CA (1996)
Saracevic, T.: Digital library evaluation: Toward an evolution of concepts. Library Trends 49(2), 350–369 (2000)
Marchionini, G., Plaisant, C., Komlodi, A.: The people in digital libraries: Multifaceted approaches to assessing needs and impact. In: Bishop, A., Buttenfield, B., VanHouse, N. (eds.) Digital Library Use, pp. 119–160. MIT Press, Cambridge (2003)
Gonçalves, M.A., Fox, E.A., Watson, L.T., Kipp, N.A.: Streams, Structures, Spaces, Scenarios, Societies (5S): A Formal Model for Digital Libraries. ACM Transactions on Information Systems 22(2), 270–312 (2004)
Gonçalves, M.A., Moreira, B.L., Fox, E.A., Watson, L.T.: “What is a good digital library?” – A quality model for digital libraries. Information Processing and Management 43(5), 1416–1437 (2007)
Fuhr, N., Tsakonas, G., Aalberg, T., Agosti, M., Hansen, P., Kapidakis, S., et al.: Evaluation of digital libraries. International Journal on Digital Libraries 8(1), 21–38 (2007)
Tsakonas, G., Kapidakis, S., Papatheodorou, C.: Evaluation of user interaction in digital libraries. In: The DELOS Workshop on the Evaluation of Digital Libraries, Padua, Italy (2004), http://dlib.ionio.gr/wp7/WS2004_Kapidakis.pdf (retrieved)
Candela, L., Castelli, D., Ferro, N., Ioannidis, Y., Koutrika, G., Meghini, C., et al.: The Digital Library Reference Model. Foundations for Digital Libraries: DELOS Network of Excellence on Digital Libraries Project (2010)
Porter, M.: Competitive advantage. Creating and sustaining superior performance. The Free Press, New York (1998)
Khoo, M., Giersch, S.: Planning digital library evaluation with logic models. In: Papatheodorou, C., Tsakonas, G. (eds.) Evaluation of Digital Libraries, pp. 217–234. Chandos Publishing, Oxford (2009)
Cooksy, L.J., Gill, P., Kelly, P.A.: The program logic model as an integrative framework for a multimethod evaluation. Evaluation and Program Planning 24, 119–128 (2001)
Millar, A., Simeone, R.S., Carnevale, J.T.: Logic models: a systems tool for performance management. Evaluation and Program Planning 24, 73–81 (2001)
McLaughlin, J.A., Jordan, G.B.: Logic models: a tool for telling your program’s performance story. Evaluation and Program Planning 22, 65–72 (1999)
Frechtling, J.: The 2002 User Friendly Handbook for Project Evaluation. The National Science Foundation, Arlington (2002)
Centers for Disease Control and Prevention, Introduction to process evaluation in tobacco use prevention and control. U.S. Department of Health and Human Services, Atlanta(2008)
Kellogg Foundation, Logic model development guide. W. K. Kellogg Foundationm, Battle Creek (2004)
Burger, A., Park, J.-R., Lu, G.: Application of Reference Guidelines for Assessing the Quality of the Internet Public Library’s Virtual Reference Services. Internet Reference Services Quarterly 15(4), 209–226 (2010)
Mayernik, M.: The distributions of fields in bibliographic records. A Power Law Analysis. Library Resources and Technical Services 54(1), 40–54 (2009)
Khoo, M., Hall, C.: Merging Metadata: A Sociotechnical Study of Crosswalking and Interoperability. In: JCDL 2010, Brisbane, Australia, pp. 361–364 (2010)
Khoo, M., Pagano, J., Washington, A., Recker, M., Palmer, B., Donahue, R.: Using Web metrics to analyze digital libraries. In: JCDL 2008, Pittsburgh, PA, pp. 375–384 (2008)
Google (n.d.). Google Analytics, http://code.google.com/apis/analytics/docs/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Khoo, M., MacDonald, C. (2011). An Organizational Model for Digital Library Evaluation. In: Gradmann, S., Borri, F., Meghini, C., Schuldt, H. (eds) Research and Advanced Technology for Digital Libraries. TPDL 2011. Lecture Notes in Computer Science, vol 6966. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24469-8_34
Download citation
DOI: https://doi.org/10.1007/978-3-642-24469-8_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24468-1
Online ISBN: 978-3-642-24469-8
eBook Packages: Computer ScienceComputer Science (R0)