Skip to main content
SpringerLink
Log in

An Organizational Model for Digital Library Evaluation

  • Conference paper
Book cover Research and Advanced Technology for Digital Libraries (TPDL 2011)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 6966))

Included in the following conference series:

Abstract

Evaluation is a central digital library practice. It provides important data for managing digital libraries and informing strategic decision-making. Digital library evaluation and management are organizational as well as technical practices. What evaluation models can account for these organizational factors, in practice as well as in theory? To address these questions, this paper integrates two models, one from the organizational literature (Porter’s value chain), and one from the evaluation literature (evaluation logic models), into a generic, flexible and extensible evaluation model that supports the goal-oriented evaluation and management of digital libraries in specific sociotechnical contexts. A case study is provided.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Reeves, T.C., Apedoe, X., Woo, Y.H.: Evaluating Digital Libraries: A User- Friendly Guide. National Science Digital Library, Boulder (2005)

    Book  Google Scholar 

  2. Khoo, M., MacArthur, D., Zia, L.: An agency perspective on digital library evaluation. In: Papatheodorou, C., Tsakonas, G. (eds.) Evaluation of Digital Libraries, pp. 41–59. Chandos Publishing, Oxford (2009)

    Chapter  Google Scholar 

  3. Bishop, A.P., Van House, N.A., Buttenfield, B.P. (eds.): Digital Library Use. Social Practice in Design and Evaluation. The MIT Press, Cambridge (2003)

    Google Scholar 

  4. Khoo, M.: A Sociotechnical Framework for Evaluating a Large-Scale Distributed Educational Digital Library. In: Gonzalo, J., Thanos, C., Verdejo, M.F., Carrasco, R.C. (eds.) ECDL 2006. LNCS, vol. 4172, pp. 449–452. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  5. Borgman, C.: Designing digital libraries for usability. In: Bishop, A.P., Van House, N.A., Buttenfield, B.P. (eds.) Digital Library Use, pp. 85–118. The MIT Press, Cambridge (2003)

    Google Scholar 

  6. Chowdhury, G., McMenemy, D., Poulter, A.: Large-Scale Impact of Digital Library Services: Findings from a Major Evaluation of SCRAN. In: Gonzalo, J., Thanos, C., Verdejo, M.F., Carrasco, R.C. (eds.) ECDL 2006. LNCS, vol. 4172, pp. 256–266. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  7. Blandford, A., Adams, A., Attfield, S., Buchanan, G., Gow, J., Makri, S., et al.: The PRET A Rapporter framework: Evaluating digital libraries from the perspective of information work. Information Processing and Management 44(1), 4–21 (2008)

    Article  Google Scholar 

  8. Jeng, J.: Usability assessment of academic digital libraries: Effectiveness, efficiency, satisfaction, and learnability. In: LIBRI, vol. 52(2-3), pp. 96–121 (2005a)

    Google Scholar 

  9. Borgman, C.L., Bates, M.J., Bates, M.V., Efthimiadis, E.N., Gilliland-Swetland, A.J., Kafai, Y.B., et al.: Social aspects of digital libraries. Graduate School of Education & Information Studies, University of California, Los Angeles, CA (1996)

    Google Scholar 

  10. Saracevic, T.: Digital library evaluation: Toward an evolution of concepts. Library Trends 49(2), 350–369 (2000)

    Google Scholar 

  11. Marchionini, G., Plaisant, C., Komlodi, A.: The people in digital libraries: Multifaceted approaches to assessing needs and impact. In: Bishop, A., Buttenfield, B., VanHouse, N. (eds.) Digital Library Use, pp. 119–160. MIT Press, Cambridge (2003)

    Google Scholar 

  12. Gonçalves, M.A., Fox, E.A., Watson, L.T., Kipp, N.A.: Streams, Structures, Spaces, Scenarios, Societies (5S): A Formal Model for Digital Libraries. ACM Transactions on Information Systems 22(2), 270–312 (2004)

    Article  Google Scholar 

  13. Gonçalves, M.A., Moreira, B.L., Fox, E.A., Watson, L.T.: “What is a good digital library?” – A quality model for digital libraries. Information Processing and Management 43(5), 1416–1437 (2007)

    Article  Google Scholar 

  14. Fuhr, N., Tsakonas, G., Aalberg, T., Agosti, M., Hansen, P., Kapidakis, S., et al.: Evaluation of digital libraries. International Journal on Digital Libraries 8(1), 21–38 (2007)

    Article  Google Scholar 

  15. Tsakonas, G., Kapidakis, S., Papatheodorou, C.: Evaluation of user interaction in digital libraries. In: The DELOS Workshop on the Evaluation of Digital Libraries, Padua, Italy (2004), http://dlib.ionio.gr/wp7/WS2004_Kapidakis.pdf (retrieved)

  16. Candela, L., Castelli, D., Ferro, N., Ioannidis, Y., Koutrika, G., Meghini, C., et al.: The Digital Library Reference Model. Foundations for Digital Libraries: DELOS Network of Excellence on Digital Libraries Project (2010)

    Google Scholar 

  17. Porter, M.: Competitive advantage. Creating and sustaining superior performance. The Free Press, New York (1998)

    Book  Google Scholar 

  18. Khoo, M., Giersch, S.: Planning digital library evaluation with logic models. In: Papatheodorou, C., Tsakonas, G. (eds.) Evaluation of Digital Libraries, pp. 217–234. Chandos Publishing, Oxford (2009)

    Chapter  Google Scholar 

  19. Cooksy, L.J., Gill, P., Kelly, P.A.: The program logic model as an integrative framework for a multimethod evaluation. Evaluation and Program Planning 24, 119–128 (2001)

    Article  Google Scholar 

  20. Millar, A., Simeone, R.S., Carnevale, J.T.: Logic models: a systems tool for performance management. Evaluation and Program Planning 24, 73–81 (2001)

    Article  Google Scholar 

  21. McLaughlin, J.A., Jordan, G.B.: Logic models: a tool for telling your program’s performance story. Evaluation and Program Planning 22, 65–72 (1999)

    Article  Google Scholar 

  22. Frechtling, J.: The 2002 User Friendly Handbook for Project Evaluation. The National Science Foundation, Arlington (2002)

    Google Scholar 

  23. Centers for Disease Control and Prevention, Introduction to process evaluation in tobacco use prevention and control. U.S. Department of Health and Human Services, Atlanta(2008)

    Google Scholar 

  24. Kellogg Foundation, Logic model development guide. W. K. Kellogg Foundationm, Battle Creek (2004)

    Google Scholar 

  25. Burger, A., Park, J.-R., Lu, G.: Application of Reference Guidelines for Assessing the Quality of the Internet Public Library’s Virtual Reference Services. Internet Reference Services Quarterly 15(4), 209–226 (2010)

    Article  Google Scholar 

  26. Mayernik, M.: The distributions of fields in bibliographic records. A Power Law Analysis. Library Resources and Technical Services 54(1), 40–54 (2009)

    Article  Google Scholar 

  27. Khoo, M., Hall, C.: Merging Metadata: A Sociotechnical Study of Crosswalking and Interoperability. In: JCDL 2010, Brisbane, Australia, pp. 361–364 (2010)

    Google Scholar 

  28. Khoo, M., Pagano, J., Washington, A., Recker, M., Palmer, B., Donahue, R.: Using Web metrics to analyze digital libraries. In: JCDL 2008, Pittsburgh, PA, pp. 375–384 (2008)

    Google Scholar 

  29. Google (n.d.). Google Analytics, http://code.google.com/apis/analytics/docs/

Download references

Author information

Authors and Affiliations

  1. The iSchool, Drexel University, 3141 Chestnut Street, Philadelphia, PA, 19104, USA

    Michael Khoo & Craig MacDonald

Authors
  1. Michael Khoo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Craig MacDonald
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Humboldt-Universität zu Berlin, Unter den Linden 6, 10099, Berlin, Germany

    Stefan Gradmann

  2. Consiglio Nazionale delle Richerche, Istituto di Scienza e Tecnologie dell’Informazione, Via Moruzzi, 1, 56124, Pisa, Italy

    Francesca Borri

  3. Consiglio Nazionale delle Ricerche, Istituto della Scienza e delle Tecnologie della Informazione, 56124, Pisa, Italy

    Carlo Meghini

  4. Databases and Information Systems Group, University of Basel, Bernoullistr. 16, 5056, Basel, Switzerland

    Heiko Schuldt

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Khoo, M., MacDonald, C. (2011). An Organizational Model for Digital Library Evaluation. In: Gradmann, S., Borri, F., Meghini, C., Schuldt, H. (eds) Research and Advanced Technology for Digital Libraries. TPDL 2011. Lecture Notes in Computer Science, vol 6966. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24469-8_34

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-24469-8_34

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-24468-1

  • Online ISBN: 978-3-642-24469-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation