Advertisement

Impact-ED - A New Model of Digital Library Impact Evaluation

  • Gemma Madle
  • Patty Kostkova
  • Abdul Roudsari
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5173)

Abstract

This paper presents Impact-ED, a new model for digital library impact evaluation. The model draws on assumptions from the Theory of Planned Behaviour and the Sense-Making Model. The paper discusses the current shortfalls of digital library impact evaluation and presents an alternative. Knowledge and attitude are put forward as potential measures of impact and different methods are triangulated and data linked to provide a comprehensive picture of the impact of the library at the time of use. The model shows how the digital library is being used to benefit users in their work, how it is changing their knowledge and attitudes and how the information found is used in real-time in the real world. It is being tested in the healthcare domain on the National Resource for Infection Control (www.nric.org.uk) but is expected to be transferable to other domains as further work will prove.

Keywords

Digital Library Evaluation Sense-making Knowledge and Attitudes Impact Evaluation 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    National Program for IT, http://www.npfit.nhs.uk/default.asp
  2. 2.
    National Knowledge Service, http://www.nks.nhs.uk/
  3. 3.
    Marshall, J.G.: The Impact of the Hospital Library on Clinical Decision Making: The Rochester Study. Bull. Med. Libr. Assoc. 80, 169–178 (1992)Google Scholar
  4. 4.
    O’Connor, P.: Determining the Impact of Health Library Services on Patient Care: A Review of the Literature. Health Inf. Libr. J. 19, 1–13 (2002)CrossRefGoogle Scholar
  5. 5.
    King, D.N.: The Contribution of Hospital Library Information Services to Clinical Care: A Study in Eight Hospitals. Bull. Med. Libr. Assoc. 75, 291–301 (1987)Google Scholar
  6. 6.
    Klein, M.S., Ross, F.V., Adams, D.L., Gilbert, C.M.: Determining the Impact of Health Library Services on Patient Care: A Review of the Literature. Acad. Med. 69, 489–495 (1994)CrossRefGoogle Scholar
  7. 7.
    Cullen, R.: Evaluating Digital Libraries in the Health Sector. Part 2: Measuring Impacts and Outcomes. Health Inf. Libr. J. 21, 3–13 (2004)Google Scholar
  8. 8.
    Cullen, R.: Evaluating Digital Libraries in the Health Sector. Part 1: Measuring Inputs and Outputs. Health Inf. Libr. J. 20, 195–204 (2003)Google Scholar
  9. 9.
    Cullen, R., Esson, R.: Assessing the Impact of Information Services in the Health Sector. Health Inf. Libr. J. 24(s1), 1–3 (2007)CrossRefGoogle Scholar
  10. 10.
    Urquhart, C.: Assessing Impact: Let Us Count the Ways? Libr. Inf. Update 4(12), 26 (2005)Google Scholar
  11. 11.
    Weightman, A.L., Williamson, J.: The Value and Impact of Information Provided Through Library Services for Patient Care: A Systematic Review. Health Inf. Libr. J. 22(1), 4–25 (2005)CrossRefGoogle Scholar
  12. 12.
    Madle, G., Kostkova, P., Roudsari, A.: The Impact of Healthcare Digital Libraries: a Systematic Review of Evaluation Methods (in preparation, 2008)Google Scholar
  13. 13.
    Fox, E., Marchionini, G.: Progress Towards Digital Libraries: Augmentation Through Integration. Inform. Process. Manag. 35, 219–225 (1999)CrossRefGoogle Scholar
  14. 14.
    Ajzen, I.: The Theory of Planned Behavior. Organ. Behav. Hum. Dec. 50, 179–211 (1991)CrossRefGoogle Scholar
  15. 15.
    Dervin, B.: Audience as Listener and Learner, Teacher and Confidante: The Sense-Making Approach. In: Dervin, B., Foreman-Wernet, L., Lauterbach, E. (eds.) Sense-making Methodology Reader: Selected Writings of Brenda Dervin, pp. 215–232. Hampton Press, Cresskill (2003)Google Scholar
  16. 16.
    Dervin, B.: A Theoretic Perspective and Research Approach for Generating Research Helpful to Communication Practice. In: Dervin, B., Foreman-Wernet, L., Lauterbach, E. (eds.) Sense-making Methodology Reader: Selected Writings of Brenda Dervin, pp. 251–268. Hampton Press, Cresskill (2003)Google Scholar
  17. 17.
    Dervin, B.: Sense-making Instrument. Sense-making Home Page, http://communication.sbs.ohio-state.edu/sense-making/inst/idervin97tech.html
  18. 18.
    Madle, G., Kostkova, P., Roudsari, A.: Impact-ED: The development of a new Digital Library Evaluation Model (2008) (in preparation)Google Scholar
  19. 19.
  20. 20.
    Choudhury, S., Hobbs, B., Lorie, M., Flores, N., Coleman, A., Martin, M., Kuhlman, D.L., McNair, J.H., Rhodes, W.A., Tipton, R., Agnew, G., Nicholson, D., Macgregor, G.: A Framework for Evaluating Digital Library Services. D-Lib. 8(7-8) (2002)Google Scholar
  21. 21.
  22. 22.
    Conyers, A.: The E-measures Project: Developing Statistical Measures for Electronic Information Services. In: E-measures Conference (2004)Google Scholar
  23. 23.
    Clarke, Z.: Equinox: Library Performance Measurement and Quality Management System. Learn. Res. J. 16(2), 28–31 (2000)Google Scholar
  24. 24.
    Miller, R., Schmidt, S.: E-metrics: Measures for Electronic Resources. In: 4th Northumbria International Conference on Performance Measurement in Libraries and Information Services, Washington, DC (2001)Google Scholar
  25. 25.
    Franklin, B., Plum, T.: Successful Web Survey Methodologies for Measuring the Impact of Networked Electronic Services (MINES for Libraries). IFLA 32(1), 28–40 (2006)CrossRefGoogle Scholar
  26. 26.
    Reeves, T.C., Apedo, X., Young, H.W.: Evaluating Digital Libraries: A User Friendly Guide. National Science Digital Library (2003), http://eduimpact.comm.nsdl.org/evalworkshop/UserGuideOct20.doc

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Gemma Madle
    • 1
  • Patty Kostkova
    • 1
  • Abdul Roudsari
    • 2
  1. 1.City eHealth Research CentreCity UniversityLondon
  2. 2.Centre for Health InformaticsCity UniversityLondon

Personalised recommendations