Usability Evaluation of Information Literacy Programmes: The Case Study of “Orion”

  • Emmanouel Garoufallou
  • Anxhela Dani
  • Chrysanthi Chatzopoulou
  • Rania Siatri
  • Sirje Virkus
  • Fotis Mystakopoulos
  • Stavroula Antonopoulou
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 552)


This paper refers to an evaluation project conducted at the Alexander Technological Educational Institute of Thessaloniki during 2014. The project aimed to evaluate the information literacy programme Orion. Orion is a useful tool that constitutes a most vital part of the information literacy skills evolution. The project aimed to evaluate the usability of Orion, specifying whether or not the programme improves information literacy skills of students providing content and functionality excellence. Additionally, it is very important to measure the usability of the structure that the programme follows. The method applied was measuring effectiveness, efficiency, learnability, and satisfaction. Most users appeared to be positively inclined towards the service, but during task performance and as they became more acquainted with the system, they became more critical as they confronted difficulties; such as the terminology used in it.


Information literacy Information literacy programmes Evaluation Usability Accessibility Information systems Orion Digital literacy Media literacy System evaluation Effectiveness 



This research paper was made possible through the project “Digital Libraries and Open Access services of ATEI of Thessaloniki” funded by the European Union within the framework of “Digital Plan” and the Greek Ministry of Education. This project undertakes the assignment of Digital Services of increased value from the library towards the academic community, according to which Information Literacy Services for the academic community of ATEI of Thessaloniki were created.


  1. 1.
    Luo, L.: Web 2.0 integration in information literacy instruction: an overview. J. Acad. Librarianship 36(1), 32–40 (2010)CrossRefGoogle Scholar
  2. 2.
    American Library Association: Information Literacy Competency Standards for Higher Education (2000).
  3. 3.
    Cameron, L., Wise, S.L., Lottridge, S.M.: The development and validation of the information literacy test. Coll. Res. Libr. 68(3), 229–237 (2007)CrossRefGoogle Scholar
  4. 4.
    Winship, J.: The First Step Forward: IT Literacy Policy Project. Council of Australian University Directors, New Zealand (2001)Google Scholar
  5. 5.
    Saranto, K., Hovenga, E.J.: Information literacy-what it is about?: Literature review of the concept and the context. Int. J. Med. Inf. 73(6), 503–513 (2004)CrossRefGoogle Scholar
  6. 6.
    Wallace, M.C., Shorten, A., Crookes, P.A.: Teaching information literacy skills: an evaluation. Nurse Educ. Today 20(6), 485–489 (2000)CrossRefGoogle Scholar
  7. 7.
    Blandford, A., Buchanan, G., Jones, M.: Usability of digital libraries. Int. J. Digit. Libr. 4(2), 69–70 (2004)CrossRefGoogle Scholar
  8. 8.
    Blandford, A., Keith, S., Connell, I., Edwards, H.: Analytical usability evaluation for digital libraries: a case study. In: Proceedings of the 2004 Joint ACM/IEEE Conference on Digital Libraries, pp. 27–36. IEEE, London (2004)Google Scholar
  9. 9.
    Brinck, T., Gergle, D., Wood, S.D.: Designing Web Sites that Work: Usability for the Web. Morgan Kaufmann, San Fransisco (2002)Google Scholar
  10. 10.
    Karoulis, A., Pombortsis, A.: heuristic evaluation of web-based ODL programs. In: Usability Evaluation of Online Learning Programs, pp. 88–109. Information Science Publishing, London (2003)Google Scholar
  11. 11.
    Booth, P.A.: An Introduction to Human-Computer Interaction. Psychology Press, Sussex (1989)Google Scholar
  12. 12.
    Nielsen, J.: Why You Only Need to Test with 5 Users. NNG [S.l.] (2000).
  13. 13.
    Nielsen, J.: Usability inspection methods. In: Conference Companion on Human Factors in Computing Systems, pp. 413–414. ACM, New York (1994)Google Scholar
  14. 14.
    Oulanov, A., Pajarillo, E.J.: CUNY+ Web: usability study of the web-based GUI Version of the Bibliographic Database of the City University of New York (CUNY). Electron. Libr. 20(6), 481–487 (2002)CrossRefGoogle Scholar
  15. 15.
    Clairmont, M., Dickstein, R., Mills, V.: Testing for usability in the design of a new information gateway. In: Living the Future, 2. AZ, Arizona (1999)Google Scholar
  16. 16.
    Jeng, J.: Usability assessment of academic digital libraries: effectiveness, efficiency, satisfaction, and learnability. Libri 55(2–3), 96–121 (2005)Google Scholar
  17. 17.
    Jeng, J.: What is usability in the context of the digital library and how can it be measured? Inf. Technol. Libr. 24, 47–56 (2005)Google Scholar
  18. 18.
    Salisbury, F., Ellis, J.: Online and face-to-face: evaluating methods for teaching information literacy skills to undergraduate arts students. Libr. Rev. 52(5), 209–217 (2003)CrossRefGoogle Scholar
  19. 19.
    Ragains, P.: Evaluation of academic librarians’ instructional performance: report of a national survey. Res. Strat. 15(3), 159–175 (1997)CrossRefGoogle Scholar
  20. 20.
    Shonrock, D.D.: Evaluating Library Instruction: Sample Questions, Forms, and Strategies for Practical Use. American Library Association, Chicago (1996)Google Scholar
  21. 21.
    Vasileiadis, L., Chatzilia, M.: Online information literacy programme ‘Orion’. Periskopio 6, 7 (2011). (in Greek)Google Scholar
  22. 22.
    Garoufallou, E., Mystakopoulos, F., Siatri, R., Balatsoukas, P., Zafeiriou, G.: Usability evaluation of the digital archive of the hellenic broadcasting corporation (ERT). Qual. Quant. Meth. Libr. (QQML) 1, 17–26 (2013)Google Scholar
  23. 23.
    Dani, A., Chatzopoulou, C., Siatri, R., Mystakopoulos, F., Antonopoulou, S., Katrinaki, E., Garoufallou, E.: Digital libraries evaluation: measuring Europeana’s usability. In: Garoufallou, E., Hartley, R.J., Gaitanou, P. (eds.) MTSR 2015. CCIS, vol. 544, pp. 225–236. Springer, Heidelberg (2015). doi: 10.1007/978-3-319-24129-6_20CrossRefGoogle Scholar
  24. 24.
    Garoufallou, E., Dani, A., Siatri, R., Chatzopoulou, C., Virkus, S., Mystakopoulos, F., Katrinaki, E.: Usability evaluation of world digital library: estimating the utility of service platform. In: 7th International Conference on Qualitative and Quantitative Methods in Libraries (QQML 2015), 26–29 May 2015, Paris, France (2015)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Open Access This chapter is distributed under the terms of the Creative Commons Attribution Noncommercial License, which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.

Authors and Affiliations

  • Emmanouel Garoufallou
    • 1
    • 3
  • Anxhela Dani
    • 1
  • Chrysanthi Chatzopoulou
    • 1
  • Rania Siatri
    • 1
  • Sirje Virkus
    • 2
  • Fotis Mystakopoulos
    • 4
  • Stavroula Antonopoulou
    • 5
    • 3
  1. 1.Department of Library Science and Information SystemsAlexander Technological Educational Institute (ATEI) of ThessalonikiThessalonikiGreece
  2. 2.Institute of Information StudiesTallinn UniversityTallinnEstonia
  3. 3.University of AlcalaMadridSpain
  4. 4.Southampton Solent UniversitySouthamptonUK
  5. 5.American Farm SchoolPerrotis CollegeThessalonikiGreece

Personalised recommendations