Usability Evaluation of Information Literacy Programmes: The Case Study of “Orion”
This paper refers to an evaluation project conducted at the Alexander Technological Educational Institute of Thessaloniki during 2014. The project aimed to evaluate the information literacy programme Orion. Orion is a useful tool that constitutes a most vital part of the information literacy skills evolution. The project aimed to evaluate the usability of Orion, specifying whether or not the programme improves information literacy skills of students providing content and functionality excellence. Additionally, it is very important to measure the usability of the structure that the programme follows. The method applied was measuring effectiveness, efficiency, learnability, and satisfaction. Most users appeared to be positively inclined towards the service, but during task performance and as they became more acquainted with the system, they became more critical as they confronted difficulties; such as the terminology used in it.
KeywordsInformation literacy Information literacy programmes Evaluation Usability Accessibility Information systems Orion Digital literacy Media literacy System evaluation Effectiveness
This research paper was made possible through the project “Digital Libraries and Open Access services of ATEI of Thessaloniki” funded by the European Union within the framework of “Digital Plan” and the Greek Ministry of Education. This project undertakes the assignment of Digital Services of increased value from the library towards the academic community, according to which Information Literacy Services for the academic community of ATEI of Thessaloniki were created.
- 2.American Library Association: Information Literacy Competency Standards for Higher Education (2000). http://www.ala.org/acrl/standards/informationliteracycompetency
- 4.Winship, J.: The First Step Forward: IT Literacy Policy Project. Council of Australian University Directors, New Zealand (2001)Google Scholar
- 8.Blandford, A., Keith, S., Connell, I., Edwards, H.: Analytical usability evaluation for digital libraries: a case study. In: Proceedings of the 2004 Joint ACM/IEEE Conference on Digital Libraries, pp. 27–36. IEEE, London (2004)Google Scholar
- 9.Brinck, T., Gergle, D., Wood, S.D.: Designing Web Sites that Work: Usability for the Web. Morgan Kaufmann, San Fransisco (2002)Google Scholar
- 10.Karoulis, A., Pombortsis, A.: heuristic evaluation of web-based ODL programs. In: Usability Evaluation of Online Learning Programs, pp. 88–109. Information Science Publishing, London (2003)Google Scholar
- 11.Booth, P.A.: An Introduction to Human-Computer Interaction. Psychology Press, Sussex (1989)Google Scholar
- 12.Nielsen, J.: Why You Only Need to Test with 5 Users. NNG [S.l.] (2000). http://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/
- 13.Nielsen, J.: Usability inspection methods. In: Conference Companion on Human Factors in Computing Systems, pp. 413–414. ACM, New York (1994)Google Scholar
- 15.Clairmont, M., Dickstein, R., Mills, V.: Testing for usability in the design of a new information gateway. In: Living the Future, 2. AZ, Arizona (1999)Google Scholar
- 16.Jeng, J.: Usability assessment of academic digital libraries: effectiveness, efficiency, satisfaction, and learnability. Libri 55(2–3), 96–121 (2005)Google Scholar
- 17.Jeng, J.: What is usability in the context of the digital library and how can it be measured? Inf. Technol. Libr. 24, 47–56 (2005)Google Scholar
- 20.Shonrock, D.D.: Evaluating Library Instruction: Sample Questions, Forms, and Strategies for Practical Use. American Library Association, Chicago (1996)Google Scholar
- 21.Vasileiadis, L., Chatzilia, M.: Online information literacy programme ‘Orion’. Periskopio 6, 7 (2011). (in Greek)Google Scholar
- 22.Garoufallou, E., Mystakopoulos, F., Siatri, R., Balatsoukas, P., Zafeiriou, G.: Usability evaluation of the digital archive of the hellenic broadcasting corporation (ERT). Qual. Quant. Meth. Libr. (QQML) 1, 17–26 (2013)Google Scholar
- 23.Dani, A., Chatzopoulou, C., Siatri, R., Mystakopoulos, F., Antonopoulou, S., Katrinaki, E., Garoufallou, E.: Digital libraries evaluation: measuring Europeana’s usability. In: Garoufallou, E., Hartley, R.J., Gaitanou, P. (eds.) MTSR 2015. CCIS, vol. 544, pp. 225–236. Springer, Heidelberg (2015). doi: 10.1007/978-3-319-24129-6_20CrossRefGoogle Scholar
- 24.Garoufallou, E., Dani, A., Siatri, R., Chatzopoulou, C., Virkus, S., Mystakopoulos, F., Katrinaki, E.: Usability evaluation of world digital library: estimating the utility of service platform. In: 7th International Conference on Qualitative and Quantitative Methods in Libraries (QQML 2015), 26–29 May 2015, Paris, France (2015)Google Scholar
Open Access This chapter is distributed under the terms of the Creative Commons Attribution Noncommercial License, which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.