Advertisement

Information Retrieval

, Volume 12, Issue 2, pp 201–226 | Cite as

Teaching and learning in information retrieval

  • Juan M. Fernández-Luna
  • Juan F. Huete
  • Andrew MacFarlane
  • Efthimis N. Efthimiadis
Article

Abstract

A literature review of pedagogical methods for teaching and learning information retrieval is presented. From the analysis of the literature a taxonomy was built and it is used to structure the paper. Information Retrieval (IR) is presented from different points of view: technical levels, educational goals, teaching and learning methods, assessment and curricula. The review is organized around two levels of abstraction which form a taxonomy that deals with the different aspects of pedagogy as applied to information retrieval. The first level looks at the technical level of delivering information retrieval concepts, and at the educational goals as articulated by the two main subject domains where IR is delivered: computer science (CS) and library and information science (LIS). The second level focuses on pedagogical issues, such as teaching and learning methods, delivery modes (classroom, online or e-learning), use of IR systems for teaching, assessment and feedback, and curricula design. The survey, and its bibliography, provides an overview of the pedagogical research carried out in the field of IR. It also provides a guide for educators on approaches that can be applied to improving the student learning experiences.

Keywords

Teaching Learning Educational assessment Information retrieval Curricula 

Notes

Acknowledgements

This paper has been partially supported by the Spanish Ministerio de Ciencia e Innovación under projects TIN2005-02516 and TIN2008-06566-C04-01, and Consejería de Innovación, Ciencia y Empresa de la Junta de Andalucía, under project TIC-276. The authors acknowledge the assistance of Jennifer Rohan in compiling the bibliography and the University of Washington Information School for resources.

References

  1. ACM, AIS, & AITP. (2002). Model curriculum and guidelines for undergraduate degree programs in information systems. http://www.acm.org/education/education/curric_vols/is2002.pdf. Accessed 4 December 2008.
  2. ACM, & AITP. (1997). IS 97 model curriculum and guidelines for undergraduate degree programs in information systems.Google Scholar
  3. Airio, E., Sormunen, E., Halttunen, K., & Keskustalo, H. (2007). Integrating standard test collections in interactive IR instruction. In Proceedings of the first international workshop on teaching and learning of information retrieval. http://www.bcs.org/server.php?show=ConWebDoc.8783. Accessed 4 December 2008.
  4. Argamon, S., Goharian, N., Grossman, D., Frieder, O., & Raju, N. (2005). A specialization in information and knowledge management systems for the undergraduate computer science curriculum. In Proceedings of the international conference on information technology: coding and computing (ITCC’05).Google Scholar
  5. Atchison, W. F., Conte, S. D., Hamblen, J. W., et al. (1968). Curriculum 68: Recommendations for academic programs in computer science: A report of the ACM curriculum committee on computer science. Communications of the ACM, 11(3), 151–197.CrossRefGoogle Scholar
  6. Bates, J., Bawden, D., Cordeiro, I., Steinerova, J., Vakkari, P., & Vilar, P. (2005). Information seeking and information retrieval. In L. Kajberg & L. Lørring (Eds.), European curriculum reflections on library and information science. Denmark: The Royal School of Library and Information Science.Google Scholar
  7. Bawden, D., Bates, J., Steinerová, J., Vakkari, P., & Vilar, P. (2007). Information retrieval curricula; contexts and perspectives. In Proceedings of the first workshop on teaching and learning of information retrieval. http://www.bcs.org/server.php?show=ConWebDoc.8777. Accessed 4 December 2008.
  8. Bawden, D., Vilar, P., Bates, J., Cordeiro, I., Steinerová, J., & Vakkari, P. (2005). Europe-wide programmes for information retrieval and information seeking. In Proceedings of the international online information meeting (pp. 143–148).Google Scholar
  9. Bell, J. P., & Schauder, D. (2002). The WEBWORKFORCE—A learning repository to support educators, trainers and Information Technology courses. In Proceedings of the Australasian computing education conference (ACE2003) (pp. 239–245).Google Scholar
  10. Bernard, D. F., & Hollingsworth, Y. (1999). Teaching web-based full-text databases. New concepts for new technology. Reference & User Services Quarterly, 39(1), 63–70.Google Scholar
  11. Bhavnani, S., Drabenstott, K., & Radev, D. (2001). Towards a unified framework of IR tasks and strategies. In Proceedings of the ASIST annual meeting (Vol. 38, pp. 340–354).Google Scholar
  12. Block, M. (2001). Teaching kids indirectly. School Library Journal, Summer, 33–34.Google Scholar
  13. Brajnik, G., Mizzaro, S., & Tasso, C. (2003). Strategic help in user interfaces for information retrieval. Journal of the American Society for Information Science and Technology, 53(5), 343–358.CrossRefGoogle Scholar
  14. Brandt, D. S. (1997). Constructivism: Teaching for under of the internet. Communications of the ACM, 40(10), 112–117.CrossRefGoogle Scholar
  15. Brandt, D. S., & Uden, L. (2003). Insight into mental models of novice Internet searchers. Communications of the ACM, 46(7), 133–136.Google Scholar
  16. Brower, S. (2004). Millennials in action: A student-guided effort in curriculum-integration of library skills. Medical Reference Services Quarterly, 23, 81–88.CrossRefGoogle Scholar
  17. Brusilovsky, P. (2002). Web-based interactive visualization in an information retrieval course. In Proceedings of the world conference on educational multimedia, hypermedia and telecommunications (EDMEDIA) (pp. 198–203).Google Scholar
  18. Cacheda, F., Fernández, D., & López, R. (2008). Experiences on a practical course of web information retrieval: Developing a search engine. In Proceedings of the second international workshop on teaching and learning of information retrieval. http://www.bcs.org/server.php?show=ConWebDoc.22357. Accessed 4 December 2008.
  19. Calado, P., Cardoso-Cachopo, A., & Oliveira, A. (2007). IR-BASE: An integrated framework for the research and teaching of information retrieval technologies. In Proceedings of the first international workshop on teaching and learning of information retrieval. http://www.bcs.org/server.php?show=ConWebDoc.8762. Accessed 4 December 2008.
  20. Charted Institute of Library and Information Professionals (CLILP). (2004). Body of professional knowledge: Setting out an adaptable and flexible framework for your changing needs. http://www.cilip.org.uk/qualificationschartership/bpk. Accessed 5 December 2008.
  21. Chau, M., Huang, Z., & Chen, H. (2003). Teaching key topics in computer science and information systems through a web search engine project. ACM Journal of Educational Resources in Computing, 3(3), Article 2.Google Scholar
  22. Choi, Y., & Rasmussen, E. (2006). What is needed to educate future digital librarians: A stud of current practice and staffing patterns in academic and research libraries. D-Lib Magazine, 12(9). http://www.dlib.org/dlib/september06/choi/09choi.html. Accessed 5 December 2008.
  23. Cohen, L. B. (2001, November). 10 tips for teaching how to search the Web. American Libraries, 44–46.Google Scholar
  24. Cohen, L. B. (2007). A query-based approach in Web search instruction: An assessment of current practice. Research Strategies, 20, 442–457.CrossRefGoogle Scholar
  25. Coleman, A. (2002). The road ahead for education in digital libraries. D-Lib Magazine, 8(7/8).Google Scholar
  26. Croft, B. (2003). Information retrieval and computer science: An evolving relationship. In Proceedings of the SIGIR conference (pp. 1–2).Google Scholar
  27. de Campos, L. M., Fernández-Luna, J. M., Huete, J. F., & Romero, A. E. (2007). A flexible object-oriented system for teaching and learning structured IR. In Proceedings of the first international workshop on teaching and learning of information retrieval. http://www.bcs.org/server.php?show=ConWebDoc.8769. Accessed 4 December 2008.
  28. Digital Library Curriculum Development project (DLCD). (2008). Digital Library Curriclum development project web site. http://curric.dlib.vt.edu/. Accessed 15th December 2008.
  29. Dimattia, S. (2007, March–April). How we teach (or should teach) online searching. Online Magazine (www.onlinemag.net), 34–38.
  30. Drabenstott, K. (2004). Why I still teach online searching. Journal of Education for Library and Information Science, 45(1), 75–80.Google Scholar
  31. Druin, A., Weeks, A., Massey, S., & Bederson, B. B. (2007). Children’s interests and concerns when using the international children’s digital library: A four-country case study. In Proceedings of the joint conference on digital libraries (pp. 167–176).Google Scholar
  32. Efthimiadis, E. N., & Freier, N. G. (2007). IR-Toolbox: An experiential learning tool for teaching IR. In Proceedings of the SIGIR conference (p. 914).Google Scholar
  33. Efthimiadis, E. N., & Hendry, D.G. (2005). Search engines and how students think they work. In Proceedings of the SIGIR conference (pp. 595–596).Google Scholar
  34. Fjallbrant, N. (1996). EDUCATE—A user education program for information retrieval and handling. In Proceedings of the international associate of technological university libraries—IATUL 1996. http://www.iatul.org/conferences/pastconferences/1996proceedings.asp. Accessed 5 December 2008.
  35. Fourie, I. (2001). The use of CAI for distance teaching in the formulation of search strategies. Library Tends, 50(1), 110–129.MathSciNetGoogle Scholar
  36. Fourie, I., & van Brakel, P. (1995). Multimedia study package for distance teaching of computerized information retrieval. South African Journal of Library and Information Science, 63(3), 139–147.Google Scholar
  37. Fox, E. (1996). Courseware, training and curriculum in information retrieval. In Proceedings of the ACM SIGIR conference.Google Scholar
  38. Friman, J., Kangaspunta, J., Leppäniemi, S., Rasi, P., & Virrankoski, A. (2005). Query performance analyser—A tool for teaching information retrieval skills through an educational game. www.uta.fi/~jk62370/qpa.pdf. Accessed 4 December 2008.
  39. Goharian, N., Grossman, D., & Raju, N. (2004). Extending the undergraduate computer science curriculum to include data mining. In Proceedings of the international conference on information technology: Coding and computing (ITCC’04) (pp. 251–254).Google Scholar
  40. Gupta, A., Ludäsche, B., & Moore, R. W. (2002). Ontology services for curriculum development in NSDL. In Proceedings of the joint conference on digital libraries (pp. 219–220).Google Scholar
  41. Halttunen, E. (2002). Scaffolding performance in IR instruction: Exploring learning experiences and performance in two learning environments. Journal of Information Science, 29(5), 375–390.CrossRefGoogle Scholar
  42. Halttunen, E. (2003a). Scaffolding performance in IR instruction: Exploring learning experiences and performance in two learning environments. Journal of Information Science, 29, 375–390.CrossRefGoogle Scholar
  43. Halttunen, E. (2003b). Students’ conceptions of information retrieval implications for the design of learning environments. Library & Information Science Research, 25, 307–332.CrossRefGoogle Scholar
  44. Halttunen, E. (2007). Design experiment on two information retrieval learning environments. In Proceedings of the first international workshop on teaching and learning of information retrieval. http://www.bcs.org/server.php?show=ConWebDoc.8749. Accessed 4 December 2008.
  45. Halttunen, E., & Järvelin, K. (2005). Assessing learning outcomes in two information retrieval learning environments. Information Processing and Management, 41, 949–972.CrossRefGoogle Scholar
  46. Halttunen, E., & Sormunen, E. (2000). Learning information retrieval through an educational game. Is gaming sufficient for learning? Education for Information, 18, 289–311.Google Scholar
  47. Hendry, D. G. (2007). History places: A case study for relational database and information retrieval system design. ACM Journal on Educational Resource in Computing, 7(1), Article 3.Google Scholar
  48. Hendry, D. G., & Efthimiadis, E. N. (2008). Conceptual models for search engines. In A. Spink & M. Zimmer (Eds.), Web searching: Interdisciplinary perspectives. Springer.Google Scholar
  49. Henrich, A., & Morgenroth, K. (2007). Information retrieval as e-learning course in German—Lessons learned after 5 years of experience. In Proceedings of the first international workshop on teaching and learning of information retrieval. http://www.bcs.org/server.php?show=ConWebDoc.8765. Accessed 4 December 2008.
  50. Herrera-Viedma, E., Alonso, S., Cabrerizo, F. J., Lopez-Herrera, A. G., & Porcel, C. (2007). A software tool to teach the performance of fuzzy IR systems based on weighted queries. In Proceedings of the first international workshop on teaching and learning of information retrieval. http://www.bcs.org/server.php?show=ConWebDoc.8767. Accessed 4 December 2008.
  51. IEEE, & ACM. (2001). The joint task force on computer curricula. Computing curricula 2001. Computer science. http://www.acm.org/education/curricula-recommendations. Accessed 4 December 2008.
  52. Ingwersen, P. (1992). Information retrieval interaction. London: Taylor Graham.Google Scholar
  53. Jacobson, F., & Ignacio, E. N. (1997). Teaching reflection: Information seeking and evaluation in a digital library environment. Library Trends, 45(4), 771–802.Google Scholar
  54. Jinguji, D., Lewis, W., Efthimiadis, E. N., Minor, J., Bertram, A., et al. (2006). The University of Washington’s U WCLMA QA system. In The fifteenth Text REtrieval Conference (TREC 2006) proceedings. http://trec.nist.gov/pubs/trec15/. Accessed 4 December 2008.
  55. Johnson, F. (2008). On the relation of search and engines. In Proceedings of the second international workshop on teaching and learning of information retrieval. http://www.bcs.org/server.php?show=ConWebDoc.22355. Accessed 4 December 2008.
  56. Jones, G. (2007). Teaching information retrieval using research questions to encourage creativity and assess understanding. In Proceedings of the first international workshop on teaching and learning of information retrieval. http://www.bcs.org/server.php?how=ConWebDoc.8772. Accessed 4 December 2008.
  57. Kajberg, L., & Lørring, L. (Eds.). (2005). European curriculum reflections on library and information science education. Copenhagen, Royal School of Library and Information Science. http://biblis.db.dk/uhtbin/hyperion.exe/db.leikaj05/. Accessed 26 January 2009.
  58. Kaplan, N., Chisik, Y., Knudtzon, K., Kulkarni, R., Moulthrop, S., Summers, K., et al. (2004). Supporting sociable literacy in the international children’s digital library. In Proceedings of the international conference for interaction design and children (pp. 89–96).Google Scholar
  59. Kuhlthau, C. C. (1988). Developing a model of the library search process: Cognitive and affective aspects. RQ 28.n2 (Winter 1988), 232(11).Google Scholar
  60. Kuhlthau, C. C. (1997). Learning in digital libraries: An information search process approach. Library Trends, 45(4), 708–724.Google Scholar
  61. Lazarinis, F. (2007). Forming an instructional approach to teach web searching skills to non-English users. Program: Electronic Library and Information Systems, 41(2), 170–179.CrossRefGoogle Scholar
  62. Lazonder, A. (2003). Principles for designing web searching instruction. Education and Information Technologies, 8(2), 179–193.CrossRefGoogle Scholar
  63. Leide, J. E., Cole, C., Beheshti, J., Large, A., & Lin, Y. (2007). Task-based information retrieval: Structuring undergraduate history essays for better course evaluation using essay-type visualizations. Journal of the American Society for Information Science and Technology, 58(9), 1227–1241.CrossRefGoogle Scholar
  64. Ma, Y., Clegg, W., & O’Brien, A. (2006). Digital library education: The current status. In Proceedings of the joint conference on digital libraries—JCDL’06 (pp. 165–174).Google Scholar
  65. MacFarlane, A. (2007). Pedagogic challenges in information retrieval—Teaching mathematics to postgraduate information science students. In Proceedings of the first international workshop on teaching and learning of information retrieval. http://www.bcs.org/server.php?show=ConWebDoc.8771. Accessed 4 December 2008.
  66. Marshall, B., Chen, H., Shen, R., & Fox, E. A. (2006). Moving digital libraries into the student learning space: The GetSmart experience. ACM Journal on Educational Resources in Computing, 6(1), Article 2.Google Scholar
  67. Marshall, B., Zhang, Y., Chen, H., Lally, A., Shen, R., Fox., E., et al. (2003). Convergence of knowledge management and e-learning: The GetSmart experience. In Proceedings of the joint conference on digital libraries (pp. 135–146).Google Scholar
  68. McFarlane, A. (2001). Perspectives on the relationships between ICT and assessment. Journal of Computer Assisted Learning, 17, 227–234.zbMATHCrossRefGoogle Scholar
  69. McFarlane, A. (2003). Learners, leaning and new technologies. In Proceedings of ICEM-CIME annual conference (pp. 219–227), Granada.Google Scholar
  70. McGregor, J. (1994). Information seeking and use: Students’ thinking and their mental models. Journal of Youth Services in Libraries, 8, 69–76.Google Scholar
  71. Meng, X. (2003). Putting information retrieval theory into practice—A web search engine project for an undergraduate computer science elective course. In Proceedings of the 2003 American society for engineering education annual conference & exposition.Google Scholar
  72. Mooers, C. N. (1951). Making information retrieval pay. Boston: Zator Co.Google Scholar
  73. Nicholson, S. (2005). Understanding the foundation: The state of generalist search education in library schools as related to the needs of expert searchers in medical libraries. Journal of the Medical Library Association, 93(1), 61–68.Google Scholar
  74. Olivier, R., & Olivier, H. (1997). Using context to promote learning from information-seeking tasks. Journal of the American Society for Information Science and Technology, 48(6), 519–526.CrossRefGoogle Scholar
  75. Pollit, S. (1987). Information retrieval activity in pre-university education in the United Kingdom. SIGCUE Outlook, Spring/Summer, 71–82.Google Scholar
  76. Pomerantz, J., Oh, S., Wildemuth, B. M., Yang, S., & Fox, E. (2007). Digital library education in computer science programs. In Proceedings of the joint conference on digital libraries (pp. 177–178).Google Scholar
  77. Pomerantz, J., Oh, S., Yang, S., Fox, E., Wildemuth, B. M. (2006a). Digital library education in library and information science programs. D-Lib Magazine, 12(11).Google Scholar
  78. Pomerantz, J., Wildemuth, B. M., Yang, S., & Fox, E. (2006b). Curriculum development for digital libraries. In Proceedings of the joint conference on digital libraries (pp. 175–184).Google Scholar
  79. Poulter, A., & Brunt, R. (2007). On reading “Information storage and retrieval in the professional curriculum” by Rodney Brunt. Library Review, 56(7), 557–562.CrossRefGoogle Scholar
  80. Quality Assurance Agency for Higher Education (QAA). (2000). Librarianship and information management subject benchmark. http://www.qaa.ac.uk/academicinfrastructure/benchmark/honours/librarianship.asp. Accessed 5 December 2008.
  81. Raban, D. (2003). Searchers training searchers. Searcher, 10–11, 38–41.Google Scholar
  82. Rennie, J. S. (1986). A history of the Department of Information Science of The City University. Journal of Information Science, 12, 3–13.CrossRefMathSciNetGoogle Scholar
  83. Riding, P., Fowell, S., & Levy, P. (1995). An action research approach to curriculum development. Information Research, 1(1). http://informationR.net/ir/1-1/paper2.html. Accessed 26 January 2009.
  84. Riesthuis, G. J. A. (2002). Teaching of Information storage and retrieval at the Department for Information Science of the University of Amsterdam. In Proceedings of the 68th IFLA council and general conference. http://www.ifla.org/IV/ifla68/papers/024-144e.pdf. Accessed 4 December 2008.
  85. Ruthven, I., Elsweiler, D., & Nicol, E. (2008). Designing for users: A holistic approach to teaching information retrieval. In Proceedings of the second international workshop on teaching and learning of information retrieval. http://www.bcs.org/server.php?show=ConWebDoc.22356. Accessed 4 December 2008.
  86. Sacchanand, C., & Jaroenpuntaruk, V. (2006). Development of a web-based self-training package for information retrieval using the distance education approach. The Electronic Library, 24(4), 501–516.CrossRefGoogle Scholar
  87. Salton, G. (1969). Information science in a Ph.D. computer science program. Communications of the ACM, 12(2), 111–117.CrossRefGoogle Scholar
  88. Saracevic, T. & Dalbello, M. (2001). A survey of digital library education. In Proceedings of the American society for information science (Vol. 38, pp. 209–223).Google Scholar
  89. Sharda, N. (2007). Creating innovative new media programs: Need, challenges, and development framework. In Proceedings of the international workshop on educational multimedia and multimedia education (pp. 77–86).Google Scholar
  90. Sormunen, E., Hokkanen, S., Kangaslampi, P., Pyy, P., & Sepponen, B. (2002). Query performance analyser—A Web-based tool for IR research and instruction. In Proceedings of the SIGIR conference (p. 450).Google Scholar
  91. Sormunen, E., & Pennane, S. (2004). The challenge of automated tutoring in Web-based learning environments for information retrieval instruction. Information Research, 9(2). http://InformationR.net/ir/9-2/paper169.html. Accessed 26 January 2009.
  92. Spink, A., & Cool, C. (1999). An international survey of digital library education. D-Lib Magazine, 5(5).Google Scholar
  93. Tenopir, C. (2005). Teaching student searchers. Library Journal, 130(4), 33.Google Scholar
  94. Thornley, C. (2008). Teaching information retrieval (IR) as a philosophical problem. In Proceedings of the second international workshop on teaching and learning of information retrieval. http://www.bcs.org/server.php?show=ConWebDoc.22354. Accessed 4 December 2008.
  95. Tomaiulo, N. G. (1998). Effective simultaneous hands-on drill for basic electronic database instruction. Research Strategies, 16(2), 135–145.CrossRefGoogle Scholar
  96. Vilar, P., Žumer, M., & Bates, J. (2007). Information seeking and information retrieval curricula development for modules taught in two library and information science schools: The cases of Ljubljana and Dublin. In Proceedings of the sixth international conference on conceptions of library and information science. Information Research, 12(4).Google Scholar
  97. Vine, R. (2001). Real people don’t do Boolean: How to teach end users to find high-quality information in the Internet. Information Outlook; Mar 2001; 5, 3. Research Library, 16–23.Google Scholar
  98. Wade, S., & Braeckevelt, P. (1994). IR framework—An object-oriented framework for developing information retrieval systems. Program-Automated Library and Information Systems, 29(1), 15–29.CrossRefGoogle Scholar
  99. Walker, H. M., & Engel, K. (2006). Research exercises: Immersion experiences to promote information literacy. Journal of Computing Sciences in Colleges, 21(4), 61–68.Google Scholar
  100. Whittington, J., & Nankivell, K. (2006). Teaching strategies and assessment measures for rapidly changing technology programs. In Proceedings of the international conference on computer graphics and interactive techniques, Article 45.Google Scholar
  101. Wilson, T. D. (1999). Models in information behaviour research. Journal of Documentation, 55(3), 249–270.CrossRefGoogle Scholar
  102. Wing, J. (2000). Weaving formal methods into the undergraduate computer science curriculum. In Proceedings of the 8th international conference on algebraic methodology and software technology. Lecture Notes in Computer Science (Vol. 1816, pp. 2–9).Google Scholar
  103. Yang, S., Fox, E., Wildemuth, B. M., Pomerantz, J., & Oh, S. (2006). Interdisciplinary curriculum development for digital library education. Lecture Notes in Computer Science, 4312, 61–70.CrossRefGoogle Scholar
  104. Zhu, L., & Tang, C. (2006). A module-based integration of Information Retrieval into undergraduate curricula. Journal of Computing Sciences in Colleges, 22(2), 288–294.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  • Juan M. Fernández-Luna
    • 1
  • Juan F. Huete
    • 1
  • Andrew MacFarlane
    • 2
  • Efthimis N. Efthimiadis
    • 3
  1. 1.Departamento de Ciencias de la Computación e Inteligencia Artificial, E.T.S.I. Informática y de TelecomunicaciónUniversidad de GranadaGranadaSpain
  2. 2.Department of Information Science, School of InformaticsCity University of LondonLondonUK
  3. 3.The Information SchoolUniversity of WashingtonSeattleUSA

Personalised recommendations