International Conference of the Cross-Language Evaluation Forum for European Languages

Experimental IR Meets Multilinguality, Multimodality, and Interaction pp 545-564 | Cite as

Overview of the CLEF 2015 Social Book Search Lab

  • Marijn Koolen
  • Toine Bogers
  • Maria Gäde
  • Mark Hall
  • Hugo Huurdeman
  • Jaap Kamps
  • Mette Skov
  • Elaine Toms
  • David Walsh
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9283)

Abstract

The Social Book Search (SBS) Lab investigates book search in scenarios where users search with more than just a query, and look for more than objective metadata. Real-world information needs are generally complex, yet almost all research focuses instead on either relatively simple search based on queries or recommendation based on profiles. The goal is to research and develop techniques to support users in complex book search tasks. The SBS Lab has two tracks. The aim of the Suggestion Track is to develop test collections for evaluating ranking effectiveness of book retrieval and recommender systems. The aim of the Interactive Track is to develop user interfaces that support users through each stage during complex search tasks and to investigate how users exploit professional metadata and user-generated content.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Beckers, T., Fuhr, N., Pharo, N., Nordlie, R., Fachry, K.N.: Overview and results of the INEX 2009 interactive track. In: Lalmas, M., Jose, J., Rauber, A., Sebastiani, F., Frommholz, I. (eds.) ECDL 2010. LNCS, vol. 6273, pp. 409–412. Springer, Heidelberg (2010) CrossRefGoogle Scholar
  2. 2.
    Borlund, P., Ingwersen, P.: The development of a method for the evaluation of interactive information retrieval systems. Journal of Documentation 53(3), 225–250 (1997)CrossRefGoogle Scholar
  3. 3.
    Hall, M.M., Fernando, S., Clough, P.D., Soroa, A., Agirre, E., Stevenson, M.: Evaluating hierarchical organisation structures for exploring digital libraries. Information Retrieval 17(4), 351–379 (2014)CrossRefGoogle Scholar
  4. 4.
    Hall, M.M., Huurdeman, H.C., Koolen, M., Skov, M., Walsh, D.: Overview of the INEX 2014 interactive social book search track. In: Cappellato, L., Ferro, N., Halvey, M., Kraaij, W. (eds.) Working Notes for CLEF 2014 Conference. CEUR Workshop Proceedings, Sheffield, UK, September 15–18, 2014, vol. 1180, pp. 480–493. CEUR-WS.org (2014)Google Scholar
  5. 5.
    Hall, M.M., Toms, E.: Building a common framework for IIR evaluation. In: Forner, P., Müller, H., Paredes, R., Rosso, P., Stein, B. (eds.) CLEF 2013. LNCS, vol. 8138, pp. 17–28. Springer, Heidelberg (2013) Google Scholar
  6. 6.
    Koolen, M., Kamps, J., Kazai, G.: Social book search: the impact of professional and user-generated content on book suggestions. In: Proceedings of the International Conference on Information and Knowledge Management (CIKM 2012). ACM (2012)Google Scholar
  7. 7.
    Kuhlthau, C.C.: Inside the search process: Information seeking from the user’s perspective. Journal of the American Society for Information Science 42(5), 361–371 (1991)CrossRefGoogle Scholar
  8. 8.
    O’Brien, H.L., Toms, E.G.: The development and evaluation of a survey to measure user engagement. Journal of the American Society for Information Science and Technology 61(1), 50–69 (2009)CrossRefGoogle Scholar
  9. 9.
    Reuter, K.: Assessing aesthetic relevance: Children’s book selection in a digital library. JASIST 58(12), 1745–1763 (2007)CrossRefGoogle Scholar
  10. 10.
    Toms, E., Hall, M.M.: The chic interactive task (chici) at clef2013 (2013). http://www.clef-initiative.eu/documents/71612/1713e643-27c3-4d76-9a6f-926cdb1db0f4
  11. 11.
    Vakkari, P.: A theory of the task-based information retrieval process: a summary and generalisation of a longitudinal study. Journal of Documentation 57(1), 44–60 (2001)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Marijn Koolen
    • 1
  • Toine Bogers
    • 2
  • Maria Gäde
    • 3
  • Mark Hall
    • 4
  • Hugo Huurdeman
    • 1
  • Jaap Kamps
    • 1
  • Mette Skov
    • 5
  • Elaine Toms
    • 6
  • David Walsh
    • 4
  1. 1.University of AmsterdamAmsterdamNetherlands
  2. 2.Aalborg University CopehagenCopenhagenDenmark
  3. 3.Humboldt University BerlinBerlinGermany
  4. 4.Edge Hill UniversityOrmskirkUK
  5. 5.Aalborg UniversityAalborgDenmark
  6. 6.University of SheffieldSheffieldUK

Personalised recommendations