Designing a User Interface for Interactive Retrieval of Structured Documents — Lessons Learned from the INEX Interactive Track

  • Saadia Malik
  • Claus-Peter Klas
  • Norbert Fuhr
  • Birger Larsen
  • Anastasios Tombros
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4172)


The interactive track of the Initiative for the Evaluation of XML retrieval (INEX) aims at collecting empirical data about user interaction behaviour and to build methods and algorithms for supporting interactive retrieval in digital library systems containing structured documents. In this paper we discuss and compare the usability aspects of the web-based user interface used in 2004 with the application based user interface implemented with the Daffodil framework in 2005. The results include a validation of the element retrieval approach, successful implementation of the berrypicking model, and that additional clues for facilitating interactive retrieval (e.g. table of contents, indication of entry points, related terms, etc.) are appreciated by users.


Digital Library Query Term Query Formulation Retrieval Score Digital Library System 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bates, M.J.: The design of browsing and berrypicking techniques for the online search interface. Online Review 13, 407–424 (1989)CrossRefGoogle Scholar
  2. 2.
    Voorhees, E., Harman, D.: Overview of the eighth Text REtrieval Conference (TREC-8). In: The Eighth Text REtrieval Conference (TREC-8), pp. 1–24. NIST, Gaithersburg (2000)Google Scholar
  3. 3.
    Turpin, A.H., Hersh, W.: Why batch and user evaluations do not give the same results. In: Proc. of SIGIR, pp. 225–231. ACM Press, New York (2001)Google Scholar
  4. 4.
    O’Day, V.L., Jeffries, R.: Orienting in an information landscape: How information seekers get from here to there. In: Proc. of the INTERCHI 1993, pp. 438–445. IOS Press, Amsterdam (1993)Google Scholar
  5. 5.
    Finesilver, K., Reid, J.: User behaviour in the context of structured documents. In: Proc. of ECIR, pp. 104–119 (2003)Google Scholar
  6. 6.
    Larsen, B., Malik, S., Tombros, A.: The interactive track at inex 2005. In: Fuhr, N., Lalmas, M., Malik, S., Kazai, G. (eds.) INEX 2005. LNCS, vol. 3977, pp. 398–410. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  7. 7.
    Tombros, A., Larsen, B., Malik, S.: The interactive track at inex 2004. In: Fuhr, N., Lalmas, M., Malik, S., Szlávik, Z. (eds.) INEX 2004. LNCS, vol. 3493, pp. 410–423. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  8. 8.
    Kamps, J., de Rijke, M., Sigurbjörnsson, B.: University of amsterdam at inex 2005. In: Fuhr, N., Lalmas, M., Malik, S., Kazai, G. (eds.) INEX 2005. LNCS, vol. 3977, pp. 398–410. Springer, Heidelberg (2006)Google Scholar
  9. 9.
    van Zwol, R., Spruit, S., Baas, J.: B3-sdr@inetractive track: User interface design issues. In: INEX 2005 Workshop Pre-Proceedings (2005)Google Scholar
  10. 10.
    Crestani, F., Vegas, J., de la Fuente, P.: A graphical user interface for the retrieval of hierchically structured documents. Information Processing and Management 40, 269–289 (2004)CrossRefGoogle Scholar
  11. 11.
    Großjohann, K., Fuhr, N., Effing, D., Kriewel, S.: Query formulation and result visualization for XML retrieval. In: Proceedings ACM SIGIR 2002 Workshop on XML and Information Retrieval (2002)Google Scholar
  12. 12.
    Gövert, N., Kazai, G.: Overview of the INitiative for the Evaluation of XML retrieval. In: Proc. of INEX workshop, pp. 1–17 (2003)Google Scholar
  13. 13.
    Borlund, P.: Evaluation of interactive information retrieval systems, 276 PhD dissertation (2000)Google Scholar
  14. 14.
    Fuhr, N., Gövert, N., Großjohann, K.: HyREX: Hyper-media retrieval engine for XML. In: Proceedings of the 25th Annual International Conference on Research and Development in Information Retrieval (2002) 449 DemonstrationGoogle Scholar
  15. 15.
    Gövert, N., Fuhr, N., Abolhassani, M., Großjohann, K.: Content-oriented XML retrieval with HyREX. In: Proc. of INEX workshop, pp. 26–32 (2003)Google Scholar
  16. 16.
    Tombros, A., Malik, S., Larsen, B.: Report on the INEX 2004 interactive track. SIGIR Forum 39 (2005)Google Scholar
  17. 17.
    Klas, C.P., Fuhr, N., Schaefer, A.: Evaluating strategic support for information access in the DAFFODIL system. In: Heery, R., Lyon, L. (eds.) ECDL 2004. LNCS, vol. 3232, pp. 476–487. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  18. 18.
    Fuhr, N., Klas, C.P., Schaefer, A., Mutschke, P.: Daffodil: An integrated desktop for supporting high-level search activities in federated digital libraries. In: Agosti, M., Thanos, C. (eds.) ECDL 2002. LNCS, vol. 2458, pp. 597–612. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  19. 19.
    Fuhr, N., Gövert, N., Klas, C.P.: An agent-based architecture for supporting highlevel search activities in federated digital libraries. In: Proc. of ICADL, Taejon, Korea, KAIST, pp. 247–254 (2000)Google Scholar
  20. 20.
    Schaefer, A., Jordan, M., Klas, C.-P., Fuhr, N.: Active support for query formulation in virtual digital libraries: A case study with DAFFODIL. In: Rauber, A., Christodoulakis, S., Tjoa, A.M. (eds.) ECDL 2005. LNCS, vol. 3652, pp. 414–425. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  21. 21.
    Pehcevski, J., Thom, J.A., Vercoustre, A.: Users and assessors in the context of inex: Are relevance dimensions relevant? In: Proc. of INEX Workshop on Element Retrieval Methodology (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Saadia Malik
    • 1
  • Claus-Peter Klas
    • 1
  • Norbert Fuhr
    • 1
  • Birger Larsen
    • 2
  • Anastasios Tombros
    • 3
  1. 1.University of Duisburg-EssenDuisburgGermany
  2. 2.Royal School of Library & Information ScienceCopenhagenDenmark
  3. 3.Queen Mary, University of LondonUnited Kingdom

Personalised recommendations