Evaluation of Relevance and Knowledge Augmentation in Discussion Search

  • Ingo Frommholz
  • Norbert Fuhr
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4172)


Annotation-based discussions are an important concept for today’s digital libraries and those of the future, containing additional information to and about the content managed in the digital library. To gain access to this valuable information, discussion search is concerned with retrieving relevant annotations and comments w.r.t. a given query, making it an important means to satisfy users’ information needs. Discussion search methods can make use of a variety of context information given by the structure of discussion threads. In this paper, we present and evaluate discussion search approaches which exploit quotations in different roles as highlight and context quotations, applying two different strategies, knowledge and relevance augmentation. Evaluation shows the suitability of these augmentation strategies for the task at hand; especially knowledge augmentation using both highlight and context quotations boosts retrieval effectiveness w.r.t. the given baseline.


Digital Library Query Term Email Message Access Probability Retrieval Status 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Agosti, M., Ferro, N.: Annotations as context for searching documents. In: Crestani, F., Ruthven, I. (eds.) CoLIS 2005. LNCS, vol. 3507, pp. 155–170. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  2. 2.
    Agosti, M., Ferro, N., Frommholz, I., Thiel, U.: Annotations in digital libraries and collaboratories – facets, models and usage. In: Heery, R., Lyon, L. (eds.) ECDL 2004. LNCS, vol. 3232, pp. 244–255. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  3. 3.
    Bimbo, A.D., Gradmann, S., Ioannidis, Y.: Future research directions – 3rd DELOS brainstorming workshop report, DELOS Network of Excellence (July 2004)Google Scholar
  4. 4.
    Frommholz, I.: Applying the annotation view on messages for discussion search. In: Voorhees, Buckland: [14]Google Scholar
  5. 5.
    Frommholz, I., Fuhr, N.: Probabilistic, object-oriented logics for annotation-based retrieval in digital libraries. In: Proceedings of JCDL 2006 (2006) (in print)Google Scholar
  6. 6.
    Frommholz, I., Thiel, U., Kamps, T.: Annotation-based document retrieval with four-valued probabilistic datalog. In: Roelleke, T., de Vries, A.P. (eds.) Proceedings of the first SIGIR Workshop on the Integration of Information Retrieval and Databases (WIRD 2004), Sheffield, UK, pp. 31–38 (2004)Google Scholar
  7. 7.
    Fuhr, N.: Probabilistic Datalog: Implementing logical information retrieval for advanced applications. Journal of the American Society for Information Science 51(2), 95–110 (2000)CrossRefMathSciNetGoogle Scholar
  8. 8.
    Golovchinsky, G., Price, M.N., Schilit, B.N.: From reading to retrieval: freeform ink annotations as queries. In: Proceedings of the 22nd International Conference on Research and Development in Information Retrieval, pp. 19–25. ACM, New York (1999)Google Scholar
  9. 9.
    Marshall, C.C.: Toward an ecology of hypertext annotation. In: Proceedings of the ninth ACM conference on Hypertext and hypermedia: links, objects, time and space – structure in hypermedia systems, pp. 40–49 (1998)Google Scholar
  10. 10.
    Marshall, C.C., Brush, A.J.: Exploring the relationship between personal and public annotations. In: JCDL 2004: Proceedings of the 4th ACM/IEEE-CS Joint Conference on Digital Libraries, pp. 349–357. ACM Press, New York (2004)CrossRefGoogle Scholar
  11. 11.
    Rölleke, T.: POOL: Probabilistic Object-Oriented Logical Representation and Retrieval of Complex Objects. PhD thesis, University of Dortmund, Germany (1998)Google Scholar
  12. 12.
    Shipman, F.M., Price, M., Marshall, C.C., Golovchinsky, G.: Identifying useful passages in documents based on annotation patterns. In: Koch, T., Sølvberg, I.T. (eds.) ECDL 2003. LNCS, vol. 2769, pp. 101–112. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  13. 13.
    Thiel, U., Brocks, H., Frommholz, I., Dirsch-Weigand, A., Keiper, J., Stein, A., Neuhold, E.: COLLATE - a collaboratory supporting research on historic european films. International Journal on Digital Libraries (IJDL) 4(1), 8–12 (2004)Google Scholar
  14. 14.
    Voorhees, E.M., Buckland, L.P. (eds.): The Fourteenth Text Retrieval Conference (TREC 2005), Gaithersburg, MD, USA. NIST (2005)Google Scholar
  15. 15.
    Xi, W., Lind, J., Brill, E.: Learning effective ranking functions for newsgroup search. In: Järvelin, K., Allen, J., Bruza, P., Sanderson, M. (eds.) Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 394–401. ACM, New York (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Ingo Frommholz
    • 1
  • Norbert Fuhr
    • 1
  1. 1.University of Duisburg-EssenDuisburgGermany

Personalised recommendations