Design and Evaluation of a University-Wide Expert Search Engine

  • Ruud Liebregts
  • Toine Bogers
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5478)


We present an account of designing and evaluating a university-wide expert search engine. We performed system-based evaluation to determine the optimal retrieval settings and an extensive user-based evaluation with three different user groups: scientific researchers, students, and outside visitors of the website looking for experts. Our search engine significantly outperformed the old search system in terms of effectiveness, efficiency, and user satisfaction.


Expert search evaluation search engine interactive IR 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Maybury, M.: Expert Finding Systems. Technical Report MTR 06B000040, MITRE Corporation (2006)Google Scholar
  2. 2.
    Balog, K., Bogers, T., Azzopardi, L., de Rijke, M., van den Bosch, A.: Broad Expertise Retrieval in Sparse Data Environments. In: Proceedings of SIGIR 2007, pp. 551–558. ACM Press, New York (2007)Google Scholar
  3. 3.
    Vickery, A., Brooks, H., Vickery, B.: An Expert System for Referral: The PLEXUS Project. Intelligent Information Systems: Progress and Prospects, pp. 154–183 (1986)Google Scholar
  4. 4.
    Campbell, C.S., Maglio, P.P., Cozzi, A., Dom, B.: Expertise Identification using Email Communications. In: Proceedings of CIKM 2003, New Orleans, LA, pp. 528–531 (2003)Google Scholar
  5. 5.
    Soboroff, I., de Vries, A.P., Craswell, N.: Overview of the TREC 2006 Enterprise Track. In: TREC 2006 Working Notes (November 2006)Google Scholar
  6. 6.
    Shami, N.S., Ehrlich, K., Millen, D.R.: Pick me!: Link Selection in Expertise Search Results. In: Proceedings of CHI 2008, pp. 1089–1092. ACM, New York (2008)Google Scholar
  7. 7.
    Balog, K., Azzopardi, L., de Rijke, M.: Formal Models for Expert Finding in Enterprise Corpora. In: Proceedings of SIGIR 2006, pp. 43–50. ACM Press, New York (2006)Google Scholar
  8. 8.
    Borlund, P.: Experimental Components for the Evaluation of Interactive Information Retrieval Systems. Journal of Documentation 56(1), 71–90 (2000)CrossRefzbMATHGoogle Scholar
  9. 9.
    Käki, M.: Proportional Search Interface Usability Measures. In: Proceedings of NordiCHI 2004, pp. 365–372. ACM, New York (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Ruud Liebregts
    • 1
  • Toine Bogers
    • 1
  1. 1.ILK / Tilburg Centre for Creative ComputingTilburg UniversityTilburgThe Netherlands

Personalised recommendations