Evaluation Methods for Rankings of Facetvalues for Faceted Search

  • Anne Schuth
  • Maarten Marx
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6941)

Abstract

We introduce two metrics aimed at evaluating systems that select facetvalues for a faceted search interface. Facetvalues are the values of meta-data fields in semi-structured data and are commonly used to refine queries. It is often the case that there are more facetvalues than can be displayed to a user and thus a selection has to be made. Our metrics evaluate these selections based on binary relevant assessments for the documents in a collection. Both our metrics are based on Normalized Discounted Cumulated Gain, an often used Information Retrieval metric.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Burke, R.D., Hammond, K.J., Young, B.C.: Knowledge-based navigation of complex information spaces. In: Proceedings of The National Conference On Artificial Intelligence, vol. 462, p. 468 (1996)Google Scholar
  2. Dash, D., Rao, J., Megiddo, N., Ailamaki, A., Lohman, G.: Dynamic faceted search for discovery-driven analysis. In: Proceeding of the 17th ACM Conference on Information and Knowledge Mining, CIKM 2008, Napa Valley, California, USA, p. 3 (2008), doi:10.1145/1458082.1458087Google Scholar
  3. English, J., Hearst, M., Sinha, R., Swearingen, K., Yee, K.P.: Hierarchical faceted metadata in site search interfaces. In: CHI 2002 Extended Abstracts on Human Factors in Computing Systems, pp. 628–639 (2002)Google Scholar
  4. Hearst, M.: Design recommendations for hierarchical faceted search interfaces. In: ACM SIGIR Workshop on Faceted Search, p. 15 (2006)Google Scholar
  5. Hearst, M.: Uis for faceted navigation: Recent advances and remaining open problems. In: Proc. 2008 Workshop on Human-Computer Interaction and Information Retrieval (2008)Google Scholar
  6. Hearst, M.: Search user interfaces. Cambridge Univ. Pr., Cambridge (2009)CrossRefGoogle Scholar
  7. Järvelin, K., Kekäläinen, J.: Cumulated gain-based evaluation of IR techniques. ACM Transactions on Information Systems (TOIS) 20, 422–446 (2002) ACM ID: 582418CrossRefGoogle Scholar
  8. Kules, B., Capra, R., Banta, M., Sierra, T.: What do exploratory searchers look at in a faceted search interface? In: Proceedings of the 9th ACM/IEEE-CS Joint Conference on Digital Libraries, JCDL 2009, pp. 313–322. ACM, New York (2009); ACM ID: 1555452CrossRefGoogle Scholar
  9. Trotman, A., Wang, Q.: Overview of the inex, data centric track (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Anne Schuth
    • 1
  • Maarten Marx
    • 1
  1. 1.ISLAUniversity of AmsterdamThe Netherlands

Personalised recommendations