Effectiveness of Keyword-Based Display and Selection of Retrieval Results for Interactive Searches

  • Ezio Berenci
  • Claudio Carpineto
  • Vittorio Giannini
  • Stefano Mizzaro
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1696)

Abstract

We present an approach to increasing the effectiveness of rankedoutput retrieval systems that relies on graphical display and user manipulation of “views” of retrieval results, where a view is the subset of retrieved documents that contain a specified subset of query terms. This approach has been implemented in a system named VIEWER (VIEwing WEb Results), acting as an interface to available search engines. An experimental evaluation of the performance of VIEWER in contrast to AltaVista is the major focus of the paper. We first report the results of an experiment on single, short query searches where VIEWER, used as an interactive ranking system, markedly outperformed AltaVista. We then concentrate on a more realistic searching scenario, involving free query formulation, unconstrained selection of retrieval results, and possibility of query reformulation. We report the results of an experiment where the use of VIEWER, compared to AltaVista, seemed to shift the user effort from inspection to evaluation of results, increasing retrieval effectiveness and user satisfaction. In particular, we found that the VIEWER users retrieved half as many nonrelevant documents as the AltaVista users while retrieving a comparable number of relevant documents.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Berenci, E., Carpineto, C., and Giannini, V. (1998). Improving the effectiveness of Web search engines using selectable views of retrieval results. Journal of Universal Computer Science 4(9), 737–747.Google Scholar
  2. 2.
    Blair, D. and Maron, M. (1990). Full-text information retrieval: further analysis and clarification. Information Processing & Management, 26(3), 437–447.CrossRefGoogle Scholar
  3. 3.
    Bodoff, D., and Kambil, A. (1998). Partial coordination. I. The best of pre-coordination and post-coordination. Journal of the American Society for Information Sciences, 49(14), 1254–1269.CrossRefGoogle Scholar
  4. 4.
    Brajnik, G., Mizzaro, S., and Tasso, C. (1996). Evaluating user interfaces to information retrieval systems: a case study on user support. Proceedings of SIGIR’96, Zurich, 128–136.Google Scholar
  5. 5.
    Buckley, C., Mitra, M., Walz, J., and Cardie, C. (1999). SMART high precision: TREC-7. Proceedings of TREC-7.Google Scholar
  6. 6.
    Carpineto, C., and Romano, G. (1996). Information retrieval through hybrid navigation of lattice representations. International Journal of Human-Computer Studies, 45, 553–578.CrossRefGoogle Scholar
  7. 7.
    Chalmers, M., and Chitson, P. (1992). "Bead: explorations in information visualization", Proceedings of SIGIR’92, Copenhagen, Denmark, 330–337.Google Scholar
  8. 8.
    Clarke, C., Cormack, G., and Tudhope, E. (1997) "Relevance ranking for one to three term queries". Proceedings of RIAO’97: Computer-assisted information searching on the Internet, Montreal, Canada, 388–400.Google Scholar
  9. 9.
    Cooper, J., and Byrd, R. (1997). "Lexical navigation: visually prompted query expansion and refinement". Proceedings of the 2nd ACM Digital Library Conference, 237–246.Google Scholar
  10. 10.
    Hearst, M. (1995). "TileBars: Visualization of term distribution information in full text information access". Proceedings of CHI’95, Denver, Colorado, USA, 59–66.Google Scholar
  11. 11.
    Hearst, M. (1996). Improving full-text precision on short queries using simple constraints. Proceedings of the Symposium on Document Analysis and Information Retrieval.Google Scholar
  12. 12.
    Hemmje, M., Kunkel, C., and Willet, A. (1994). "LyberWorld–A visualization user interface supporting full text retrieval". Proceedings of SIGIR’94, Dublin, Ireland, 249–259.Google Scholar
  13. 13.
    Preece, J., Rogers, Y., Sharp, H., Benyon, D., Holland, S. and Carey, T. (1994). Human-Computer Interaction. Addison Wesley.Google Scholar
  14. 14.
    Robinson, C. (1983). Experiment, design, and statistics in psychology, 2nd edn., Harmondsworth: Penguin.Google Scholar
  15. 15.
    Salton, G. (1989). Automatic Text Processing: The Transformation, Analysis and Retrieval of Information by Computer. Addison Wesley.Google Scholar
  16. 16.
    Spoerri, A. (1994). "InfoCrystal: Integrating exact and partial matching approaches through visualization". Proceedings of RIAO’94: Intelligent Multimedia Information Retrieval Systems and Management, New York, New York, USA, 687–696.Google Scholar
  17. 17.
    Tague-Sutcliffe, J. (1992). The Pragmatics of Information Retrieval Experimentation, Revisited. Information Processing & Management, 28,4, 467–490.CrossRefGoogle Scholar
  18. 18.
    Tombros, A., and Sanderson, M. (1998). Advantages of query biased summaries in information retrieval. Proceedings of SIGIR’98, Melbourne, 3–10.Google Scholar
  19. 19.
    Van Rijsbergen, C. (1979). Information Retrieval (second edition), Butterworths, London.Google Scholar
  20. 20.
    Veerasamy, A., and Heikes, R. (1997). Effectiveness of a graphical display of retrieval results. Proceedings of SIGIR’97, Philadelphia, USA, 236–245.Google Scholar
  21. 21.
    Zamir, O., and Etzioni, O. (1998). Web document clustering: a feasibility demonstration. Proceedings of SIGIR’98, Melbourne, 46–54.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1999

Authors and Affiliations

  • Ezio Berenci
    • 1
  • Claudio Carpineto
    • 1
  • Vittorio Giannini
    • 1
  • Stefano Mizzaro
    • 2
  1. 1.Fondazione Ugo BordoniRomeItaly
  2. 2.Department of Mathematics and Computer ScienceUniversity of UdineUdineItaly

Personalised recommendations