A Comparative Study of the Effectiveness of Search Result Presentation on the Web

  • Hideo Joho
  • Joemon M. Jose
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3936)


Presentation of search results in Web-based information retrieval (IR) systems has been dominated by a textual form of information such as the title, snippet, URL, and/or file type of retrieved documents. On the other hand, document’s visual aspects such as the layout, colour scheme, or presence of images have been studied in a limited context with regard to their effectiveness of search result presentation. This paper presents a comparative evaluation of textual and visual forms of document summaries as the additional document surrogate in the search result presentation. In our study, a sentence-based summarisation technique was used to create a textual document summary, and the thumbnail image of web pages was used to represent a visual summary. The experimental results suggest that both have the cases where the additional elements contributed to a positive effect not only in users’ relevance assessment but also in query re/formulation. The results also suggest that the two forms of document summary are likely to have different contexts to facilitate user’s search experience. Therefore, our study calls for further research on adaptive models of IR systems to make use of their advantages in appropriate contexts.


Search Task Result List Search Interface Relevance Assessment Search Session 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Jansen, B.J., et al.: Real Life Information Retrieval: A Study of User Queries on the Web. ACM SIGIR Forum: A Publication of the Special Interest Group on Information Retrieval 32(1), 5–17 (1998)CrossRefGoogle Scholar
  2. 2.
    Ingwersen, P., Järvelin, K.: The Turn - Integration of Information Seeking and Retrieval in Context. The Information Retrieval Series, vol. 18. Springer, Heidelberg (2005)MATHGoogle Scholar
  3. 3.
    Belkin, N.J., Oddy, R.N., Brooks, H.M.: ASK for information retrieval: Part I. Background and theory. Journal of Documentation 38(2), 61–71 (1982)CrossRefGoogle Scholar
  4. 4.
    Belew, R.: Finding Out About- Search Engine Technology from a Cognitive Perspective. Cambridge University Press, Cambridge (2000)MATHGoogle Scholar
  5. 5.
    Hearst, M.A., Pederson, J.O.: Re-examining the Cluster Hypothesis: Scatter/Gather on Retrieval Results. In: Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, Zurich (1996)Google Scholar
  6. 6.
    Taylor, R.S.: Question negotiation and information seeking in libraries. College and Research Libraries 29, 178–194 (1968)CrossRefGoogle Scholar
  7. 7.
    White, R., Jose, J.M., Ruthven, I.: Using Top-Ranking Sentences to Facilitate Effective Information Access. Journal of the American Society for Information Science and Technology 56(10), 1113–1125 (2005)CrossRefGoogle Scholar
  8. 8.
    Chen, H., Dumais, S.: Bringing Order to the Web: Automatically Categorizing Search Results. In: Proceedings of the CHI 2000 Conference on Human factors in computing systems. ACM, The Hague (2000)Google Scholar
  9. 9.
    White, R., Jose, J.M., Ruthven, I.: A task oriented-study on the influencing effects of query-biased summarisation in web searching. Information Processing and Management 9(5), 707–733 (2003)CrossRefMATHGoogle Scholar
  10. 10.
    Dziadosz, S., Chandrasekar, R.: Do thumbnail previews help users make better relevance decisions about web search results? In: Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval. ACM, Tampere (2002)Google Scholar
  11. 11.
    Tombros, A., Sanderson, M.: Advantages of query-biased summaries in information retrieval. In: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, Melbourne (1998)Google Scholar
  12. 12.
    Borlund, P.: Experimental components for the evaluation of interactive information retrieval systems. Journal of Documentation 56(1), 71–90 (2000)CrossRefMATHGoogle Scholar
  13. 13.
    Tombros, A., Ruthven, I., Jose, J.M.: How Users Assess Web Pages for Information Seeking. Journal of the American Society for Information Science and Technology 56(4), 327–344 (2005)CrossRefGoogle Scholar
  14. 14.
    Woodruff, A., et al.: A comparison of the use of text summaries, plain thumbnails, and enhanced thumbnails for Web search tasks. Journal of the American Society for Information Science and Technology 53(2), 172–185 (2002)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Hideo Joho
    • 1
  • Joemon M. Jose
    • 1
  1. 1.Department of Computing ScienceUniversity of GlasgowGlasgowUK

Personalised recommendations