Abstract
Search engines present query results as a long ordered list of web snippets divided into several pages. Post-processing of retrieval results for easier access of desired information is an important research problem. In this paper, we present a novel search result clustering approach to split the long list of documents returned by search engines into meaningfully grouped and labeled clusters. Our method emphasizes clustering quality by using cover coefficient-based and sequential k-means clustering algorithms. A cluster labeling method based on term weighting is also introduced for reflecting cluster contents. In addition, we present a new metric that employs precision and recall to assess the success of cluster labeling. We adopt a comparative strategy to derive the relative performance of the proposed method with respect to two prominent search result clustering methods: Suffix Tree Clustering and Lingo. Experimental results in the publicly available AMBIENT and ODP-239 datasets show that our method can successfully achieve both clustering and labeling tasks.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Can, F., Altingovde, I.S., Demir, E.: Efficiency and Effectiveness of Query Processing in Cluster-based Retrieval. Information Systems 29(8), 697–717 (2004)
Can, F., Kocberber, S., Baglioglu, O., Kardas, S., Ocalan, H.C., Uyar, E.: Bilkent News Portal: A personalizable system with new event detection and tracking capabilities. In: Proceedings of the 31st International ACM SIGIR Conference on Research and Development in Information Retrieval, p. 885. ACM Press, Singapore (2008)
Can, F., Ozkarahan, E.A.: Concepts and Effectiveness of the Cover-Coefficient-based Clustering Methodology for Text Databases. ACM Transactions on Database Systems 15(4), 483–517 (1990)
Carbonell, J., Goldstein, J.: The Use of MMR, Diversity-based Reranking for Reordering Documents and Producing Summaries. In: Proceedings of the 21st International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 335–336. ACM Press, Melbourne (1998)
Carpineto, C., Mizzaro, S., Romano, G., Snidero, M.: Mobile Information Retrieval with Search Results Clustering: Prototypes and evaluations. Journal of the American Society for Information Science and Technology 60(5), 877–895 (2009)
Carpineto, C., Osinski, S., Romano, R., Weiss, D.: A Survey of Web Clustering Engines. ACM Computing Surveys 41(3(17)) (2009) ISSN:0360-0300
Carpineto, C., Romano, G.: AMBIENT Dataset (2008), http://credo.fub.it/ambient/
Carpineto, C., Romano, G.: ODP239 Dataset (2009), http://credo.fub.it/odp239/
Dong, Z.: Towards Web Information Clustering. PhD thesis, Southeast University, Nanjing, China (2002)
Dumais, S.: Improving the Retrieval of Information from External Sources. Behavior Research Methods, Instruments, and Computers 23(2), 229–236 (1991)
Fellbaum, C.: WordNet: An Electronic Lexical Database. MIT Press, Cambridge (1998)
Hannappel, P., Klapsing, R., Neumann, G.: MSEEC a Multi Search Engine with Multiple Clustering. In: Proceedings of the 1999 Information Resources Management Association Conference (1999)
Hearst, M.A., Pedersen, J.O.: Reexamining the Cluster Hypothesis: Scatter/Gather on Retrieval Results. In: Proceedings of the 19th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 76–84 (1996)
Jain, A.K., Dubes, R.C.: Algorithms for Clustering Data. Prentice Hall (1988)
Jiang, J., Conrath, D.: Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy. In: Proceedings of the International Conference Research on Computational Linguistics, ROCLING (1997)
Osinski, S., Stefanowski, J., Weiss, D.: Lingo: Search Results Clustering Algorithm Based on Singular Value Decomposition. In: Proceedings of the International Conference on Intelligent Information Systems (2004)
Pirro, G.: A Semantic Similarity Metric Combining Features and Intrinsic Information Content. Data and Knowledge Engineering 68(11), 1289–1308 (2009)
Porter, M.F.: An Algorithm for Suffix Stripping. Program 14(3), 130–137 (1980)
Turel, A.: A New Approach to Search Result Clustering and Labeling. M.Sc. thesis, Bilkent University, Ankara, Turkey (2011)
Weiss, D.: Descriptive Clustering as a Method for Exploring Text Collections. PhD thesis, Poznań University of Technology, Poznań, Poland (2006)
Weiss, D., Osinski, S.: Carrot2 Open Source Search Results Clustering Engine (2002), http://project.carrot2.org/
Zamir, O., Etzioni, O.: Web Document Clustering: A Feasibility Demonstration. In: Proceedings of the 19th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 46–54 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Turel, A., Can, F. (2011). A New Approach to Search Result Clustering and Labeling. In: Salem, M.V.M., Shaalan, K., Oroumchian, F., Shakery, A., Khelalfa, H. (eds) Information Retrieval Technology. AIRS 2011. Lecture Notes in Computer Science, vol 7097. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25631-8_26
Download citation
DOI: https://doi.org/10.1007/978-3-642-25631-8_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25630-1
Online ISBN: 978-3-642-25631-8
eBook Packages: Computer ScienceComputer Science (R0)