Abstract
Classical approaches for evaluating information retrieval tools have limitations and shortcomings, particularly regarding to the consideration of the user, the manner in which these approaches measure the adequacy between the user’s query and the returned documents, and the consideration of the search tool characteristics. This critical finding prompted our reflections for the exploitation of contextual elements around the user, the query and the search tool during the evaluation process. This paper presents a new approach based on three complementary levels of context for evaluating information retrieval tools. The experiments gives at the end of this article has shown the applicability of the proposed approach to real research tools. The tests were performed with the most popular searching engine (i.e. Google, Bing and Yahoo) selected in particular for their high selectivity. The results have revealed that the evaluation of search engines at three different levels of context is a promising way to diagnose the performance, characteristics and behavior of these engines and the relevance of the results that they return.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Tamine, L., Boughanem, M., Daoud, M.: Evaluation of contextual information retrieval effectiveness: overview of issues and research. Journal of Knowledge and Information Systems 24(1), 1–34 (2010)
Menegon, D., Mizzaro, S., Nazzi, E., Vassena, L.: Benchmark evaluation of context-aware Web search. In: Workshop on Contextual Information Access, Seeking and Retrieval Evaluation, Toulouse, France. Springer, Heidelberg (2009)
Bouramoul, A., Kholladi, M.K., Doan, B.L.: PRESY: A Context based query reformulation tool for information retrieval on the Web. Journal of Computer Science 6(4), 470–477 (2010), ISSN 1549-3636
Brézillon, P.: Making context explicit in communicating objects. In: Kintzig, C., Poulain, G., Privat, G., Favennec, P.-N. (eds.) Communicating with Smart Objects, ch. 21, pp. 273–284. Kogan Page Science, London (2003)
Winograd, T.: Architectures for context, human-computer interaction, vol. 16, pp. 402–419. L. Erlbaum Associates Inc., Hillsdale (2001)
Belkin, N., Muresan, G., Zhang, X.: Using User’s Context for IR Personalization. In: Proceedings of the ACM/SIGIR Workshop on Information Retrieval in Context (2004)
Navigli, R., Velardi, P.: An analysis of ontology-based query expansion strategies. In: Proceeding of the Workshop on Adaptive Text Extraction and Mining, Dubrovnik –Croatia (2003)
Chen, X., Jia, K., Deng, Z.: A Video Retrieval Algorithm Based on Spatio-temporal Feature Curves and Key Frames. In: Fifth International Conference on Intelligent Information Hiding and Multimedia Signal Processing, Kyoto, Japan, pp. 1078–1081 (2009)
Rosset, S., Galibert, O., Illouz, G., Max, A.: Interaction et recherche d’information: le projet Ritel. Traitement Automatique des Langues (2006)
Lin, H.-C., Wang, L.-H.: Query expansion for document retrieval based on fuzzy rules and user relevance feedback techniques. Expert Systems with Applications 31(2), 397–405 (2006)
Daoud, M., Tamine, L., Boughanem, M.: A contextual evaluation protocol for a session-based personalized search. In: Workshop on Contextual Information Access, Seeking and Retrieval Evaluation, Toulouse, France. Springer, Heidelberg (2009)
Peters, C.: What Happened in CLEF 2009. In: Peters, C., Di Nunzio, G.M., Kurimo, M., Mostefa, D., Penas, A., Roda, G. (eds.) CLEF 2009. LNCS, vol. 6241, pp. 1–12. Springer, Heidelberg (2010)
Chaudiron, S., Ihadjadenem, M.: Quelle place pour l’usager dans l’évaluation des SRI? In: Couzinet, V., Regimbeau, G. (eds.) Recherches récentes en sciences de l’information: Convergences et dynamiques. Actes du colloque international MICS LERASS, Toulouse, March 2002, pp. 211–232 (2002)
Soucy, P., Mineau, G.W.: Beyond TFIDF Weighting for Text Categorization in the Vector Space Model. In: Proceedings of the 19th International Joint Conference on Artificial Intelligence (IJCAI 2005), Edinburgh, Scotland (2005)
Véronis,J.: Etude comparative de six moteurs de recherche. Université de Provence ( 2006), http://sites.univ-provence.fr/veronis/pdf/2006-etude-comparative.pdf
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bouramoul, A., Kholladi, MK., Doan, BL. (2011). A New Three Levels Context Based Approach for Web Search Engines Evaluation. In: Zamojski, W., Kacprzyk, J., Mazurkiewicz, J., Sugier, J., Walkowiak, T. (eds) Dependable Computer Systems. Advances in Intelligent and Soft Computing, vol 97. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21393-9_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-21393-9_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21392-2
Online ISBN: 978-3-642-21393-9
eBook Packages: EngineeringEngineering (R0)