Evaluating Leading Web Search Engines on Children’s Queries
This study compared retrieved results, relevance ranking, and overlap across Google, Yahoo!, Bing, Yahoo Kids!, and Ask Kids on 15 queries constructed by middle school children. Queries included one word, two words, and multiple words/phrases/natural language, and the results were benchmarked against Google and Yahoo Kids! top 5 and top 10 retrieved results using a new relevance ranking metric. Yahoo! and Bing yielded similar results on all queries, but their relevance ranking differed on one-word queries. Ask Kids outperformed Yahoo Kids! on all queries, and a modest percentage of results had the same relevance ranking as Google. Yahoo Kids! and Ask Kids returned unique results that were not retrieved by the other three engines on the first results page. Yahoo! and Bing produced the highest percentage in overlap with Google followed by Ask Kids. Implications are made for children and mediators concerning the use of search engines on children’s queries.
KeywordsChildren queries query construction web search engines evaluation information retrieval relevance ranking ranking comparison overlap unique results Google Yahoo! Bing Yahoo Kids! Ask Kids
Unable to display preview. Download preview PDF.
- 1.Nielsen, J.: Children’s Websites: Usability issues in designing for kids, http://www.useit.com/alertbox/childen.html
- 2.Olsen, S.: Google seeks to help children search better, http://www.nytimes.com/2009/12/26/technology/internet/26kidsearch.html
- 6.Bilal, D.: Web search engines for children: A comparative study and performance evaluation of Yahooligans!, Ask Jeeves Kids, and Super Snooper. In: Kids, J., Snooper, S. (eds.) 62nd Am. Soc. Inform. Sci. Meeting, pp. 70–82. Information Today, Inc., Medford (1999)Google Scholar
- 11.Druin, A., et al.: How children search the internet with keyword interfaces. In: 8th International Conference on Interaction Design and Children, Como, Italy, pp. 89–96 (2009)Google Scholar