Evaluating Leading Web Search Engines on Children’s Queries

  • Dania Bilal
  • Rebekah Ellis
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6764)


This study compared retrieved results, relevance ranking, and overlap across Google, Yahoo!, Bing, Yahoo Kids!, and Ask Kids on 15 queries constructed by middle school children. Queries included one word, two words, and multiple words/phrases/natural language, and the results were benchmarked against Google and Yahoo Kids! top 5 and top 10 retrieved results using a new relevance ranking metric. Yahoo! and Bing yielded similar results on all queries, but their relevance ranking differed on one-word queries. Ask Kids outperformed Yahoo Kids! on all queries, and a modest percentage of results had the same relevance ranking as Google. Yahoo Kids! and Ask Kids returned unique results that were not retrieved by the other three engines on the first results page. Yahoo! and Bing produced the highest percentage in overlap with Google followed by Ask Kids. Implications are made for children and mediators concerning the use of search engines on children’s queries.


Children queries query construction web search engines evaluation information retrieval relevance ranking ranking comparison overlap unique results Google Yahoo! Bing Yahoo Kids! Ask Kids 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Nielsen, J.: Children’s Websites: Usability issues in designing for kids, http://www.useit.com/alertbox/childen.html
  2. 2.
    Olsen, S.: Google seeks to help children search better, http://www.nytimes.com/2009/12/26/technology/internet/26kidsearch.html
  3. 3.
    Thelwall, M.: Quantitative comparisons of search engine results. J. Am. Soc. Inform. Sci. 59, 1702–1710 (2008)CrossRefGoogle Scholar
  4. 4.
    Lewandowski, D.: The retrieval effectiveness of Web search engines: Considering results descriptions. J. Doc. 64, 915–937 (2008)CrossRefGoogle Scholar
  5. 5.
    Spink, A., Jansen, B.J., Blakely, C., Koshman, S.: A study of overlap and uniqueness among major Web search engines. Inform. Process. Manag. 42, 1379–1391 (2006)CrossRefGoogle Scholar
  6. 6.
    Bilal, D.: Web search engines for children: A comparative study and performance evaluation of Yahooligans!, Ask Jeeves Kids, and Super Snooper. In: Kids, J., Snooper, S. (eds.) 62nd Am. Soc. Inform. Sci. Meeting, pp. 70–82. Information Today, Inc., Medford (1999)Google Scholar
  7. 7.
    Large, A., Beheshti, J., Rahman, T.: Design criteria for children’s Web portals: The users speak out. J. Am. Soc. Inform. Sci. Tech. 53, 79–94 (2002)CrossRefGoogle Scholar
  8. 8.
    Bilal, D.: Children’s use of the Yahooligans! Web search engine. I. Cognitive, physical, and affective behaviors on fact-based tasks. J. Am. Soc. Inform. Sci. 51, 646–665 (2000)CrossRefGoogle Scholar
  9. 9.
    Bilal, D.: Children’s use of the Yahooligans! Web search engine. III. Cognitive and physical behaviors on fully self-generated tasks. J. Am. Soc. Inform. Sci. Tech. 53, 1170–1183 (2002)CrossRefGoogle Scholar
  10. 10.
    Bilal, D.: Children’s use of the Yahooligans! Web search engine. II. Cognitive and physical behaviors on research tasks. J. Am. Soc. for Inform. Sci. Tech. 52, 118–137 (2001)CrossRefGoogle Scholar
  11. 11.
    Druin, A., et al.: How children search the internet with keyword interfaces. In: 8th International Conference on Interaction Design and Children, Como, Italy, pp. 89–96 (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Dania Bilal
    • 1
  • Rebekah Ellis
    • 1
  1. 1.School of Information SciencesUniversity of TennesseeKnoxvilleUSA

Personalised recommendations