Abstract
Our research aims at understanding children’s information search and their use of information search tools during educational pursuits. We conducted an observation study with 50 New Zealand school children between the ages of 9 and 13 years old. In particular, we studied the way that children constructed search queries and interacted with the Google search engine when undertaking a range of educationally appropriate inquiry tasks. As a result of this in situ study, we identified typical query-creation and query-reformulation strategies that children use. The children worked through 250 tasks, and created a total of 550 search queries. 64.4% of the successful queries made were natural language queries compared to only 35.6% keyword queries. Only three children used the related searches feature of the search engine, while 46 children used query suggestions. We gained insights into the information search strategies children use during their educational pursuits. We observed a range of issues that children encountered when interacting with a search engine to create searches as well as to triage and explore information in the search engine results page lists. We found that search tasks posed as questions were more likely to result in query constructions based on natural language questions, while tasks posed as instructions were more likely to result in query constructions using natural language sentences or keywords. Our findings have implications for both educators and search engine designers.
Similar content being viewed by others
Notes
ELAN is a qualitative video and audio annotation software developed by The Language Archive, (https://archive.mpi.nl/tla/elan).
The term data columns refers to those table columns that contain measured values; header columns and rows are omitted from enumeration.
References
Shaffer, D.R., Kipp, K.: Developmental Psychology: Childhood and Adolescence. Cengage Learning, USA (2013)
Timpany, C., Vanderschantz, N.: Learning outcome dependency on contemporary ict in the new zealand middle school classroom. In: Proceedings of the 12th Annual Conference of the New Zealand Chapter of the ACM Special Interest Group on Computer-Human Interaction, pp. 65–72 (2011). https://doi.org/10.1145/2000756.2000765
van der Sluis, F., van Dijk, E.M.A.G.: A closer look at children’s information retrieval usage: Towards child-centered relevance. In: Proceedings of the Workshop on Accessible Search Systems, at ACM SIGIR 2010, pp. 3–10 (2010)
Bilal, D., Gwizdka, J.: Children’s query types and reformulations in google search. Inform. Process. Manag. 54(6), 1022–1041 (2018). https://doi.org/10.1016/j.ipm.2018.06.008
Vanderschantz, N., Hinze, A.: A study of Children’s search query formulation habits. In: Proceedings of the 31st British Computer Society Human Computer Interaction Conference, p. 7. https://doi.org/10.14236/ewic/HCI2017.7. BCS Learning & Development Ltd. (2017)
Vanderschantz, N., Hinze, A.: Children’s internet search behaviour in an educational context. In: Proceeding of IR for Children 2000-2020: Where Are We Now?–Workshop Co-located with the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM (2021)
Vanderschantz, N., Hinze, A., Cunningham, S.J.: Sometimes the internet reads the question wrong: children’s search strategies & difficulties. Am. Soc. Inform. Sci. Technol. 51(1), 1–10 (2014). https://doi.org/10.1002/meet.2014.14505101053
Vakkari, P., Pennanen, M., Serola, S.: Changes of search terms and tactics while writing a research proposal: a longitudinal case study. Inform. Process. Manag. 39(3), 445–463 (2003). https://doi.org/10.1016/S0306-4573(02)00031-6
Gross, M., Latham, D.: Attaining information literacy: an investigation of the relationship between skill level, self-estimates of skill, and library anxiety. Lib. Inform. Sci. Res. 29(3), 332–353 (2007). https://doi.org/10.1016/j.lisr.2007.04.012
Kuhlthau, C.C.: Seeking Meaning: A Process Approach to Library and Information Services. Libraries Unlimited Incorporated, USA (2004)
Ghosh, S., Rath, M., Shah, C.: Searching as learning: Exploring search behavior and learning outcomes in learning-related tasks. In: Proceedings of the 2018 Conference on Human Information Interaction&Retrieval, pp. 22–31 (2018). https://doi.org/10.1145/3176349.3176386. ACM
Wang, L., Bruce, C., Hughes, H.: Sociocultural theories and their application in information literacy research and education. Aust. Acad. Res. Libr. 42(4), 296–308 (2011). https://doi.org/10.1080/00048623.2011.10722242
Rieh, S.Y., Collins-Thompson, K., Hansen, P., Lee, H.-J.: Towards searching as a learning process: a review of current perspectives and future directions. J. Inform. Sci. 42(1), 19–34 (2016). https://doi.org/10.1177/0165551515615841
Hughes-Hassell, S., Agosto, D.E.: Modeling the everyday life information needs of urban teenagers, pp. 27–61. Scarecrow Press, USA (2007)
Eickhoff, C., Dekker, P., De Vries, A.P.: Supporting children’s web search in school environments. In: Proceedings of the 4th Information Interaction in Context Symposium, pp. 129–137 (2012). https://doi.org/10.1145/2362724.2362748. ACM
Usta, A., Altingovde, I.S., Vidinli, I.B., Ozcan, R., Ulusoy, Ö.: How k-12 students search for learning?: analysis of an educational search engine log. In: Proceedings of the 37th International ACM SIGIR Conference on Research & Development in Information Retrieval, pp. 1151–1154 (2014). https://doi.org/10.1145/2600428.2609532. ACM
Foss, E., Druin, A.: Children’s internet search: Using roles to understand children’s search behavior. Synthesis Lectures on information concepts, retrieval, and services 6(2), 1–106 (2014). https://doi.org/10.2200/S00591ED1V01Y201408ICR034
Gossen, T., Höbel, J., Nürnberger, A.: Usability and perception of young users and adults on targeted web search engines. In: Proceedings of the 5th Information Interaction in Context Symposium, pp. 18–27 (2014). https://doi.org/10.1145/2637002.2637007. ACM
Bailey, E., Kelly, D.: Developing a measure of search expertise. In: Proceedings of the ACM on Conference on Human Information Interaction and Retrieval. CHIIR ’16, pp. 237–240. ACM, USA (2016). https://doi.org/10.1145/2854946.2854983
Gross, M.: Studying children’s questions: Imposed and self-generated information seeking at school, vol. 3. Scarecrow Press, USA (2006)
Agarwal, N.K.: Exploring context in information behavior: seeker, situation, surroundings, and shared identities. Synthesis lectures on information concepts, retrieval, and services 9(7), 1–163 (2017). https://doi.org/10.2200/S00807ED1V01Y201710ICR061
Molin-Juustila, T., Kinnula, M., Iivari, N., Kuure, L., Halkola, E.: Multiple voices in ICT design with children - a nexus analytical enquiry. Behav. IT 34(11), 1079–1091 (2015). https://doi.org/10.1080/0144929X.2014.1003327
Druin, A., Bederson, B.B., Weeks, A., Farber, A., Grosjean, J., Guha, M.L., Hourcade, J.P., Lee, J., Liao, S., Reuter, K., et al.: The international children’s digital library: description and analysis of first use. Technical Report CS-TR-4433 UMIACS, University of Maryland (2003)
Lingnau, A., Ruthven, I., Landoni, M., Van Der Sluis, F.: Interactive search interfaces for young children-the puppyir approach. In: Proceedings of the 10th international conference on advanced learning technologies (ICALT), pp. 389–390 (2010). https://doi.org/10.1109/ICALT.2010.111. IEEE
Gossen, T., Nitsche, M., Nürnberger, A.: Knowledge journey: a web search interface for young users. In: Proceedings of the symposium on human-computer interaction and information retrieval, pp. 1–10 (2012). https://doi.org/10.1145/2391224.2391225. ACM
Wu, K., Chen, H.-C.: Children use second-and third-dimensional digital library interfaces. Library Hi Tech (2016). https://doi.org/10.1108/LHT-07-2015-0078
Reuter, K., Druin, A.: Bringing together children and books: An initial descriptive study of children’s book searching and selection behavior in a digital library. Proc. Am. Soc. Inform. Sci. Technol. 41(1), 339–348 (2004). https://doi.org/10.1002/meet.1450410140
Jochmann-Mannak, H., Huibers, T., Lentz, L., Sanders, T.: Children searching information on the internet: Performance on children’s interfaces compared to google. In: Proceedings of Workshop on Accessible Search Systems at SIGIR, pp. 27–35 (2010)
Landoni, M., Matteri, D., Murgia, E., Huibers, T., Pera, M.S.: Sonny, cerca! evaluating the impact of using a vocal assistant to search at school. In: Proceedings of the International Conference of the Cross-Language Evaluation Forum for European Languages, pp. 101–113 (2019). https://doi.org/10.1007/978-3-030-28577-7_6. Springer
Bilal, D.: Children’s use of the yahooligans! web search engine: I. cognitive, physical, and affective behaviors on fact-based search tasks. J. Assoc. Inform. Sci. Technol. 51(7), 646–665 (2000). https://doi.org/10.1002/(SICI)1097-4571(2000)51:7<646::AID-ASI7>3.0.CO;2-A
Druin, A., Foss, E., Hatley, L., Golub, E., Guha, M.L., Fails, J., Hutchinson, H.: How children search the internet with keyword interfaces. In: Proceedings of the International Conference on Interaction Design and Children, pp. 89–96 (2009). https://doi.org/10.1145/1551788.1551804. ACM
Druin, A., Foss, E., Hutchinson, H., Golub, E., Hatley, L.: Children’s roles using keyword search interfaces at home. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 413–422 (2010). https://doi.org/10.1145/1753326.1753388. ACM
Duarte-Torres, S., Weber, I.: What and how children search on the web. In: Proceedings of the 20th ACM International Conference on Information and Knowledge Management, pp. 393–402 (2011). https://doi.org/10.1145/2063576.2063638. ACM
Bilal, D., Kirby, J.: Differences and similarities in information seeking: children and adults as web users. Inform. Process. Manag. 38(5), 649–670 (2002). https://doi.org/10.1016/S0306-4573(01)00057-7
Bilal, D.: Children’s search processes in using world wide web search engines: An exploratory study. In: Proceedings of the ASIS Annual Meeting, vol. 35, pp. 45–53 (1998)
Weber, I., Jaimes, A.: Who uses web search for what: and how. In: Proceedings of the Fourth ACM International Conference on Web Search and Data Mining, pp. 15–24 (2011). https://doi.org/10.1145/1935826.1935839. ACM
Duarte-Torres, S., Hiemstra, D., Serdyukov, P.: An analysis of queries intended to search information for children. In: Proceedings of the Symposium Information Interaction in Context, pp. 235–244 (2010). https://doi.org/10.1145/1840784.1840819. ACM
Cole, C., Beheshti, J., Abuhimed, D., Lamoureux, I.: The end game in kuhlthau’s isp model: knowledge construction for grade 8 students researching an inquiry-based history project. J. Assoc. Inform. Sci. Technol. 66(11), 2249–2266 (2015). https://doi.org/10.1002/asi.23300
Large, A., Nesset, V., Beheshti, J.: Children as information seekers: what researchers tell us. New Rev. Child. Lit. Librar. 14(2), 121–140 (2008)
Gross, M., Latham, D.: What’s skill got to do with it?: information literacy skills and self-views of ability among first-year college students. J. Am. Soc. Inform. Sci. Technol. 63(3), 574–583 (2012). https://doi.org/10.1002/asi.21681
Allan, J., Croft, B., Moffat, A., Sanderson, M.: Frontiers, challenges, and opportunities for information retrieval: report from swirl 2012 the second strategic workshop on information retrieval in lorne. ACM SIGIR Forum 46(1), 2–32 (2012). https://doi.org/10.1145/2215676.2215678
Anuyah, O., Milton, A., Green, M., Pera, M.S.: An empirical analysis of search engines‘response to web search queries associated with the classroom setting. Aslib J. Inform. Manag. (2019). https://doi.org/10.1108/AJIM-06-2019-0143
Bilal, D., Gwizdka, J.: Children’s eye-fixations on google search results. In: Proceedings of the 79th ASIS&T Annual Meeting: Creating Knowledge, Enhancing Lives Through Information & Technology, p. 89 (2016). https://doi.org/10.1002/pra2.2016.14505301089. American Society for Information Science
Hautala, J., Kiili, C., Kammerer, Y., Loberg, O., Hokkanen, S., Leppänen, P.H.: Sixth graders‘ evaluation strategies when reading internet search results: an eye-tracking study. Behav. Inform. Technol. 37(8), 761–773 (2018). https://doi.org/10.1080/0144929X.2018.1477992
Hutchins, E.: Cognition in the Wild. MIT press, USA (1995). https://doi.org/10.7551/mitpress/1881.001.0001
Anuyah, O., Fails, J.A., Pera, M.S.: Investigating query formulation assistance for children. In: Proceedings of the 17th ACM Conference on Interaction Design and Children. IDC ’18, pp. 581–586. ACM, Trondheim, Norway (2018). https://doi.org/10.1145/3202185.3210779
Duarte-Torres, S., Hiemstra, D., Weber, I., Serdyukov, P.: Query recommendation for children. In: Proceedings of the 21st ACM International Conference on Information and Knowledge Management, pp. 2010–2014 (2012). https://doi.org/10.1145/2396761.2398562. ACM
Madrazo Azpiazu, I., Dragovic, N., Anuyah, O., Pera, M.S.: Looking for the movie seven or sven from the movie frozen?: A multi-perspective strategy for recommending queries for children. In: Proceedings of the Conference on Human Information Interaction & Retrieval, pp. 92–101 (2018). https://doi.org/10.1145/3176349.3176379. ACM
Usta, A., Altingovde, I.S., Ozcan, R., Ulusoy, Ö.: Re-finding behaviour in educational search. In: Proceedings of the International Conference on Theory and Practice of Digital Libraries, pp. 401–405 (2019). https://doi.org/10.1007/978-3-030-30760-8_43. Springer
Spink, A., Danby, S., Mallan, K., Butler, C.: Exploring young children’s web searching and technoliteracy. J. Document. (2010). https://doi.org/10.1108/00220411011023616
Kammerer, Y., Bohnacker, M.: Children’s web search with google: the effectiveness of natural language queries. In: Proceedings of the 11th International Conference on Interaction Design and Children, pp. 184–187 (2012). https://doi.org/10.1145/2307096.2307121. ACM
Hutchinson, H., Druin, A., Bederson, B.B., Reuter, K., Rose, A., Weeks, A.C.: How do I find blue books about dogs? the errors and frustrations of young digital library users. Proc. HCII 2005, 22–27 (2005)
McKay, D., Hinze, A., Heese, R., Vanderschantz, N., Timpany, C., Cunningham, S.J.: An exploration of ebook selection behavior in academic library collections. In: Proceedings of the International Conference on Theory and Practice of Digital Libraries, pp. 13–24 (2012). https://doi.org/10.1007/978-3-642-33290-6_2. Springer
Vanderschantz, N., Timpany, C., Hinze, A.: Design exploration of ebook interfaces for personal digital libraries on tablet devices. In: Proceedings of the 15th New Zealand Conference on Human-Computer Interaction, pp. 21–30 (2015). https://doi.org/10.1145/2808047.2808054
Ureta, J., Brito, C.I., Dy, J.B., Santos, K.-A., Villaluna, W., Ong, E.: At home with alexa: A tale of two conversational agents. In: Proceedings of the International Conference on Text, Speech, and Dialogue, pp. 495–503 (2020). https://doi.org/10.1007/978-3-030-58323-1_53. Springer
Rieh, S.Y., Xie, H.: Analysis of multiple query reformulations on the web: the interactive information retrieval context. Inform. Process. Manag. 42(3), 751–768 (2006). https://doi.org/10.1016/j.ipm.2005.05.005
White, R.W., Richardson, M., Yih, W.-t.: Questions vs. queries in informational search tasks. In: Proceedings of the 24th International Conference on World Wide Web, pp. 135–136 (2015). https://doi.org/10.1145/2740908.2742769. ACM
Rose, D.E., Levinson, D.: Understanding user goals in web search. In: Proceedings of the 13th International Conference on World Wide Web, pp. 13–19 (2004). https://doi.org/10.1145/988672.988675. ACM
Duarte-Torres, S., Hiemstra, D., Serdyukov, P.: Query log analysis in the context of information retrieval for children. In: Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 847–848 (2010). https://doi.org/10.1145/1835449.1835646. ACM
Yarosh, S., Thompson, S., Watson, K., Chase, A., Senthilkumar, A., Yuan, Y., Brush, A.B.: Children asking questions: speech interface reformulations and personification preferences. In: Proceedings of the 17th ACM Conference on Interaction Design and Children, pp. 300–312 (2018). https://doi.org/10.1145/3202185.3202207
Jansen, B.J., Booth, D.L., Spink, A.: Patterns of query reformulation during web searching. J. Am. Soc. Inform. Sci. Technol. 60(7), 1358–1371 (2009). https://doi.org/10.1002/asi.21071
Huang, J., Efthimiadis, E.N.: Analyzing and evaluating query reformulation strategies in web search logs. In: Proceedings of the 18th ACM Conference on Information and Knowledge Management, pp. 77–86 (2009). https://doi.org/10.1145/1645953.1645966. ACM
Sanchiz, M., Amadieu, F., Paubel, P.-V., Chevalier, A.: User-friendly search interface for older adults: supporting search goal refreshing in working memory to improve information search strategies. Behav. Inform. Technol. (2019). https://doi.org/10.1080/0144929X.2019.1642384
Liu, C., Gwizdka, J., Liu, J., Xu, T., Belkin, N.J.: Analysis and evaluation of query reformulations in different task types. In: Proceedings of the 73rd ASIS&T Annual Meeting on Navigating Streams in an Information Ecosystem-Volume 47, p. 17 (2010). https://doi.org/10.1002/meet.14504701214. American Society for Information Science
Marchionini, G.: Information-seeking strategies of novices using a full-text electronic encyclopedia. J. Am. Soc. Inform. Sci. 40(1), 54–66 (1989). https://doi.org/10.1002/(SICI)1097-4571(198901)40:1h54::AID-ASI6i3.0.CO;2-R
Fails, J.A., Pera, M.S., Anuyah, O., Kennington, C., Wright, K.L., Bigirimana, W.: Query formulation assistance for kids: What is available, when to help & what kids want. In: Proceedings of the 18th ACM International Conference on Interaction Design and Children, pp. 109–120 (2019). https://doi.org/10.1145/3311927.3323131. ACM
Rutter, S., Ford, N., Clough, P.: How do children reformulate their search queries? In: Proceedings of ISIC: the Information Behaviour Conference (2015)
Byström, K., Hansen, P.: Conceptual framework for tasks in information studies. J. Am. Soc. Inform. Sci. Technol. 56(10), 1050–1061 (2005). https://doi.org/10.1002/asi.20197
Borlund, P.: A study of the use of simulated work task situations in interactive information retrieval evaluations: a meta-evaluation. J. Document. 72(3), 394–413 (2016). https://doi.org/10.1108/JD-06-2015-0068
Foss, E., Druin, A., Yip, J., Ford, W., Golub, E., Hutchinson, H.: Adolescent search roles. J. Am. Soc. Inform. Sci. Technol. 64(1), 173–189 (2013). https://doi.org/10.1002/asi.22809
Vanderschantz, N., Hinze, A., Cunningham, S.J.: Current educational technology use for digital information acquisition by young new zealand children. In: Proceedings of the Australasian Computer Science Conference, pp. 125–134 (2014). ACS
Vanderschantz, N., Hinze, A.: Computer what’s your favourite colour? Children’s information seeking strategies in the classroom. Am. Soc. Inform. Sci. Technol. 51(1), 1–10 (2019)
Markopoulos, P., Bekker, M.: On the assessment of usability testing methods for children. Interact. Comput. 15(2), 227–243 (2003). https://doi.org/10.1016/S0953-5438(03)00009-2
Schacter, J., Chung, G.K., Dorr, A.: Children’s internet searching on complex problems: performance and process analyses. J. Assoc. Inform. Sci. Technol. 49(9), 840–849 (1998). https://doi.org/10.1002/(SICI)1097-4571(199807)49:9h840::AID-ASI9i3.0.CO;2-D
Gossen, T., Nitsche, M., Nürnberger, A.: Evolving search user interfaces. In: Proceedings of EuroHCIR, pp. 31–34 (2013)
Vanderschantz, N., Hinze, A.: Designing an internet search interface for children. In: Proceedings of the 32nd BCS Human Computer Interaction Conference (BCS HCI 2018), pp. 1–12 (2018). https://doi.org/10.14236/ewic/HCI2018.30. BCS Learning and Development Ltd
Acknowledgements
We thank the two anonymous reviewers whose comments, suggestions, and recommendations helped to improve the clarity this manuscript. We would further like to thank and acknowledge the participants, teachers, and parents from three New Zealand Schools for their time and support.
Funding
This research did not receive any external grants.
Author information
Authors and Affiliations
Contributions
Vanderschantz contributed to conceptualisation, methodology, formal analysis, investigation, data curation, writing (original draft), writing (review and editing), visualisation; Hinze contributed to conceptualisation, methodology, validation, writing (review and editing), visualisation, supervision
Corresponding author
Ethics declarations
Conflict of interest
The authors have no conflicts of interest to declare.
Ethics approval
Ethical approval for this research was given by the University of Waikato Human Research Ethics Committee in accordance with University policies and principles of human research.
Consent to participate
Signed informed consent was given by the principal of each school and the parents of each child; verbal consent was given by each child at the beginning and end of each session.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Vanderschantz, N., Hinze, A. Children’s query formulation and search result exploration. Int J Digit Libr 22, 385–410 (2021). https://doi.org/10.1007/s00799-021-00316-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00799-021-00316-9