Task Effects on Interactive Search: The Query Factor

  • Elaine G. Toms
  • Heather O’Brien
  • Tayze Mackenzie
  • Chris Jordan
  • Luanne Freund
  • Sandra Toze
  • Emilie Dawe
  • Alexandra MacNutt
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4862)

Abstract

The purpose of this research is to examine how search differs according to selected task variables. Three types of task information goals and two types of task structures were explored. This mixed within- and between-subjects designed study had 96 participants complete three of 12 tasks in a laboratory setting using a specialized search system based on Lucene. Using a combination metrics (user perception collected by questionnaires, transaction log data, and characteristics of relevant documents), we assessed the effect of goals and structure on search as demonstrated through queries and their use in interactive searching.

Keywords

Information search task query analysis Wikipedia 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Belkin, N.J., et al.: Query length in interactive information retrieval. In: Proceedings of ACM SIGIR, Toronto, CA, pp. 205–212 (2003)Google Scholar
  2. 2.
    Bell, D.J., Ruthven, I.: Searcher’s Assessments of Task Complexity for Web Searching. In: McDonald, S., Tait, J.I. (eds.) ECIR 2004. LNCS, vol. 2997, pp. 57–71. Springer, Heidelberg (2004)Google Scholar
  3. 3.
    Borlund, P.: The IIR evaluation model: a framework for evaluation of interactive information retrieval systems. Inf. Res. 8(3) (2003) http://informationr.net/ir/8-3/paper152.html
  4. 4.
    Broder, A.: A taxonomy of web search. SIGIR Forum. 36(2) (2002)Google Scholar
  5. 5.
    Bruza, P., McArthur, R., Dennis, S.: Interactive Internet search: Keyword, directory and query reformulation mechanisms compared. In: ACM SIGIR, Athens, Greece, pp. 280–287 (2000)Google Scholar
  6. 6.
    Bystrom, K., Jarvelin, K.: Task complexity affects information seeking and use. Information Processing and Management 31(2), 191–213 (1995)CrossRefGoogle Scholar
  7. 7.
    Bystrom, K., Hansen, P.: Conceptual framework for tasks in information studies. Journal of the American Society for Information Science and Technology 56(10), 1050–1061 (2005)CrossRefGoogle Scholar
  8. 8.
    Campbell, D.J.: Task complexity: A review and analysis. The Academy of Management Review 13(1), 40–52 (1988)CrossRefGoogle Scholar
  9. 9.
    Efthimiadis, E.N.: Query expansion. Annual Review of Information Science and Technology 31, 121–187 (1996)Google Scholar
  10. 10.
    Freund, L., Toms, E.G., Waterhouse, J.: Modeling the information behaviour of software engineers using a work task framework. In: Proceedings of the ASIST Annual Meeting, Charlotte, NC, November 1-3, vol. 42 (2005)Google Scholar
  11. 11.
    Gill, T.G., Hicks, R.C.: Task Complexity and Informing Science: A Synthesis. Informing Science 9 (2006)Google Scholar
  12. 12.
    Gwizdka, J., Spence, I.: What can searching Behavior tell us about the difficulty of information tasks? A study of Web navigation. In: Proceedings of the Annual Meeting of ASIS&T 43, Austin, TX, USA (2006)Google Scholar
  13. 13.
    Jansen, B.J., Booth, D.L., Spink, A.: Determining the informational, navigational, and transactional intent of Web queries. Information Processing & Management. Corrected Proof  1618 (in Press)Google Scholar
  14. 14.
    Jansen, B.J., Spink, A., Bateman, J., Saracevic, T.: Real life information retrieval: Study of user queries on the Web. SIGIR Forum. 32(1), 5–17 (1998)CrossRefGoogle Scholar
  15. 15.
    Jarvelin, K., Ingwersen, P.: Information seeking research needs extension towards tasks and technology. Information Research 10(1) (2004), http://informationr.net/ir/10-11/paper212.html
  16. 16.
    Kang, I.-H., Kim, G.C.: Integration of multiple evidences based on a query type for web search. Information Processing & Management 40(3), 459–478 (2004)MATHCrossRefMathSciNetGoogle Scholar
  17. 17.
    Kellar, M., Watters, C., Sheppard, M.: A field study characterizing Web-based information-seeking tasks. Journal of the American Society for Information Science and Technology 58, 999–1018 (2007)CrossRefGoogle Scholar
  18. 18.
    Kelly, D., Fu, X.: Eliciting better information need descriptions from users of information search systems. Information Processing & Management 43(1), 30–46 (2007)CrossRefGoogle Scholar
  19. 19.
    Lau, E.P., Goh, D.H.-L.: In search of query patterns: A case study of a university OPAC. Information Processing & Management 42(5), 1316–1329 (2006)CrossRefGoogle Scholar
  20. 20.
    Li, Y.: Task Type and a Faceted Classification of Tasks. In: Proceedings of the Annual Meeting of ASIS&T, Providence, Rhode Island [poster] (2004)Google Scholar
  21. 21.
    Lorigo, L., Pan, B., Hembrooke, H., Joachims, T., Granka, L., Gay, G.: The influence of task and gender on search and evaluation behavior using Google. Information Processing & Management 42(4), 1123–1131 (2006)CrossRefGoogle Scholar
  22. 22.
    Rieh, S.Y., Xie, H.: Analysis of multiple query reformulations on the web: The interactive information retrieval context. Information Processing & Management 42(3), 751–768 (2006)CrossRefGoogle Scholar
  23. 23.
    Silverstein, C., Henzinger, M., Marais, H., Moricz, M.: Analysis of a very large Alta Vista query log (Technical Report 1998-014). Palo Alto, CA COMPAQ System Research Center (1998)Google Scholar
  24. 24.
    Spink, A., Gunar, O.: E-commerce Web queries: Excite and Ask Jeeves study. First Monday 6(7) (2001)Google Scholar
  25. 25.
    Toms, E.G., Freund, L.: Priming the query specification process. Proceedings of ASIS&T 40(1), 381–388 (2003)Google Scholar
  26. 26.
    Toms, E.G., Freund, L., Cara Li, C.: WiIRE: the Web interactive information retrieval experimentation system prototype. Information Processing & Management 40(4), 655–675 (2004)MATHCrossRefGoogle Scholar
  27. 27.
    Wacholder, N., Liu, L.: Assessing term effectiveness in the interactive information access process. Information Processing & Management (in Press) 1618Google Scholar
  28. 28.
    White, R.W., Drucker, S.M.: Investigating behavioral variability in web search. In: WWW 2007, Banff, Alberta, May 8-12, pp. 21–30 (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Elaine G. Toms
    • 1
  • Heather O’Brien
    • 1
  • Tayze Mackenzie
    • 1
  • Chris Jordan
    • 1
  • Luanne Freund
    • 2
  • Sandra Toze
    • 1
  • Emilie Dawe
    • 1
  • Alexandra MacNutt
    • 1
  1. 1.Centre for Management Informatics, Faculty of ManagementDalhousie UniversityHalifaxCanada
  2. 2.SLAISUniversity of British ColumbiaVancouverCanada

Personalised recommendations