Abstract
A 2x2 mixed design experiment (N=52) was conducted to examine the effects of search interface and task complexity on participants’ information-seeking performance and affective experience. Keyword vs. natural language search was the within-participants factor; simple vs. complex tasks was the between-participants factor. There were cross-over interactions such that complex-task participants were more successful and thought the tasks were less difficult and reported more enjoyment and confidence when they used keyword search vs. natural language queries, while the opposite was found for simple-task participants. The findings suggest that natural language search is not the panacea for all information retrieval tasks: task complexity is a critical mediator. Implications for interface design and directions for future research are discussed.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Laurel, B.: Interface Agents: Metaphors with Character. In: Laurel, B. (ed.) The Art of Human-Computer Interface Design. Addison-Wesley, Reading (1990)
Doszkocs, T.: Natural Language Processing in Intelligent Information Retrieval. In: Proceedings of the 1985 ACM Annual Conference on The Range of Computing: Mid-80’s Perspective, pp. 356–359. ACM Press, New York (1985)
Guglielmo, E.J., Rowe, N.C.: Natural-Language Retrieval of Images Based on Descriptive Captions. ACM Transactions on Information Systems (TOIS) 14(3), 237–267 (1996)
Jacob, P.S., Rau, L.F.: Natural Language Techniques for Intelligent Information Retrieval. In: Proceedings of the Eleventh International Conference on Research & development in Information Retrieval, pp. 85–99 (1988)
Meng, F.: A Natural Language Interface for Information Retrieval from Forms on the World Wide Web. In: Proceeding of the 20th International Conference on Information Systems, pp. 540–545 (1999)
Turtle, H.: Natural Language vs. Boolean Query Evaluation: A Comparison of Retrieval Performance. In: Proceedings of the Seventeenth Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval, pp. 212–220 (1994)
Chen, H., Dumais, S.: Optimizing Search by Showing Results in Context. In: Proceedings of CHI 2001, pp. 145–152. ACM Press, New York (2001)
Dumais, S.T., Furnas, G.W., Landauer, T.K., Deerwester, S., Harshman, R.: Using Latent Semantic Analysis to Improve Access to Textual Information. In: Proceedings of CHI 1988, pp. 281–285. ACM Press, New York (1988)
Woodruff, A., Faulring, A., Rosenholtz, R., Morrison, J., Pirolli, P.: Using Thumbnails to Search the Web. In: Proceedings of CHI 2001, pp. 198–205. ACM Press, New York (2001)
Borgman, C.L.: The Participant’s Mental Model of an Information Retrieval System: An Experiment on a Prototype Online Catalog. International Journal of Man-Machine Studies 24(1), 47–64 (1986)
Borgman, C.L.: Psychological Research in Human-Computer Interaction. In: Williams, M. (ed.) Annual Review of Information Science and Technology, vol. 19, pp. 33–64. Knowledge Industry Publications, White Plains (1984)
Greene, S.L., Devlin, S.J., Cannata, P.E., Gomez, L.M.: No IFs, ANDs or ORs: a Study of Database Querying. International Journal of Man-Machine Studies 32(3), 303–326 (1990)
Cleverdon, C.W.: The Significance of the Cranfield Tests on Index Languages. In: Bookstein, A., Chiaramella, Y., Salton, G., Raghavan, V.V. (eds.) Proceedings of the 14th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 3–12. ACM Press, New York (1991)
Cooper, W.S.: Getting Beyond Boole. Information Processing & Management 24(3), 243–248 (1988)
Muramatsu, J., Pratt, W.: Transparent Queries: Investigating Participants’ Mental Models of Search Engines. In: SIGIR: Proceedings of the 24th International Conference on Research & Development in Information Retrieval (2001)
Navarro-Prieto, R., Scaife, M., Rogers, Y.: Cognitive Strategies in Web Searching. In: Proceedings of the 5th Conference on Human Factors & the Web (1999)
Conversagent, Inc., http://www.conversagent.com
Clark, H.H.: Using Language. Cambridge University Press, New York (1996)
Brennan, S.: Conversation with and through Computers. Participant Modeling and Participant-Adapted Interaction 1, 67–86 (1991)
Pearson, J., Pickering, M.J., Branigan, H.P., McLean, J.F., Nass, C.I., Hu, J.: The Influence of Beliefs about an Interlocutor on Lexical and Syntactic Alignment: Evidence from Human-Computer Dialogues. In: Proceeding of the 10th Annual Architectures and Mechanisms of Language Processing Conference (2004)
Nass, C.I., Hu, J., Pearson, J., Pickering, M.J., Branigan, H.P.: Linguistic Alignment in HCI vs. CMC: Do Participants Mimic Conversation Partners’ Grammar and Word Choices (2004) (Unpublished manuscript)
Zoltan-Ford, E.: How to Get People to Say and Type What Computers Can Understand. International Journal of Man-Machine Studies 34(4), 527–547 (1991)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 IFIP International Federation for Information Processing
About this paper
Cite this paper
Wang, Q., Nass, C., Hu, J. (2005). Natural Language Query vs. Keyword Search: Effects of Task Complexity on Search Performance, Participant Perceptions, and Preferences. In: Costabile, M.F., Paternò, F. (eds) Human-Computer Interaction - INTERACT 2005. INTERACT 2005. Lecture Notes in Computer Science, vol 3585. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11555261_12
Download citation
DOI: https://doi.org/10.1007/11555261_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28943-2
Online ISBN: 978-3-540-31722-7
eBook Packages: Computer ScienceComputer Science (R0)