Exploring Result Presentation in Conversational IR Using a Wizard-of-Oz Study

  • Souvick GhoshEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11438)


Recent researches in conversational IR have explored problems related to context enhancement, question-answering, and query reformulations. However, very few researches have focused on result presentation over audio channels. The linear and transient nature of speech makes it cognitively challenging for the user to process a large amount of information. Presenting the search results (from SERP) is equally challenging as it is not feasible to read out the list of results. In this paper, we propose a study to evaluate the users’ preference of modalities when using conversational search systems. The study will help us to understand how results should be presented in a conversational search system. As we observe how users search using audio queries, interact with the intermediary, and process the results presented, we aim to develop an insight on how to present results more efficiently in a conversational search setting. We also plan on exploring the effectiveness and consistency of different media in a conversational search setting. Our observations will inform future designs and help to create a better understanding of such systems.


Conversational information retrieval Spoken search Information seeking Result presentation 


  1. 1.
    Arguello, J., Choi, B., Capra, R.: Factors affecting users’ information requests. In: SIGIR 1st International Workshop on Conversational Approaches to Information Retrieval (CAIR 2017), vol. 4 (2017)Google Scholar
  2. 2.
    Begany, G.M., Sa, N., Yuan, X.: Factors affecting user perception of a spoken language vs. textual search interface: a content analysis. Interact. Comput. 28(2), 170–180 (2015)Google Scholar
  3. 3.
    Belkin, N.J., Oddy, R.N., Brooks, H.M.: Ask for information retrieval: part I. Background and theory. J. Doc. 38(2), 61–71 (1982)CrossRefGoogle Scholar
  4. 4.
    Borlund, P.: Experimental components for the evaluation of interactive information retrieval systems. J. Doc. 56(1), 71–90 (2000)CrossRefGoogle Scholar
  5. 5.
    Borlund, P.: Evaluation of interactive information retrieval systems (2002)Google Scholar
  6. 6.
    Guy, I.: Searching by talking: analysis of voice queries on mobile web search. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 35–44. ACM (2016)Google Scholar
  7. 7.
    Lai, J., Yankelovich, N.: Conversational speech interfaces. In: The Human-Computer Interaction Handbook, pp. 698–713. L. Erlbaum Associates Inc. (2002)Google Scholar
  8. 8.
    Tague-Sutcliffe, J.: The pragmatics of information retrieval experimentation, revisited. Inf. Process. Manag. 28(4), 467–490 (1992)CrossRefGoogle Scholar
  9. 9.
    Trippas, J.R., Spina, D., Sanderson, M., Cavedon, L.: Results presentation methods for a spoken conversational search system. In: Proceedings of the First International Workshop on Novel Web Search Interfaces and Systems, pp. 13–15. ACM (2015)Google Scholar
  10. 10.
    Turunen, M., Hakulinen, J., Rajput, N., Nanavati, A.A.: Evaluation of mobile and pervasive speech applications. In: Speech in Mobile and Pervasive Environments, pp. 219–262 (2012)CrossRefGoogle Scholar
  11. 11.
    White, R.W., Jose, J.M., Ruthven, I.: An implicit feedback approach for interactive information retrieval. Inf. Process. Manag. 42(1), 166–190 (2006)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Rutgers UniversityNew BrunswickUSA

Personalised recommendations