Abstract
Various conceptual and descriptive models of conversational search have been proposed in the literature – while useful, they do not provide insights into how interaction between the agent and user would change in response to the costs and benefits of the different interactions. In this paper, we develop two economic models of conversational search based on patterns previously observed during conversational search sessions, which we refer to as: Feedback First where the agent asks clarifying questions then presents results, and Feedback After where the agent presents results, and then asks follow up questions. Our models show that the amount of feedback given/requested depends on its efficiency at improving the initial or subsequent query and the relative cost of providing said feedback. This theoretical framework for conversational search provides a number of insights that can be used to guide and inform the development of conversational search agents. However, empirical work is needed to estimate the parameters in order to make predictions specific to a given conversational search setting.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aliannejadi, M., Azzopardi, L., Zamani, H., Kanoulas, E., Thomas, P., Craswell, N.: Analysing mixed initiatives and search strategies during conversational search. In: CIKM, pp. 16–26. ACM (2021)
Aliannejadi, M., Kiseleva, J., Chuklin, A., Dalton, J., Burtsev, M.S.: Convai3: generating clarifying questions for open-domain dialogue systems (ClariQ). CoRR abs/2009.11352 (2020)
Aliannejadi, M., Zamani, H., Crestani, F., Croft, W.B.: Asking clarifying questions in open-domain information-seeking conversations. In: SIGIR, pp. 475–484. ACM (2019)
Allen, J., Guinn, C.I., Horvtz, E.: Mixed-initiative interaction. IEEE Intell. Syst. Their Appl. 14(5), 14–23 (1999)
Anand, A., Cavedon, L., Joho, H., Sanderson, M., Stein, B.: Conversational search (dagstuhl seminar 19461). Dagstuhl Rep. 9(11), 34–83 (2019)
Azzopardi, L.: The economics in interactive information retrieval. In: SIGIR, pp. 15–24. ACM (2011)
Azzopardi, L.: Modelling interaction with economic models of search. In: SIGIR, pp. 3–12. ACM (2014)
Azzopardi, L., Dubiel, M., Halvey, M., Dalton, J.: Conceptualizing agent-human interactions during the conversational search process. The Second International Workshop on Conversational Approaches to Information Retrieval, CAIR (2018)
Belkin, N.J., Cool, C., Stein, A., Thiel, U.: Cases, scripts, and information-seeking strategies: on the design of interactive information retrieval systems. Expert Syst. Appl. 9(3), 379–395 (1995)
Croft, W.B., Thompson, R.H.: I\({}^{\text{3 }}\)r: a new approach to the design of document retrieval systems. JASIS 38(6), 389–404 (1987)
Culpepper, J.S., Diaz, F., Smucker, M.D.: Research frontiers in information retrieval: report from the third strategic workshop on information retrieval in Lorne (SWIRL 2018). SIGIR Forum 52(1), 34–90 (2018)
Hashemi, H., Zamani, H., Croft, W.B.: Guided transformer: leveraging multiple external sources for representation learning in conversational search. In: SIGIR, pp. 1131–1140. ACM (2020)
Kiesel, J., Bahrami, A., Stein, B., Anand, A., Hagen, M.: Toward voice query clarification. In: SIGIR, pp. 1257–1260 (2018)
Rao, S., Daumé, H.: Learning to ask good questions: ranking clarification questions using neural expected value of perfect information. In: ACL (1), pp. 2736–2745 (2018)
Vakulenko, S., Revoredo, K., Di Ciccio, C., de Rijke, M.: QRFA: a data-driven model of information-seeking dialogues. In: Azzopardi, L., Stein, B., Fuhr, N., Mayr, P., Hauff, C., Hiemstra, D. (eds.) ECIR 2019. LNCS, vol. 11437, pp. 541–557. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-15712-8_35
Vtyurina, A., Savenkov, D., Agichtein, E., Clarke, C.L.A.: Exploring conversational search with humans, assistants, and wizards. In: CHI Extended Abstracts, pp. 2187–2193 (2017)
Yan, R., Song, Y., Wu, H.: Learning to respond with deep neural networks for retrieval-based human-computer conversation system. In: SIGIR, pp. 55–64 (2016)
Zamani, H., Dumais, S.T., Craswell, N., Bennett, P.N., Lueck, G.: Generating clarifying questions for information retrieval. In: WWW, pp. 418–428. ACM / IW3C2 (2020)
Acknowledgements
This research was supported by the NWO (No. 016.Vidi 189.039 and No. 314-99-301), and the Horizon 2020 (No. 814961).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Azzopardi, L., Aliannejadi, M., Kanoulas, E. (2022). Towards Building Economic Models of Conversational Search. In: Hagen, M., et al. Advances in Information Retrieval. ECIR 2022. Lecture Notes in Computer Science, vol 13186. Springer, Cham. https://doi.org/10.1007/978-3-030-99739-7_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-99739-7_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-99738-0
Online ISBN: 978-3-030-99739-7
eBook Packages: Computer ScienceComputer Science (R0)