Abstract
In this chapter, we revisit the fundamental formal models of IR and associated simplified assumptions, with the goal of exploring and introducing actionable directions toward which the assumptions can be extended to at least partially cover the triggers and characteristics of bounded rationality. To this end, we first categorize different types of explicit and implicit assumptions into three groups, pre-search, within-search, and post-search, and discuss their conflicts with empirical findings on bounded rationality. Within each group, we discuss possible ways to extend and revise existing rational assumptions, as a key preparation for enhancing formal user models and IR evaluation techniques. When explaining the methods for extending rational assumptions, we also discuss related boundaries and explain the implications for user modeling and evaluation and how these potential boundaries are related to IIR-specific factors.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Agarwal, A., Zaitsev, I., Wang, X., Li, C., Najork, M., & Joachims, T. (2019). Estimating position bias without intrusive interventions. In Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining (pp. 474–482). ACM. https://doi.org/10.1145/3289600.3291017
André, P., Teevan, J., & Dumais, S. T. (2009). From x-rays to silly putty via Uranus: serendipity and its role in web search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 2033–2036). ACM. https://doi.org/10.1145/1518701.1519009
Azzopardi, L. (2011). The economics in interactive information retrieval. In Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 15–24). ACM. https://doi.org/10.1145/2009916.2009923
Azzopardi, L. (2014). Modelling interaction with economic models of search. In Proceedings of the 37th ACM SIGIR Conference on Research & Development in Information Retrieval (pp. 3–12). ACM. https://doi.org/10.1145/2600428.2609574
Azzopardi, L. (2021). Cognitive biases in search: A review and reflection of cognitive biases in information retrieval. In Proceedings of the 2021 ACM SIGIR Conference on Human Information Interaction and Retrieval (pp. 27–37). ACM. https://doi.org/10.1145/3406522.3446023
Caputo, A. (2014). Relevant information, personality traits and anchoring effect. International Journal of Management and Decision Making, 13(1), 62–76.
Chapelle, O., Metlzer, D., Zhang, Y., & Grinspan, P. (2009). Expected reciprocal rank for graded relevance. In Proceedings of the 18th ACM Conference on Information and Knowledge Management (pp. 621–630). ACM. https://doi.org/10.1145/1645953.1646033
Chen, Y., Zhou, K., Liu, Y., Zhang, M., & Ma, S. (2017). Meta-evaluation of online and offline web search evaluation metrics. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 15–24). ACM. https://doi.org/10.1145/3077136.3080804
Cheng, H., & Cantú-Paz, E. (2010). Personalized click prediction in sponsored search. In Proceedings of the Third ACM International Conference on Web Search and Data Mining (pp. 351–360). ACM. https://doi.org/10.1145/1718487.1718531
Collins-Thompson, K., Bennett, P. N., White, R. W., De La Chica, S., & Sontag, D. (2011). Personalizing web search results by reading level. In Proceedings of the 20th ACM International Conference on Information and Knowledge Management (pp. 403–412). ACM. https://doi.org/10.1145/2063576.2063639
Draws, T., Rieger, A., Inel, O., Gadiraju, U., & Tintarev, N. (2021). A checklist to combat cognitive biases in crowdsourcing. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing (Vol. 9, pp. 48–59). https://ojs.aaai.org/index.php/HCOMP/article/view/18939
Fredrickson, B. L., & Kahneman, D. (1993). Duration neglect in retrospective evaluations of affective episodes. Journal of Personality and Social Psychology, 65(1), 45–55. https://doi.org/10.1037/0022-3514.65.1.45
Gäde, M., Koolen, M., Hall, M., Bogers, T., & Petras, V. (2021). A manifesto on resource re-use in interactive information retrieval. In Proceedings of the 2021 International ACM SIGIR Conference on Human Information Interaction and Retrieval (pp. 141–149). ACM. https://doi.org/10.1145/3406522.3446056
Gilboa, I., & Schmeidler, D. (1995). Case-based decision theory. The Quarterly Journal of Economics, 110(3), 605–639. https://doi.org/10.2307/2946694
Gneezy, U., Goette, L., Sprenger, C., & Zimmermann, F. (2017). The limits of expectations-based reference dependence. Journal of the European Economic Association, 15(4), 861–876. https://doi.org/10.1093/jeea/jvw020
Hands, D. S., & Avons, S. E. (2001). Recency and duration neglect in subjective assessment of television picture quality. Applied Cognitive Psychology: The Official Journal of the Society for Applied Research in Memory and Cognition, 15(6), 639–657. https://doi.org/10.1002/acp.731
Hilligoss, B., & Rieh, S. Y. (2008). Developing a unifying framework of credibility assessment: Construct, heuristics, and interaction in context. Information Processing & Management, 44(4), 1467–1484. https://doi.org/10.1016/j.ipm.2007.10.001
Jansen, B. J., Booth, D. L., & Spink, A. (2007). Determining the user intent of web search engine queries. In Proceedings of the 16th International Conference on World Wide Web (pp. 1149–1150). https://doi.org/10.1145/1242572.1242739
Järvelin, K., Price, S. L., Delcambre, L. M., & Nielsen, M. L. (2008). Discounted cumulated gain based evaluation of multiple-query IR sessions. In European Conference on Information Retrieval (pp. 4–15). Springer.
Kahneman, D. (2003). Maps of bounded rationality: Psychology for behavioral economics. American Economic Review, 93(5), 1449–1475. https://doi.org/10.1257/000282803322655392
Kelly, D. (2009). Methods for evaluating interactive information retrieval systems with users. Foundations and Trends in Information Retrieval, 3(1–2), 1–224. https://doi.org/10.1561/1500000012
Kelly, D., & Sugimoto, C. R. (2013). A systematic review of interactive information retrieval evaluation studies, 1967–2006. Journal of the American Society for Information Science and Technology, 64(4), 745–770. https://doi.org/10.1002/asi.22799
Knobloch-Westerwick, S., Johnson, B. K., & Westerwick, A. (2015). Confirmation bias in online searches: Impacts of selective exposure before an election on political attitude strength and shifts. Journal of Computer-Mediated Communication, 20(2), 171–187. https://doi.org/10.1111/jcc4.12105
Koskela, M., Luukkonen, P., Ruotsalo, T., Sjöberg, M., & Floréen, P. (2018). Proactive information retrieval by capturing search intent from primary task context. ACM Transactions on Interactive Intelligent Systems (TiiS), 8(3), 1–25. https://doi.org/10.1145/3150975
Langer, T., Sarin, R., & Weber, M. (2005). The retrospective evaluation of payment sequences: Duration neglect and peak-and-end effects. Journal of Economic Behavior & Organization, 58(1), 157–175. https://doi.org/10.1016/j.jebo.2004.01.001
Lin, J., Liu, W., Dai, X., Zhang, W., Li, S., Tang, R., He, X., Hao, J., & Yu, Y. (2021). A graph-enhanced click model for web search. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 1259–1268). ACM. https://doi.org/10.1145/3404835.3462895
Liu, J. (2021). Deconstructing search tasks in interactive information retrieval: A systematic review of task dimensions and predictors. Information Processing & Management, 58(3), 102522. https://doi.org/10.1016/j.ipm.2021.102522
Liu, J. (2022). Toward Cranfield-inspired reusability assessment in interactive information retrieval evaluation. Information Processing & Management, 59(5), 103007. https://doi.org/10.1016/j.ipm.2022.103007
Liu, C., Belkin, N. J., & Cole, M. J. (2012). Personalization of search results using interaction behaviors in search sessions. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 205–214). ACM. https://doi.org/10.1145/2348283.2348314
Liu, J., Mitsui, M., Belkin, N. J., & Shah, C. (2019). Task, information seeking intentions, and user behavior: Toward a multi-level understanding of Web search. In Proceedings of the 2019 ACM SIGIR Conference on Human Information Interaction and Retrieval (pp. 123–132). ACM. https://doi.org/10.1145/3295750.3298922
Liu, J., Sarkar, S., & Shah, C. (2020). Identifying and predicting the states of complex search tasks. In Proceedings of the 2020 ACM SIGIR Conference on Human Information Interaction and Retrieval (pp. 193–202). ACM. https://doi.org/10.1145/3343413.3377976
Liu, J., & Shah, C. (2019). Interactive IR user study design, evaluation, and reporting. Synthesis Lectures on Information Concepts, Retrieval, and Services, 11(2), i–93. https://doi.org/10.2200/S00923ED1V01Y201905ICR067
Mao, J., Liu, Y., Luan, H., Zhang, M., Ma, S., Luo, H., & Zhang, Y. (2017). Understanding and predicting usefulness judgment in web search. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 1169–1172). ACM. https://doi.org/10.1145/3077136.3080750
Mitsui, M., Liu, J., Belkin, N. J., & Shah, C. (2017). Predicting information seeking intentions from search behaviors. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 1121–1124). ACM. https://doi.org/10.1145/3077136.3080737
Mitsui, M., Liu, J., & Shah, C. (2018). How much is too much? Whole session vs. first query behaviors in task type prediction. In Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval (pp. 1141–1144). ACM. https://doi.org/10.1145/3209978.3210105
Moffat, A., Scholer, F., & Thomas, P. (2012). Models and metrics: IR evaluation as a user process. In Proceedings of the Seventeenth Australasian Document Computing Symposium (pp. 47–54). https://doi.org/10.1145/2407085.2407092
Moffat, A., & Zobel, J. (2008). Rank-biased precision for measurement of retrieval effectiveness. ACM Transactions on Information Systems (TOIS), 27(1), 1–27. https://doi.org/10.1145/1416950.1416952
Montazeralghaem, A., Zamani, H., & Shakery, A. (2018). Theoretical analysis of interdependent constraints in pseudo-relevance feedback. In Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval (pp. 1249–1252). ACM. https://doi.org/10.1145/3209978.3210156
Nickerson, R. S. (1998). Confirmation bias: A ubiquitous phenomenon in many guises. Review of General Psychology, 2(2), 175–220. https://doi.org/10.1037/1089-2680.2.2.175
Oliver, R. L. (1980). A cognitive model of the antecedents and consequences of satisfaction decisions. Journal of Marketing Research, 17(4), 460–469. https://doi.org/10.1177/002224378001700405
Radlinski, F., Bennett, P. N., Carterette, B., & Joachims, T. (2009). Redundancy, diversity and interdependent document relevance. In ACM SIGIR Forum (Vol. 43, No. 2, pp. 46–52). ACM. https://doi.org/10.1145/1670564.1670572
Rahman, A., & Wilson, M. L. (2015). Exploring opportunities to facilitate serendipity in search. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 939–942). ACM. https://doi.org/10.1145/2766462.2767783
Redelmeier, D. A., Katz, J., & Kahneman, D. (2003). Memories of colonoscopy: A randomized trial. Pain, 104(1–2), 187–194. https://doi.org/10.1016/S0304-3959(03)00003-4
Rieger, A., Draws, T., Theune, M., & Tintarev, N. (2021). This item might reinforce your opinion: Obfuscation and labeling of search results to mitigate confirmation bias. In Proceedings of the 32nd ACM Conference on Hypertext and Social Media (pp. 189–199). ACM. https://doi.org/10.1145/3465336.3475101
Schneider, S., Stone, A. A., Schwartz, J. E., & Broderick, J. E. (2011). Peak and end effects in patients’ daily recall of pain and fatigue: A within-subjects analysis. The Journal of Pain, 12(2), 228–235. https://doi.org/10.1016/j.jpain.2010.07.001
Scholer, F., Kelly, D., Wu, W. C., Lee, H. S., & Webber, W. (2013). The effect of threshold priming and need for cognition on relevance calibration and assessment. In Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 623–632). ACM. https://doi.org/10.1145/2484028.2484090
Schwartz, B., Ward, A., Monterosso, J., Lyubomirsky, S., White, K., & Lehman, D. R. (2002). Maximizing versus satisficing: Happiness is a matter of choice. Journal of Personality and Social Psychology, 83(5), 1178. https://doi.org/10.1037/0022-3514.83.5.1178
Shah, C. (2018). Information fostering-being proactive with information seeking and retrieval: Perspective paper. In Proceedings of the 2018 International ACM SIGIR Conference on Human Information Interaction & Retrieval (pp. 62–71). ACM. https://doi.org/10.1145/3176349.3176389
Shen, S., Hu, B., Chen, W., & Yang, Q. (2012). Personalized click model through collaborative filtering. In Proceedings of the Fifth ACM International Conference on Web Search and Data Mining (pp. 323–332). ACM. https://doi.org/10.1145/2124295.2124336
Simon, H. A. (1955). A behavioral model of rational choice. The Quarterly Journal of Economics, 69(1), 99–118. https://doi.org/10.2307/1884852
Thaler, R. H. (2016). Behavioral economics: Past, present, and future. American Economic Review, 106(7), 1577–1600. https://doi.org/10.1257/aer.106.7.1577
Trautmann, S. T., & van de Kuilen, G. (2012). Prospect theory or construal level theory? Diminishing sensitivity vs. psychological distance in risky decisions. Acta Psychologica, 139(1), 254–260. https://doi.org/10.1016/j.actpsy.2011.08.006
Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases: Biases in judgments reveal some heuristics of thinking under uncertainty. Science, 185(4157), 1124–1131. https://doi.org/10.1126/science.185.4157.1124
Tversky, A., & Kahneman, D. (1985). The framing of decisions and the psychology of choice. In Behavioral Decision Making (pp. 25–41). Springer.
Tversky, A., & Kahneman, D. (1991). Loss aversion in riskless choice: A reference-dependent model. The Quarterly Journal of Economics, 106(4), 1039–1061. https://doi.org/10.2307/2937956
Tversky, A., & Kahneman, D. (1992). Advances in prospect theory: Cumulative representation of uncertainty. Journal of Risk and Uncertainty, 5(4), 297–323. https://doi.org/10.1007/BF00122574
Venkatesh, V., & Goyal, S. (2010). Expectation disconfirmation and technology adoption: Polynomial modeling and response surface analysis. MIS Quarterly, 34(2), 281–303. https://doi.org/10.2307/20721428
Voorhees, E. M. (2001). The philosophy of information retrieval evaluation. In Workshop of the Cross-Language Evaluation Forum for European Languages (pp. 355–370). Springer.
Wakker, P., & Tversky, A. (1993). An axiomatization of cumulative prospect theory. Journal of Risk and Uncertainty, 7(2), 147–175. https://doi.org/10.1007/BF01065812
Wang, X., Golbandi, N., Bendersky, M., Metzler, D., & Najork, M. (2018). Position bias estimation for unbiased learning to rank in personal search. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining (pp. 610–618). ACM. https://doi.org/10.1145/3159652.3159732
Wedell, D. H., & Pettibone, J. C. (1996). Using judgments to understand decoy effects in choice. Organizational Behavior and Human Decision Processes, 67(3), 326–344. https://doi.org/10.1006/obhd.1996.0083
White, R. W., Dumais, S. T., & Teevan, J. (2009). Characterizing the influence of domain expertise on web search behavior. In Proceedings of the second ACM International Conference on Web Search and Data Mining (pp. 132–141). ACM. https://doi.org/10.1145/1498759.1498819
Workman, M. (2018). An empirical study of social media exchanges about a controversial topic: Confirmation bias and participant characteristics. The Journal of Social Media in Society, 7(1), 381–400.
Wu, L., Liu, P., Chen, X., Hu, W., Fan, X., & Chen, Y. (2020). Decoy effect in food appearance, traceability, and price: Case of consumer preference for pork hindquarters. Journal of Behavioral and Experimental Economics, 87, 101553. https://doi.org/10.1016/j.socec.2020.101553
Xing, Q., Liu, Y., Nie, J. Y., Zhang, M., Ma, S., & Zhang, K. (2013). Incorporating user preferences into click models. In Proceedings of the 22nd ACM international Conference on Information & Knowledge Management (pp. 1301–1310). ACM. https://doi.org/10.1145/2505515.2505704
Zhai, C., Cohen, W. W., & Lafferty, J. (2015). Beyond independent relevance: Methods and evaluation metrics for subtopic retrieval. In ACM SIGIR Forum (Vol. 49, No. 1, pp. 2–9). ACM. https://doi.org/10.1145/2795403.2795405
Zhang, Y., Liu, X., & Zhai, C. (2017). Information retrieval evaluation as search simulation: A general formal framework for IR evaluation. In Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval (pp. 193–200). ACM. https://doi.org/10.1145/3121050.3121070
Zhang, Y., & Zhai, C. (2016). A sequential decision formulation of the interface card model for interactive IR. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval (pp. 85–94). ACM. https://doi.org/10.1145/2911451.2911543
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Liu, J. (2023). Back to the Fundamentals: Extend the Rational Assumptions. In: A Behavioral Economics Approach to Interactive Information Retrieval. The Information Retrieval Series, vol 48. Springer, Cham. https://doi.org/10.1007/978-3-031-23229-9_5
Download citation
DOI: https://doi.org/10.1007/978-3-031-23229-9_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-23228-2
Online ISBN: 978-3-031-23229-9
eBook Packages: Computer ScienceComputer Science (R0)