Abstract
Critiquing-based recommender systems elicit users’ feedback, called critiques, which they made on the recommended items. This conversational style of interaction is in contract to the standard model where users receive recommendations in a single interaction. Through the use of the critiquing feedback, the recommender systems are able to more accurately learn the users’ profiles, and therefore suggest better recommendations in the subsequent rounds. Critiquing-based recommenders have been widely studied in knowledge-, content-, and preference-based recommenders and are beginning to be tried in several online websites, such as MovieLens. This article examines the motivation and development of the subject area, and offers a detailed survey of the state of the art concerning the design of critiquing interfaces and development of algorithms for critiquing generation. With the help of categorization analysis, the survey reveals three principal branches of critiquing based recommender systems, using respectively natural language based, system-suggested, and user-initiated critiques. Representative example systems will be presented and analyzed for each branch, and their respective pros and cons will be discussed. Subsequently, a hybrid framework is developed to unify the advantages of different methods and overcome their respective limitations. Empirical findings from user studies are further presented, indicating how hybrid critiquing supports could effectively enable end-users to achieve more confident decisions. Finally, the article will point out several future trends to boost the advance of critiquing-based recommenders.
Article PDF
Similar content being viewed by others
References
Agrawal R., Imielinski T., Swami A.: Mining association rules between sets of items in large databases. In: Buneman, P., Jajodia, S. (eds) Proceedings of the 1993 ACM SIGMOD International Conference on Management of Data (SIGMOD’93), pp. 207–216. ACM, New York (1993)
Burke, R.: Knowledge-based Recommender Systems. Encyclopedia of Library and Information Systems 69 (2000)
Burke, R., Hammond, K., Cooper, E.: Knowledge-based navigation of complex information spaces. In: Proceedings of the 13th National Conference on Artificial Intelligence (AAAI’96), pp. 462–468 (1996)
Burke R., Hammond K., Young B.: The FindMe approach to assisted browsing. IEEE Expert: Intell. Syst. Their Appl. 12, 32–40 (1997)
Carenini, G., Poole, D.: Constructed preferences and value-focused thinking: implications for AI research on preference elicitation. AAAI-02 Workshop on Preferences in AI and CP: symbolic approaches, Edmonton (2000)
Chen, L.: Adaptive tradeoff explanations in conversational recommenders. In: Proceedings of ACM Conference on Recommender Systems (RecSys’09), ACM, New York, pp. 225–228 (2009)
Chen, L., Pu, P.: Evaluating critiquing-based recommender agents. In: Proceedings of Twenty-first National Conference on Artificial Intelligence (AAAI’06), Boston, pp. 157–162 (2006)
Chen, L., Pu, P.: Hybrid critiquing-based recommender systems. In: Proceedings of International Conference on Intelligent User Interfaces (IUI’07), Hawaii, pp. 22–31 (2007a)
Chen, L., Pu, P.: The evaluation of a hybrid critiquing system with preference-based recommendations organization. In: Proceedings of ACM Conference on Recommender Systems (RecSys’07), Minneapolis, Minnesota, pp. 169–172 (2007b)
Chen, L., Pu, P.: Preference-based organization interfaces: aiding user critiques in recommender systems. In: Proceedings of International Conference on User Modeling (UM’07), Corfu, pp. 77–86 (2007c)
Chen L., Pu P.: Interaction design guidelines on critiquing-based recommender systems. User Model. User-Adapt. Interact. J. (UMUAI) 19(3), 167–206 (2009)
Chen L., Pu P.: Experiments on the preference-based organization interface in recommender systems. ACM Trans. Comput.-Hum. Interact. (TOCHI) 17(1), 1–33 (2010)
Faltings, B., Pu, P., Torrens, M., Viappiani, P.: Designing example-critiquing interaction. In: Proceedings of International Conference on Intelligent User Interfaces (IUI’04), ACM, New York, pp. 22–29 (2004a)
Faltings B., Torrens M., Pu P.: Solution generation with qualitative models of preferences. Int. J. Comput. Intell. Appl. 20, 246–264 (2004b)
Jurca, A.: Consumer-centered interfaces: customizing online travel planning. In: CHI ’00 Extended Abstracts on Human Factors in Computing Systems, ACM, New York, pp. 93–94 (2000)
Keeney R., Raiffa H.: Decisions with multiple objectives: preferences and value tradeoffs. Cambridge University Press, Cambridge (1976)
Konstan, J.A., Riedl, J.: Recommender systems: from algorithms to user experience. User Model. User-Adapt. Interact. J. (UMUAI), 22 (2012)
Linden, G., Hanks, S., Lesh, N.: Interactive assessment of user preference models: the automated travel assistant. In: Proceedings of International Conference on User Modeling (UM’97), pp. 67–78 (1997)
Mahmood, T., Ricci, F.: Improving recommender systems with adaptive conversational strategies. In: Proceedings of the 20th ACM Conference on Hypertext and Hypermedia (HT ’09), ACM, New York, pp. 73–82 (2009)
McCarthy, K., Reilly, J., McGinty, L., Smyth, B.: On the dynamic generation of compound critiques in conversational recommender systems. In: Proceedings of the Third International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems (AH’04), pp. 176–184 (2004a)
McCarthy, K., Reilly, J., McGinty, L., Smyth, B.: Thinking positively: explanatory feedback for conversational recommender systems. In: Proceedings of the Workshop on Explanation in CBR at the Seventh European Conference on Case-Based Reasoning, Madrid, pp. 115–124 (2004b)
McCarthy, K., McGinty, L., Smyth, B., Reilly, J.: A live-user evaluation of incremental dynamic critiquing. In: Proceedings of International Conference on Case-based Reasoning (ICCBR’05), pp. 339–352 (2005a)
McCarthy, K., McGinty, L., Smyth, B., Reilly, J.: On the evaluation of dynamic critiquing: a large-scale user study. In: Proceedings of the Twentieth National Conference on Artificial Intelligence and the Seventeenth Innovative Applications of Artificial Intelligence Conference, Pittsburgh, pp. 535–540 (2005b)
McCarthy, K., Reilly, J., McGinty, L., Smyth, B.: Experiments in dynamic critiquing. In: Proceedings of International Conference on Intelligent User Interfaces (IUI’05), San Diego, pp. 175–182 (2005c)
Payne J.W., Bettman J.R., Johnson E.J.: The adaptive decision maker. Cambridge University Press, Cambridge (1993)
Payne J.W., Bettman J.R., Schkade D.A.: Measuring constructed preference: towards a building code. J. Risk Uncertain. 19(1–3), 243–270 (1999)
Pu, P., Chen, L.: Integrating tradeoff support in product search tools for e-commerce sites. In: Proceeding of the ACM Conference on Electronic Commerce (EC’05), Vancouver, pp. 269–278 (2005)
Pu, P., Chen, L.: Trust building with explanation interfaces. In: Proceedings of International Conference on Intelligent User Interfaces (IUI’06), Sydney, pp. 93–100 (2006)
Pu P., Chen L., Kumar P.: Evaluating product search and recommender systems for e-commerce environments. Elec. Commer. Res. J. 8(1–2), 1–27 (2008)
Pu, P., Faltings, B.: Enriching buyers’ experiences: the SmartClient approach. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’00), ACM, New York, pp. 289–296 (2000)
Pu, P., Faltings, B.: Personalized navigation of heterogeneous product spaces using SmartClient. In: Proceedings of the International Conference on Intelligent User Interfaces (IUI’02), pp. 212–213 (2002)
Pu P., Faltings B.: Decision tradeoff using example critiquing and constraint programming. Special Issue on User-Interaction in Constraint Satisfaction, CONSTRAINT 9(4), 289–310 (2004)
Pu, P., Faltings, B., Chen, L., Zhang, J., Viappiani, P.: Usability guidelines for product recommenders based on example critiquing research.In: Recommender systems handbook, ISBN: 978-0-387-85819-7, pp. 511–546 (2011)
Pu, P., Kumar, P.: Evaluating example-based search tools. In: Proceeding of the ACM Conference on Electronic Commerce (EC’04), New York, pp. 208–217 (2004)
Pu, P., Zhou, M., Castagnos, S.: Critiquing recommenders for public taste products. In: Proceedings of the 3rd ACM Conference on Recommender Systems (RecSys’09), New York, pp. 249–252 (2009)
Reilly, J., McCarthy, K., McGinty, L., Smyth, B.: Dynamic critiquing. In: Proceedings of European Conference on Case-based Reasoning (ECCBR’04), Madrid, pp. 763–777 (2004)
Reilly, J., McCarthy, K., McGinty, L., Smyth, B.: Explaining compound critiques. Artif. intell. Rev. 24(2) (2005a)
Reilly J., McCarthy K., McGinty L., Smyth B.: Incremental critiquing. J. Knowl.-Based Syst. 18(4–5), 143–151 (2005)
Reilly, J., Zhang, J., McGinty, L., Pu, P., Smyth, B.: Evaluating compound critiquing recommenders: a real-user study. In: Proceedings of ACM Conference on Electronic Commerce (EC’07), San Diego, pp. 114–123 (2007)
Shearin, S., Lieberman, H.: Intelligent profiling by example. In: Proceedings of Conference on Intelligent User Interfaces (IUI’01), Santa Fe, pp. 145–151 (2001)
Shimazu, H.: ExpertClerk: navigating shoppers’ buying process with the combination of asking and proposing. In: Proceedings of the 17th International Joint Conference on Artificial Intelligence (IJCAI’01), Seattle (2001)
Smyth, B., McGinty, L.: An analysis of feedback strategies in conversational recommenders. In: the Fourteenth Irish Artificial Intelligence and Cognitive Science Conference, Dublin (2003)
Thompson C.A., Goker M.H., Langley P.: A personalized system for conversational recommendations. J. Artif. Intell. Res. 21, 393–428 (2004)
Torrens M., Faltings B., Pu P.: SmartClients: constraint satisfaction as a paradigm for scaleable intelligent information systems. Int J Constraints 7(1), 49–69 (2002)
Torrens, M., Weigel, R., Faltings, B.: Java constraint library: bringing constraints technology on the Internet using the Java language. In: Workshop of National Conference on Artificial Intelligence (AAAI), pp. 10–15 (1997)
Tversky A., Simonson I.: Context-dependent preferences. Manag. Sci. 39(10), 1179–1189 (1993)
Viappiani, P., Faltings, B., Pu, P.: Evaluating preference-based search tools: a tale of two approaches. In: Proceedings of the Twenty-first National Conference on Artificial Intelligence (AAAI’06), Boston, pp. 205–211 (2006)
Viappiani, P., Faltings, B., Pu, P.: Preference-based search using example-critiquing with suggestions. J. Artif. Intell. Res. 27, pp. 465–503 (2007a)
Viappiani, P., Pu, P., Faltings, B.: Conversational recommenders with adaptive suggestions. In: Proceedings of the 2007 ACM Conference on Recommender Systems (RecSys ’07), Minneapolis, pp. 89–96 (2007b)
Vig, J., Sen, S., Riedl, J.: Navigating the tag genome. In: Proceedings of the 16th International Conference on Intelligent User Interfaces (IUI’11), Palo Alto, pp. 93–102 (2011)
Zhang, J., Pu, P.: A comparative study of compound critique generation in conversational recommender systems. In: Proceedings of International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems (AH’06), Dublin, pp. 234–243 (2006)
Zhang, J., Jones, N., Pu, P.: A visual interface for critiquing-based recommender systems. In: Proceedings of ACM Conference on Electronic Commerce (EC’08), Chicago, pp. 230–239 (2008)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chen, L., Pu, P. Critiquing-based recommenders: survey and emerging trends. User Model User-Adap Inter 22, 125–150 (2012). https://doi.org/10.1007/s11257-011-9108-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11257-011-9108-6