Critiquing-based recommenders: survey and emerging trends

Original Paper

Abstract

Critiquing-based recommender systems elicit users’ feedback, called critiques, which they made on the recommended items. This conversational style of interaction is in contract to the standard model where users receive recommendations in a single interaction. Through the use of the critiquing feedback, the recommender systems are able to more accurately learn the users’ profiles, and therefore suggest better recommendations in the subsequent rounds. Critiquing-based recommenders have been widely studied in knowledge-, content-, and preference-based recommenders and are beginning to be tried in several online websites, such as MovieLens. This article examines the motivation and development of the subject area, and offers a detailed survey of the state of the art concerning the design of critiquing interfaces and development of algorithms for critiquing generation. With the help of categorization analysis, the survey reveals three principal branches of critiquing based recommender systems, using respectively natural language based, system-suggested, and user-initiated critiques. Representative example systems will be presented and analyzed for each branch, and their respective pros and cons will be discussed. Subsequently, a hybrid framework is developed to unify the advantages of different methods and overcome their respective limitations. Empirical findings from user studies are further presented, indicating how hybrid critiquing supports could effectively enable end-users to achieve more confident decisions. Finally, the article will point out several future trends to boost the advance of critiquing-based recommenders.

Keywords

Critiquing-based recommenders Survey Preference elicitation Example critiquing Dynamic critiquing Hybrid critiquing User evaluations 

References

  1. Agrawal R., Imielinski T., Swami A.: Mining association rules between sets of items in large databases. In: Buneman, P., Jajodia, S. (eds) Proceedings of the 1993 ACM SIGMOD International Conference on Management of Data (SIGMOD’93), pp. 207–216. ACM, New York (1993)CrossRefGoogle Scholar
  2. Burke, R.: Knowledge-based Recommender Systems. Encyclopedia of Library and Information Systems 69 (2000)Google Scholar
  3. Burke, R., Hammond, K., Cooper, E.: Knowledge-based navigation of complex information spaces. In: Proceedings of the 13th National Conference on Artificial Intelligence (AAAI’96), pp. 462–468 (1996)Google Scholar
  4. Burke R., Hammond K., Young B.: The FindMe approach to assisted browsing. IEEE Expert: Intell. Syst. Their Appl. 12, 32–40 (1997)Google Scholar
  5. Carenini, G., Poole, D.: Constructed preferences and value-focused thinking: implications for AI research on preference elicitation. AAAI-02 Workshop on Preferences in AI and CP: symbolic approaches, Edmonton (2000)Google Scholar
  6. Chen, L.: Adaptive tradeoff explanations in conversational recommenders. In: Proceedings of ACM Conference on Recommender Systems (RecSys’09), ACM, New York, pp. 225–228 (2009)Google Scholar
  7. Chen, L., Pu, P.: Evaluating critiquing-based recommender agents. In: Proceedings of Twenty-first National Conference on Artificial Intelligence (AAAI’06), Boston, pp. 157–162 (2006)Google Scholar
  8. Chen, L., Pu, P.: Hybrid critiquing-based recommender systems. In: Proceedings of International Conference on Intelligent User Interfaces (IUI’07), Hawaii, pp. 22–31 (2007a)Google Scholar
  9. Chen, L., Pu, P.: The evaluation of a hybrid critiquing system with preference-based recommendations organization. In: Proceedings of ACM Conference on Recommender Systems (RecSys’07), Minneapolis, Minnesota, pp. 169–172 (2007b)Google Scholar
  10. Chen, L., Pu, P.: Preference-based organization interfaces: aiding user critiques in recommender systems. In: Proceedings of International Conference on User Modeling (UM’07), Corfu, pp. 77–86 (2007c)Google Scholar
  11. Chen L., Pu P.: Interaction design guidelines on critiquing-based recommender systems. User Model. User-Adapt. Interact. J. (UMUAI) 19(3), 167–206 (2009)CrossRefGoogle Scholar
  12. Chen L., Pu P.: Experiments on the preference-based organization interface in recommender systems. ACM Trans. Comput.-Hum. Interact. (TOCHI) 17(1), 1–33 (2010)Google Scholar
  13. Faltings, B., Pu, P., Torrens, M., Viappiani, P.: Designing example-critiquing interaction. In: Proceedings of International Conference on Intelligent User Interfaces (IUI’04), ACM, New York, pp. 22–29 (2004a)Google Scholar
  14. Faltings B., Torrens M., Pu P.: Solution generation with qualitative models of preferences. Int. J. Comput. Intell. Appl. 20, 246–264 (2004b)MathSciNetGoogle Scholar
  15. Jurca, A.: Consumer-centered interfaces: customizing online travel planning. In: CHI ’00 Extended Abstracts on Human Factors in Computing Systems, ACM, New York, pp. 93–94 (2000)Google Scholar
  16. Keeney R., Raiffa H.: Decisions with multiple objectives: preferences and value tradeoffs. Cambridge University Press, Cambridge (1976)Google Scholar
  17. Konstan, J.A., Riedl, J.: Recommender systems: from algorithms to user experience. User Model. User-Adapt. Interact. J. (UMUAI), 22 (2012)Google Scholar
  18. Linden, G., Hanks, S., Lesh, N.: Interactive assessment of user preference models: the automated travel assistant. In: Proceedings of International Conference on User Modeling (UM’97), pp. 67–78 (1997)Google Scholar
  19. Mahmood, T., Ricci, F.: Improving recommender systems with adaptive conversational strategies. In: Proceedings of the 20th ACM Conference on Hypertext and Hypermedia (HT ’09), ACM, New York, pp. 73–82 (2009)Google Scholar
  20. McCarthy, K., Reilly, J., McGinty, L., Smyth, B.: On the dynamic generation of compound critiques in conversational recommender systems. In: Proceedings of the Third International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems (AH’04), pp. 176–184 (2004a)Google Scholar
  21. McCarthy, K., Reilly, J., McGinty, L., Smyth, B.: Thinking positively: explanatory feedback for conversational recommender systems. In: Proceedings of the Workshop on Explanation in CBR at the Seventh European Conference on Case-Based Reasoning, Madrid, pp. 115–124 (2004b)Google Scholar
  22. McCarthy, K., McGinty, L., Smyth, B., Reilly, J.: A live-user evaluation of incremental dynamic critiquing. In: Proceedings of International Conference on Case-based Reasoning (ICCBR’05), pp. 339–352 (2005a)Google Scholar
  23. McCarthy, K., McGinty, L., Smyth, B., Reilly, J.: On the evaluation of dynamic critiquing: a large-scale user study. In: Proceedings of the Twentieth National Conference on Artificial Intelligence and the Seventeenth Innovative Applications of Artificial Intelligence Conference, Pittsburgh, pp. 535–540 (2005b)Google Scholar
  24. McCarthy, K., Reilly, J., McGinty, L., Smyth, B.: Experiments in dynamic critiquing. In: Proceedings of International Conference on Intelligent User Interfaces (IUI’05), San Diego, pp. 175–182 (2005c)Google Scholar
  25. Payne J.W., Bettman J.R., Johnson E.J.: The adaptive decision maker. Cambridge University Press, Cambridge (1993)Google Scholar
  26. Payne J.W., Bettman J.R., Schkade D.A.: Measuring constructed preference: towards a building code. J. Risk Uncertain. 19(1–3), 243–270 (1999)MATHCrossRefGoogle Scholar
  27. Pu, P., Chen, L.: Integrating tradeoff support in product search tools for e-commerce sites. In: Proceeding of the ACM Conference on Electronic Commerce (EC’05), Vancouver, pp. 269–278 (2005)Google Scholar
  28. Pu, P., Chen, L.: Trust building with explanation interfaces. In: Proceedings of International Conference on Intelligent User Interfaces (IUI’06), Sydney, pp. 93–100 (2006)Google Scholar
  29. Pu P., Chen L., Kumar P.: Evaluating product search and recommender systems for e-commerce environments. Elec. Commer. Res. J. 8(1–2), 1–27 (2008)MATHCrossRefGoogle Scholar
  30. Pu, P., Faltings, B.: Enriching buyers’ experiences: the SmartClient approach. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’00), ACM, New York, pp. 289–296 (2000)Google Scholar
  31. Pu, P., Faltings, B.: Personalized navigation of heterogeneous product spaces using SmartClient. In: Proceedings of the International Conference on Intelligent User Interfaces (IUI’02), pp. 212–213 (2002)Google Scholar
  32. Pu P., Faltings B.: Decision tradeoff using example critiquing and constraint programming. Special Issue on User-Interaction in Constraint Satisfaction, CONSTRAINT 9(4), 289–310 (2004)Google Scholar
  33. Pu, P., Faltings, B., Chen, L., Zhang, J., Viappiani, P.: Usability guidelines for product recommenders based on example critiquing research.In: Recommender systems handbook, ISBN: 978-0-387-85819-7, pp. 511–546 (2011)Google Scholar
  34. Pu, P., Kumar, P.: Evaluating example-based search tools. In: Proceeding of the ACM Conference on Electronic Commerce (EC’04), New York, pp. 208–217 (2004)Google Scholar
  35. Pu, P., Zhou, M., Castagnos, S.: Critiquing recommenders for public taste products. In: Proceedings of the 3rd ACM Conference on Recommender Systems (RecSys’09), New York, pp. 249–252 (2009)Google Scholar
  36. Reilly, J., McCarthy, K., McGinty, L., Smyth, B.: Dynamic critiquing. In: Proceedings of European Conference on Case-based Reasoning (ECCBR’04), Madrid, pp. 763–777 (2004)Google Scholar
  37. Reilly, J., McCarthy, K., McGinty, L., Smyth, B.: Explaining compound critiques. Artif. intell. Rev. 24(2) (2005a)Google Scholar
  38. Reilly J., McCarthy K., McGinty L., Smyth B.: Incremental critiquing. J. Knowl.-Based Syst. 18(4–5), 143–151 (2005)CrossRefGoogle Scholar
  39. Reilly, J., Zhang, J., McGinty, L., Pu, P., Smyth, B.: Evaluating compound critiquing recommenders: a real-user study. In: Proceedings of ACM Conference on Electronic Commerce (EC’07), San Diego, pp. 114–123 (2007)Google Scholar
  40. Shearin, S., Lieberman, H.: Intelligent profiling by example. In: Proceedings of Conference on Intelligent User Interfaces (IUI’01), Santa Fe, pp. 145–151 (2001)Google Scholar
  41. Shimazu, H.: ExpertClerk: navigating shoppers’ buying process with the combination of asking and proposing. In: Proceedings of the 17th International Joint Conference on Artificial Intelligence (IJCAI’01), Seattle (2001)Google Scholar
  42. Smyth, B., McGinty, L.: An analysis of feedback strategies in conversational recommenders. In: the Fourteenth Irish Artificial Intelligence and Cognitive Science Conference, Dublin (2003)Google Scholar
  43. Thompson C.A., Goker M.H., Langley P.: A personalized system for conversational recommendations. J. Artif. Intell. Res. 21, 393–428 (2004)Google Scholar
  44. Torrens M., Faltings B., Pu P.: SmartClients: constraint satisfaction as a paradigm for scaleable intelligent information systems. Int J Constraints 7(1), 49–69 (2002)MATHCrossRefGoogle Scholar
  45. Torrens, M., Weigel, R., Faltings, B.: Java constraint library: bringing constraints technology on the Internet using the Java language. In: Workshop of National Conference on Artificial Intelligence (AAAI), pp. 10–15 (1997)Google Scholar
  46. Tversky A., Simonson I.: Context-dependent preferences. Manag. Sci. 39(10), 1179–1189 (1993)MATHCrossRefGoogle Scholar
  47. Viappiani, P., Faltings, B., Pu, P.: Evaluating preference-based search tools: a tale of two approaches. In: Proceedings of the Twenty-first National Conference on Artificial Intelligence (AAAI’06), Boston, pp. 205–211 (2006)Google Scholar
  48. Viappiani, P., Faltings, B., Pu, P.: Preference-based search using example-critiquing with suggestions. J. Artif. Intell. Res. 27, pp. 465–503 (2007a)Google Scholar
  49. Viappiani, P., Pu, P., Faltings, B.: Conversational recommenders with adaptive suggestions. In: Proceedings of the 2007 ACM Conference on Recommender Systems (RecSys ’07), Minneapolis, pp. 89–96 (2007b)Google Scholar
  50. Vig, J., Sen, S., Riedl, J.: Navigating the tag genome. In: Proceedings of the 16th International Conference on Intelligent User Interfaces (IUI’11), Palo Alto, pp. 93–102 (2011)Google Scholar
  51. Zhang, J., Pu, P.: A comparative study of compound critique generation in conversational recommender systems. In: Proceedings of International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems (AH’06), Dublin, pp. 234–243 (2006)Google Scholar
  52. Zhang, J., Jones, N., Pu, P.: A visual interface for critiquing-based recommender systems. In: Proceedings of ACM Conference on Electronic Commerce (EC’08), Chicago, pp. 230–239 (2008)Google Scholar

Copyright information

© Springer Science+Business Media B.V. 2011

Authors and Affiliations

  1. 1.Department of Computer ScienceHong Kong Baptist UniversityHong KongChina
  2. 2.Human Computer Interaction Group, School of Computer and Communication SciencesSwiss Federal Institute of Technology in Lausanne (EPFL)LausanneSwitzerland

Personalised recommendations