Information Technology & Tourism

, Volume 14, Issue 2, pp 119–149 | Cite as

Leveraging multi-criteria customer feedback for satisfaction analysis and improved recommendations

  • Dietmar Jannach
  • Markus ZankerEmail author
  • Matthias Fuchs
Original Research


Travel websites and online booking platforms represent today’s major sources for customers when gathering information before a trip. In particular, community-provided customer reviews and ratings of various tourism services represent a valuable source of information for trip planning. With respect to customer ratings, many modern travel and tourism platforms—in contrast to several other e-commerce domains—allow customers to rate objects along multiple dimensions and thus to provide more fine-granular post-trip feedback on the booked accommodation or travel package. In this paper, we first show how this multi-criteria rating information can help to obtain a better understanding of factors driving customer satisfaction for different segments. For this purpose, we performed a Penalty-Reward contrast analysis on a data set from a major tourism platform, which reveals that customer segments significantly differ in the way the formation of overall satisfaction can be explained. Beyond the pure identification of segment-specific satisfaction factors, we furthermore show how this fine-granular rating information can be exploited to improve the accuracy of rating-based recommender systems. In particular, we propose to utilize user- and object-specific factor relevance weights which can be learned through linear regression. An empirical evaluation on datasets from different domains finally shows that our method helps us to predict the customer preferences more accurately and thus to develop better online recommendation services.


Online booking platforms Multi-criteria rating feedback Customer satisfaction Recommender systems 


  1. Adomavicius G, Zhang J (2012) Impact of data characteristics on recommender systems performance. ACM Trans Manage Inform Syst 3(1):3:1–3:17Google Scholar
  2. Baltrunas L, Ludwig B, Peer S, Ricci F (2011) Context-aware places of interest recommendations for mobile users. In: Proceedings of International Conference on Human-Computer Interaction (HCII 2011). Orlando, pp 531–540Google Scholar
  3. Brandt RD (1988) How service marketers can identify value enhancing service elements. J Serv Mark 2(3):35–41CrossRefGoogle Scholar
  4. Busacca B, Padula G (2005) Understanding the relationship between attribute performance and overall satisfaction: theory, measurement and implications. Mark Intell Plann 23(6):543–561CrossRefGoogle Scholar
  5. Drucker H, Burges C, Kaufman L, Smola S, Vapnik V (1997) Support vector regression machines. Adv Neural Inform Process Syst 9(9):155–161Google Scholar
  6. Fuchs M, Weiermair K (2003) New perspectives on satisfaction research in tourism destinations. Tourism Rev 58(3):6–14CrossRefGoogle Scholar
  7. Fuchs M, Weiermair K (2004) Destination benchmarking: an indicator-system’s potential for exploring guest satisfaction. J Travel Res 42:212–225CrossRefGoogle Scholar
  8. Gedikli F, Jannach D (2013) Improving recommendation accuracy based on item-specific tag preferences. ACM Trans Intell Syst Technol 4(1):11CrossRefGoogle Scholar
  9. Gediminas A, Kwon YO (2007) New recommendation techniques for multicriteria rating systems. IEEE Intell Syst 22:48–55CrossRefGoogle Scholar
  10. Gediminas A, Nikos M, Kwon YO (2011) Multi-criteria recommender systems. In: Francesco R, Lior R, Bracha S, Paul BK (eds) Recommender systems handbook. Springer, New York, pp 769–803Google Scholar
  11. Gretzel U, Yoo KH (2008) Use and impact of online travel reviews. In: Proceedings of ENTER 2008. Innsbruck, pp 35–46Google Scholar
  12. Guyon I, Gunn S, Nikravesh M, Zadeh LA (2006) Feature extraction: foundations and applications (studies in fuzziness and soft computing). Springer-Verlag, New YorkCrossRefGoogle Scholar
  13. Hair JF, Anderson RE, Bubin BJ, Tatham RL, Black WC (2006) Multivariate data analysis, 6th edn. Prentice-Hall, New YorkGoogle Scholar
  14. Hofmann T (2004) Latent semantic models for collaborative filtering. ACM Trans Inform Syst 22:89–115CrossRefGoogle Scholar
  15. Jannach D, Zanker M, Fuchs M (2009) Constraint-based recommendation in tourism: a multiperspective case study. Int J Inform Technol Tourism 11(2):139–155CrossRefGoogle Scholar
  16. Jannach D, Zanker M, Felfernig A, Gerhard F (2010) Recommender systems: an introduction. Cambridge University Press, CambridgeCrossRefGoogle Scholar
  17. Jannach D, Gedikli F, Karakaya Z, Juwig O (2012) Recommending hotels based on multi-dimensional customer ratings. In: Proceedings ENTER 2012 eTourism Conference. Helsingborg, pp 320–331Google Scholar
  18. Jannach D, Karakaya Z, Gedikli F (2012) Accuracy improvements for multi-criteria recommender systems. In: Proceedings of the 13th ACM Conference on Electronic Commerce (EC 2012), pp 674–689Google Scholar
  19. Jannach D, Kreutler G (2005) Personalized user preference elicitation for e-services. In: Proceedings of the IEEE International Conference one-Technology, e-Commerce and e-Service, EEE ’05, pp 604–611Google Scholar
  20. Jannach D, Lerche L, Gedikli F, Bonnin G (2013) What recommenders recommend: an analysis of accuracy, popularity, and sales diversity effects. In: Proceedings of the 21st International Conference on User Modeling, Adaptation and Personalization (UMAP 2013). RomeGoogle Scholar
  21. Jannach D, Zanker M, Jessenitschnig M, Seidler O (2007) Developing a conversational travel advisor with ADVISOR SUITE. In: Proceedings ENTER 2007 eTourism Conference. Ljubljana, pp 43–52Google Scholar
  22. Johnston R (1995) The determinants of service quality: satisfiers and dis-satisfiers. Int J Serv Indus Manage 6(1):53–71CrossRefGoogle Scholar
  23. Kano N (1984) Attractive quality and must-be quality. Hinshitsu J Jpn Soc Qual Control 14(2):39–48Google Scholar
  24. Kline RB (2005) Principles and practice of structural equation modeling. Guilford Press, LondonGoogle Scholar
  25. Koren Y (2010) Factor in the neighbors: scalable and accurate collaborative filtering. ACM Trans Knowl Discovery Data 4:1–24CrossRefGoogle Scholar
  26. Kutner MH, Nachtsheim CJ, Neter J (2004) Applied linear regression models, 4th edn. McGraw-Hill, IrwinGoogle Scholar
  27. Lemire D, Maclachlan A (2005) Slope one predictors for online rating-based collaborative filtering. In: Proceedings of the 5th SIAM International Conference on Data Mining (SDM’05). Newport Beach, pp 471–480Google Scholar
  28. Liu H, Setiono R (1995) Chi2: feature selection and discretization of numeric attributes. In: Proceedings of the Seventh International Conference on Tools with Artificial Intelligence (ICTAI 1995). Vancouver, Canada, pp 388–391Google Scholar
  29. Liu L, Mehandjiev N, Xu DL (2011) Multi-criteria service recommendation based on user criteria preferences. In: Proceedings of the fifth ACM Conference on Recommender Systems (RecSys 2011). Chicago, pp 77–84Google Scholar
  30. Li Q, Wang C, Geng G (2008) Improving personalized services in mobile commerce by a novel multicriteria rating approach. In: Proceedings of the 17th International Conference on World Wide Web (WWW 2008). Beijing, pp 1235–1236Google Scholar
  31. Mahmood T, Ricci F, Venturini A (2009) Improving recommendation effectiveness: adapting a dialogue strategy in online travel planning. Int J Inform Technol Tourism 11(4):285–302CrossRefGoogle Scholar
  32. Manouselis N, Costopoulou C (2007) Analysis and classification of multi-criteria recommender systems. World Wide Web 10:415–441CrossRefGoogle Scholar
  33. Matzler K, Sauerwein E (2002) The factor structure of customer satisfaction: an empirical test of the importance grid and the penalty-reward-contrast analysis. Int J Serv Ind Manage 13(4):314–332CrossRefGoogle Scholar
  34. Matzler K, Bailom F, Hinterhuber H, Renzl B, Pichler J (2004) The asymmetric relationship between attribute-level performance and overall customer satisfaction: a reconsideration of the importance-performance analysis. Ind Mark Manage 33:271–277CrossRefGoogle Scholar
  35. Mierswa I (2009) Non-convex and multi-objective optimization in data mining. Ph.D thesis, Department of Computer Science, TU DortmundGoogle Scholar
  36. Mikulic J, Prebeac D (2008) Prioritizing improvement of service attributes using impact range-performance analysis and impact-asymmetry analysis. Managing Serv Qual 18(6):559–576CrossRefGoogle Scholar
  37. Müller K-R, Smola AJ, Rätsch G, Schölkopf B, Kohlmorgen J, Vapnik V (1997) Predicting time series with support vector machines. Artificial Neural Networks ICANN’97., vol 1327 of Lecture Notes in Computer Science. Springer, Berlin Heidelberg, pp 999–1004Google Scholar
  38. Nakagawa M, Mobasher B (2003) A hybrid web personalization model based on site connectivity. In: Proceedings of the Workshop on Web Mining and Web Usage Analysis (WebKDD’03). Washington, DC, pp 59–70Google Scholar
  39. Peter K (1985) Quality epiphenomenon: the conceptual understanding of quality in face-to-face service encounters. In: The Service Encounter: Managing Employee Customer Interaction in Service Business. Lexington, pp 17–33Google Scholar
  40. Reisinger Y, Turner L (1999) Structural equation modeling with lisrel: application in tourism. Tourism Manage 20(1):71–88CrossRefGoogle Scholar
  41. Ricci F (2011) Mobile recommender systems. Int J Inform Technol Tourism 12(3):205–231CrossRefGoogle Scholar
  42. Sahoo N, Krishnan R, Duncan G, Callan JP (2012) The Halo Effect in multi-component ratings and its implications for recommender systems: the case of Yahoo! Movies. Inform Syst Res 23(1):231–246CrossRefGoogle Scholar
  43. Sahoo N, Krishnan R, Duncan G, Callan JP (2006) Collaborative filtering with multi-component rating for recommender systems. In: Proceedings of the Sixteenth Annual Workshop on Information Technologies and Systems (WITS’06). MilwaukeeGoogle Scholar
  44. Schölkopf B, Smola AJ (2001) Learning with kernels: support vector machines, regularization, optimization, and beyond. MIT Press, CambridgeGoogle Scholar
  45. Sen S, Vig J, Riedl J (2009) Tagommenders: connecting users to items through tags. In: Proceedings of the 18th International World Wide Web Conference (WWW’09). Madrid, pp 671–680Google Scholar
  46. Si L, Jin R (2003) Flexible mixture model for collaborative filtering. In: Proceedings of the Twentieth International Conference on Machine Learning (ICML 2003). Washington, DC, pp 704–711Google Scholar
  47. Simon F (2006) Try this at home. Last accessed 03:2013
  48. Steenkamp JEM, Baumgartner H (2000) On the use of structural equation models for marketing modeling. Int J Res Mark 17(2/3):195–202CrossRefGoogle Scholar
  49. Weiermair K, Fuchs M (1999) Measuring tourist judgments on service quality. Ann Tourism Res 26(4):1004–1021CrossRefGoogle Scholar
  50. Yoo K-H, Gretzel U, Zanker M (2013) Persuasive recommender systems: conceptual background and implications. Springer, New YorkCrossRefGoogle Scholar
  51. Zanker M, Fuchs M, Höpken W, Tuta M, Müller N (2008) Evaluating recommender systems in tourism: a case study from Austria. In Proceedings ENTER 2008 eTourism Conference. Amsterdam, pp 24–34Google Scholar
  52. Zanker M, Ninaus D (2010) Knowledgable explanations for recommender systems. In: Proceedings of the IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI/IAT). IEEE, pp 657–660Google Scholar
  53. Zhang Y, Zhuang Y, Jiangqin W, Zhang L (2009) Applying probabilistic latent semantic analysis to multi-criteria recommender system. AI Commun 22(2):97–107Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  • Dietmar Jannach
    • 1
  • Markus Zanker
    • 2
    Email author
  • Matthias Fuchs
    • 3
  1. 1.TU DortmundDortmundGermany
  2. 2.Alpen-Adria-Universität KlagenfurtKlagenfurtAustria
  3. 3.Mid Sweden UniversityÖstersundSweden

Personalised recommendations