Skip to main content

Aspect-Based Sentiment Detection: Comparing Human Versus Automated Classifications of TripAdvisor Reviews

  • Conference paper
  • First Online:
Information and Communication Technologies in Tourism 2018

Abstract

Review platforms are gaining more and more importance in the tourism industry. From a consumer’s point of view, reviews facilitate information search and influence the decision making process. Service providers are unable to neglect the impact of such websites and are thus forced to track reviews. However, due to the massive load of reviews, this task becomes more and more time consuming. Text mining tools assist in extracting decision-relevant knowledge from user-generated content (UGC). In order to assess the appropriateness of machine-driven approaches, TripAdvisor reviews of restaurants as well as hotels were collected and analysed applying the AYLIEN Text Analysis API on RapidMiner. The conclusions hereof were then compared with results generated by traditional manual content analysis. Findings support the adequacy of fully automated domain specific aspect-based sentiment analysis tools. The authors argue that the suggested methodology facilitates the analysis dramatically and can thus be simply applied on a regular basis with the aim to constantly monitor reviews.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 189.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Agresti, A.: Tutorial on modelling ordered categorical response data. Psychol. Bull. 105(2), 290–301 (1989)

    Article  Google Scholar 

  • Albayrak, T., Caber, M.: Prioritisation of the hotel attributes according to their influence on satisfaction: a comparison of two techniques. Tour. Manag. 46, 43–50 (2015)

    Article  Google Scholar 

  • Alkalbani, A.M., Gadhvi, L., Patel, B., Hussain, F.K., Ghamry, A.M., Hussain, O.K.: Analysing cloud services reviews using opining mining. In: 2017 IEEE 31st International Conference on Advanced Information Networking and Applications (AINA), pp. 1124–1129. IEEE (2017, March)

    Google Scholar 

  • AYLIEN: Aspect-based sentiment analysis now available in AYLIEN Google Sheets Add-on. Retrieved from http://blog.aylien.com/aspect-based-sentiment-analysis-now-available-in/ (2016)

  • Berezina, K., Bilgihan, A., Cobanoglu, C., Okumus, F.: Understanding satisfied and dissatisfied hotel customers: text mining of online hotel reviews. J. Hosp. Mark. Manag. 25(1), 1–24 (2016)

    Google Scholar 

  • Boon, E., Bonera, M., Bigi, A.: Measuring hotel service quality from online consumer reviews: a proposed method. In: Cantoni, L., Xiang, Z.P. (eds.) Information and Communication Technologies in Tourism 2014, pp. 367–379. Springer (2013)

    Google Scholar 

  • Borooah, V.K.: Logit and probit: ordered and multinomial models. Sage University Paper series on Quantitative Applications in the Social Sciences, pp. 1–87. Sage, Thousand Oaks, CA (2002)

    Google Scholar 

  • Briggs, S., Sutherland, J., Drummond, S.: Are hotels serving quality? An exploratory study of service quality in the Scottish hotel sector. Tour. Manag. 28(4), 1006–1019 (2007)

    Article  Google Scholar 

  • Chung, J.Y., Buhalis, D.: Information needs in online social networks. Inf. Technol. Tour. 10(4), 267–281 (2008)

    Article  Google Scholar 

  • Demaris, A.: Logit modelling: practical applications. Sage University Paper series on Quantitative Applications in the Social Sciences, pp. 1–87. Sage, Thousand Oaks, CA (1992)

    Google Scholar 

  • Dirsehan, T.: An application of text mining to capture and analyze eWOM: a pilot study on tourism sector. In: Rathore, S., Panwar, A. (eds.) Capturing, Analyzing, and Managing Word-of-Mouth in the Digital Marketplace, pp. 168–186 (2015)

    Google Scholar 

  • Dolnicar, S., Otter, T.: Which hotel attributes matter? A review of previous and a framework for future research. In: Griffin, T., Harris, R. (eds.) Proceedings of the 9th Annual Conference of the Asia Pacific Tourism Association (APTA), pp. 176–188. University of Technology Sydney (2003)

    Google Scholar 

  • Feldman, R.: Techniques and applications for sentiment analysis. Commun. ACM 56(4), 82–89 (2013)

    Article  Google Scholar 

  • Gretzel, U., Yoo, K.H.: Use and impact of online travel reviews. In: O’Connor P., Höpken, W., Gretzel, U. (eds.) Information and Communication Technologies in Tourism 2008, pp. 35–46. Springer (2008)

    Google Scholar 

  • Heyes, A., Kapur, S.: Angry customers, e-word-of-mouth and incentives for quality provision. J. Econ. Behav. Organ. 84(3), 813–828 (2012)

    Article  Google Scholar 

  • Hu, N., Zhang, J., Pavlou, P.A.: Overcoming the J-shaped distribution of product reviews. Commun. ACM 52(10), 144–147 (2009)

    Article  Google Scholar 

  • Liao, T.F.: Interpreting probability models: logit, probit, and other generalized linear models. Sage University Paper series on Quantitative Applications in the Social Sciences, pp. 1–87. Sage, Thousand Oaks, CA (1994)

    Google Scholar 

  • Litvin, S.W., Goldsmith, R.E., Pan, B.: Electronic word-of-mouth in hospitality and tourism management. Tour. Manag. 29(3), 458–468 (2008)

    Article  Google Scholar 

  • Luca, M., Zervas, G.: Fake it till you make it: reputation, competition, and Yelp review fraud. Manage. Sci. 62(12), 3412–3427 (2016)

    Article  Google Scholar 

  • Markopoulos, G., Mikros, G., Iliadi, A., Liontos, M.: Sentiment analysis of hotel reviews in Greek: a comparison of unigram features. In: Cultural Tourism in a Digital Era, pp. 373–383. Springer (2015)

    Google Scholar 

  • Menner, T., Höpken, W., Fuchs, M., Lexhagen, M.: Topic detection: identifying relevant topics in tourism reviews. In: Inversini A., Schegg R. (eds.) Information and Communication Technologies in Tourism 2016, pp. 411–423. Springer (2016)

    Google Scholar 

  • Miguéns, J., Baggio, R., Costa, C.: Social media and tourism destinations: TripAdvisor case study. Adv. Tour. Res. 26(28), 1–6 (2008)

    Google Scholar 

  • Ngo-Ye, T.L., Sinha, A.P.: The influence of reviewer engagement characteristics on online review helpfulness: a text regression model. Decis. Support Syst. 61, 47–58 (2014)

    Article  Google Scholar 

  • O’Connell, A.A.: Logistic regression models for ordinal response variables. Sage University Paper series on Quantitative Applications in the Social Sciences, pp. 1–107. Sage, Thousand Oaks, CA (2006)

    Google Scholar 

  • O’Connor, P.: User-generated content and travel: a case study on Tripadvisor.com. In: O’Connor, P., Höpken, W., Gretzel, U. (eds.) Information and Communication Technologies in Tourism 2008, pp. 47–58. Springer (2008)

    Google Scholar 

  • Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up? Sentiment classification using machine learning. In: Proceedings of EMNLP, pp. 79–86 (2002)

    Google Scholar 

  • Pontiki, M., Galanis, D., Papageorgiou, H., Manandhar, S., Androutsopoulos, I.: SemEval-2015 Task 12: aspect based sentiment analysis. In: Proceedings of the 9th International Workshop on Semantic Evaluation, pp. 486–495 (2015)

    Google Scholar 

  • Ruder, S., Ghaffari, P., Breslin, J.G.: A hierarchical model of reviews for aspect-based sentiment analysis. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 999–1005 (2016)

    Google Scholar 

  • Saleh, M.R., Martín-Valdivia, M.T., Montejo-Ráez, A., Ureña-López, L.A.: Experiments with SVM to classify opinions in different domains. Expert Syst. Appl. 38(12), 14799–14804 (2011)

    Article  Google Scholar 

  • Schmunk, S., Höpken, W., Fuchs, M., Lexhagen, M.: Sentiment analysis: extracting decision-relevant knowledge from UGC. In: Cantoni, L., Xiang, Z.P. (eds.) Information and Communication Technologies in Tourism 2014, pp. 253–265. Springer (2014)

    Google Scholar 

  • Schuckert, M., Liu, X., Law, R.: Hospitality and tourism online reviews: recent trends and future directions. J. Travel & Tour. Mark. 32(5), 608–621 (2015)

    Article  Google Scholar 

  • Smyth, P.C.B., Wu, G., Greene, D.: Does tripadvisor makes hotels better. Technical Report UCD-CSI-2010-06. Retrieved 7 July 2017, from https://www.researchgate.net/profile/Barry_Smyth/publication/222089362_Does_TripAdvisor_Makes_Hotels_Better/links/0fcfd50f3fa6feed46000000.pdf (2010)

  • Tsytsarau, M., Palpanas, T.: Survey on mining subjective data on the web. Springer, Trento (2011)

    Google Scholar 

  • TripAdvisor: 5 Tips Inspired by Our New Traveler. Survey. Retrieved 3 July 2017, from https://www.tripadvisor.com/TripAdvisorInsights/n2665/5-tips-inspired-our-new-traveler-survey (2015)

  • TripAdvisor: About Us. Retrieved 22 April 2017, from https://tripadvisor.mediaroom.com/US-about-us (2017a)

  • TripAdvisor: TripCollective FAQs. Retrieved 23 April 2017, from https://www.tripadvisor.com/TripCollectiveFAQ (2017b)

  • Vasquez, C.: The Discourse of Online Consumer Reviews. Bloomsbury Publishing (2014)

    Google Scholar 

  • Vermeulen, I.E., Seegers, D.: Tried and tested: the impact of online hotel reviews on consumer consideration. Tour. Manag. 30(1), 123–127 (2009)

    Article  Google Scholar 

  • Xiang, Z., Schwartz, Z., Gerdes, J.H., Uysal, M.: What can big data and text analytics tell us about hotel guest experience and satisfaction? Int. J. Hospitality Manag. 44, 120–130 (2015)

    Google Scholar 

  • Xiang, Z., Du, Q., Ma, Y., Fan, W.: A comparative analysis of major online review platforms: implications for social media analytics in hospitality and tourism. Tour. Manag. 58, 51–65 (2017)

    Article  Google Scholar 

  • Ye, Q., Gu, B., Chen, W., Law, R.: Measuring the value of managerial responses to online reviews-A natural experiment of two online travel agencies. In: ICIS 2008 Proceedings, p. 115 (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Christian Weismayer .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Weismayer, C., Pezenka, I., Gan, C.HK. (2018). Aspect-Based Sentiment Detection: Comparing Human Versus Automated Classifications of TripAdvisor Reviews. In: Stangl, B., Pesonen, J. (eds) Information and Communication Technologies in Tourism 2018. Springer, Cham. https://doi.org/10.1007/978-3-319-72923-7_28

Download citation

Publish with us

Policies and ethics