Multimedia Systems

, Volume 19, Issue 6, pp 543–558 | Cite as

A recommender system for the TV on the web: integrating unrated reviews and movie ratings

  • Filipa Peleja
  • Pedro Dias
  • Flávio Martins
  • João Magalhães
Regular Paper


The activity of Social-TV viewers has grown considerably in the last few years—viewers are no longer passive elements. The Web has socially empowered the viewers in many new different ways, for example, viewers can now rate TV programs, comment them, and suggest TV shows to friends through Web sites. Some innovations have been exploring these new activities of viewers but we are still far from realizing the full potential of this new setting. For example, social interactions on the Web, such as comments and ratings in online forums, create valuable feedback about the targeted TV entertainment shows. In this paper, we address this last setting: a media recommendation algorithm that suggests recommendations based on users’ ratings and unrated comments. In contrast to similar approaches that are only ratings-based, we propose the inclusion of sentiment knowledge in recommendations. This approach computes new media recommendations by merging media ratings and comments written by users about specific entertainment shows. This contrasts with existing recommendation methods that explore ratings and metadata but do not analyze what users have to say about particular media programs. In this paper, we argue that text comments are excellent indicators of user satisfaction. Sentiment analysis algorithms offer an analysis of the users’ preferences in which the comments may not be associated with an explicit rating. Thus, this analysis will also have an impact on the popularity of a given media show. Thus, the recommendation algorithm—based on matrix factorization by Singular Value Decomposition—will consider both explicit ratings and the output of sentiment analysis algorithms to compute new recommendations. The implemented recommendation framework can be integrated on a Web TV system where users can view and comment entertainment media from a video-on-demand service. The recommendation framework was evaluated on two datasets from IMDb with 53,112 reviews (50 % unrated) and Amazon entertainment media with 698,210 reviews (26 % unrated). Recommendation results with ratings and the inferred preferences—based on the sentiment analysis algorithms—exhibited an improvement over the ratings only based recommendations. This result illustrates the potential of sentiment analysis of user comments in recommendation systems.


Social-TV Recommendation Reviews analysis Sentiment analysis Opinion mining 



The authors are much appreciated to the authors of [19] who have kindly provided us with their IMDb dataset. This work has been funded by the Portuguese Foundation for Science and Technology under project references UTA-Est/MAI/0010/2009 and PEst-OE/EEI/UI0527/2011, Centro de Informática e Tecnologias da Informação (CITI/FCT/UNL)—2011–2012.


  1. 1.
    Aciar, S., et al.: Informed recommender: basing recommendations on consumer product reviews. IEEE Intell. Syst. 22(3), 39–47 (2007)CrossRefGoogle Scholar
  2. 2.
    Adomavicius, G., Tuzhilin, A.: Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans. Knowl. Data Eng. 17(6), 734–749 (2005)CrossRefGoogle Scholar
  3. 3.
    Baccianella, S., et al.: SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Proceedings of the Seventh Conference on International Language Resources and Evaluation (LREC’10) (2010)Google Scholar
  4. 4.
    Baudisch, P.: Recommending TV programs: how far can we get at zero user effort? AAAI Workshop on Recommender Systems (1998)Google Scholar
  5. 5.
    Bespalov, D., et al.: Sentiment classification based on supervised latent n-gram analysis. Building, 375–382 (2011)Google Scholar
  6. 6.
    Bollen, J.: Determining the public mood state by analysis of microblogging posts. Alife XII Conf. MIT Press (2010)Google Scholar
  7. 7.
    Brown, B., Barkhuus, L.: The television will be revolutionized: effects of PVRs and filesharing on television watching. ACM SIGCHI Conference on Human Factors in Computing Systems. ACM (2006)Google Scholar
  8. 8.
    Das, S., Chen, M.: Yahoo! for Amazon: sentiment parsing from small talk on the Web. EFA 2001 Barcelona Meetings (2001)Google Scholar
  9. 9.
    Denecke, K.: Are SentiWordNet scores suited for multi-domain sentiment classification? In: Proceedings of ICDIM’2009, 33–38 (2009)Google Scholar
  10. 10.
    Diakopoulos, N.A., Shamma, D.A.: Characterizing debate performance via aggregated twitter sentiment. In: Proceedings of the 28th International Conference on Human Factors in Computing Systems (2010)Google Scholar
  11. 11.
    Ding, X., et al.: A holistic lexicon-based approach to opinion mining. In: Proceedings of the International Conference on Web Search and Web Data Mining, pp. 231–240 (2008)Google Scholar
  12. 12.
    Esuli, A., Sebastiani, F.: Determining the semantic orientation of terms through gloss classification. In: Proceedings of the 14th ACM International Conference on Information and Knowledge Management CIKM 05, 617 (2005)Google Scholar
  13. 13.
    Esuli, A., Sebastiani, F.: Sentiwordnet: a publicly available lexical resource for opinion mining. In: Proceedings of the 5th Conference on Language Resources and Evaluation (LREC’06). Citeseer (2006)Google Scholar
  14. 14.
    Ferman, A.M., et al.: Multimedia content recommendation engine with automatic inference of user preferences. In: IEEE International Conference on Image Processing (2003)Google Scholar
  15. 15.
    Harboe, G., et al.: Ambient social TV: drawing people into a shared experience. In: ACM SIGCHI Conference on Human Factors in Computing Systems. ACM (2008)Google Scholar
  16. 16.
    Haythornthwaite, C.: The strength and the impact of new media. In: Proceedings of the 34th Annual Hawaii International Conference on System Sciences (HICSS-34)-Volume 1-Volume 1. IEEE Computer Society (2001)Google Scholar
  17. 17.
    Heerschop, B., et al.: Polarity analysis of texts using discourse structure. In: Proceedings of the 20th ACM International Conference on Information and Knowledge Management CIKM 11, 1061 (2011)Google Scholar
  18. 18.
    Hu, M., Liu, B.: Mining and summarizing customer reviews. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM (2004)Google Scholar
  19. 19.
    Jakob, N., et al.: Beyond the stars: exploiting free-text user reviews to improve the accuracy of movie recommendations. In: Proceeding of the 1st International CIKM Workshop on TOPIC-Sentiment Analysis for Mass Opinion (TSA), pp. 57–64 (2009)Google Scholar
  20. 20.
    Jenkins, H.: Convergence Culture—Where Old and New Collide. NYU Press, New York (2006)Google Scholar
  21. 21.
    Jindal, N., Liu, B.: Opinion spam and analysis. In: WSDM’08 Proceedings of the International Conference on Web Search and Web Data Mining, pp. 219–230 (2008)Google Scholar
  22. 22.
    Kim, S.-M., Hovy, E.: Determining the sentiment of opinions. In: Proceedings of the 20th International Conference on Computational Linguistics COLING 04, 1367-es (2004)Google Scholar
  23. 23.
    Koren, Y.: Collaborative filtering with temporal dynamics. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 447–456 (2009)Google Scholar
  24. 24.
    Koren, Y.: Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceeding of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 426–434 (2008)Google Scholar
  25. 25.
    Koren, Y., et al.: Matrix factorization techniques for recommender systems. IEEE Comput. 42(8), 30–37 (2009)MathSciNetCrossRefGoogle Scholar
  26. 26.
    Leung, C.W.K., et al.: Integrating collaborative filtering and sentiment analysis: a rating inference approach. In: Proceedings of the ECAI 2006 Workshop on Recommender Systems, pp. 62–66 (2006)Google Scholar
  27. 27.
    Liu, B.: Sentiment analysis and subjectivity. Handbook of Natural Language Processing. (2010), 978-1420085921Google Scholar
  28. 28.
    Moshfeghi, Y., et al.: Handling data sparsity in collaborative filtering using emotion and semantic based features. In: Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information—SIGIR’11 (New York, NY, USA, Jul. 2011), 625 (2011)Google Scholar
  29. 29.
    Ohana, B., Tierney, B.: Sentiment classification of reviews using SentiWordNet. In: 9th. IT & T Conference (2009)Google Scholar
  30. 30.
    Oliveira, E. et al.: Ifelt: accessing movies through our emotions. In; Proceedings of the 9th International Interactive Conference on Interactive Television—EuroITV’11 (New York, NY, USA, Jun. 2011), 105 (2011)Google Scholar
  31. 31.
    Pang, B., et al.: Thumbs up? Sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing-Volume 10, 79–86 (2002)Google Scholar
  32. 32.
    Pang, B., Lee, L.: A sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts. In: Proceedings of the Association for Computational Linguistics (ACL) (2004)Google Scholar
  33. 33.
    Pang, B., Lee, L.: Seeing stars: exploiting class relationships for sentiment categorization with respect to rating scales. Computer 43(1), 115–124 (2005)Google Scholar
  34. 34.
    Qu, L., et al.: The bag-of-opinions method for review rating prediction from sparse text patterns. In: COLING’10 Proceedings of the 23rd International Conference on Computational Linguistics, pp. 913–921 (2010)Google Scholar
  35. 35.
    Sparling, E.I.: Rating: how difficult is it? Methodology 21(3), 149–156 (2011)Google Scholar
  36. 36.
    Takama, Y., Muto, Y.: Profile generation from TV watching behavior using sentiment analysis. In: Proceedings of the 2007 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology—Workshops. IEEE Computer Society (2007)Google Scholar
  37. 37.
    Takamura, H., et al.: Extracting semantic orientations of words using spin model. In: Proceedings of ACL05 43rd Annual Meeting of the Association for Computational Linguistics, pp. 133–140 (2005)Google Scholar
  38. 38.
    Turney, P.: Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. In: Proceedings of the 40th Annual Meeting on Association for Computational Linguistics (2002)Google Scholar
  39. 39.
    Turney, P.D., Littman, M.L.: Measuring praise and criticism: inference of semantic orientation from association. ACM Trans. Inf. Syst. 21(4), 37 (2003)CrossRefGoogle Scholar
  40. 40.
    Turney, P.D., Littman, M.L.: Unsupervised learning of semantic orientation from a hundred-billion-word corpus. Information Retrieval. ERB-1094, 11 (2002)Google Scholar
  41. 41.
    Uchyigit, G., Clark, K.: Personalised multi-modal electronic program guide. In: European Conference on Interactive Television: from Viewers to Actors? (2003)Google Scholar
  42. 42.
    Vildjiounaite, E., Kyllönen, V.: Unobtrusive dynamic modelling of TV program preferences in a household. Changing Television (2008)Google Scholar
  43. 43.
    Xu, J., Zhang, L.: The development and prospect of personalized TV program recommendation systems. Multimedia Software Engineering (2002)Google Scholar
  44. 44.
    Yi, J., et al.: Sentiment analyzer: extracting sentiments about a given topic using natural language processing techniques. In: IEEE International Conference on Data Mining (ICDM), pp. 427–434 (2003)Google Scholar
  45. 45.
    Yuan, G.X., et al.: Recent advances of large-scale linear classification. Computer 3, 1–15 (2011)Google Scholar
  46. 46.
    Zaletelj, J., et al.: Real-time viewer feedback in the iTV production. European Conference on Interactive Television and Video. ACM (2009)Google Scholar
  47. 47.
    Zhang, W., et al.: Augmenting online video recommendations by fusing review sentiment classification. Data Mining Workshops (ICDMW), 2010 IEEE International Conference on, pp. 1143–1150 (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Filipa Peleja
    • 1
  • Pedro Dias
    • 1
  • Flávio Martins
    • 1
  • João Magalhães
    • 1
  1. 1.Departamento de Informática, Centro de Informática e Tecnologias da Informação, Faculdade de Ciências e TecnologiaUniversidade Nova de LisboaCaparicaPortugal

Personalised recommendations