User Personality and User Satisfaction with Recommender Systems

  • Tien T. Nguyen
  • F. Maxwell Harper
  • Loren Terveen
  • Joseph A. Konstan
Article

Abstract

In this study, we show that individual users’ preferences for the level of diversity, popularity, and serendipity in recommendation lists cannot be inferred from their ratings alone. We demonstrate that we can extract strong signals about individual preferences for recommendation diversity, popularity and serendipity by measuring their personality traits. We conducted an online experiment with over 1,800 users for six months on a live recommendation system. In this experiment, we asked users to evaluate a list of movie recommendations with different levels of diversity, popularity, and serendipity. Then, we assessed users’ personality traits using the Ten-item Personality Inventory (TIPI). We found that ratings-based recommender systems may often fail to deliver preferred levels of diversity, popularity, and serendipity for their users (e.g. users with high-serendipity preferences). We also found that users with different personalities have different preferences for these three recommendation properties. Our work suggests that we can improve user satisfaction when we integrate users’ personality traits into the process of generating recommendations.

Keywords

Human factors Personality Recommender systems Big-five personality traits User preferences Recommendation diversity Recommendation popularity Recommendation serendipity 

References

  1. Adomavicius, G., & Kwon, Y. (2009). Toward more diverse recommendations: Item re-ranking methods for recommender systems. In Workshop on Information Technologies and Systems.Google Scholar
  2. Ali, K., & van Wijnand, S. (2004). TiVo: making show recommendations using a distributed collaborative filtering architecture. In Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 394–401.Google Scholar
  3. Bachrach, Y., Kosinski, M., Graepel, T., Kohli, P., & Stillwell, D. (2012). Personality and patterns of Facebook usage. In Proceedings of the 4th Annual ACM Web Science Conference. ACM, 24–32.Google Scholar
  4. Celma, O., & Cano, P. (2008). From hits to niches?: Or how popular artists can bias music recommendation and discovery. In Proceedings of the 2nd KDD Workshop on Large-Scale Recommender Systems and the Netflix Prize Competition. ACM, 5.Google Scholar
  5. Chang, S., Maxwell Harper, F., & Terveen, L. (2015). Using groups of items for preference elicitation in recommender systems. In Proceedings of the 18th ACM conference on computer supported cooperative work; social computing (CSCW ‘15) (pp. 1258–1269). New York, NY, USA: ACM.Google Scholar
  6. Chausson, O. (2010). Who watches what?: Assessing the impact of gender and personality on film preferences. Paper published online on the MyPersonality project website. http://mypersonality.org/wiki/doku.
  7. Chen, L., Wu, W., & He, L. (2013). How personality influences users’ needs for recommendation diversity? In CHI’13 Extended Abstracts on Human Factors in Computing Systems. ACM, 829–834.Google Scholar
  8. Costa, P. T., & McCrae, R. R. (2008). The revised neo personality inventory (neo-pi-r). The SAGE handbook of personality theory and assessment, 2, 179–198.Google Scholar
  9. Ekstrand, M. D., Maxwell Harper, F., Willemsen, M. C., & Konstan, J. A. (2014). User perception of differences in recommender algorithms. In Proceedings of the 8th ACM Conference on Recommender systems. ACM, 161–168.Google Scholar
  10. Fleder, D. M., & Hosanagar, K. (2007). Recommender systems and their impact on sales diversity. In Proceedings of the 8th ACM conference on Electronic commerce. ACM, 192–199.Google Scholar
  11. Gosling, S. D., Rentfrow, P. J., & Swann Jr., W. B. (2003). A very brief measure of the big-five personality domains. Journal of Research in Personality, 37(6), 504–528.CrossRefGoogle Scholar
  12. Herlocker, J. L., Konstan, J. A., Terveen, L. G., & Riedl, J. T. (2004). Evaluating collaborative filtering recommender systems. ACM Transactions on Information Systems (TOIS), 22(1), 5–53.CrossRefGoogle Scholar
  13. Hu, R., & Pu, P. (2009). Acceptance issues of personality-based recommender systems. In Proceedings of the third ACM conference on Recommender systems. ACM, 221–224.Google Scholar
  14. Hu, R., & Pu, P. (2011). Enhancing collaborative filtering systems with personality information. In Proceedings of the fifth ACM conference on Recommender systems. ACM, 197–204.Google Scholar
  15. John, O. P., & Srivastava, S. (1999). The big five trait taxonomy: History, measurement, and theoretical perspectives. Handbook of personality: Theory and research, 2, 102–138.Google Scholar
  16. Karatzoglou, A., Amatriain, X., Baltrunas, L., & Oliver, N. (2010). Multiverse recommendation: N-dimensional tensor factorization for context-aware collaborative filtering. In proceedings of the fourth ACM conference on recommender systems. ACM, 79–86.Google Scholar
  17. Kemp, A. E. (1996). The musical temperament: Psychology and personality of musicians. Oxford: Oxford University Press.CrossRefGoogle Scholar
  18. Kraaykamp, G., & van Eijck, K. (2005). Personality, media preferences, and cultural participation. Personality and Individual Differences, 38(7), 1675–1688.CrossRefGoogle Scholar
  19. McCrae, R. R., & Costa, P. T. (1987). Validation of the five-factor model of personality across instruments and observers. Journal of Personality and Social Psychology, 52(1), 81.CrossRefGoogle Scholar
  20. McLaughlin, M. R., & Herlocker, J. L. (2004). A collaborative filtering algorithm and evaluation metric that accurately model the user experience. In Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval. ACM, 329–336.Google Scholar
  21. McNee, S. M., Riedl, J., & Konstan, J. A. (2006). Being accurate is not enough: How accuracy metrics have hurt recommender systems. In CHI’06 extended abstracts on Human factors in computing systems. ACM, 1097–1101.Google Scholar
  22. Nguyen, T. T., Hui, P.-M., Maxwell Harper, F., Terveen, L., & Konstan, J. A. (2014). Exploring the filter bubble: The effect of using recommender systems on content diversity. In Proceedings of the 23rd international conference on World Wide Web. ACM, 677–686.Google Scholar
  23. Oh, J., Park, S., Yu, H., Song, M., & Park, S.-T. (2011). Novel recommendation based on personal popularity tendency. In In Data Mining (ICDM), 2011 I.E. 11th International Conference on. IEEE (pp. 507–516).CrossRefGoogle Scholar
  24. Quercia, D., Kosinski, M., Stillwell, D., & Crowcroft, J. (2011). Our twitter profiles, our selves: Predicting personality with twitter. In In Privacy, Security, Risk and Trust (PASSAT) and 2011 I.E. Third International Conference on Social Computing (SocialCom), 2011 I.E. Third International Conference on. IEEE (pp. 180–185).CrossRefGoogle Scholar
  25. Rendle, S., Freudenthaler, C., Gantner, Z., & SchmidtThieme, L. (2009). BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the twenty-fifth conference on uncertainty in artificial intelligence. AUAI press, 452–461.Google Scholar
  26. Rentfrow, P. J., & Gosling, S. D. (2003). The do re mi’s of everyday life: The structure and personality correlates of music preferences. Journal of Personality and Social Psychology, 84(6), 1236.CrossRefGoogle Scholar
  27. Shephard, R. W., & Fare, R. (1974). The law of diminishing returns. Berlin: Springer.CrossRefGoogle Scholar
  28. Steck, H. (2011). Item popularity and recommendation accuracy. In Proceedings of the fifth ACM conference on Recommender systems. ACM, 125–132.Google Scholar
  29. Tkalcic, M., Kunaver, M., Tasic, J., & Kosir, A. (2009). Personality based user similarity measure for a collaborative recommender system. In Proceedings of the 5th Workshop on Emotion in Human-Computer Interaction-Real world challenges. 30–37.Google Scholar
  30. Vargas, S., & Castells, P. (2013). Exploiting the diversity of user preferences for recommendation. In Proceedings of the 10th conference on open research areas in information retrieval (pp. 129–136). Le centre de hautes etudes internationals d’informatique documentaires.Google Scholar
  31. Jesse Vig, Shilad Sen, and John Riedl. (2012). The tag genome: Encoding community knowledge to support novel interaction. ACM Transactions on Interactive Intelligent Systems (TiiS) 2, 3, 13.Google Scholar
  32. Wu, W., & Chen, L. (2015). Implicit acquisition of user personality for augmenting movie recommendations. In In International Conference on User Modeling, Adaptation, and Personalization. Springer (pp. 302–314).CrossRefGoogle Scholar
  33. Youyou, W., Kosinski, M., & Stillwell, D. (2015). Computer-based personality judgments are more accurate than those made by humans. Proceedings of the National Academy of Sciences. 112(4), 1036–1040.Google Scholar
  34. Zhang, M., & Hurley, N. (2009). Novel item recommendation by user profile partitioning. In Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology-Volume 01. IEEE computer society, 508–515.Google Scholar
  35. Zhang, Y. C., Seaghdha, D. O., Quercia, D., & Jambor, T. (2012). Auralist: Introducing serendipity into music recommendation. In Proceedings of the fifth ACM international conference on Web search and data mining. ACM, 13–22.Google Scholar
  36. Ziegler, C.-N., McNee, S. M., Konstan, J. A., & Lausen, G. (2005). Improving recommendation lists through topic diversification. In Proceedings of the 14th international conference on World Wide Web. ACM, 22–32.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2017

Authors and Affiliations

  • Tien T. Nguyen
    • 1
  • F. Maxwell Harper
    • 1
  • Loren Terveen
    • 1
  • Joseph A. Konstan
    • 1
  1. 1.5-240, GroupLens Research, Keller Hall, Department of Computer Science and EngineeringUniversity of MinnesotaMinneapolisUSA

Personalised recommendations