Skip to main content
SpringerLink
Log in

Clustering-based diversity improvement in top-N recommendation

  • Published:
Journal of Intelligent Information Systems Aims and scope Submit manuscript

Abstract

The major aim of recommender algorithms has been to predict accurately the rating value of items. However, it has been recognized that accurate prediction of rating values is not the only requirement for achieving user satisfaction. One other requirement, which has gained importance recently, is the diversity of recommendation lists. Being able to recommend a diverse set of items is important for user satisfaction since it gives the user a richer set of items to choose from and increases the chance of discovering new items. In this study, we propose a novel method which can be used to give each user an option to adjust the diversity levels of their own recommendation lists. Experiments show that the method effectively increases the diversity levels of recommendation lists with little decrease in accuracy. Compared to the existing methods, the proposed method, while achieving similar diversification performance, has a very low computational time complexity, which makes it highly scalable and allows it to be used in the online phase of the recommendation process.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. http://www.grouplens.org/node/73/

  2. http://goldberg.berkeley.edu/jester-data/

  3. http://www.informatik.uni-freiburg.de/~cziegler/BX/

References

  • Adomavicius, G., & Kwon, Y. (2011). Maximizing aggregate recommendation diversity: A graph-theoretic approach. In Proceedings of workshop on novelty and diversity in recommender systems (pp. 3–10). Chicago, Illinois, USA.

  • Adomavicius, G., & Kwon, Y. (2012). Improving aggregate recommendation diversity using ranking-based techniques. IEEE Transactions on Knowledge and Data Engineering, 24(5), 896–911.

    Article  Google Scholar 

  • Adomavicius, G., & Tuzhilin, A. (2005). Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering, 17(6), 734–749.

    Article  Google Scholar 

  • Ahn, H.J. (2008). A new similarity measure for collaborative filtering to alleviate the new user cold-starting problem. Information Sciences, 178(1), 37–51.

    Article  Google Scholar 

  • Bell, R.M., Koren, Y., Volinsky, C. (2007). Modeling relationships at multiple scales to improve accuracy of large recommender systems. In Proceedings of the 13th ACM international conference on knowledge discovery and data mining (pp. 95–104). San Jose, California, USA.

  • Billsus, D., & Pazzani, M.J. (1998). Learning collaborative information filters. In J.W. Shavlik (Ed.), ICML (pp. 46–54). Morgan Kaufmann.

  • Bobadilla, J., Serradilla, F., Hernando, A. (2009). Collaborative filtering adapted to recommender systems of e-learning. Knowledge-Based Systems, 22(4), 261–265.

    Article  Google Scholar 

  • Boim, R., Milo, T., Novgorodov, S. (2011). Diversification and refinement in collaborative filtering recommender. In C. Macdonald, I. Ounis, I. Ruthven (Eds.), CIKM (pp. 739–744). ACM.

  • Bradley, K., & Smyth, B. (2001). Improving recommendation diversity. In Proceedings of the 12th irish conference on artificial intelligence and cognitive science.

  • Breese, J.S., Heckerman, D., Kadie, C.M. (1998). Empirical analysis of predictive algorithms for collaborative filtering. In Proceedings of the 14th conference on uncertainty in artificial intelligence (pp. 43–52). Madison, Wisconsin, USA.

  • Castells, P., Wang, J., Lara, R., Zhang, D. (2011). Workshop on novelty and diversity in recommender systems—divers 2011. In B. Mobasher, R.D. Burke, D. Jannach, G. Adomavicius (Eds.), RecSys (pp. 393–394). ACM.

  • Chen, H., & Chen, A. (2005). A music recommendation system based on music and user grouping. Journal of Intelligent Information System, 24(2), 113–132.

    Article  MATH  Google Scholar 

  • Cremonesi, P., Koren, Y., Turrin, R. (2010). Performance of recommender algorithms on top-N recommendation tasks. In Proceedings of the 4th ACM conference on recommender systems (pp. 39–46). Barcelona, Spain.

  • Deshpande, M., & Karypis, G. (2004). Item-based top-N recommendation algorithms. ACM Transactions on Information Systems, 22(1), 143–177.

    Article  Google Scholar 

  • Desrosiers, C., & Karypis, G. (2011). A comprehensive survey of neighborhood-based recommendation methods. In F. Ricci, L. Rokach, B. Shapira, P.B. Kantor (Eds.), Recommender Systems Handbook (pp. 107–144). Springer.

  • Funk, S. (2006). Netflix update: Try this at home. http://sifter.org/~simon/journal/20061211.html. Accessed 10 Feb 2012.

  • Golbeck, J. (2006). Generating predictive movie recommendations from trust in social networks. In K. Stølen, W.H. Winsborough, F. Martinelli, F. Massacci (Eds.), Proceedings of the 4th international conference on trust management. Lecture Notes in Computer Science (Vol. 3986, pp. 93–104). Pisa: Springer.

  • Gollapudi, S., & Sharma, A. (2009). An axiomatic approach for result diversification. In J. Quemada, G. León, Y.S. Maarek, W. Nejdl (Eds.), WWW (pp. 381–390). ACM.

  • Herlocker, J.L., Konstan, J.A., Terveen, L.G., Riedl, J. (2004). Evaluating collaborative filtering recommender systems. ACM Transactions on Information Systems, 22(1), 5–53.

    Article  Google Scholar 

  • Hurley, N., & Zhang, M. (2011). Novelty and diversity in top-N recommendation—analysis and evaluation. ACM Transactions on Internet Technology, 10(4), 14.

    Article  Google Scholar 

  • Konstan, J.A., Miller, B.N., Maltz, D., Herlocker, J.L., Gordon, L.R., Riedl, J. (1997). Grouplens: applying collaborative filtering to usenet news. Communications of the ACM, 40(3), 77–87.

    Article  Google Scholar 

  • Koren, Y., & Bell, R.M. (2011). Advances in collaborative filtering. In F. Ricci, L. Rokach, B. Shapira, P.B. Kantor (Eds.), Recommender Systems Handbook (pp. 145–186). Springer.

  • Linden, G., Smith, B., York, J. (2003). Amazon.com recommendations: item-to-item collaborative filtering. IEEE Internet Computing, 7(1), 76–80.

    Article  Google Scholar 

  • Luo, X., Xia, Y., Zhu, Q. (2012). Incremental collaborative filtering recommender based on regularized matrix factorization. Knowledge-Based Systems, 27, 271–280.

    Article  Google Scholar 

  • McNee SM, Riedl J, Konstan JA (2006) Being accurate is not enough: How accuracy metrics have hurt recommender systems. In G.M. Olson, & R. Jeffries (Eds.), CHI extended abstracts (pp. 1097–1101). ACM.

  • Ricci, F., Rokach, L., Shapira, B., Kantor, P.B. (eds) (2011). Recommender systems handbook. Springer.

  • Rosaci, D., & Sarnè, G.M.L. (2012). A multi-agent recommender system for supporting device adaptivity in e-commerce. Journal of Intelligent Information System, 38(2), 393–418.

    Article  Google Scholar 

  • Shih, D.H., Yen, D.C., Lin, H.C., Shih, M.H. (2011). An implementation and evaluation of recommender systems for traveling abroad. Expert Systems with Applications, 38(12), 15,344–15,355.

    Google Scholar 

  • Smyth, B., & McClave, P. (2001). Similarity vs. diversity. In D.W. Aha, & I. Watson (Eds.), Proceedings of the 4th international conference on case-based reasoning. Lecture Notes in Computer Science (Vol. 2080, pp. 347–361). Vancouver: Springer.

    Google Scholar 

  • Tan, P.N., Steinbach, M., Kumar, V. (2005). Introduction to data mining (Chapter 8). Boston: Addison-Wesley.

    Google Scholar 

  • Zhang, M., & Hurley, N. (2008). Avoiding monotony: Improving the diversity of recommendation lists. In Proceedings of the 2nd ACM conference on recommender systems (pp. 123–130). Lausanne, Switzerland.

  • Zhang, M., & Hurley, N. (2009). Novel item recommendation by user profile partitioning. In Proceedings of the IEEE/WIC/ACM international conference on web intelligence (pp. 508–515). Milan, Italy.

  • Ziegler, C.N., McNee, S.M., Konstan, J.A., Lausen, G. (2005). Improving recommendation lists through topic diversification. In Proceedings of the 14th international conference on World Wide Web (pp. 22–32). Chiba, Japan.

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Bahçeşehir University, Çırağan Caddesi, 34353, Beşiktaş, İstanbul, Turkey

    Tevfik Aytekin & Mahmut Özge Karakaya

Authors
  1. Tevfik Aytekin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mahmut Özge Karakaya
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tevfik Aytekin.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Aytekin, T., Karakaya, M.Ö. Clustering-based diversity improvement in top-N recommendation. J Intell Inf Syst 42, 1–18 (2014). https://doi.org/10.1007/s10844-013-0252-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10844-013-0252-9

Keywords

Search

Navigation