Abstract
Collaborative Filtering (CF) technique has proved to be one of the most successful techniques in recommendation systems in recent years. However, traditional centralized CF system has suffered from its limited scalability as calculation complexity increases rapidly both in time and space when the record in the user database increases. Peer-to-peer (P2P) network has attracted much attention because of its advantage of scalability as an alternative architecture for CF systems. In this paper, authors propose a decentralized CF algorithm, called PipeCF, based on distributed hash table (DHT) method which is the most popular P2P routing algorithm because of its efficiency, scalability, and robustness. Authors also propose two novel approaches: significance refinement (SR) and unanimous amplification (UA), to improve the scalability and prediction accuracy of DHT-based CF algorithm. The experimental data show that our DHT-based CF system has better prediction accuracy, efficiency and scalability than traditional CF systems.
This is a preview of subscription content, log in via an institution to check access.
References
Amund, T., 2001. Peer-to-peer Based Recommendations for Mobile Commerce. Proceedings of the First International Mobile Commerce Workshop, ACM Press, Rome, Italy, p. 26–29.
Breese, J., Heckerman, D., Kadie, C., 1998. Empirical Analysis of Predictive Algorithms for Collaborative Filtering. Proceedings of the 14th Conference on Uncertainty in Artificial Intelligence, p.43–52.
Canny, J., 2002. Collaborative Filtering with Privacy. Proceedings of the IEEE Symposium on Research in Security and Privacy, Oakland, CA, p. 45–57.
David, G., David, N., Brian, O.M., Douglas, T., 1992. Using Collaborative Filtering to weave an information tapestry.Communications of the ACM,35(12):61–70.
EachMovie, 1997. EachMovie Collaborative Filtering Data Set. http://research.compaq.com/SRC/eachmovie.
Herlocker, L.J., Konstan, A.J., Borchers, A., Riedl, J., 1999. An Algorithmic Framework for Performing Collaborative Filtering. Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, p.230–237.
Krämer, B.J., Schmidt, H.W., 2001. Component and tools for on-line education.European Journal of Education,36(2):14–41.
Olesson, T., 2003. Bootstrapping and Decentralizing Recommender Systems, Licentiate Thesis. Department of Information Technology, Uppsala University and SICS, Uppsala, Sweden.
Resinck., P., Neophytos, I., Mitesh, S., Peter, B., John, R., 1994. GroupLens: An Open Architecture for Collaborative Filtering of Netnews. Proceedings of the 1994 ACM conference on Computer Supported Cooperative Work, Chapel Hill, North Carolina, United States p. 175–186.
Ratnasamy, S., Francis, P., Handley M., Karp, R., Shenker, S., 2001. A Scalable Content-addressable Network. ACM SIGCOMM, San Diego, CA, USA, 2001.
Rowstron, A., Druschel, P., 2001. Pastry: Scalable, Distributed Object Location and Routing for Large Scale Peer-to-peer Systems. IEIP/ACM Middleware, Hedelberg, Germany.
Stocal, I., Morris, R., Karger, D., Kaashoek, M.F., Balakrishnan, H., 2001. Chord: A Scalable Peer-to-peer Lookuo Service for Internet Applications. ACM SIGCOMM, San Diego, CA, USA, p. 149–160.
Upendra, S., Pattie, M., 1995. Social Information Filtering: Algorithms for Automating “Word of Mouth”. Proceedings of the SIGCHI Conference on Human factors in Computing Systems. Denver, Colorado, United States, p. 210–217.
Wang, F., 2002. Self-organizing Communities Formed by Middle Agents. Proceedings of the First International Conference on Autonomous Agents and Multi-agent Systems, Bologna, Italy, p. 1333–1339.
Zhao, B.Y., Kubiatowicz, J.D., Joseph, A.D., 2001. Tapestry: An Infrastructure for Fault-tolerant Wide-area Location and Routing. Tech. Rep. UCB/CSB-0-114. UC Berkeley EECS.
Author information
Authors and Affiliations
Additional information
Project (No. 60372078) supported by the National Natural Science Foundation of China
Rights and permissions
About this article
Cite this article
Rui-min, S., Fan, Y., Peng, H. et al. PipeCF: a DHT-based collaborative filtering recommendation system. J. Zheijang Univ.-Sci. A 6, 118–125 (2005). https://doi.org/10.1631/BF02847975
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1631/BF02847975