Abstract
In recent years, there are numerous works been proposed to leverage the techniques of deep learning to improve social-aware recommendation performance. In most cases, it requires a larger number of data to train a robust deep learning model, which contains a lot of parameters to fit training data. However, both data of user ratings and social networks are facing critical sparse problem, which makes it not easy to train a robust deep neural network model. Towards this problem, we propose a novel correlative denoising autoencoder (CoDAE) method by taking correlations between users with multiple roles into account to learn robust representations from sparse inputs of ratings and social networks for recommendation. We develop the CoDAE model by utilizing three separated autoencoders to learn user features with roles of rater, truster and trustee, respectively. Especially, on account of that each input unit of user vectors with roles of truster and trustee is corresponding to a particular user, we propose to utilize shared parameters to learn common information of the units that corresponding to same users. Moreover, we propose a related regularization term to learn correlations between user features that learnt by the three subnetworks of CoDAE model. We further conduct a series of experiments to evaluate the proposed method on two public datasets for Top-N recommendation task. The experimental results demonstrate that the proposed model outperforms state-of-the-art algorithms on rank-sensitive metrics of MAP and NDCG.
Similar content being viewed by others
References
Leng J W, Jiang P Y. A deep learning approach for relationship extraction from interaction context in social manufacturing paradigm. Knowledge-Based Systems, 2016, 100: 188–199
Wu Y Q, He F Z, Zhang D J, Li X X. Service-oriented feature-based data exchange for cloud-based design and manufacturing. IEEE Transactions on Services Computing, 2018, 11: 341–353
Ma H, Yang H X, Lyu M R, King I. Sorec: social recommendation using probabilistic matrix factorization. In: Proceedings of the 17th ACM Conference on Information and Knowledge Management. 2008, 931–940
Jamali M, Ester M. A matrix factorization technique with trust propagation for recommendation in social networks. In: Proceedings of the 4th ACM Conference on Recommender Systems. 2010, 135–142
Ma H, Zhou T C, Lyu M R, King I. Improving recommender systems by incorporating social contextual information. ACM Transactions on Information Systems (TOIS), 2011, 29: 9
Yang B, Lei Y, Liu D Y, Liu J M. Social collaborative filtering by trust. In: Proceedings of the 23rd International Joint Conference on Artificial Intelligence. 2013, 2747–2753
Yao W L, He J, Huang G G, Zhang Y C. Modeling dual role preferences for trust-aware recommendation. In: Proceedings of the 37th International ACM SIGIR Conference on Research & Development in Information Retrieval. 2014, 975–978
Jiang M, Cui P, Liu R, Yang Q, Wang F, Zhu W W, Yang S Q. Social contextual recommendation. In: Proceedings of the 21st ACM International Conference on Information and Knowledge Management. 2012, 45–54
Guo G B, Zhang J, Yorke-Smith N. Trustsvd: collaborative filtering with both the explicit and implicit influence of user trust and of item ratings. In: Proceedings of the 29th AAAI Conference on Artificial Intelligence. 2015, 123–129
Krizhevsky A, Sutskever I, Hinton G E. Imagenet classification with deep convolutional neural networks. In: Proceedings of the 25th International Conference on Neural Information Processing Systems. 2012, 1097–1105
He K M, Zhang X Y, Ren S Q, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016, 770–778
Kalchbrenner N, Grefenstette E, Blunsom P. A convolutional neural network for modelling sentences. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics. 2014, 655–665
Bansal T, Belanger D, McCallum A. Ask the GRU: multi-task learning for deep text recommendations. In: Proceedings of the 10th ACM Conference on Recommender Systems. 2016, 107–114
Zhang S D, He F Z, Ren W Q, Yao J. Joint learning of image detail and transmission map for single image dehazing. The Visual Computer, 2018, DOI: https://doi.org/10.1007/s00371-018-1612-9
Hofmann T, Schölkopf B, Smola A J. Kernel methods in machine learning. The Annals of Statistics, 2008, 36: 1171–1220
Li K, He F Z, Yu H P, Chen X. A correlative classifiers approach based on particle filter and sample set for tracking occluded target. Applied Mathematics-A Journal of Chinese Universities, 2017, 32: 294–312
Li K, He F Z, Yu H P, Chen X. A parallel and robust object tracking approach synthesizing adaptive bayesian learning and improved incremental subspace learning. Frontiers of Computer Science, 2019, 13(5): 1116–1135
Li K, He F Z, Yu H P. Robust visual tracking based on convolutional features with illumination and occlusion handing. Journal of Computer Science and Technology, 2018, 33: 223–236
Yu H P, He F Z, Pan Y T. A novel segmentation model for medical images with intensity inhomogeneity based on adaptive perturbation. Multimedia Tools and Applications, 2019, 78(9): 11779–11798
Yu H P, He F Z, Pan Y T. A novel region-based active contour model via local patch similarity measure for image segmentation. Multimedia Tools and Applications, 2018, 77: 24097–24119
Chen X, He F Z, Yu H P. A matting method based on full feature coverage. Multimedia Tools and Applications, 2019, 78(9): 11173–11201
Li H R, He F Z, Yan X H. IBEA-SVM: an indicator-based evolutionary algorithm based on pre-selection with classification guided by SVM. Applied Mathematics—A Journal of Chinese Universities, 2019, 34: 1–26
Sedhain S, Menon A K, Sanner S, Xie L X. Autorec: autoencoders meet collaborative filtering. In: Proceedings of the 24th International Conference on World Wide Web. 2015, 111–112
Wang H, Wang N Y, Yeung D Y. Collaborative deep learning for recommender systems. In: Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2015, 1235–1244
Wang H, Shi X J, Yeung D Y. Relational stacked denoising autoencoder for tag recommendation. In: Proceedings of the 29th AAAI Conference on Artificial Intelligence. 2015, 3052–3058
He R N, Lin C B, Wang J G, McAuley J L. Sherlock: sparse hierarchical embeddings for visually-aware one-class collaborative filtering. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence. 2016, 3740–3746
Wu Y, DuBois C, Zheng A X, Ester M. Collaborative denoising autoencoders for top-N recommender systems. In: Proceedings of the 9th ACM International Conference on Web Search and Data Mining. 2016, 153–162
Deng S, Huang L, Xu G, Wu X, Wu Z. On deep learning for trust-aware recommendations in social networks. IEEE Transactions on Neural Networks and Learning Systems, 2017, 28: 1164–1177
Vincent P, Larochelle H, Bengio Y, Manzagol P A. Extracting and composing robust features with denoising autoencoders. In: Proceedings of the 25th International Conference on Machine Learning. 2008, 1096–1103
Koren Y, Bell R, Volinsky C. Matrix factorization techniques for recommender systems. Computer, 2009, 42: 30–37
Wang Z J, Yang Y, Hu Q M, He L. An empirical study of personal factors and social effects on rating prediction. In: Proceedings of Pacific-Asia Conference on Knowledge Discovery and Data Mining. 2015, 747–758
Guo L, Wen Y F, Wang X H. Exploiting pre-trained network embeddings for recommendations in social networks. Journal of Computer Science and Technology, 2018, 33: 682–696
Wang M Q, Wu Z Y, Sun X X, Feng G Z, Zhang B Z. Trust-aware collaborative filtering with a denoising autoencoder. Neural Processing Letters, 2019, 49(2): 835–849
Wu Z M, Aggarwal C C, Sun J M. The troll-trust model for ranking in signed networks. In: Proceedings of the 9th ACM International Conference on Web Search and Data Mining. 2016, 447–456
Pan Y T, He F Z, Yu H P. A novel enhanced collaborative autoencoder with knowledge distillation for top-N recommender systems. Neurocomputing, 2019, 332: 137–148
Rendle S, Balby Marinho L, Nanopoulos A, Schmidt-Thieme L. Learning optimal ranking with tensor factorization for tag recommendation. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2009, 727–736
Zhang Y F, Ai Q Y, Chen X, Croft W B. Joint representation learning for top-N recommendation with heterogeneous information sources. In: Proceedings of the 2017 ACM Conference on Information and Knowledge Management. 2017, 1449–1458
Tang J L, Gao H J, Liu H, Das Sarma A. Etrust: understanding trust evolution in an online world. In: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2012, 253–261
Liu N N, Yang Q. Eigenrank: a ranking-oriented approach to collaborative filtering. In: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 2008, 83–90
Rafailidis D, Crestani F. Collaborative ranking with social relationships for top-N recommendations. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2016, 785–788
Koren Y. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2008, 426–434
Guo L, Ma J, Jiang H R, Chen Z M, Xing C M. Social trust aware item recommendation for implicit feedback. Journal of Computer Science and Technology, 2015, 30: 1039–1053
Pan W K, Chen L. GBPR: group preference based bayesian personalized ranking for one-class collaborative filtering. In: Proceedings of the 23rd International Joint Conference on Artificial Intelligence. 2013, 2691–2697
Zhao T, McAuley J L, King I. Leveraging social connections to improve personalized ranking for collaborative filtering. In: Proceedings of the 23rd ACM International Conference on Information and Knowledge Management. 2014, 261–270
Zhou Y, He F Z, Qiu Y M. Dynamic strategy based parallel ant colony optimization on GPUs for TSPs. Science China Information Sciences, 2017, 60: 068102
Zhou Y, He F Z, Hou N, Qiu Y M. Parallel ant colony optimization on multi-core SIMD CPUs. Future Generation Computer Systems, 2018, 79: 473–487
Zhang D J, He F Z, Han S H, Li X X. Quantitative optimization of interoperability during feature-based data exchange. Integrated Computer-Aided Engineering, 2016, 23: 31–50
Chen Y L, He F Z, Wu Y Q, Hou N. A local start search algorithm to compute exact hausdorff distance for arbitrary point sets. Pattern Recognition, 2017, 67: 139–148
Lv X, He F Z, Cheng Y, Wu Y Q. A novel crdt-based synchronization method for real-time collaborative cad systems. Advanced Engineering Informatics, 2018, 38: 381–391
Lv X, He F Z, Cai W W, Cheng Y. Supporting selective undo of string-wise operations for collaborative editing systems. Future Generation Computer Systems, 2018, 28: 41–62
Yan X H, He F Z, Chen Y L. A novel hardware/software partitioning method based on position disturbed particle swarm optimization with invasive weed optimization. Journal of Computer Science and Technology, 2017, 32: 340–355
Yan X H, He F Z, Hou N, Ai H J. An efficient particle swarm optimization for large-scale hardware/software co-design system. International Journal of Cooperative Information Systems, 2018, 27: 1741001
Acknowledgements
This research has been supported by the National Natural Science Foundation of China (Grant No. 61472289) and the National Key Research and Development Project (2016YFC0106305).
Author information
Authors and Affiliations
Corresponding author
Additional information
Yiteng Pan received the MS degree from the School of Electronic Information, WuHan University, China in 2012. He is currently pursuing the PhD degree with the School of Computer Science in Wuhan University, China. His research interests include data mining, recommender systems, and deep learning.
Fazhi He received PhD degree from Wuhan University of Technology, China. He was post-doctor researcher in The State Key Laboratory of CAD&CG at Zhejiang University, China, a visiting researcher in Korea Advanced Institute of Science & Technology and a visiting faculty member in the University of North Carolina at Chapel Hill. Now he is a professor in School of Computer, Wuhan University, China. His research interests are computer graphics, computer-aided design, image processing, and computer supported cooperative work.
Haiping Yu is currently a PhD candidate at the school of computer science in Wuhan University, China. Her research interests are pattern recognition, image processing, and computer graphics.
Electronic supplementary material
Rights and permissions
About this article
Cite this article
Pan, Y., He, F. & Yu, H. A correlative denoising autoencoder to model social influence for top-N recommender system. Front. Comput. Sci. 14, 143301 (2020). https://doi.org/10.1007/s11704-019-8123-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11704-019-8123-3