Abstract
In the domain of sequence recommendation, contextual information has been shown to effectively improve the accuracy of predicting the user’s next interaction. However, existing studies do not consider the dependencies between contextual information and item sequences, but the contextual information is directly fusing with the item sequences, which brings the problems described below: (1) Direct fusion fuses contextual information (e.g., time and categories) with item sequences which increases the dimensionality of the embedding matrix, thus increasing the complexity of the attention computation. (2) The attention computation of heterogeneous context information in the same embedding matrix makes it difficult for the recommendation model to distinguish this heterogeneous information. Therefore, we propose a bidirectional multi-sequence decoupling fusion method for sequence recommendation (BMDF-SR) to address the above issues. To establish the dependencies between temporal context sequences and item sequences, we first treat temporal contextual information as independent sequences and build bidirectional dependencies between contextual information sequences and item sequences via a three-layer seq2seq structure. Then, we perform attention computation independently for context sequences such as categories, and the complexity of attention computation can be effectively reduced by this decoupled attention computation. Moreover, since the attention computation is performed separately for each sequence, the interference between heterogeneous information during sequence fusion is reduced, allowing the model to effectively discriminate between different types of information. Extensive experiments on four real-world datasets show that the BMDF-SR method outperforms popular models.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
-MovieLens-1M: Availabile at https://grouplens.org/datasets/movielens/1m/. -Gowalla: Availabile at https://snap.stanford.edu/data/loc-gowalla.html/. -JDshop: Availabile at https://www.jd.com/. -Taobao : Available at https://tianchi.aliyun.com/dataset/dataDetail?dataId=649/.
Code Availability
The code will be released at https://github.com/WayneHuahua/BMDF-SR.git.
References
Dang, Y., Yang, E., & Guo, G., et al. (2023). Uniform sequence better: Time interval aware data augmentation for sequential recommendation. In: Proceedings of the AAAI conference on artificial intelligence. AAAI, Washington DC, USA. https://doi.org/10.1609/aaai.v37i4.25540
Duan, J., Zhang, P. F., Qiu, R., et al. (2023). Long short-term enhanced memory for sequential recommendation. World Wide Web, 26, 561–583. https://doi.org/10.1007/s11280-022-01056-9
Garcin, F., Dimitrakakis, C., & Faltings, B. (2013). Personalized news recommendation with context trees. In: Proceedings of the 7th ACM conference on recommender systems. ACM, Hong Kong, China. https://doi.org/10.1145/2507157.2507166
Gong, J., Wan, Y., Liu, Y., et al. (2023). Reinforced moocs concept recommendation in heterogeneous information networks. ACM Transactions on the Web, 17, 1–27. https://doi.org/10.1145/3580510
Guo, L., Zhang, J., Chen, T., et al. (2023). Reinforcement learning-enhanced shared-account cross-domain sequential recommendation. IEEE Transactions on Knowledge and Data Engineering, 35, 7397–7411. https://doi.org/10.1109/TKDE.2022.3185101
Hao, Y., Ma, J., Zhao, P., et al. (2023). Multi-dimensional graph neural network for sequential recommendation. Pattern Recognition, 139, 109504. https://doi.org/10.1016/j.patcog.2023.109504
He, R., Kang, W.C., & McAuley, J. (2017). Translation-based recommendation. In: Proceedings of the eleventh ACM conference on recommender systems. ACM, Como, Italy. https://doi.org/10.1145/3109859.3109882
Hidasi, B., & Karatzoglou, A. (2018). Recurrent neural networks with top-k gains for session-based recommendations. In: Proceedings of the 27th ACM international conference on information and knowledge management. ACM, Torino, Italy. https://doi.org/10.1145/3269206.3271761
Hidasi, B., Karatzoglou, A., & Baltrunas, L., et al. (2015). Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939, https://doi.org/10.48550/arXiv.1511.06939
Hou, Y., Hu, B., & Zhang, Z., et al. (2022). Core: simple and effective session-based recommendation within consistent representation space. In: Proceedings of the 45th international ACM SIGIR conference on research and development in information retrieval. ACM, Madrid, Spain. https://doi.org/10.1145/3477495.3531955
Kang, W.C., & McAuley, J. (2018). Self-attentive sequential recommendation. In: 2018 IEEE International conference on data mining (ICDM). IEEE, Singapore. https://doi.org/10.1109/ICDM.2018.00035
Le, D.T., Lauw, H.W., & Fang, Y. (2018) Modeling contemporaneous basket sequences with twin networks for next-item recommendation. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence. IJCAI, Stockholm, Sweden. https://doi.org/10.24963/ijcai.2018/474
Lei, J., Li, Y., Yang, S., et al. (2022). Two-stage sequential recommendation for side information fusion and long-term and short-term preferences modeling. Journal of Intelligent Information Systems, 59, 657–677. https://doi.org/10.1007/s10844-022-00723-7
Li, J., Wang, Y., & McAuley, J. (2020). Time interval aware self-attention for sequential recommendation. In: Proceedings of the 13th international conference on web search and data mining. ACM, Houston, TX. https://doi.org/10.1145/3336191.3371786
Ling, Z. H., Ai, Y., Gu, Y., et al. (2018). Waveform modeling and generation using hierarchical recurrent neural networks for speech bandwidth extension. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 26, 883–894. https://doi.org/10.1109/TASLP.2018.2798811
Li, P., Que, M., & Tuzhilin, A. (2023). Dual contrastive learning for efficient static feature representation in sequential recommendations. IEEE Transactions on Knowledge and Data Engineering, 1, 1–13. https://doi.org/10.1109/TKDE.2023.3289469
Liu, C., Li, X., & Cai, G., et al. (2021). Noninvasive self-attention for side information fusion in sequential recommendation. In: Proceedings of the AAAI conference on artificial intelligence. AAAI, Palo Alto, California. https://doi.org/10.1609/aaai.v35i5.16549
Liu, Q., Wu, S., & Wang, D., et al. (2016). Context-aware sequential recommendation. In: 2016 IEEE 16th International conference on data mining. IEEE, Barcelona, Spain. https://doi.org/10.1109/ICDM.2016.0135
Li, L., Xiahou, J., Lin, F., et al. (2023). Distvae: distributed variational autoencoder for sequential recommendation. Knowledge-Based Systems, 264, 110313. https://doi.org/10.1016/j.knosys.2023.110313
Rakkappan, L., & Rajan, V. (2019). Context-aware sequential recommendations withstacked recurrent neural networks. In: The world wide web conference. ACM, San Francisco, CA. https://doi.org/10.1145/3308558.3313567
Rendle, S., Freudenthaler, C., & Schmidt-Thieme, L. (2010). Factorizing personalized markov chains for next-basket recommendation. In: Proceedings of the 19th international conference on world wide web. ACM, Raleigh, North Carolina. https://doi.org/10.1145/1772690.1772773
Ren, J., & Gan, M. (2023). Mining dynamic preferences from geographical and interactive correlations for next poi recommendation. Knowledge and Information Systems, 65, 183–206. https://doi.org/10.1007/s10115-022-01749-7
Sun, F., Liu, J., & Wu, J., et al. (2019). Bert4rec: sequential recommendation with bidirectional encoder representations from transformer. In: Proceedings of the 28th ACM international conference on information and knowledge management. ACM, Beijing, China. https://doi.org/10.1145/3357384.3357895
Sun, K., Qian, T., Chen, X., et al. (2021). Context-aware seq2seq translation model for sequential recommendation. Information Sciences, 581, 60–72. https://doi.org/10.1016/j.ins.2021.09.001
Tang, J., & Wang, K. (2018). Personalized top-n sequential recommendation via convolutional sequence embedding. In: Proceedings of the eleventh ACM international conference on web search and data mining. ACM, Marina Del Rey, CA. https://doi.org/10.1145/3159652.3159656
Tang, H., Zhao, G., Bu, X., et al. (2021). Dynamic evolution of multi-graph based collaborative filtering for recommendation systems. Knowledge-Based Systems, 228, 107251. https://doi.org/10.1016/j.knosys.2021.107251
Vaswani, A., Shazeer, N., & Parmar, N., et al. (2017). Attention is all you need. In: roceedings of the 31st international conference on neural information processing systems. Curran Associates, Inc., Long Beach, California. https://doi.org/10.48550/arXiv.1706.03762
Wang, S., Hu, L., & Cao, L., et al. (2018). Attention-based transactional context embedding for next-item recommendation. In: Proceedings of the AAAI conference on artificial intelligence. AAAI, New Orleans, Lousiana. https://doi.org/10.1609/aaai.v32i1.11851
Wang, C., Ma, W., Chen, C., et al. (2023). Sequential recommendation with multiple contrast signals. ACM Transactions on Information Systems, 41, 1–27. https://doi.org/10.1145/3522673
Xie, Y., Zhou, P., & Kim, S. (2022). Decoupled side information fusion for sequential recommendation. In: Proceedings of the 45th international ACM SIGIR conference on research and development in information retrieval. ACM, Madrid, Spain. https://doi.org/10.1145/3477495.3531963
Ye, X., & Liu, D. (2022). A cost-sensitive temporal-spatial three-way recommendation with multi-granularity decision. Information Sciences, 589, 670–689. https://doi.org/10.1016/j.ins.2021.12.105
Yuan, X., Duan, D., & Tong, L., et al. (2021). Icai-sr: Item categorical attribute integrated sequential recommendation. In: Proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval. ACM, Virtual Event, Canada. https://doi.org/10.1145/3404835.3463060
Yuan, W., Wang, H., Yu, X., et al. (2020). Attention-based context-aware sequential recommendation model. Information Sciences, 510, 122–134. https://doi.org/10.1016/j.ins.2019.09.007
Zhang, T., Zhao, P., & Liu, Y., et al. (2019). Feature-level deeper self-attention network for sequential recommendation. In: Proceedings of the twenty-eighth international joint conference on artificial intelligence. IJCAI, Macao, China. https://doi.org/10.24963/ijcai.2019/600
Zhang, Y., Yang, B., Liu, H., et al. (2023). A time-aware self-attention based neural network model for sequential recommendation. Applied Soft Computing, 133, 109894. https://doi.org/10.1016/j.asoc.2022.109894
Zhao, W.X., Mu, S., & Hou, Y., et al. (2021). Recbole: Towards a unified, comprehensive and efficient framework for recommendation algorithms. In: Proceedings of the 30th ACM international conference on information & knowledge management. ACM, Virtual Event, Queensland. https://doi.org/10.1145/3459637.3482016
Zhong, C., Xiong, F., Pan, S., et al. (2023). Hierarchical attention neural network for information cascade prediction. Information Sciences, 622, 1109–1127. https://doi.org/10.1016/j.ins.2022.11.163
Zhou, C., Bai, J., & Song, J., et al. (2018). Atrank: An attention-based user behavior modeling framework for recommendation. In: Proceedings of the AAAI conference on artificial intelligence. AAAI, New Orleans, Lousiana. https://doi.org/10.1609/aaai.v32i1.11618
Zhou, K., Wang, H., & Zhao, W.X., et al. (2019). S3-rec: Self-supervised learning for sequential recommendation with mutual information maximization. In: Proceedings of the 29th ACM international conference on information & knowledge management. ACM, Virtual Event, Ireland. https://doi.org/10.1145/3340531.3411954
Zhou, W., Liu, Y., Li, M., et al. (2023). Dynamic multi-objective optimization framework with interactive evolution for sequential recommendation. IEEE Transactions on Emerging Topics in Computational Intelligence, 7, 1228–1241. https://doi.org/10.1109/TETCI.2023.3251352
Acknowledgements
Thanks to Professor Qin Jiwei for his help and support during the research process.
Funding
This work was supported by the Science Fund for Outstanding Youth of Xinjiang Uygur Autonomous Region under Grant No. 2021D01E14.
Author information
Authors and Affiliations
Contributions
-Aohua Gao: Writing, Main idea, Experiments, Analysis -Jiwei Qin: Provide guidance -Chao Ma and Tao Wang: Analysis
Corresponding author
Ethics declarations
Ethical Approval
Not applicable as this study did not involve human participants.
Consent for Publication
The authors grant the Publisher an exclusive licence to publish the article
Competing interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Gao, A., Qin, J., Ma, C. et al. BMDF-SR: bidirectional multi-sequence decoupling fusion method for sequential recommendation. J Intell Inf Syst (2023). https://doi.org/10.1007/s10844-023-00825-w
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10844-023-00825-w