Abstract
Variational autoencoders (VAEs) have shown unique advantages as a generative model for sequence recommendation. The core of VAEs is the reconstruction of error targets through similarity metrics to provide a supervised signal for training. However, VAE reconstruction tends to generate non-realistic outputs, which severely affects the accuracy of sequential recommendation. To solve the above problem, in this paper, we propose a new framework called Wasserstein Adversarial Variational Autoencoder (WAVAE) for Sequential Recommendation. In WAVAE, the VAE first combines with the Generative Adversarial Network (GAN) network to differentiate the true and false samples by introducing an adversarially trained discriminative network, and then the learning feature representation in the discriminative network is used as the basis for the VAE reconstruction target so that the VAE tends to generate true samples. We further used Wasserstein loss to optimise the training process, with the aim of avoiding the gradient disappearance problem that occurs when the above-mentioned adversarial network is trained on discrete data, ensuring that the VAE can obtain accurate reconstruction targets through adversarial learning. In addition, we concatenate the original samples with their labels as input to control the generated content and thus control the generated sample tendency. Finally, we conduct experiments on several real datasets to evaluate the model, and the experiment results show that our model outperforms the state-of-the-art baselines significantly.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Adler, J., Lunz, S.: Banach wasserstein gan. Adv. Neural Inf. Process. Syst. (2018)
Chae, D.K., Kang, J.S., Kim, S.W.: CFGAN: a generic collaborative filtering framework based on generative adversarial networks. In: CIKM, pp. 137–146 (2018)
Chen, X., et al.: Sequential recommendation with user memory networks. In: WSDM, pp. 108–116 (2018)
Chen, Z., Liu, P.: Towards better data augmentation using wasserstein distance in variational auto-encoder. arXiv preprint arXiv:2109.14795 (2021)
Ezukwoke, K., Hoayek, A., Batton-Hubert, M., Boucher, X.: GCVAE: generalized-controllable variational autoencoder (2022)
Hidasi, B., Karatzoglou, A., Baltrunas, L., Tikk, D.: Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939 (2015)
Higgins, I., et al.: Beta-vae: learning basic visual concepts with a constrained variational framework (2016)
Kang, W.C., McAuley, J.: Self-attentive sequential recommendation. In: ICDM, pp. 197–206. IEEE (2018)
Liang, D., Krishnan, R.G., Hoffman, M.D., Jebara, T.: Variational autoencoders for collaborative filtering. In: Proceedings of the 2018 World Wide Web Conference, pp. 689–698 (2018)
Mescheder, L., Nowozin, S., Geiger, A.: Adversarial variational bayes: unifying variational autoencoders and generative adversarial networks. In: ICML, pp. 2391–2400. PMLR (2017)
Miladinović, D., Shridhar, K., Jain, K., Paulus, M.B., Buhmann, J.M., Allen, C.: Learning to drop out: an adversarial approach to training sequence VAEs (2022)
Sachdeva, N., Manco, G., Ritacco, E., Pudi, V.: Sequential variational autoencoders for collaborative filtering. In: WSDM, pp. 600–608 (2019)
Sohn, K., Lee, H.: Learning structured output representation using deep conditional generative models. Adv. Neural Inf. Process. Syst. (2015)
Sun, F., et al.: Bert4rec: sequential recommendation with bidirectional encoder representations from transformer. In: CIKM, pp. 1441–1450 (2019)
Tang, J., Wang, K.: Personalized top-n sequential recommendation via convolutional sequence embedding. In: WSDM, pp. 565–573 (2018)
Van Den Oord, A., Kalchbrenner, N.: Pixel recurrent neural networks. In: International Conference on Machine Learning, pp. 1747–1756. PMLR (2016)
Wang, J., et al.: A minimax game for unifying generative and discriminative information retrieval models. In: SIGIR Proceedings (2018)
Wang, S., Hu, L., Wang, Y., Cao, L., Sheng, Q.Z., Orgun, M.A.: Sequential Recommender Systems - Challenges, Progress and Prospects, pp. 6332–6338 (2019)
Wang, X., et al.: Normative modeling via conditional variational autoencoder and adversarial learning to identify brain dysfunction in Alzheimer’s disease (2022)
Xie, Z., Liu, C., Zhang, Y., Lu, H., Wang, D., Ding, Y.: Adversarial and contrastive variational autoencoder for sequential recommendation. In: Proceedings of the Web Conference 2021, pp. 449–459 (2021)
Yu, X., Zhang, X., Cao, Y., Xia, M.: Vaegan: a collaborative filtering framework based on adversarial variational autoencoders. In: Twenty-Eighth International Joint Conference on Artificial Intelligence IJCAI-19 (2019)
Zhao, S., Song, J., Ermon, S.: Infovae: Balancing learning and inference in variational autoencoders, pp. 5885–5892 (2019)
Acknowledgements
This work was supported by the Natural Science Foundation of Heilongjiang Province of China, LH2022F045.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Liu, W., Rong, X., Zhong, Y., Zhu, J. (2024). Wasserstein Adversarial Variational Autoencoder for Sequential Recommendation. In: Song, X., Feng, R., Chen, Y., Li, J., Min, G. (eds) Web and Big Data. APWeb-WAIM 2023. Lecture Notes in Computer Science, vol 14334. Springer, Singapore. https://doi.org/10.1007/978-981-97-2421-5_25
Download citation
DOI: https://doi.org/10.1007/978-981-97-2421-5_25
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-2420-8
Online ISBN: 978-981-97-2421-5
eBook Packages: Computer ScienceComputer Science (R0)