Skip to main content

Wasserstein Adversarial Variational Autoencoder for Sequential Recommendation

  • Conference paper
  • First Online:
Web and Big Data (APWeb-WAIM 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14334))

  • 34 Accesses

Abstract

Variational autoencoders (VAEs) have shown unique advantages as a generative model for sequence recommendation. The core of VAEs is the reconstruction of error targets through similarity metrics to provide a supervised signal for training. However, VAE reconstruction tends to generate non-realistic outputs, which severely affects the accuracy of sequential recommendation. To solve the above problem, in this paper, we propose a new framework called Wasserstein Adversarial Variational Autoencoder (WAVAE) for Sequential Recommendation. In WAVAE, the VAE first combines with the Generative Adversarial Network (GAN) network to differentiate the true and false samples by introducing an adversarially trained discriminative network, and then the learning feature representation in the discriminative network is used as the basis for the VAE reconstruction target so that the VAE tends to generate true samples. We further used Wasserstein loss to optimise the training process, with the aim of avoiding the gradient disappearance problem that occurs when the above-mentioned adversarial network is trained on discrete data, ensuring that the VAE can obtain accurate reconstruction targets through adversarial learning. In addition, we concatenate the original samples with their labels as input to control the generated content and thus control the generated sample tendency. Finally, we conduct experiments on several real datasets to evaluate the model, and the experiment results show that our model outperforms the state-of-the-art baselines significantly.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://github.com/WAVAE/WAVAE-PyTorch.

References

  1. Adler, J., Lunz, S.: Banach wasserstein gan. Adv. Neural Inf. Process. Syst. (2018)

    Google Scholar 

  2. Chae, D.K., Kang, J.S., Kim, S.W.: CFGAN: a generic collaborative filtering framework based on generative adversarial networks. In: CIKM, pp. 137–146 (2018)

    Google Scholar 

  3. Chen, X., et al.: Sequential recommendation with user memory networks. In: WSDM, pp. 108–116 (2018)

    Google Scholar 

  4. Chen, Z., Liu, P.: Towards better data augmentation using wasserstein distance in variational auto-encoder. arXiv preprint arXiv:2109.14795 (2021)

  5. Ezukwoke, K., Hoayek, A., Batton-Hubert, M., Boucher, X.: GCVAE: generalized-controllable variational autoencoder (2022)

    Google Scholar 

  6. Hidasi, B., Karatzoglou, A., Baltrunas, L., Tikk, D.: Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939 (2015)

  7. Higgins, I., et al.: Beta-vae: learning basic visual concepts with a constrained variational framework (2016)

    Google Scholar 

  8. Kang, W.C., McAuley, J.: Self-attentive sequential recommendation. In: ICDM, pp. 197–206. IEEE (2018)

    Google Scholar 

  9. Liang, D., Krishnan, R.G., Hoffman, M.D., Jebara, T.: Variational autoencoders for collaborative filtering. In: Proceedings of the 2018 World Wide Web Conference, pp. 689–698 (2018)

    Google Scholar 

  10. Mescheder, L., Nowozin, S., Geiger, A.: Adversarial variational bayes: unifying variational autoencoders and generative adversarial networks. In: ICML, pp. 2391–2400. PMLR (2017)

    Google Scholar 

  11. Miladinović, D., Shridhar, K., Jain, K., Paulus, M.B., Buhmann, J.M., Allen, C.: Learning to drop out: an adversarial approach to training sequence VAEs (2022)

    Google Scholar 

  12. Sachdeva, N., Manco, G., Ritacco, E., Pudi, V.: Sequential variational autoencoders for collaborative filtering. In: WSDM, pp. 600–608 (2019)

    Google Scholar 

  13. Sohn, K., Lee, H.: Learning structured output representation using deep conditional generative models. Adv. Neural Inf. Process. Syst. (2015)

    Google Scholar 

  14. Sun, F., et al.: Bert4rec: sequential recommendation with bidirectional encoder representations from transformer. In: CIKM, pp. 1441–1450 (2019)

    Google Scholar 

  15. Tang, J., Wang, K.: Personalized top-n sequential recommendation via convolutional sequence embedding. In: WSDM, pp. 565–573 (2018)

    Google Scholar 

  16. Van Den Oord, A., Kalchbrenner, N.: Pixel recurrent neural networks. In: International Conference on Machine Learning, pp. 1747–1756. PMLR (2016)

    Google Scholar 

  17. Wang, J., et al.: A minimax game for unifying generative and discriminative information retrieval models. In: SIGIR Proceedings (2018)

    Google Scholar 

  18. Wang, S., Hu, L., Wang, Y., Cao, L., Sheng, Q.Z., Orgun, M.A.: Sequential Recommender Systems - Challenges, Progress and Prospects, pp. 6332–6338 (2019)

    Google Scholar 

  19. Wang, X., et al.: Normative modeling via conditional variational autoencoder and adversarial learning to identify brain dysfunction in Alzheimer’s disease (2022)

    Google Scholar 

  20. Xie, Z., Liu, C., Zhang, Y., Lu, H., Wang, D., Ding, Y.: Adversarial and contrastive variational autoencoder for sequential recommendation. In: Proceedings of the Web Conference 2021, pp. 449–459 (2021)

    Google Scholar 

  21. Yu, X., Zhang, X., Cao, Y., Xia, M.: Vaegan: a collaborative filtering framework based on adversarial variational autoencoders. In: Twenty-Eighth International Joint Conference on Artificial Intelligence IJCAI-19 (2019)

    Google Scholar 

  22. Zhao, S., Song, J., Ermon, S.: Infovae: Balancing learning and inference in variational autoencoders, pp. 5885–5892 (2019)

    Google Scholar 

Download references

Acknowledgements

This work was supported by the Natural Science Foundation of Heilongjiang Province of China, LH2022F045.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jinghua Zhu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liu, W., Rong, X., Zhong, Y., Zhu, J. (2024). Wasserstein Adversarial Variational Autoencoder for Sequential Recommendation. In: Song, X., Feng, R., Chen, Y., Li, J., Min, G. (eds) Web and Big Data. APWeb-WAIM 2023. Lecture Notes in Computer Science, vol 14334. Springer, Singapore. https://doi.org/10.1007/978-981-97-2421-5_25

Download citation

  • DOI: https://doi.org/10.1007/978-981-97-2421-5_25

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-97-2420-8

  • Online ISBN: 978-981-97-2421-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics