Skip to main content
Log in

Leveraging user itinerary to improve personalized deep matching at Fliggy

  • Regular Paper
  • Published:
The VLDB Journal Aims and scope Submit manuscript

Abstract

Matching items for a user from a travel item pool of large cardinality has been the most important technology for Fliggy, one of the most popular online travel platforms (OTPs) in China. In this paper, we propose a novel Fliggy ITinerary-aware deep matching network (FitNET) to address the major challenges facing OTPs. FitNET is designed based on the effective deep matching framework. First, the concept of user active itinerary is well defined for OTPs. Then, several itinerary-aware attention mechanisms that capture the interactions between user active itineraries and other inputs are designed, to better infer users’ travel intentions, preferences, and handle their diverse needs. Then, two learning objectives, i.e., user travel intention prediction and user click behavior prediction, are proposed to be optimized simultaneously. In addition to the FitNET model, its improved version, named FitNET\(^+\), is also proposed. FitNET\(^+\) optimizes FitNET by additionally considering the information of a user’s historical itineraries and devising an effective itinerary weighting unit to control the impact of each historical itinerary on the learning of the user’s preferences. An offline experiment on the Fliggy production dataset and an online A/B test both show that FitNET and FitNET\(^+\) outperform other state-of-the-art methods, due to the idea that a user should be learned based on the granularity of his or her itinerary rather than on a single order. In addition, FitNET\(^+\) further improves FitNET by on average \(9.4\%\) in precision and \(2.4\%\) in hit rate, which indicates the importance of leveraging the historical itineraries of users to better capture their needs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. https://www.fliggy.com/

References

  1. Covington, P., Adams, J., Sargin, E.: Deep neural networks for youtube recommendations. In: Proceedings of the 10th ACM RecSys, pp. 191–198. Boston, MA, USA, September 15-19, 2016, (2016)

  2. Li, C., Liu, Z., Wu, M., Xu, Y., Zhao, H., Huang, P., Kang, G., Chen, Q., Li, W., Lee, D. L.: Multi-interest network with dynamic routing for recommendation at tmall. In: Proceedings of the 28th ACM CIKM, pp. 2615–2623, ACM, Beijing, China, November 3-7, 2019, (2019)

  3. Lv, F., Jin, T., Yu, C., Sun, F., Lin, Q., Yang, K., Ng, W.: SDM: sequential deep matching model for online large-scale recommender system. In: Proceedings of the 28th ACM CIKM, pp. 2635–2643, ACM, Beijing, China, November 3-7, 2019 (2019)

  4. Huang, G., Liu, Z., van der Maaten, L., Weinberger, K. Q.: Densely connected convolutional networks. In: Proceedings of the CVPR (2017)

  5. Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. Computer (2014)

  6. Wang, J., Huang, P., Zhao, H., Zhang, Z., Zhao, B., Lee, D. L.: Billion-scale commodity embedding for e-commerce recommendation in alibaba. In: Proceedings of the 24th ACM SIGKDD, pp. 839–848, ACM, London, UK, August 19–23, 2018, (2018)

  7. Zhang, Y., Lu, H., Niu,W., Caverlee, J.: Quality-aware neural complementary item recommendation. In: Proceedings of the 12th ACM RecSys, pp. 77–85, ACM, Vancouver, BC, Canada October 2–7, 2018, (2018)

  8. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, U., Polosukhin, I.: Attention is all you need. In: Proceedings of the 31st NIPS, Long Beach, p. 6000–6010, California, Curran Associates Inc., USA (2017)

  9. Kang, W., McAuley, J.J.: Self-attentive sequential recommendation. In: Proceedings of the IEEE ICDM, pp. 197–206, IEEE Computer Society, Singapore, November 17–20, 2018 (2018)

  10. Zhang, S., Tay, Y., Yao, L., Sun, A., An, J.: Next item recommendation with self-attentive metric learning. In: Proceedings of the 33rd AAAI, vol. 9 (2019)

  11. Xu, J., Wang, Z., Chen, Z., Lv, D., Yu, Y., Xu, C.: Itinerary-aware personalized deep matching at fliggy. In: Proceedings of the ACM WWW, p. 3234–3245, Ljubljana, Slovenia, April 12–16 (2021)

  12. Zhu, H., Li, X., Zhang, P., Li, G., He, J., Li, H., Gai, K.: Learning tree-based deep model for recommender systems. In: Proceedings of the 24th ACM SIGKDD. pp. 1079–1088, ACM, London, UK, August 19–23, 2018 (2018)

  13. Su, X., Khoshgoftaar, T. M.: A survey of collaborative filtering technique. Adv. Artif. Intell. 2009, 421–425 (2009)

    Google Scholar 

  14. Linden, G., Smith, B., York, J.: Amazon.com recommendations: Item-to-item collaborative filtering. IEEE Internet Comput. 7(1), 76–80 (2003)

    Article  Google Scholar 

  15. Koren, Y.: Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of the 14th ACM SIGKDD, pp. 426–434, ACM, Las Vegas, Nevada, USA, August 24-27, 2008 (2008)

  16. Chen, T., Zhang, W., Lu, Q., Chen, K., Zheng, Z., Yu, Y.: Svdfeature: a toolkit for feature-based collaborative filtering. J. Mach. Learn. Res. 13, 3619–3622 (2012)

    MathSciNet  Google Scholar 

  17. Beutel, A., Murray, K., Faloutsos, C., Smola, A.J.: Cobafi: collaborative bayesian filtering. In: Proceedings of the 23rd WWW, Seoul, pp. 97–108, ACM, Republic of Korea, April 7–11, 2014 (2014)

  18. Abdi, M.H., Okeyo, G.O., Mwangi, R.W.: Matrix factorization techniques for context-aware collaborative filtering recommender systems: A survey. Comput. Inf. Sci. 11(2), 1–10 (2018)

    Google Scholar 

  19. Lyu, Z., Dong, Y., Huo, C., Ren, W.: Deep match to rank model for personalized click-through rate prediction. In: Proceedings of the 34th AAAI, pp. 156–163, AAAI Press, New York, NY, USA, February 7–12, 2020 (2020)

  20. Kabbur, S., Ning, X., Karypis, G.: FISM: factored item similarity models for top-n recommender systems. In: Proceedings of the 19th ACM SIGKDD, pp. 659–667, ACM, Chicago, IL, USA, August 11–14, 2013 (2013)

  21. J. Sun, G. Wang, X. Cheng, and Y. Fu, “Mining affective text to improve social media item recommendation,” Inf. Process. Manag., vol. 51, no. 4, pp. 444–457, 2015

  22. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Annual Conference on Neural Information Processing Systems, pp. 1106–1114, Lake Tahoe, Nevada, United States, December 3–6 (2012)

  23. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7–9, 2015 (2015)

  24. Hinton, G., Salakhutdinov, R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (July2006)

    Article  MathSciNet  MATH  Google Scholar 

  25. Zhou, G., Song, C., Zhu, X., Fan, Y., Zhu, H., Ma, X., Yan, Y., Jin, J., Li, H., Gai, K.: Deep interest network for click-through rate prediction. (2017)

  26. Grbovic, M., Cheng, H.: Real-time personalization using embeddings for search ranking at airbnb. In: Proceedings of the 24th ACM SIGKDD, pp. 311–320, ACM, London, UK, August 19–23, (2018) 2018

  27. Huang, J., Li, Y., Sun, S., Zhang, B., Huang, J.: Personalized flight itinerary ranking at fliggy. In: Proceedings of the 29th ACM CIKM, pp. 2615–2623, Virtual Event, Ireland, October 19–23, 2019 (2020)

  28. Perozzi, B., Al-Rfou, R., Skiena, S.: Deepwalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD, pp. 701–710, ACM, New York, NY, USA, August 24–27, 2014 (2014)

  29. Wang, H., Wang, N., Yeung, D.: Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD, pp. 1235–1244, ACM, Sydney, NSW, Australia, August 10–13, 2015 (2015)

  30. Sedhain, S., Menon, A. K., Sanner, S., Xie, L.: Autorec: Autoencoders meet collaborative filtering. In: Proceedings of the 24th WWW, pp. 111–112, ACM, Florence, Italy, May 18–22 2015 (2015)

  31. He, X., Liao, L., Zhang, H., Nie, L., Hu, X., Chua, T.-S.: Neural collaborative filtering. In: Proceedings of the 26th International Conference on World Wide Web, ser. WWW ’17.Republic and Canton of Geneva, CHE: International World Wide Web Conferences Steering Committee, p. 173–182 (2017)

  32. McMahan, H. B., Holt, G., Sculley, D., Young, M., Ebner, D., Grady, J., Nie, L., Phillips, T., Davydov, E., Golovin, D., Chikkerur, S., Liu, D., Wattenberg, M., Hrafnkelsson, A.M., Boulos, T., Kubica, J.: Ad click prediction: a view from the trenches. In: Proceedings of the 19th ACM SIGKDD. p. 1222–1230 Association for Computing Machinery, New York, NY, USA (2013)

  33. Shan, Y., Hoens, T.R., Jiao, J., Wang, H., Mao, J.C.: Deep crossing: web-scale modeling without manually crafted combinatorial features. In: The 22nd ACM SIGKDD International Conference (2016)

  34. Mikolov, T., Sutskever, I., Chen, K., Corrado,G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Conference on Neural Information Processing Systems 2013, pp. 3111–3119, Lake Tahoe, Nevada, US, December 5–8, 2013 (2013)

  35. Alsmadi, M. K., Omar, K. B., Noah, S. A., Almarashdah, I.: Performance comparison of multi-layer perceptron (back propagation, delta rule and perceptron) algorithms in neural networks. In: IEEE International Advance Computing Conference (2009)

  36. Huang, J., Sharma, A., Sun, S., Xia, L., Zhang, D., Pronin, P., Padmanabhan, J., Ottaviano, G., Yang, L.: Embedding-based retrieval in facebook search. In: Proceedings of the ACM SIGKDD, Virtual Event, pp. 2553–2561, ACM, CA, USA, August 23-27, 2020 (2020)

  37. Jin, F., Hua, W., Zhou, T., Xu, J., Francia, M., Orlowska, M. E., Zhou, X.: Trajectory-based spatiotemporal entity linking IEEE Transactions on Knowledge and Data Engineering, 9:34, (2022)

    Google Scholar 

  38. Chen, W., Yin, H., Wang, W., Zhao, L., Hua, W., Zhou, X.: Exploiting spatio-temporal user behaviors for user linkage. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pp. 517–526 (2017)

  39. Samarati, P.: Protecting respondents identities in microdata release. IEEE transactions on Knowledge and Data Engineering 13(6), 1010–1027 (2001)

    Article  Google Scholar 

  40. Lin, J.-L., Wei, M.-C.: An efficient clustering method for k-anonymization. In: Proceedings of the 2008 international workshop on Privacy and anonymity in information society, pp. 46–50 (2008)

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Zulong Chen or Wanjie Tao.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This work is supported by the National Natural Science Foundation of China (No. 62067001) and the Special funds for Guangxi BaGui Scholars. This work is partially supported by the Guangxi Natural Science Foundation (No. 2019JJA170045).

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, J., Chen, Z., Tao, W. et al. Leveraging user itinerary to improve personalized deep matching at Fliggy. The VLDB Journal 32, 1065–1086 (2023). https://doi.org/10.1007/s00778-023-00787-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00778-023-00787-z

Keywords

Navigation