Deep-Learning Domain Adaptation Techniques for Credit Cards Fraud Detection

  • Bertrand LebichotEmail author
  • Yann-Aël Le Borgne
  • Liyun He-Guelton
  • Frédéric Oblé
  • Gianluca Bontempi
Conference paper
Part of the Proceedings of the International Neural Networks Society book series (INNS, volume 1)


Although the incidence of credit card fraud is limited to a small percentage of transactions, the related financial losses may be huge. This demands the design of automatic Fraud Detection Systems (FDS) able to detect fraudulent transactions with high precision and deal with the heterogeneous nature of the fraudster behavior. Indeed, the nature of the fraud behavior may strongly differ according to the payment system (e.g. e-commerce or shop terminal), the country and the population segment. Given the high cost of designing data-driven FDSs, it is more and more important for transactional companies to reuse existing pipelines and adapt them to different domains and contexts: this boils down to a well-known problem of transfer learning.

This paper deals with deep transfer learning approaches for credit card fraud detection and focuses on transferring classification models learned on a specific category of transactions (e-commerce) to another (face-to-face). In particular we present and discuss two domain adaptation techniques in a deep neural network setting: the first one is an original domain adaptation strategy relying on the creation of additional features to transfer properties of the source domain to the target one and the second is an extension of a recent work of Ganin et al.

The two methods are assessed, together with three state-of-the-art benchmarks, on a five-months dataset (more than 80 million e-commerce and face-to face transactions) provided by a major card issuer.


Fraud detection Domain adaptation Transfer learning 


  1. 1.
    Abdallah, A., Maarof, M.A., Zainal, A.: Fraud detection system. J. Netw. Comput. Appl. 68, 90–113 (2016)CrossRefGoogle Scholar
  2. 2.
    Ahmed, A., Yu, K., Xu, W., Gong, Y., Xing, E.: Training hierarchical feed-forward visual recognition models using transfer learning from pseudo-tasks. In: ECCV (3), pp. 69–82 (2008)Google Scholar
  3. 3.
    Bolton, R., Hand, D.: Statistical fraud detection: a review. Stat. Sci. 17, 235–249 (2002)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Carcillo, F., Dal Pozzolo, A., Le Borgne, Y.A., Caelen, O., Mazzer, Y., Bontempi, G.: SCARFF: a scalable framework for streaming credit card fraud detection with spark. Inf. Fusion 41(C), 182–194 (2018)CrossRefGoogle Scholar
  5. 5.
    Caruana, R.: Multitask learning. Mach. Learn. 28(1), 41–75 (1997)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Chollet, F., et al.: Keras (2015).
  7. 7.
    Chopra, S., Balakrishnan, S., Gopalan, R.: DLID: deep learning for domain adaptation by interpolating between domains. In: ICML Workshop on Challenges in Representation Learning (2013)Google Scholar
  8. 8.
    Ciresan, D.C., Meier, U., Schmidhuber, J.: Transfer learning for Latin and Chinese characters with deep neural networks. In: IJCNN, pp. 1–6. IEEE (2012)Google Scholar
  9. 9.
    Dai, W., Yang, Q., Xue, G.R., Yu, Y.: Boosting for transfer learning. In: Proceedings of the 24th International Conference on Machine Learning, ICML 2007, pp. 193–200. ACM (2007)Google Scholar
  10. 10.
    Dal Pozzolo, A., Boracchi, G., Caelen, O., Alippi, C., Bontempi, G.: Credit card fraud detection and concept-drift adaptation with delayed supervised information. In: Proceedings of the International Joint Conference on Neural Networks, pp. 1–8. IEEE (2015)Google Scholar
  11. 11.
    Dal Pozzolo, A., Boracchi, G., Caelen, O., Alippi, C., Bontempi, G.: Credit card fraud detection: a realistic modeling and a novel learning strategy. IEEE Trans. Neural Netw. Learn. Syst. 29(8), 3784–3797 (2018)CrossRefGoogle Scholar
  12. 12.
    Dal Pozzolo, A., Caelen, O., Le Borgne, Y.A., Waterschoot, S., Bontempi, G.: Learned lessons in credit card fraud detection from a practitioner perspective. Expert. Syst. Appl. 10(41), 4915–4928 (2014)CrossRefGoogle Scholar
  13. 13.
    Daume III, H.: Frustratingly easy domain adaptation. In: Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pp. 256–263. Association for Computational Linguistics, Prague, Czech Republic, June 2007Google Scholar
  14. 14.
    Demsar, J.: Statistical comparaison of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)MathSciNetzbMATHGoogle Scholar
  15. 15.
    Fawcett, T., Provost, F.: Adaptive fraud detection. Data Min. Knowl. Discov. 1, 291–316 (1997)CrossRefGoogle Scholar
  16. 16.
    Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., Lempitsky, V.: Domain-adversarial training of neural networks. J. Mach. Learn. Res. 17(1), 2096–2030 (2016)MathSciNetzbMATHGoogle Scholar
  17. 17.
    Gao, J., Fan, W., Jiang, J., Han, J.: Knowledge transfer via multiple model local structure mapping. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2008, pp. 283–291. ACM, New York (2008)Google Scholar
  18. 18.
    Glorot, X., Bordes, A., Bengio, Y.: Domain adaptation for large-scale sentiment classification: a deep learning approach. In: Proceedings of the Twenty-eight International Conference on Machine Learning, ICML (2011)Google Scholar
  19. 19.
    Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning, 2nd edn. Springer, New York (2009)CrossRefGoogle Scholar
  20. 20.
    HSN Consultants, Inc.: The Nilson report (consulted on 2018-10-23) (2017).
  21. 21.
    Jurgovsky, J., Granitzer, M., Ziegler, K., Calabretto, S., Portier, P.E., He, L., Caelen, O.: Sequence classification for credit-card fraud detection. Expert. Syst. Appl. 100, 234–245 (2018)CrossRefGoogle Scholar
  22. 22.
    Lebichot, B., Braun, F., Caelen, O., Saerens, M.: A graph-based, semi-supervised, credit card fraud detection system, pp. 721–733. Springer, Cham (2017)Google Scholar
  23. 23.
    Lu, J., Behbood, V., Hao, P., Zuo, H., Xue, S., Zhang, G.: Transfer learning using computational intelligence: a survey. Knowl. Based Syst. 80, 14–23 (2015)CrossRefGoogle Scholar
  24. 24.
    Margolis, A.: A literature review of domain adaptation with unlabeled data. Technical report, University of Washington (2011)Google Scholar
  25. 25.
    Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)CrossRefGoogle Scholar
  26. 26.
    Pan, S.J., Yang, Q., et al.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)CrossRefGoogle Scholar
  27. 27.
    Sugiyama, M., Kawanabe, M.: Machine Learning in Non-Stationary Environments: Introduction to Covariate Shift Adaptation. The MIT Press, Cambridge (2012)CrossRefGoogle Scholar
  28. 28.
    Tan, S., Cheng, X., Wang, Y., Xu, H.: Adapting Naive Bayes to domain adaptation for sentiment analysis. In: Proceedings of the 31th European Conference on IR Research on Advances in Information Retrieval, ICML 2009, pp. 337–349. Springer (2009)Google Scholar
  29. 29.
    Van Vlasselaer, V., Bravo, C., Caelen, O., Eliassi-Rad, T., Akoglu, L., Snoeck, M., Baesens, B.: APATE: a novel approach for automated credit card transaction fraud detection using network-based extensions. Decis. Support Syst. 75, 38–48 (2015)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Machine Learning Group, Computer Science Department, Faculty of SciencesULB, Université Libre de BruxellesCity of BrusselsBelgium
  2. 2.High Processing & Volume, R&D, WorldlineLyonFrance

Personalised recommendations