Abstract
Cross-Project Defect Prediction (CPDP) is an attractive topic for locating defects in projects with little labeled data (target projects) by using the prediction model from other projects with sufficient data (source projects). However, previous models may not fully capture the semantic features of programs because of inappropriate feature extraction models. Besides, researchers may fail to consider the relationship between the decision boundary and target project data when matching two feature distributions by adopting transfer learning methods, which would lead to the misclassification of target samples that are near boundary. To handle these drawbacks, we propose a novel Adversarial Domain Adaptation (ADA) model for CPDP. Specifically, we leverage a Long Short-Term Memory network with attention mechanism to extract semantic features that better represent programs. Then, we train two classifiers to correctly categorize source samples and distinguish ambiguous target instances that influence prediction accuracy. Next, we treat the classifiers as a discriminator and feature extraction model as a generator, and train them based on adversarial learning methods to depict the desired relationship. As the classifiers know this relationship, they should attain better performance. Extensive experiments on two benchmark datasets are conducted to verify the effectiveness of the proposed ADA methods. Experimental and statistical results show that ADA significantly outperforms other state-of-the-art baseline methods.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability Statements
The PROMISE dataset we use in this work is available at https://doi.org/10.1145/1868328.1868342. The AEEEM dataset we use in this work is available at https://doi.org/10.1109/MSR.2010.5463279. The implementation of the proposed ADA model is available from the corresponding author on a reasonable request.
References
Almeida F, Xexéo G (2019) Word embeddings: A survey
Alon U, Zilberstein M, Levy O, Yahav E (2019) Code2vec: Learning distributed representations of code. Proc ACM Program Lang 3 (POPL). https://doi.org/10.1145/3290353
Bal PR, Kumar S (2020) Wr-elm: Weighted regularization extreme learning machine for imbalance learning in software fault prediction. IEEE Trans Reliab 69(4):1355–1375. https://doi.org/10.1109/TR.2020.2996261
Bal PR, Kumar S (2023) A data transfer and relevant metrics matching based approach for heterogeneous defect prediction. IEEE Trans Softw Eng 49(3):1232–1245. https://doi.org/10.1109/TSE.2022.3173678
Balog M, Gaunt AL, Brockschmidt M, Nowozin S, Tarlow D (2017) Deepcoder: Learning to write programs. In: Proceedings of the 5th International Conference on Learning Representations (ICLR). https://openreview.net/forum?id=ByldLrqlx
Balogun AO, Basri S, Capretz LF, Mahamad S, Imam AA, Almomani MA, Adeyemo VE, Kumar, G (2021) An adaptive rank aggregation-based ensemble multi-filter feature selection method in software defect prediction. Entropy 23(10). https://doi.org/10.3390/e23101274
Bekkar M, Djemaa HK, Alitouche TA (2013) Evaluation measures for models assessment over imbalanced data sets. J Inf Eng Appl 3(10):27–38. https://eva.fing.edu.uy/pluginfile.php/69453/mod_resource/content/1/7633-10048-1-PB.pdf
Borgwardt KM, Gretton A, Rasch MJ, Kriegel HP, Schölkopf B, Smola AJ (2006) Integrating structured biological data by kernel maximum mean discrepancy. Bioinformatics 22(14):e49–e57. https://doi.org/10.1093/bioinformatics/btl242
Briand LC, Melo WL, Wust J (2002) Assessing the applicability of fault-proneness models across object-oriented software projects. IEEE Trans Softw Eng 28(7):706–720. https://doi.org/10.1109/TSE.2002.1019484
Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP (2002) Smote: Synthetic minority over-sampling technique. J Artif Intell Res 16:321–357. https://doi.org/10.1613/jair.953
Chen H, Jing XY, Li Z, Wu D, Peng Y, Huang Z (2021) An empirical study on heterogeneous defect prediction approaches. IEEE Trans Softw Eng 47(12):2803–2822. https://doi.org/10.1109/TSE.2020.2968520
Chen L, Fang B, Shang Z, Tang Y (2015) Negative samples reduction in cross-company software defects prediction. Inf Softw Technol 62:67–77. https://doi.org/10.1016/j.infsof.2015.01.014
Chen L, Li J, Peng J, Xie T, Cao Z, Xu K, He X, Zheng Z (2020) A survey of adversarial learning on graphs
Chen X, Liu C, Shin R, Song D, Chen M (2016) Latent attention for if-then program synthesis. In: Proceedings of the 30th International Conference on Neural Information Processing Systems, NIPS’16, pp 4581–4589. Red Hook, NY, USA. https://dl.acm.org/doi/pdf/10.5555/3157382.3157609
Chidamber SR, Kemerer CF (1994) A metrics suite for object oriented design. IEEE Trans Softw Eng 20(6):476–493. https://doi.org/10.1109/32.295895
Compton R, Frank E, Patros P, Koay A (2020) Embedding java classes with code2vec: Improvements from variable obfuscation. In: Proceedings of the 17th International Conference on Mining Software Repositories, pp 243–253. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3379597.3387445
Dai W, Yang Q, Xue GR, Yu Y (2007) Boosting for transfer learning. In: Proceedings of the 24th International Conference on Machine Learning, ICML ’07, pp 193–200. Association for Computing Machinery, New York, NY, USA. ewblock https://doi.org/10.1145/1273496.1273521
D’Ambros M, Lanza M, Robbes R (2010) An extensive comparison of bug prediction approaches. In: 2010 7th IEEE Working Conference on Mining Software Repositories (MSR 2010), pp 31–41. https://doi.org/10.1109/MSR.2010.5463279
Deng J, Lu L, Qiu S (2020) Software defect prediction via lstm. IET Software 14(4):443–450. https://doi.org/10.1049/iet-sen.2019.0149
Gong L, Jiang S, Bo L, Jiang L, Qian J (2020) A novel class-imbalance learning approach for both within-project and cross-project defect prediction. IEEE Trans Reliab 69(1):40–54. https://doi.org/10.1109/TR.2019.2895462
Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 2, NIPS’14, pp 2672–2680. MIT Press, Cambridge, MA, USA. https://proceedings.neurips.cc/paper/2014/file/5ca3e9b122f61f8f06494c97b1afccf3-Paper.pdf
Halstead MH (1977) Elements of Software Science (Operating and Programming Systems Series). Elsevier Science Inc
He H, Garcia EA (2009) Learning from imbalanced data. IEEE Trans Knowl Data Eng 21(9):1263–1284. https://doi.org/10.1109/TKDE.2008.239
He P, Li B, Liu X, Chen J, Ma Y (2015) An empirical study on software defect prediction with a simplified metric set. Inf Softw Technol 59:170–190. https://doi.org/10.1016/j.infsof.2014.11.006
He Z, Shu F, Yang Y, Li M, Wang Q (2012) An investigation on the feasibility of cross-project defect prediction. Autom Softw Eng 19(2):167–199. https://doi.org/10.1007/s10515-011-0090-3
Herbold S (2013) Training data selection for cross-project defect prediction. In: Proceedings of the 9th International Conference on Predictive Models in Software Engineering, pp 1–10. https://doi.org/10.1145/2499393.2499395
Herbold S, Trautsch A, Grabowski J (2018) A comparative study to benchmark cross-project defect prediction approaches. IEEE Trans Softw Eng 44(9):811–833. https://doi.org/10.1109/TSE.2017.2724538
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735
Hosseini S, Turhan B, Gunarathna D (2019) A systematic literature review and meta-analysis on cross project defect prediction. IEEE Trans Softw Eng 45(2):111–147. https://doi.org/10.1109/TSE.2017.2770124
Hosseini S, Turhan B, Mäntylä M (2018) A benchmark study on the effectiveness of search-based data selection and feature selection for cross project defect prediction. Inf Softw Technol 95:296–312. https://doi.org/10.1016/j.infsof.2017.06.004
Huang J, Guan X, Li S (2021) Software defect prediction model based on attention mechanism. In: 2021 International Conference on Computer Engineering and Application (ICCEA), pp 338–345. IEEE. https://doi.org/10.1109/ICCEA53728.2021.00073
Huang Q, Ma L, Jiang S, Wu G, Song H, Jiang L, Zheng C (2021) A cross-project defect prediction method based on multi-adaptation and nuclear norm. IET Softw pp 1–14. https://doi.org/10.1049/sfw2.12053
Jin C (2021) Cross-project software defect prediction based on domain adaptation learning and optimization. Expert Syst Appl 171:114637. https://doi.org/10.1016/j.eswa.2021.114637
Jing X, Wu F, Dong X, Qi F, Xu B (2015) Heterogeneous cross-company defect prediction by unified metric representation and cca-based transfer learning. In: Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering, pp 496-507. Association for Computing Machinery. https://doi.org/10.1145/2786805.2786813
Jing XY, Wu F, Dong X, Xu B (2017) An improved sda based defect prediction framework for both within-project and cross-project class-imbalance problems. IEEE Trans Softw Eng 43(4):321–339. https://doi.org/10.1109/TSE.2016.2597849
Jing XY, Ying S, Zhang ZW, Wu SS, Liu J (2014) Dictionary learning based software defect prediction. In: Proceedings of the 36th International Conference on Software Engineering, ICSE 2014, pp 414–423. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/2568225.2568320
Jureczko M, Madeyski L (2010) Towards identifying software project clusters with regard to defect prediction. In: Proceedings of the 6th International Conference on Predictive Models in Software Engineering, pp 1–10. https://doi.org/10.1145/1868328.1868342
Khatri Y, Singh SK (2021) Cross project defect prediction: A comprehensive survey with its swot analysis. Innovations Syst Softw Eng pp 1–19. https://doi.org/10.1007/s11334-020-00380-5
Kingma DP, Ba J (2017) Adam: A method for stochastic optimization
Kubat M, Matwin S (1997) Addressing the curse of imbalanced training sets: One-sided selection. In: In Proceedings of the 14th International Conference on Machine Learning, pp 179–186. Morgan Kaufmann. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.43.4487 &rep=rep1 &type=pdf
LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444. https://doi.org/10.1038/nature14539
Li H, Li X, Chen X, Xie X, Mu Y, Feng Z (2019) Cross-project defect prediction via asttoken2vec and blstm-based neural network. In: 2019 International Joint Conference on Neural Networks (IJCNN), pp 1–8. https://doi.org/10.1109/IJCNN.2019.8852135
Li J, He P, Zhu J, Lyu MR (2017) Software defect prediction via convolutional neural network. In: 2017 IEEE International Conference on Software Quality, Reliability and Security (QRS), pp 318–328. https://doi.org/10.1109/QRS.2017.42
Li Y, Yuan L, Vasconcelos N (2019) Bidirectional learning for domain adaptation of semantic segmentation. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 6929–6938. https://doi.org/10.1109/CVPR.2019.00710
Li Z, Jing XY, Wu F, Zhu X, Xu B, Ying S (2018) Cost-sensitive transfer kernel canonical correlation analysis for heterogeneous defect prediction. Autom Softw Eng 25:201–245. https://doi.org/10.1007/s10515-017-0220-7
Li Z, Jing XY, Zhu X (2018) Progress on approaches to software defect prediction. IET Softw 12(3):161–175. https://doi.org/10.1049/iet-sen.2017.0148
Li Z, Jing XY, Zhu X, Zhang H, Xu B, Ying S (2019) Heterogeneous defect prediction with two-stage ensemble learning. Autom Softw Eng 26:599–651. https://doi.org/10.1007/s10515-019-00259-1
Li Z, Jing XY, Zhu X, Zhang H, Xu B, Ying S (2019) On the multiple sources and privacy preservation issues for heterogeneous defect prediction. IEEE Trans Softw Eng 45(4):391–411. https://doi.org/10.1109/TSE.2017.2780222
Liang H, Yu Y, Jiang L, Xie Z (2019) Seml: A semantic lstm model for software defect prediction. IEEE Access 7:83812–83824
Liu C, Yang D, Xia X, Yan M, Zhang X (2019) A two-phase transfer learning model for cross-project defect prediction. Inf Softw Technol 107:125–136. https://doi.org/10.1016/j.infsof.2018.11.005
Ma X, Mou X, Wang J, Liu X, Geng J, Wang H (2021) Cross-dataset hyperspectral image classification based on adversarial domain adaptation. IEEE Trans Geosci Remote Sens 59(5):4179–4190. https://doi.org/10.1109/TGRS.2020.3015357
McCabe TJ (1976) A complexity measure. IEEE Trans Softw Eng SE-2(4):308–320. https://doi.org/10.1109/TSE.1976.233837
Nam J, Kim S (2015) Heterogeneous defect prediction. In: Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering, pp 508–519. Association for Computing Machinery. https://doi.org/10.1145/2786805.2786814
Nam J, Pan SJ, Kim S (2013) Transfer defect learning. In: 2013 35th International Conference on Software Engineering (ICSE), pp 382–391. https://doi.org/10.1109/ICSE.2013.6606584
Ni C, Chen X, Wu F, Shen Y, Gu Q (2019) An empirical study on pareto based multi-objective feature selection for software defect prediction. J Syst Softw 152:215–238. https://doi.org/10.1016/j.jss.2019.03.012
Pan SJ, Tsang IW, Kwok JT, Yang Q (2010) Domain adaptation via transfer component analysis. IEEE Trans Neural Networks 22(2):199–210. https://doi.org/10.1109/TNN.2010.2091281
Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359. https://doi.org/10.1109/TKDE.2009.191
Pandey SK, Tripathi AK (2021) Dnnattention: A deep neural network and attention based architecture for cross project defect number prediction. Knowl-Based Syst 233:107541. https://doi.org/10.1016/j.knosys.2021.107541
Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, Killeen T, Lin Z, Gimelshein N, Antiga L, Desmaison A, Kopf A, Yang E, DeVito Z, Raison M, Tejani A, Chilamkurthy S, Steiner B, Fang L, Bai J, Chintala S (2019) Pytorch: An imperative style, high-performance deep learning library. In: Advances in Neural Information Processing Systems, 32, pp 8024–8035. https://proceedings.neurips.cc/paper/2019/file/bdbca288fee7f92f2bfa9f7012727740-Paper.pdf
Qiu S, Lu L, Cai Z, Jiang S (2019a) Cross-project defect prediction via transferable deep learning-generated and handcrafted features. In: The 31st International Conference on Software Engineering and Knowledge Engineering, pp 431–436. https://doi.org/10.18293/SEKE2019-070
Qiu S, Lu L, Jiang S (2019) Joint distribution matching model for distribution-adaptation-based cross-project defect prediction. IET Softw 13(5):393–402. https://doi.org/10.1049/iet-sen.2018.5131
Qiu S, Lu L, Jiang S, Guo Y (2019) An investigation of imbalanced ensemble learning methods for cross-project defect prediction. Int J Pattern Recogn Artif Intell 33(12):1959037. https://doi.org/10.1142/S0218001419590377
Qiu S, Xu H, Deng J, Jiang S, Lu L (2019) Transfer convolutional neural network for cross-project defect prediction. Appl Sci 9(13):2660. https://doi.org/10.3390/app9132660
Rathore SS, Kumar S (2021) An empirical study of ensemble techniques for software fault prediction. Appl Int 51:3615–3644. https://doi.org/10.1007/s10489-020-01935-6
Ryu D, Choi O, Baik J (2016) Value-cognitive boosting with a support vector machine for cross-project defect prediction. Empir Softw Eng 21(1):43–71. https://doi.org/10.1007/s10664-014-9346-4
Ryu D, Jang JI, Baik J (2017) A transfer cost-sensitive boosting approach for cross-project defect prediction. Softw Qual J 25(1):235–272. https://doi.org/10.1007/s11219-015-9287-1
Saito K, Watanabe K, Ushiku Y, Harada T (2018) Maximum classifier discrepancy for unsupervised domain adaptation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2018). https://doi.org/10.1109/CVPR.2018.00392
Shepperd M, Bowes D, Hall T (2014) Researcher bias: The use of machine learning in software defect prediction. IEEE Trans Softw Eng 40(6):603–616. https://doi.org/10.1109/TSE.2014.2322358
Song Q, Guo Y, Shepperd M (2019) A comprehensive investigation of the role of imbalanced learning for software defect prediction. IEEE Trans Softw Eng 45(12):1253–1269. https://doi.org/10.1109/TSE.2018.2836442
Song S, Yu H, Miao Z, Fang J, Zheng K, Ma C, Wang S (2020) Multi-spectral salient object detection by adversarial domain adaptation. Proceedings of the AAAI Conference on Artificial Intelligence 34:12023–12030. https://doi.org/10.1609/aaai.v34i07.6879
Su JC, Tsai YH, Sohn K, Liu B, Maji S, Chandraker M (2020) Active adversarial domain adaptation. In: 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), pp 728–737. https://doi.org/10.1109/WACV45572.2020.9093390
Tantithamthavorn C, McIntosh S, Hassan AE, Matsumoto K (2016) An empirical comparison of model validation techniques for defect prediction models. IEEE Trans Softw Eng 43(1):1–18. https://doi.org/10.1109/TSE.2016.2584050
Thota MK, Shajin FH, Rajesh P (2020) Survey on software defect prediction techniques. Int J Appl Sci Eng 17:331–344. https://doi.org/10.6703/IJASE.202012_17(4).331
Tong H, Liu B, Wang S, Li Q (2019) Transfer-learning oriented class imbalance learning for cross-project defect prediction
Turhan B, Menzies T, Bener AB, Di Stefano J (2009) On the relative value of cross-company and within-company data for defect prediction. Empir Softw Eng 14(5):540–578. https://doi.org/10.1007/s10664-008-9103-7
Tzeng E, Hoffman J, Saenko K, Darrell T (2017) Adversarial discriminative domain adaptation. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 2962–2971. https://doi.org/10.1109/CVPR.2017.316
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin, I (2017) Attention is all you need. In: Proceedings of the 31st International Conference on Neural Information Processing Systems, NIPS’17, pp 6000-6010. Curran Associates Inc., Red Hook, NY, USA. https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf
Veličković P, Cucurull G, Casanova A, Romero A, Lió P, Bengio Y (2018) Graph attention networks. In: Proceedings of the 6th International Conference on Learning Representations (ICLR). https://openreview.net/forum?id=rJXMpikCZ
Wang K, Chen G, Huang Z, Wan X, Huang F (2021) Bridging the domain gap: Improve informal language translation via counterfactual domain adaptation. In: Proceedings of the AAAI Conference on Artificial Intelligence, 35, pp 13970–13978. https://ojs.aaai.org/index.php/AAAI/article/view/17645
Wang S, Liu T, Nam J, Tan L (2020) Deep semantic feature learning for software defect prediction. IEEE Trans Softw Eng 46(12):1267–1293. https://doi.org/10.1109/TSE.2018.2877612
Wang S, Liu T, Tan L (2016) Automatically learning semantic features for defect prediction. In: 2016 IEEE/ACM 38th International Conference on Software Engineering (ICSE), pp 297–308. https://doi.org/10.1145/2884781.2884804
Watanabe S, Kaiya H, Kaijiri K (2008) Adapting a fault prediction model to allow inter languagereuse. In: Proceedings of the 4th International Workshop on Predictor Models in Software Engineering, PROMISE ’08, pp 19–24. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/1370788.1370794
Wilcoxon F (1945) Individual comparisons by ranking methods. Biom Bull 1(6):80–83. https://doi.org/10.2307/3001968
Wu F, Jing XY, Sun Y, Sun J, Huang L, Cui F, Sun Y (2018) Cross-project and within-project semisupervised software defect prediction: A unified approach. IEEE Trans Reliab 67(2):581–597. https://doi.org/10.1109/TR.2018.2804922
Xu Z, Pang S, Zhang T, Luo XP, Liu J, Tang YT, Yu X, Xue L (2019) Cross project defect prediction via balanced distribution adaptation based transfer learning. J Comput Sci Technol 34(5):1039–1062. https://doi.org/10.1007/s11390-019-1959-z
Xu Z, Yuan P, Zhang T, Tang Y, Li S, Xia Z (2018) Hda: Cross-project defect prediction via heterogeneous domain adaptation with dictionary learning. IEEE Access 6:57597–57613. https://doi.org/10.1109/ACCESS.2018.2873755
Yi L, Gong B, Funkhouser T (2021) Complete & label: A domain adaptation approach to semantic segmentation of lidar point clouds. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 15363–15373. https://doi.org/10.1109/CVPR46437.2021.01511
Yu Q, Jiang S, Zhang Y (2017) A feature matching and transfer approach for cross-company defect prediction. J Syst Softw 132:366–378. https://doi.org/10.1016/j.jss.2017.06.070
Zeng J, Wu S, Yin Y, Jiang Y, Li M (2021) Recurrent attention for neural machine translation. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pp 3216–3225. https://doi.org/10.18653/v1/2021.emnlp-main.258
Zhu K, Ying S, Zhang N, Zhu D (2021) Software defect prediction based on enhanced metaheuristic feature selection optimization and a hybrid deep neural network. J Syst Softw 180:111026. https://doi.org/10.1016/j.jss.2021.111026
Zimmermann T, Nagappan N, Gall H, Giger E, Murphy B (2009) Cross-project defect prediction: A large scale experiment on data vs. domain vs. process. In: Proceedings of the 7th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering, pp 91–100. https://doi.org/10.1145/1595696.1595713
Zou Q, Lu L, Yang Z, Gu X, Qiu S (2021) Joint feature representation learning and progressive distribution matching for cross-project defect prediction. Inf Softw Technol 137:106588. https://doi.org/10.1016/j.infsof.2021.106588
Özakıncı R, Tarhan A (2018) Early software defect prediction: A systematic map and review. J Syst Softw 144:216–239. https://doi.org/10.1016/j.jss.2018.06.025
Acknowledgements
This work was supported by the Science and Technology Planning Project of Guangzhou (Grant No. 202102020637).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Communicated by: Leandro L. Minku.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Song, H., Wu, G., Ma, L. et al. Adversarial domain adaptation for cross-project defect prediction. Empir Software Eng 28, 127 (2023). https://doi.org/10.1007/s10664-023-10371-2
Accepted:
Published:
DOI: https://doi.org/10.1007/s10664-023-10371-2