Skip to main content
SpringerLink
Log in

Evidential combination of augmented multi-source of information based on domain adaptation

  • Research Paper
  • Special Focus on Multi-source Information Fusion
  • Published:
Science China Information Sciences Aims and scope Submit manuscript

Abstract

In the applications of domain adaptation (DA), there may exist multiple source domains, and each source domain usually provides some auxiliary information for object classification. The combination of such complementary knowledge from different source domains is helpful for improving the accuracy. We propose an evidential combination of augmented multi-source of information (ECAMI) method. The information sources are augmented at first by merging several randomly selected source domains to generate extra auxiliary information. We can obtain one piece of classification result with the assistance of each information source based on DA. Then these multiple classification results are combined by belief functions theory, which is expert at dealing with the uncertain information. Nevertheless, the classification results derived from different information sources may have different weights. The optimal weights are calculated by minimizing an given error criteria defined by the distance between the combination result and the ground truth using some training data. For each object, the augmented information sources will produce multiple classification results that will be discounted by the learnt weights under the belief functions framework. Then the combination of these discounted results is employed to make the final class decision. The effectiveness of ECAMI is evaluated with respect to some related methods based on several real data sets, and the experimental results show that ECAMI can significantly improve the classification accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Pan S J, Yang Q. A survey on transfer learning. IEEE Trans Knowl Data Eng, 2010, 22: 1345–1359

    Google Scholar 

  2. Dai W, Yang Q, Xue G-R, et al. Boosting for transfer learning. In: Proceedings of the International Conference on Machine Learning, 2007. 193–200

    Google Scholar 

  3. Pan S J, Tsang I W, Kwok J T, et al. Domain adaptation via transfer component analysis. IEEE Trans Neural Netw, 2011, 22: 199–210

    Google Scholar 

  4. Long M, Wang J, Ding G, et al. Transfer feature learning with joint distribution adaptation. In: Proceedings of the IEEE International Conference on Computer Vision, 2013. 2200-2207

    Google Scholar 

  5. Fernando B, Habrard A, Sebban M, et al. Unsupervised visual domain adaptation using subspace alignment. In: Proceedings of the IEEE International Conference on Computer Vision, 2014. 2960–2967

    Google Scholar 

  6. Gong B, Shi Y, Sha F, et al. Geodesic flow kernel for unsupervised domain adaptation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2012. 2066–2073

    Google Scholar 

  7. Wang J, Chen Y, Hao S, et al. Balanced distribution adaptation for transfer learning. In: Proceedings of the IEEE International Conference on Data Mining, 2017. 1129–1134

    Google Scholar 

  8. Deng W Y, Lendasse A, Ong Y S, et al. Domain adaption via feature selection on explicit feature map. IEEE Trans Neural Netw Learn Syst, 2019, 30: 1180–1190

    MathSciNet  Google Scholar 

  9. Wen L, Gao L, Li X. A new deep transfer learning based on sparse auto-encoder for fault diagnosis. IEEE Trans Syst Man Cybern Syst, 2019, 49: 136–144

    Google Scholar 

  10. Long M, Cao Y, Cao Z, et al. Transferable representation learning with deep adaptation networks. IEEE Trans Pattern Anal Mach Intell, 2019, 41: 3071–3085

    Google Scholar 

  11. Tzeng E, Hoffman J, Saenko K, et al. Adversarial discriminative domain adaptation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017. 7167–7176

    Google Scholar 

  12. Sun S, Shi H, Wu Y. A survey of multi-source domain adaptation. Inf Fusion, 2015, 24: 84–92

    Google Scholar 

  13. Liu H, Shao M, Fu Y. Structure-preserved multi-source domain adaptation. In: Proceedings of the IEEE International Conference on Data Mining, 2016. 1059–1064

    Google Scholar 

  14. Duan L X, Xu D, Tsang I W. Domain adaptation from multiple sources: a domain-dependent regularization approach. IEEE Trans Neural Netw Learn Syst, 2012, 23: 504–518

    Google Scholar 

  15. Ding Z, Shao M, Fu Y. Incomplete multisource transfer learning. IEEE Trans Neural Netw Learn Syst, 2018, 29: 310–323

    MathSciNet  Google Scholar 

  16. Zhu Y, Zhuang F, Zhuang D. Aligning domain-specific distribution and classifier for cross-domain classification from multiple sources. In: Proceedings of the AAAI Conference on Artificial Intelligence, 2019. 5989–5996

    Google Scholar 

  17. Xu R, Chen Z, Zuo W, et al. Deep cocktail network: multi-source unsupervised domain adaptation with category shift. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018. 3964–3973

    Google Scholar 

  18. Zhao H, Zhang S, Wu G, et al. Multiple source domain adaptation with adversarial learning. In: Proceedings of the International Conference on Learning Representations, 2018. 8559–8570

    Google Scholar 

  19. Pizzi N J, Pedrycz W. Aggregating multiple classification results using fuzzy integration and stochastic feature selection. Int J Approximate Reasoning, 2010, 51: 883–894

    Google Scholar 

  20. Shafer G. A Mathematical Theory of Evidence. Princeton: Princeton University Press, 1976. 42

    MATH  Google Scholar 

  21. Liu Z G, Pan Q, Dezert J, et al. Combination of classifiers with optimal weight based on evidential reasoning. IEEE Trans Fuzzy Syst, 2018, 26: 1217–1230

    Google Scholar 

  22. Liu Z G, Huang L Q, Zhou K, et al. Combination of transferable classification with multisource domain adaptation based on evidential reasoning. IEEE Trans Neural Netw Learn Syst, 2020. doi: 10.1109/TNNLS.2020.2995862

    Google Scholar 

  23. Kobetski M, Sullivan J. Apprenticeship learning: transfer of knowledge via dataset augmentation. In: Proceedings of the Scandinavian Conference on Image Analysis, 2013. 432–443

    Google Scholar 

  24. Aftab U, Siddiqui G. Big data augmentation with data warehouse: a survey. In: Proceedings of the IEEE International Conference on Big Data, 2018. 2775–2784

    Google Scholar 

  25. Shao L, Zhu F, Li X L. Transfer learning for visual categorization: a survey. IEEE Trans Neural Netw Learn Syst, 2015, 26: 1019–1034

    MathSciNet  Google Scholar 

  26. Chen Y, Song S, Li S, et al. Domain space transfer extreme learning machine for domain adaptation. IEEE Trans Cybern, 2019, 49: 1909–1922

    Google Scholar 

  27. Raina R, Battle A, Lee H, et al. Self-taught learning: transfer learning from unlabeled data. In: Proceedings of the International Conference on Machine learning, 2007. 759–766

    Google Scholar 

  28. Xu Y, Pan S J, Xiong H, et al. A unified framework for metric transfer learning. IEEE Trans Knowl Data Eng, 2017, 29: 1158–1171

    Google Scholar 

  29. Li S, Song S, Huang G, et al. Cross-domain extreme learning machines for domain adaptation. IEEE Trans Syst Man Cybern Syst, 2019, 49: 1194–1207

    Google Scholar 

  30. Borgwardt K M, Gretton A, Rasch M J, et al. Integrating structured biological data by Kernel Maximum Mean Discrepancy. Bioinformatics, 2006, 22: e49–e57

    Google Scholar 

  31. Ben-David S, Blitzer J, Crammer K, et al. Analysis of representations for domain adaptation. In: Proceedings of the International Conference on Neural Information Processing Systems, 2007. 137–144

    Google Scholar 

  32. Denœux T. Decision-making with belief functions: a review. Int J Approximate Reasoning, 2019, 109: 87–110

    MathSciNet  MATH  Google Scholar 

  33. Denœux T. Logistic regression, neural networks and Dempster-Shafer theory: a new perspective. Knowledge-Based Syst, 2019, 176: 54–67

    Google Scholar 

  34. Denœux T. A k-nearest neighbor classification rule based on Dempster-Shafer theory. IEEE Trans Syst Man Cybern, 1995, 25: 804–813

    Google Scholar 

  35. Liu Z, Pan Q, Dezert J, et al. Credal c-means clustering method based on belief functions. Knowledge-Based Syst, 2015, 74: 119–132

    Google Scholar 

  36. Zhou Z J, Liu T Y, Hu G Y, et al. Fault-alarm-threshold optimization method based on interval evidence reasoning. Sci China Inf Sci, 2019, 62: 089202

    Google Scholar 

  37. Si X S, Zhou C H, Hu Z J. Fault prediction model based on evidential reasoning approach. Sci China Inf Sci, 2010, 53: 2032–2046

    Google Scholar 

  38. Han S P. A globally convergent method for nonlinear programming. J Opt Theor Appl, 1977, 22: 297–309

    MathSciNet  MATH  Google Scholar 

  39. Sun B, Feng J, Saenko K. Return of frustratingly easy domain adaptation. In: Proceedings of the AAAI Conference on Artificial Intelligence, 2016. 2058–2065

    Google Scholar 

  40. Long M, Wang J, Ding G, et al. Transfer joint matching for unsupervised domain adaptation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014. 1410–1417

    Google Scholar 

  41. Dezert J, Tchamova A. On the validity of Dempster’s fusion rule and its interpretation as a generalization of Bayesian fusion rule. Int J Intell Syst, 2014, 29: 223–252

    Google Scholar 

Download references

Acknowledgements

This work was partially supported by National Natural Science Foundation of China (Grant Nos. 61672431, 61790552, 61790554, 61701409), Shaanxi Science Fund for Distinguished Young Scholars (Grant No. 2018JC-006), and Fundamental Research Funds for the Central Universities.

Author information

Authors and Affiliations

  1. School of Automation, Northwestern Polytechnical University, Xi’an, 710072, China

    Linqing Huang, Zhunga Liu & Quan Pan

  2. ONERA-The French Aerospace Lab, Palaiseau, F-91761, France

    Jean Dezert

Authors
  1. Linqing Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhunga Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Quan Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jean Dezert
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhunga Liu.

Electronic supplementary material

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huang, L., Liu, Z., Pan, Q. et al. Evidential combination of augmented multi-source of information based on domain adaptation. Sci. China Inf. Sci. 63, 210203 (2020). https://doi.org/10.1007/s11432-020-3080-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11432-020-3080-3

Keywords

Search

Navigation