A Joint Unsupervised Cross-Domain Model via Scalable Discriminative Extreme Learning Machine
Extreme learning machine (ELM) is a well-known cognitive model, that has been extended to cross-domain tasks. Nonetheless, most existing paradigms that are based on ELM either concern about a case in which a specific number of instances are labelled in the target domain or a learner is trained without sufficient capacity to eliminate the gap between domains. To cope with the scenario in which there are no target labels and to acquire a better adaptive learner, we propose a joint unsupervised cross-domain model via scalable discriminative ELM, which is abbreviated as JUC-SDELM. Within the framework, the scalable factor is integrated into discriminative ELM (DELM) to adjust the output margin, which strengthens the discriminative capacity of the ELM classifier. In addition, we follow the basic strategy of joint distribution adaptation (JDA) to align the subspaces generated by JUC-SDELM in terms of their statistics. The discrepancy across domains is alleviated after a few iterations. Moreover, a metric on the outputs of ELM is utilized to filter unreliable pseudo labels in the target domain, with the aim of eliminating the negative transfer effect. Results are obtained by comparing JUC-SDELM with state-of-the-art baseline methods on 16 cross-domain benchmarks that were constructed based on three combined datasets. Likewise, the outcomes in terms of key parameters are also examined. According to the experiments, our proposed model achieves competitive overall performance.
KeywordsExtreme learning machine (ELM) Cross-domain adaptation Joint distribution Scalable factor
This work was funded by SGCC (State Grid Corporation of China) Thousand Talents program special support project (EPRIPDKJ (2014)2863), and partially funded by the National Natural Science Foundation of China (61273165).
Compliance with Ethical Standards
Conflict of interest
The authors declare that they have no conflict of interest.
No studies with human participants or animals are involved in this paper.
- 2.Gao S, Li H. A cross-domain adaptation method for sentiment classification using probabilistic latent analysis. Proceedings of the 20th ACM international conference on Information and knowledge management; 2011. p. 1047–1052.Google Scholar
- 5.Gong B, Shi Y, Sha F, Grauman K. Geodesic flow kernel for unsupervised domain adaptation. IEEE conference on computer vision and pattern recognition (CVPR); 2012. p. 2066–2073.Google Scholar
- 7.Ando S, Suzuki E. Unsupervised cross-domain learning by interaction information co-clustering. Eighth IEEE international conference on data mining data mining; 2008. p. 13–22.Google Scholar
- 10.Pan SJ, Kwok JT, Yang Q. Transfer learning via dimensionality reduction. Proceedings of the Twenty-Third AAAI conference on artificial intelligence; 2008. p. 677–682.Google Scholar
- 11.Borgwardt KM, Gretton A, Rasch MJ, Kriegel HP, Schölkopf B, Smola AJ. Integrating structured biological data by kernel maximum mean discrepancy. Bioinformatics. 2006; 22(14):e49–e57.Google Scholar
- 13.Long M, Cao Y, Wang J, Jordan MI. Learning transferable features with deep adaptation networks. International conference on machine learning; 2015. p. 97–105.Google Scholar
- 14.Fernando B, Habrard A, Sebban M, Tuytelaars T. Unsupervised visual domain adaptation using subspace alignment. Proceedings of the IEEE international conference on computer vision (ICCV); 2013. p. 2960–2967.Google Scholar
- 17.Long M, Wang J, Ding G, Sun J, Yu PS. Transfer feature learning with joint distribution adaptation. Proceedings of the IEEE international conference on computer vision (ICCV); 2013. p. 2200–2207.Google Scholar
- 19.Luo L, Wang X, Hu S, Chen L. Robust data geometric structure aligned close yet discriminative domain adaptation. 2017. arXiv:1705.08620v1.
- 22.Wang X, Ma Y, Cheng Y. 2017. Domain adaptation network based on hypergraph regularized denoising autoencoder. Artif Intell Rev. https://doi.org/10.1007/s10462-017-9576-0.
- 23.Lu B, Chellappa R, Nasrabadi NM. Incremental dictionary learning for unsupervised domain adaptation. British machine vision conference (BMVC); 2015. p. 108.1–108.12.Google Scholar
- 24.Hou CA, Yeh YR, Wang YCF. An unsupervised domain adaptation approach for cross-domain visual classification. IEEE international conference on advanced video and signal based surveillance (AVSS); 2015. p. 1–6.Google Scholar
- 33.Yan D, Chu Y, Zhang H, Liu D. 2016. Information discriminative extreme learning machine. Soft Comput. https://doi.org/10.1007/s00500-016-2372-y.
- 34.Iosifidis A, Tefas A, Pitas I. Semi-supervised classification of human actions based on neural networks. 22nd international conference on pattern recognition (ICPR), IEEE; 2014. p. 1336–1341.Google Scholar
- 44.Cortes C, Vapnik V. Support-vector networks. Mach Learn. 1995;20(3):273–297.Google Scholar
- 46.Al-Shedivat M, Wang JJY, Alzahrani M, Huang JZ, Gao X. Supervised transfer sparse coding. Proceedings of the Twenty-Eighth AAAI conference on artificial intelligence; 2014. p. 1665–1672.Google Scholar
- 48.Saenko K, Kulis B, Fritz M, Darrell T. Adapting visual category models to new domains. European conference on computer vision (ECCV); 2010. p. 213–226.Google Scholar
- 49.Griffin G, Holub AD, Perona P. Caltech-256 object category dataset. Caltech Technical Report. 2007.Google Scholar
- 52.Nene SA, Nayar SK, Murase H. 1996. Columbia object image library (COIL-20). Technical Report CUCS-005-96.Google Scholar
- 53.Chang CC, Lin CJ. LIBSVM: A library for support vector machines. ACM TIST. 2011;2(3):27.Google Scholar
- 54.Ghifary M, Kleijn WB, Zhang M. Domain adaptive neural networks for object recognition. Pacific Rim international conference on artificial intelligence; 2014. p. 898–904.Google Scholar
- 56.Niu J, Shi Y, Cai M, Cao Z, Wang D, Zhang Z, et al. 2017. Detection of sputum by interpreting the time-frequency distribution of respiratory sound signal using image processing techniques. Bioinformatics. https://doi.org/10.1093/bioinformatics/btx652.
- 58.Chen Y, Song S. Domain transfer extreme learning machine and its application on domain adaptation problems. China Sciencepaper. 2017;12(14):1565–1569 + 1609.Google Scholar