Advertisement

Multiview Transfer Learning and Multitask Learning

  • Shiliang Sun
  • Liang Mao
  • Ziang Dong
  • Lidan Wu
Chapter

Abstract

Transfer learning is proposed to transfer the learned knowledge from source domains to target domains where the target ones own fewer training data. Multitask learning learns multiple tasks simultaneously and makes use of the relationship among these tasks. Both of these learning methods can combine with the multiview learning, which exploits the information from the consistency of diverse views. In this chapter, we introduce four multiview transfer learning methods and three multiview multitask learning methods. We review research on multiview transfer learning under the large margin framework, discuss multiview discriminant transfer learning in detail, and introduce how to adapt Adaboost into multiview transfer learning. Three multiview multitask learning methods concentrate on the shared structures between tasks and views. The most natural way is to represent the relationships based on the bipartite graph and use an iterative algorithm to optimize its objective function. Another method constructs additional regularization function to ensure the view consistency. In general, convex shared structure learning algorithm provides structure parameters to share information. Besides, we introduce other methods; as supplements, where multi-transfer, multitask multiview discriminant analysis, and clustering are briefly mentioned.

References

  1. Absil PA, Mahony R, Sepulchre R (2010) Optimization on manifolds: methods and applications. In: Recent advances in optimization and its applications in engineering, pp 125–144CrossRefGoogle Scholar
  2. Dhillon IS (2001) Co-clustering documents and words using bipartite spectral graph partitioning. In: Proceedings of the 7th ACM SIGKDD international conference on knowledge discovery and data mining, pp 269–274Google Scholar
  3. Diethe T, Hardoon DR, Shawe-Taylor J (2008) Multiview fisher discriminant analysis. In: Proceedings of NIPS workshop on learning from multiple sourcesGoogle Scholar
  4. He J, Lawrence R (2011) A graphbased framework for multi-task multi-view learning. In: Proceedings of the 28th international conference on machine learning, pp 25–32Google Scholar
  5. Jin X, Zhuang F, Wang S, He Q, Shi Z (2013) Shared structure learning for multiple tasks with multiple views. In: Proceedings of joint european conference on machine learning and knowledge discovery in databases, Springer, pp 353–368Google Scholar
  6. Jin X, Zhuang F, Xiong H, Du C, Luo P, He Q (2014) Multi-task multi-view learning for heterogeneous tasks. In: Proceedings of the 23rd ACM international conference on conference on information and knowledge management, pp 441–450Google Scholar
  7. Pan SJ, Yang Q et al (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359CrossRefGoogle Scholar
  8. Perkins DN, Salomon G et al (1992) Transfer of learning. Int Encycl Educ 2:6452–6457Google Scholar
  9. Tan B, Zhong E, Xiang EW, Yang Q (2014) Multi-transfer: transfer learning with multiple views and multiple sources. Statist Anal Data Min 7(4):282–293MathSciNetCrossRefGoogle Scholar
  10. Xu Z, Sun S (2011) Multi-view transfer learning with adaboost. In: Proceedings of the 23rd IEEE international conference on tools with artificial intelligence, IEEE, pp 399–402Google Scholar
  11. Xu Z, Sun S (2012) Multi-source transfer learning with multi-view adaboost. In: Proceedings of the 19th international conference on neural information processing, Springer, pp 332–339Google Scholar
  12. Yang P, Gao W (2013) Multi-view discriminant transfer learning. In: Proceedings of the 23rd international joint conference on artificial intelligence, pp 1848–1854Google Scholar
  13. Zhang D, He J, Liu Y, Si L, Lawrence R (2011) Multi-view transfer learning with a large margin approach. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 1208–1216Google Scholar
  14. Zhang J, Huan J (2012) Inductive multi-task learning with multiple view data. In: Proceedings of the 18th ACM SIGKDD international conference on knowledge discovery and data mining, pp 543–551Google Scholar
  15. Zhang X, Zhang X, Liu H (2015) Multi-task multi-view clustering for non-negative data. In: Proceedings of the 24th international joint conference on artificial intelligence, pp 4055–4061Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Department of Computer Science and TechnologyEast China Normal UniversityShanghaiChina

Personalised recommendations