Improving Transfer Learning by Introspective Reasoner

  • Zhongzhi Shi
  • Bo Zhang
  • Fuzhen Zhuang
Part of the IFIP Advances in Information and Communication Technology book series (IFIPAICT, volume 385)


Traditional learning techniques have the assumption that training and test data are drawn from the same data distribution, and thus they are not suitable for dealing with the situation where new unlabeled data are obtained from fast evolving, related but different information sources. This leads to the cross-domain learning problem which targets on adapting the knowledge learned from one or more source domains to target domains. Transfer learning has made a great progress, and a lot of approaches and algorithms are presented. But negative transfer learning will cause trouble in the problem solving, which is difficult to avoid. In this paper we have proposed an introspective reasoner to overcome the negative transfer learning.

Introspective learning exploits explicit representations of its own organization and desired behavior to determine when, what, and how to learn in order to improve its own reasoning. According to the transfer learning process we will present the architecture of introspective reasoner for transductive transfer learning.


Introspective reasoned Transfer learning Negative transfer 


  1. 1.
    Shi, Z.: Intelligence Science. World Scientific, Singapore (2011)Google Scholar
  2. 2.
    Cox, M.: Metacognition in computation: A selected research review. Artificial Intelligence 169(2), 104–141 (2005)CrossRefGoogle Scholar
  3. 3.
    Leake, D.B., Wilson, M.: Extending introspective learning from self- models. In: Cox, M.T., Raja, A. (eds.) Metareasoning: Thinking About Thinking (2008)Google Scholar
  4. 4.
    Laird, J.E., Newell, A., Rosenbloom, Soar, P.S.: A Architecture for General Intelligence. Artificial Intelligence (1987)Google Scholar
  5. 5.
    Birnbaum, L., Collins, G., Brand, M., Freed, M., Krulwich, B., Pryor, L.: A model-based approach to the construction of adaptive case-based planning systems. In: Bareiss, R. (ed.) Proceedings of the DARPA Case-Based Reasoning Workshop, pp. 215–224. Morgan Kaufmann, San Mateo (1991)Google Scholar
  6. 6.
    Cox, M.T., Ram, A.: Introspective multistrategy learning on the construction of learning strategies. Artificial Intelligence 112, 1–55 (1999)zbMATHCrossRefGoogle Scholar
  7. 7.
    Fox, S., Leake, D.B.: Using Introspective Reasoning to Refine Indexing. In: Proceedings of the 14th International Joint Conference on Artificial Intelligence, pp. 391–397 (1995)Google Scholar
  8. 8.
    Oehlmann, R., Edwards, P., Sleeman, D.: Changing the Viewpoint: Re-Indexing by Introspective Question. In: Proceedings of the 16th Annual Conference of the Cognitive Science Society, pp. 381–386 (1995)Google Scholar
  9. 9.
    Leake, D.B., Kinley, A., Wilson, D.: Learning to Improve Case Adaptation by Introspective Reasoning and CBR. Case-Based Reasoning Research and Development. In: Aamodt, A., Veloso, M.M. (eds.) ICCBR 1995. LNCS, vol. 1010. Springer, Heidelberg (1995)CrossRefGoogle Scholar
  10. 10.
    Zhang, Z., Yang, Q.: Feature Weight Maintenance in Case Bases Using Introspective Learning. Journal of Intelligent Information Systems 16(2), 95–116 (2001)zbMATHCrossRefGoogle Scholar
  11. 11.
    Craw, S.: Introspective Learning to Build Case-Based Reasoning (CBR) Knowledge Containers. In: Perner, P., Rosenfeld, A. (eds.) MLDM 2003. LNCS, vol. 2734, pp. 1–6. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  12. 12.
    Cheetham, W., Price, J.: Measures of Solution Accuracy in Case-Based Reasoning Systems. In: Funk, P., González Calero, P.A. (eds.) ECCBR 2004. LNCS (LNAI), vol. 3155, pp. 106–118. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  13. 13.
    Arcos, J.L., Mulayim, O., Leake, D.: Using Introspective Reasoning to Improve CBR System Performance. In: AAAI Metareasoning Workshop, pp. 21–28. AAAI Press (2008)Google Scholar
  14. 14.
    Soh, L.-K., Blank, T.: Integrated Introspective Case-Based Reasoning for Intelligent Tutoring Systems. In: Association for the Advancement of Artificial Intelligence. AAAI 2007 (2007)Google Scholar
  15. 15.
    Leake, D.B., Powell, J.H.: Enhancing Case Adaptation with Introspective Reasoning and Web Mining. In: IJCAI 2011, pp. 2680–2685 (2011)Google Scholar
  16. 16.
    Torrey, L., Shavlik, J.: Transfer Learning. In: Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques, pp. 242–264 (2010)Google Scholar
  17. 17.
    Croonenborghs, T., Driessens, K., Bruynooghe, M.: Learning Relational Options for Inductive Transfer in Relational Reinforcement Learning. In: Blockeel, H., Ramon, J., Shavlik, J., Tadepalli, P. (eds.) ILP 2007. LNCS (LNAI), vol. 4894, pp. 88–97. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  18. 18.
    Kuhlmann, G., Stone, P.: Graph-Based Domain Mapping for Transfer Learning in General Games. In: Kok, J.N., Koronacki, J., Lopez de Mantaras, R., Matwin, S., Mladenič, D., Skowron, A. (eds.) ECML 2007. LNCS (LNAI), vol. 4701, pp. 188–200. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  19. 19.
    Eaton, E., DesJardins, M.: Knowledge transfer with a multiresolution ensemble learning of classifiers. In: ICML Workshop on Structural Knowledge Transfer for Machine (2006)Google Scholar
  20. 20.
    Carroll, C., Seppi, K.: Task similarity measures for transfer in reinforcement works learning task libraries. In: IEEE International Joint Conference on Neural Net (2005)Google Scholar
  21. 21.
    Bakker, B., Heskes, T.: Task Clustering and Gating for Bayesian Multitask Learning. J. Machine Learning Research 4, 83–99 (2003)Google Scholar
  22. 22.
    Argyriou, A., Maurer, A., Pontil, M.: An Algorithm for Transfer Learning in a Heterogeneous Environment. In: Daelemans, W., Goethals, B., Morik, K. (eds.) ECML PKDD 2008, Part I. LNCS (LNAI), vol. 5211, pp. 71–85. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  23. 23.
    Pan, S.J., Yang, Q.: A Survey on Transfer Learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)CrossRefGoogle Scholar
  24. 24.
    Huang, J., Smola, A., Gretton, A., Borgwardt, K.M., Scholkopf, B.: Correcting Sample Selection Bias by Unlabeled Data. In: Proc. 19th Ann. Conf. Neural Information Processing Systems (2006)Google Scholar
  25. 25.
    Sugiyama, M., Nakajima, S., Kashima, H., Buenau, P.V., Kawanabe, M.: Direct Importance Estimation with Model Selection and its Application to Covariate Shift Adaptation. In: Proc. 20th Ann. Conf. Neural Information Processing Systems (December 2008)Google Scholar
  26. 26.
    Lewis, D.D.: Representation and learning in information retrieval. Ph.D. Dissertation, Amherst, MA, USA (1992)Google Scholar
  27. 27.
    Dai, W., Xue, G., Yang, Q., Yu, Y.: Transferring Naive Bayes Classifiers for Text Classification. In: Proc. 22nd Assoc. for the Advancement of Artificial Intelligence (AAAI) Conf. Artificial Intelligence, pp. 540–545 (July 2007)Google Scholar
  28. 28.
    Dai, W.Y., Xue, G.R., Yang, Q., et al.: Co-clustering based Classification for Out-of-domain Documents. In: Proceedings of 13th ACM International Conference on Knowledge Discovery and Data Mining, pp. 210–219. ACM Press, New York (2007)CrossRefGoogle Scholar
  29. 29.
    Ling, X., Dai, W.Y., Xue, G.R., et al.: Spectral Domain-Transfer Learning. In: Proceedings of 14th ACM International Conference on Knowledge Discovery and Data Mining, pp. 488–496. ACM Press, New York (2008)CrossRefGoogle Scholar
  30. 30.
    Fuzhen, Z., Ping, L., Hui, X., Yuhong, X., Qing, H., Zhongzhi, S.: Cross-domain Learning from Multiple Sources: A Consensus Regularization Perspective. IEEE Transactions on Knowledge and Data Engineering (TKDE) 22(12), 1664–1678 (2010)CrossRefGoogle Scholar
  31. 31.
    Shi, Z., Zhang, S.: Case-Based Introspective Learning. In: Proceedings of the Fourth IEEE International Conference on Cognitive Informatics. IEEE (2005)Google Scholar
  32. 32.
    Dong, Q., Shi, Z.: A Research on Introspective Learning Based on CBR. International Journal of Advanced Intelligence 3(1), 147–157 (2011)Google Scholar
  33. 33.
    Daume III, H., Marcu, D.: Domain Adaptation for Statistical Classifiers. J. Artificial Intelligence Research 26, 101–126 (2006)MathSciNetzbMATHGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2012

Authors and Affiliations

  • Zhongzhi Shi
    • 1
  • Bo Zhang
    • 1
    • 2
  • Fuzhen Zhuang
    • 1
  1. 1.Key Laboratory of Intelligent Information Processing, Institute of Computing TechnologyChinese Academy of SciencesBeijingChina
  2. 2.Graduate School of the Chinese Academy of SciencesBeijingChina

Personalised recommendations