A Novel Incremental Linear Discriminant Analysis for Multitask Pattern Recognition Problems
In this paper, we propose a new incremental linear discriminant analysis (ILDA) for multitask pattern recognition (MTPR) problems in which training samples of a specific recognition task are given one after another for a certain period of time and the task is switched to another related task in turn. The Pang et al.’s ILDA is extended such that a discriminant space of the current task is augmented with effective discriminant vectors that are selected from other related tasks based on the class separability. We call the selection and augmentation of such discriminant vectors knowledge transfer of feature subspaces. In the experiments, the proposed ILDA is evaluated for the four MTPR problems, each of which consists of three multi-class recognition tasks. The results demonstrate that the proposed ILDA outperforms the ILDA without the knowledge transfer with regard to both the class separability and recognition accuracy. From the experimental results, we confirm that the proposed knowledge transfer mechanism works well to construct effective discriminant feature spaces incrementally.
Unable to display preview. Download preview PDF.
- 2.Silver, D.L., Mercer, R.E.: Selective Function Transfer: Inductive Bias from Related Task. In: Proc. of IASTED Int. Conf. on AI and Soft Computing, pp. 182–189 (2001)Google Scholar
- 3.Argyriou, A., Evgeniou, T., Pontil, M.: Multi-Task Feature Learning. In: Advances in Neural Information Processing Systems, vol. 19, pp. 41–48. MIT Press, Cambridge (2007)Google Scholar
- 4.Ozawa, S., Roy, A.: Incremental Learning for Multitask Pattern Recognition Problems. In: Proc. of 17th Int. Conf. on Machine Learning and Applications (in press)Google Scholar
- 5.Pang, S., Ozawa, S., Kasabov, N.: Incremental Linear Discriminant Analysis for Classification of Data Streams. IEEE Trans. on SMC - Part B 35(5), 905–914 (2005)Google Scholar