Abstract
Information Fusion is becoming increasingly relevant in fields such as Image Processing or Information Retrieval. In this work we propose a new technique for information fusion when the sources of information are given by a set of kernel matrices. The algorithm is based on the joint diagonalization of matrices and it produces a new data representation in an Euclidean space. In addition, the proposed method is able to eliminate redundant information among the input kernels and it is robust against the presence of noisy variables and irrelevant kernels.
The performance of the algorithm is illustrated on data reconstruction and classifications problems.
Chapter PDF
Similar content being viewed by others
References
Bach, F.R., Jordan, M.I.: Kernel Principal Components Analysis. Journal of Machine Learning Research 3, 1–48 (2002)
Cardoso, J.F., Souloumiac: A Jacobi Angles for Simultaneous Diagonalization. SIAM J. Mat. Anals. Applied 17(1), 161–164 (1996)
Choi, M., Young, R., Nam, M.-R., Kim, H.O.: Fusion of Multispectral and Panchromatic Satellite Images Using the Curvelet Transform. Geoscience and Remote Sensing Letters 2(2) (2005)
Martin de Diego, I., Moguerza, J.M., Muñoz, A.: Combining Kernel Information for Support Vector Classification. In: Roli, F., Kittler, J., Windeatt, T. (eds.) MCS 2004. LNCS, vol. 3077, pp. 102–111. Springer, Heidelberg (2004)
Epifanio, I., Gutierrez, J., Malo, J.: Linear transform for simultaneous diagonalization of covariance and perceptual metric matrix in image coding. Pattern Recognition 36, 799–1811 (2003)
Gretton, A., Herbrich, R., Smola, A., Bousquet, O., Schölkop, B.: Kernel methods for measuring independence. J. Machine Learning Research 6, 2075–2129 (2005)
Hua, Y.: On SVD estimating Generalized Eigenvalues of Singular Matrix Pencils in Noise. IEEE Transactions on Signal Processing 39(4), 892–900 (1991)
Joachims, T., Cristianini, N., Shawe-Taylor, J.: Composite Kernels for Hypertext Categorisation. In: Proceedings of the International Conference on Machine Learning, pp. 250–257 (2002)
Kittler, J., Hatef, M., Duin, R.P.W., Matas, J.: On combining classifiers. IEEE Transactions on Pattern Analysis and Machine intelligence 20(3), 226–239 (1998)
Mika, S., Ratsch, W.G., Scholkopf, B., Muller, K.-R.: Fisher Discriminant Analysis with Kernels. In: Proceedings of IEEE Neural Networks for Signal Processing Workshop, IEEE Computer Society Press, Los Alamitos (1999)
Moguerza, J., Muñoz, A.: Support Vector Machines with Applications. Statistical Science 21(3), 322–336 (2006)
Beresford, P.N.: The Symmetric Eigenvalue Problem. Classics in Applied Mathematics. SIAM (1997)
Schölkopf, B., Smola, A.J., Müller, K.R.: Nonlinear Component Analysis as a Kernel Eigenvalue Problem. Neural Computation 10, 1299–1319 (1998)
Wax, M., Sheinvald, J.: A least-squares approach to joint diagonalization. IEEE Signal Processing Lett. 4, 52–53 (1997)
Bunse-Gerstner, A., Byers, R., Mehrmann, V.: Numerical methods for simultaneous diagonalization. SIAM Journal on Matrix Analysis and Applications 14(4), 927–949 (1993)
Yeredor, A.: Non-Orthogonal Joint Diagonalization in the Least-Squares Sense With Application in Blind Source Separation. IEEE Transactions on Signal Processing. 50 (7), 1545–1553 (2002)
Piella, G., Heijmans, H.: Multiresolution Image Fusion Guided by a Multimodal Segmentation. In: Proceedings of ACIVS 2002, Ghent, Belgium (September 9-11, 2002)
Newman, D.J., Hettich, S., Blake, C.L. and Merz, C.J.UCI Repository of machine learning databases. Irvine, CA: University of California, Department of Information and Computer Science 1998, http://www.ics.uci.edu/mlearn/MLRepository.html
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Muñoz, A., González, J. (2007). Joint Diagonalization of Kernels for Information Fusion. In: Rueda, L., Mery, D., Kittler, J. (eds) Progress in Pattern Recognition, Image Analysis and Applications. CIARP 2007. Lecture Notes in Computer Science, vol 4756. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76725-1_58
Download citation
DOI: https://doi.org/10.1007/978-3-540-76725-1_58
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-76724-4
Online ISBN: 978-3-540-76725-1
eBook Packages: Computer ScienceComputer Science (R0)