Summary
Real time data collected from sensors and then having been processed by multiple classifiers are correlated due to common, inherent noise resulting from the sensor. The data is collected at different ranges and may have different statistical distributions and characteristics. Measurements from different classifiers are fused together to obtain more information about the phenomenon or environment under observation. Since the classifier fusion is attempting to improve the data through processing only, this chapter focuses on object refinement or fusion level 1 within the Joint Directors of Laboratories (JDL) data fusion process model and taxonomy of algorithms. Before fusion, the correlated data is normalized using a variety of normalization techniques such as z-score and min-max normalization. Further, by dynamically weighting and combining the measurements from these classifiers, performance is improved. Weights are found using a Particle Swarm Optimization search algorithm and are a function of required accuracy and degree of correlation. Results are presented for (a) synthetic data generated using conditional multivariate normal distribution with different covariance matrices and (b) NIST BSSR dataset. For correlated classifiers, the performance of the particle swarm optimization technique outperforms the traditional data level fusion i.e., z-normalization and min-max.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Veeramachaneni, K., Osadciw, L., Ross, A., Srinivas, N.: Decision-level fusion strategies for correlated biometric classifiers. In: 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1–6. IEEE Computer Society Press, Los Alamitos (2008)
Jain, A., Nandakumar, K., Ross, A.: Score normalization in multimodal biometrics system. Pattern Recognition 38(12), 2270–2285 (2005)
Veeramachaneni, K.: An Evolutionary Algorithm Based Dynamic Thresholding for Multimodal Biometrics, Masters Thesis, School of Engineering and Computer Science, Syracuse University, USA (2005)
Veeramachaneni, K., Osadciw, L., Varshney, P.K.: An adaptive multimodal biometric management algorithm. IEEE Transactions on Systems, Man, and Cybernetics Part C: Applications and Reviews 35(3), 344–356 (2005)
Veeramachaneni, K., Osadciw, L.: Dynamic Sensor Management Using Multi Objective Particle Swarm Optimizer. In: Dasarathy, B.V. (ed.) Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2004. Proceedings of the SPIE, vol. 5434, pp. 205–216 (2004)
Ross, A., Jain, A.: Information Fusion in Biometrics. Pattern Recognition Letters 24, 2115–2125 (2003)
Kuncheva, L.I.: A Theoretical Study on Six Classifier Fusion Strategies. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(2), 281–286 (2002)
Kennedy, J., Eberhart, R., Shi, Y.H.: Swarm Intelligence. Morgan Kaufmann Publishers, San Francisco (2001)
Roli, F., Giacinto, G., Vernazza, G.: Methods for designing multiple classifier systems. In: Kittler, J., Roli, F. (eds.) MCS 2001. LNCS, vol. 2096, pp. 78–87. Springer, Heidelberg (2001)
Deb, K.: Multi-Objective Optimization Using Evolutionary Algorithms. John Wiley and Sons, Chichester (2001)
Willett, P., Swaszek, P.F., Blum, R.S.: The good, bad and ugly: distributed detection of a known signal in dependent Gaussian noise. IEEE Transactions on Signal Processing 48(12), 3266–3279 (2000)
Kitler, J., Hanef, M., Duin, R.W., Matas, J.: On Combining Classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(3), 226–239 (1998)
Opitz, D.W., Maclin, R.F.: Popular ensemble methods: An empirical study. Journal of Artificial Intelligence Research 11, 169–198 (1999)
Waltz, E.L., Llinas, J.: Multisensor Data Fusion. Artech House Radar, Norwood (1990)
Guerra-Salcedo, C., Whitley, D.: Genetic approach to feature selection for ensemble creation. In: Banzhaf, W., et al. (eds.) Proceedings of the 1999 Genetic and Evolutionary Computation Conference (GECCO 1999), pp. 236–243. Morgan Kaufmann, San Francisco (1999)
Opitz, D.W.: Feature selection for ensembles. In: Proceedings of the 16th International Conference on Artificial Intelligence, pp. 379–384. AAAI, Menlo Park (1999)
Krogh, A., Vedelsby, J.: Neural network ensembles, cross validation, and active learning. In: Tesauro, G., Touretzky, D., Leen, T. (eds.) Advances in Neural Information Processing Systems, vol. 7, pp. 231–238. The MIT Press, Cambridge (1994)
Varshney, P.K.: Distributed Detection and Data Fusion. Springer, New York (1996)
Xu, L., Krzyzak, A., Suen, C.Y.: Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Transactions on Systems, Man and Cybernetics 22(3), 418–435 (1992)
Peebles Jr., P.Z.: Probability, Random Variables and Random Signal Principles, 2nd edn., USA. McGraw -Hill Series in Electrical Engineering (1987)
Chair, Z., Varshney, P.K.: Optimal Data Fusion in Multiple Sensor Detection Systems. IEEE Transactions on Aerospace and Electronic Systems AES-22(1), 98–101 (1986)
Tenney, R.R., Sandell, N.R.: Detection with Distributed Sensors. IEEE Transactions on Aerospace and Electronic Systems AES-17(4), 501–510 (1981)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Osadciw, L., Srinivas, N., Veeramachaneni, K. (2009). Combining Correlated Data from Multiple Classifiers. In: Coello, C.A.C., Dehuri, S., Ghosh, S. (eds) Swarm Intelligence for Multi-objective Problems in Data Mining. Studies in Computational Intelligence, vol 242. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03625-5_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-03625-5_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03624-8
Online ISBN: 978-3-642-03625-5
eBook Packages: EngineeringEngineering (R0)