Skip to main content

Summary

Real time data collected from sensors and then having been processed by multiple classifiers are correlated due to common, inherent noise resulting from the sensor. The data is collected at different ranges and may have different statistical distributions and characteristics. Measurements from different classifiers are fused together to obtain more information about the phenomenon or environment under observation. Since the classifier fusion is attempting to improve the data through processing only, this chapter focuses on object refinement or fusion level 1 within the Joint Directors of Laboratories (JDL) data fusion process model and taxonomy of algorithms. Before fusion, the correlated data is normalized using a variety of normalization techniques such as z-score and min-max normalization. Further, by dynamically weighting and combining the measurements from these classifiers, performance is improved. Weights are found using a Particle Swarm Optimization search algorithm and are a function of required accuracy and degree of correlation. Results are presented for (a) synthetic data generated using conditional multivariate normal distribution with different covariance matrices and (b) NIST BSSR dataset. For correlated classifiers, the performance of the particle swarm optimization technique outperforms the traditional data level fusion i.e., z-normalization and min-max.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Veeramachaneni, K., Osadciw, L., Ross, A., Srinivas, N.: Decision-level fusion strategies for correlated biometric classifiers. In: 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1–6. IEEE Computer Society Press, Los Alamitos (2008)

    Chapter  Google Scholar 

  2. Jain, A., Nandakumar, K., Ross, A.: Score normalization in multimodal biometrics system. Pattern Recognition 38(12), 2270–2285 (2005)

    Article  Google Scholar 

  3. Veeramachaneni, K.: An Evolutionary Algorithm Based Dynamic Thresholding for Multimodal Biometrics, Masters Thesis, School of Engineering and Computer Science, Syracuse University, USA (2005)

    Google Scholar 

  4. Veeramachaneni, K., Osadciw, L., Varshney, P.K.: An adaptive multimodal biometric management algorithm. IEEE Transactions on Systems, Man, and Cybernetics Part C: Applications and Reviews 35(3), 344–356 (2005)

    Article  Google Scholar 

  5. Veeramachaneni, K., Osadciw, L.: Dynamic Sensor Management Using Multi Objective Particle Swarm Optimizer. In: Dasarathy, B.V. (ed.) Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2004. Proceedings of the SPIE, vol. 5434, pp. 205–216 (2004)

    Google Scholar 

  6. Ross, A., Jain, A.: Information Fusion in Biometrics. Pattern Recognition Letters 24, 2115–2125 (2003)

    Article  Google Scholar 

  7. Kuncheva, L.I.: A Theoretical Study on Six Classifier Fusion Strategies. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(2), 281–286 (2002)

    Article  Google Scholar 

  8. Kennedy, J., Eberhart, R., Shi, Y.H.: Swarm Intelligence. Morgan Kaufmann Publishers, San Francisco (2001)

    Google Scholar 

  9. Roli, F., Giacinto, G., Vernazza, G.: Methods for designing multiple classifier systems. In: Kittler, J., Roli, F. (eds.) MCS 2001. LNCS, vol. 2096, pp. 78–87. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  10. Deb, K.: Multi-Objective Optimization Using Evolutionary Algorithms. John Wiley and Sons, Chichester (2001)

    MATH  Google Scholar 

  11. Willett, P., Swaszek, P.F., Blum, R.S.: The good, bad and ugly: distributed detection of a known signal in dependent Gaussian noise. IEEE Transactions on Signal Processing 48(12), 3266–3279 (2000)

    Article  MathSciNet  Google Scholar 

  12. Kitler, J., Hanef, M., Duin, R.W., Matas, J.: On Combining Classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(3), 226–239 (1998)

    Article  Google Scholar 

  13. Opitz, D.W., Maclin, R.F.: Popular ensemble methods: An empirical study. Journal of Artificial Intelligence Research 11, 169–198 (1999)

    MATH  Google Scholar 

  14. Waltz, E.L., Llinas, J.: Multisensor Data Fusion. Artech House Radar, Norwood (1990)

    Google Scholar 

  15. Guerra-Salcedo, C., Whitley, D.: Genetic approach to feature selection for ensemble creation. In: Banzhaf, W., et al. (eds.) Proceedings of the 1999 Genetic and Evolutionary Computation Conference (GECCO 1999), pp. 236–243. Morgan Kaufmann, San Francisco (1999)

    Google Scholar 

  16. Opitz, D.W.: Feature selection for ensembles. In: Proceedings of the 16th International Conference on Artificial Intelligence, pp. 379–384. AAAI, Menlo Park (1999)

    Google Scholar 

  17. Krogh, A., Vedelsby, J.: Neural network ensembles, cross validation, and active learning. In: Tesauro, G., Touretzky, D., Leen, T. (eds.) Advances in Neural Information Processing Systems, vol. 7, pp. 231–238. The MIT Press, Cambridge (1994)

    Google Scholar 

  18. Varshney, P.K.: Distributed Detection and Data Fusion. Springer, New York (1996)

    Google Scholar 

  19. Xu, L., Krzyzak, A., Suen, C.Y.: Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Transactions on Systems, Man and Cybernetics 22(3), 418–435 (1992)

    Article  Google Scholar 

  20. Peebles Jr., P.Z.: Probability, Random Variables and Random Signal Principles, 2nd edn., USA. McGraw -Hill Series in Electrical Engineering (1987)

    Google Scholar 

  21. Chair, Z., Varshney, P.K.: Optimal Data Fusion in Multiple Sensor Detection Systems. IEEE Transactions on Aerospace and Electronic Systems AES-22(1), 98–101 (1986)

    Article  Google Scholar 

  22. Tenney, R.R., Sandell, N.R.: Detection with Distributed Sensors. IEEE Transactions on Aerospace and Electronic Systems AES-17(4), 501–510 (1981)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Osadciw, L., Srinivas, N., Veeramachaneni, K. (2009). Combining Correlated Data from Multiple Classifiers. In: Coello, C.A.C., Dehuri, S., Ghosh, S. (eds) Swarm Intelligence for Multi-objective Problems in Data Mining. Studies in Computational Intelligence, vol 242. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03625-5_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-03625-5_11

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-03624-8

  • Online ISBN: 978-3-642-03625-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics