Sensor-Fusion in Neural Networks

  • Gunther Palm
  • Friedhelm Schwenker
Part of the NATO Science for Peace and Security Series C: Environmental Security book series (NAPSC)


The problem of sensor-fusion arises in many applications. We have studied the problem primarily in the context of cognitive robotics. An autonomous robot has to create a meaningful representation of its position in the world and, more generally, the situation in which it has to perform an appropriate action. Such robots usually have several different sensors (sonars, laser range finders, cameras, microphones, infrared sensors, bumpers) and they have to combine the different kinds of information provided by these sensors. Neural networks seem to be particularly well suited for the combination of inputs from completely different sources. So we will be using them and the corresponding learning and training strategies for these problems. In the context of pattern recognition, a community has emerged that is analyzing these problems and has accumulated a considerable amount of practical and theoretical knowledge in the theoretical framework of multiple classifier systems. There is a strong overlap between this community and our neural networks community, and we have also contributed to the application of multiple classifier systems built from neural networks for sensor-fusion, for example, for the classification of multivariate biological time series. One question to be addressed here is the use of uncertainty measures for the combination of classifiers. Here we use the framework of multiple classifier systems to compare several methods of sensor- or information-fusion.


Artificial neural networks sensor fusion multiple classifier systems 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    H. McGurk and J. MacDonald (1976). Hearing Lips and Seeing Voices, Nature, Dec. 1976:746–748.Google Scholar
  2. 2.
    D. Dubois and H. Prade (1980). Fuzzy Sets and Systems: Theory and Applications. Academic Press.Google Scholar
  3. 3.
    D. Dubois and H. Prade (1988). Possibility Theory: An Approach to Computerized Processing of Uncertainty. Plenum Press.Google Scholar
  4. 4.
    R. Kruse, F. Klawonn, and J. Gebhardt (1995). Fuzzy Systeme. Teubner.Google Scholar
  5. 5.
    L.I. Kuncheva (2004). Combining Pattern Classification. Wiley-Interscience.Google Scholar
  6. 6.
    L.I. Kuncheva, J.C. Bezdek, and R.P.W. Duin (2001). Decision templates for multiple Classifier Fusion. Pattern Recognition, 34(2):299–314.zbMATHCrossRefGoogle Scholar
  7. 7.
    J. Kittler, M. Balette, J. Czyz, F. Roli, and L. Vanderdorpe (2002). Decision level fusion of intramodal personal identity verification experts. In F. Roli and J. Kittler (eds.): Proc. 2nd International Workshop on Multiple Classifier Systems, Vol. 2364 of Lecture Notes in Computer Science, Springer, 378–387.Google Scholar
  8. 8.
    G. Giacinto, F. Roli, and L. Didaci (2003). Fusion of multiple classifier for intrusion detection in computer networks. Pattern Recognition Letters, 24:1795–1803.CrossRefGoogle Scholar
  9. 9.
    F. Schwenker, C. Dietrich, H.A. Kestler, K. Riede, and G. Palm (2003). Radial basis function neural networks and temporal fusion for the classification of bioacoustic time series, Neurocomputing, 51:265–275.CrossRefGoogle Scholar
  10. 10.
    C. Dietrich, G. Palm, K. Riede, and F. Schwenker (2004). Classification of bioacoustic time series based on the combination of global and local features, Pattern Recognition Journal, 37(12):2293–2305.CrossRefGoogle Scholar
  11. 11.
    C. Dietrich, G. Palm and F. Schwenker (2003). Decision templates for the classification of time series, International Journal of Information Fusion Journal, 4:101–109.CrossRefGoogle Scholar
  12. 12.
    Y.S. Huang and C.Y. Suen (1995). A method of combining multiple experts for the recognition of unconstrained handwritten numerals. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17:90–93.CrossRefGoogle Scholar
  13. 13.
    F. Schwenker, H.A. Kestler, and G. Palm (2001). Three phase learning for radial basis function networks, 14:439–458.Google Scholar
  14. 14.
    S. Geman, E. Bienenstock, and R. Doursat (1992). Neural networks and the bias/variance dilemma. Neural Computation 4:1–58.CrossRefGoogle Scholar

Copyright information

© Springer Science + Business Media B.V. 2009

Authors and Affiliations

  • Gunther Palm
    • 1
  • Friedhelm Schwenker
    • 1
  1. 1.Neural Information ProcessingUniversity of UlmGermany

Personalised recommendations