Sensor-Fusion in Neural Networks
The problem of sensor-fusion arises in many applications. We have studied the problem primarily in the context of cognitive robotics. An autonomous robot has to create a meaningful representation of its position in the world and, more generally, the situation in which it has to perform an appropriate action. Such robots usually have several different sensors (sonars, laser range finders, cameras, microphones, infrared sensors, bumpers) and they have to combine the different kinds of information provided by these sensors. Neural networks seem to be particularly well suited for the combination of inputs from completely different sources. So we will be using them and the corresponding learning and training strategies for these problems. In the context of pattern recognition, a community has emerged that is analyzing these problems and has accumulated a considerable amount of practical and theoretical knowledge in the theoretical framework of multiple classifier systems. There is a strong overlap between this community and our neural networks community, and we have also contributed to the application of multiple classifier systems built from neural networks for sensor-fusion, for example, for the classification of multivariate biological time series. One question to be addressed here is the use of uncertainty measures for the combination of classifiers. Here we use the framework of multiple classifier systems to compare several methods of sensor- or information-fusion.
KeywordsArtificial neural networks sensor fusion multiple classifier systems
Unable to display preview. Download preview PDF.
- 1.H. McGurk and J. MacDonald (1976). Hearing Lips and Seeing Voices, Nature, Dec. 1976:746–748.Google Scholar
- 2.D. Dubois and H. Prade (1980). Fuzzy Sets and Systems: Theory and Applications. Academic Press.Google Scholar
- 3.D. Dubois and H. Prade (1988). Possibility Theory: An Approach to Computerized Processing of Uncertainty. Plenum Press.Google Scholar
- 4.R. Kruse, F. Klawonn, and J. Gebhardt (1995). Fuzzy Systeme. Teubner.Google Scholar
- 5.L.I. Kuncheva (2004). Combining Pattern Classification. Wiley-Interscience.Google Scholar
- 7.J. Kittler, M. Balette, J. Czyz, F. Roli, and L. Vanderdorpe (2002). Decision level fusion of intramodal personal identity verification experts. In F. Roli and J. Kittler (eds.): Proc. 2nd International Workshop on Multiple Classifier Systems, Vol. 2364 of Lecture Notes in Computer Science, Springer, 378–387.Google Scholar
- 13.F. Schwenker, H.A. Kestler, and G. Palm (2001). Three phase learning for radial basis function networks, 14:439–458.Google Scholar