Hierarchical Robot Multi-Sensor Data Fusion System

  • Ren C. Luo
  • Min-Hsiung Lin
Part of the NATO ASI Series book series (volume 58)


The objective of this paper is to develop a knowledge-based hierarchical paradigm for the effective fusion of multiple sensors into the operation of an intelligent system.

A mathematical model is developed to represent the level of confidence measures for determining the optimal fused sensor data. The proposed approach permits data to be merged in both a low-level way (to minimize the influence of noisy data) and a high level way (constraints are put on the influence between sensors and the way the data is combined). This work can potentially clear the air on a number of issues such as the usefulness of faulty sensor isolation, the accuracy of combined data sources, and the overall cohesiveness of the various templates for phased sensing.1

The investigation is based on a Unimation PUMA 560 robot and various external sensors. These include overhead vision, eye-in-hand vision, proximity, tactile array, position, force/torque, cross-fire, overload and slip sensing devices. The efficient fusion of data from different sources will enable the machine to respond promptly in dealing with the “real world.” Towards this goal, the general paradigm of a sensor data fusion system has been developed, and some simulation results for the concepts of sensor data fusion have been demonstrated.


Sensor Data Multiple Sensor Relation Matrix Quadratic Curve Fuse Sensor Data 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    T. C. Henderson and E. Shilcrat, “Logical Sensor Systems” Journal of Robotics Systems, 1 (2), 169–193, 1984.CrossRefGoogle Scholar
  2. [2]
    T. C. Henderson, W. S. Fai, and C. Hansen, “MKS: A Multisensor Kernel System,” IEEE Transactions On System, Man, and Cybernetics, Vol. SMC-14, No. 5, September/October 1984.Google Scholar
  3. [3]
    A. C. Kak, K. L. Boyer, C. H. Chern, R. J. Safranek, H. S. Yang, “A Knowledge-Based Robotics Assembly Cell,” Proc. of IEEE Int’l Conf. on Robotics and Automation, San Francisco, April, 1986.Google Scholar
  4. [4]
    Ren C. Luo, M. Kay, “Multisensor Integration and Fusion”, SPIE 1988 Conference on Multisensor Fusion, Orendo, FL. April 1988.Google Scholar
  5. [5]
    Ren C. Luo, Min H. Lin and R. S. Scherp “Dynamic Multi-Sensor Data Fusion System for Intelligent Robots”, IEEE Journal of Robotics and Automation vol 4, number 4, 1988.Google Scholar
  6. [6]
    Ren C. Luo, Min-Hsiung Lin and R. S. Scherp “The Issues and Approaches of A Robot Multi-Sensor Integration,” Proc. of IEEE Intl Conf. on Robotics and Automation, pp. 1941–1946, Raleigh, 1987.Google Scholar
  7. [7]
    Fred C. Schweppe, “Uncertain Dynamic Systems” Englewood Cliffs, N. J. Prentice-Hall, Inc., 1973.Google Scholar
  8. [8]
    T. L. Grettenberg, “Signal selection in communication and radar systems,” IEEE Trans. Information Theory, vol. IT-9, pp. 265–275, October 1963.CrossRefGoogle Scholar
  9. [9]
    T. Kailath, “The divergence and Bhattacharyya distance measures in signal selection,” IEEE Trans. Communication Technology, vol. COM-15, pp. 52–60, February 1967.Google Scholar
  10. [10]
    T. T. Kadota and L. A. Shepp, “On the best finite set of linear observables for discriminating two Gaussian signals,” IEEE Trans. Information Theory, vol. IT-13, pp. 278–284, April 1967.CrossRefGoogle Scholar
  11. [11]
    H. Kobayashi, “Distance Measures and Asymptotic Relative Efficiency,” IEEE Trans. Information Theory, vol. IT-16, pp. 288–291, May 1970.CrossRefGoogle Scholar
  12. [12]
    N. Deo, “Graph Theory with Applications to Engineering and Computer Science”, Englewood Cliffs, N.J., Prentice-Hall, 1974.Google Scholar
  13. [13]
    Ren C. Luo and Min-Hsiung Lin, “3D Object Recognition Using Combined Overhead and Robot Eye-in-Hand Vision System,” IECON ’87, Cambridge, 1987.Google Scholar
  14. [14]
    Ren C. Luo and Min-Hsiung Lin, “Intelligent Hybrid Force/Position Servo-Controlled Gripper with Eye-In-Hand Vision System,” Proceedings of Robots 12 and Vision ’88 Conference, Detroit, Michigan, June 5–9, 1988.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1990

Authors and Affiliations

  • Ren C. Luo
    • 1
  • Min-Hsiung Lin
    • 1
  1. 1.Robotics and Intelligent Systems Laboratory Department of Electrical and Computer EngineeringNorth Carolina State UniversityRaleighUSA

Personalised recommendations