Skip to main content
Log in

Multi-Layer Hierarchical Rule Learning in Reactive Robot Control Using Incremental Decision Trees

  • Published:
Journal of Intelligent and Robotic Systems Aims and scope Submit manuscript

Abstract

This paper presents a new approach to the intelligent navigation of a mobile robot. The hybrid control architecture described combines properties of purely reactive and behaviour-based systems, providing the ability both to learn automatically behaviours from inception, and to capture these in a distributed hierarchy of decision tree networks. The robot is first trained in the simplest world which has no obstacles, and is then trained in successively more complex worlds, using the knowledge acquired in the previous worlds. Each world representing the perceptual space is thus directly mapped on a unique rule layer which represents in turn the robot action space encoded in a distinct decision tree. A major advantage of the current implementation, compared with the previous work, is that the generated rules are easily understood by human users. The paper demonstrates that the proposed behavioural decomposition approach provides efficient management of complex knowledge, and that the learning mechanism is able to cope with noise and uncertainty in sensory data.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Borenstein, J. and Koren, Y.: Noise rejection for ultrasonic sensors in mobile robot applications, in: Proc. of IEEE Internat. Workshop on Robots and Systems, 1989, pp. 432–439.

  2. Bradzil, P. and Clark, P.: Learning from imperfect data, in: Machine Learning, Metareasoning and Logics, P. B. Bradzil and K. Konolige, (eds), Kluwer, 1990, pp. 207–232.

  3. Braunsting, R. and Ollero, A.: Evaluating the wall following behaviour of a mobile robot with fuzzy logic, in: IFAC/IMACS Internat.Workshop on Artificial Intelligence in Real Time Control, Bled, Slovenia, November 1995, pp. 89–93.

  4. Braunsting, R., Mujika, J., and Uribe, J. P.: A wall following robot with a fuzzy logic controller optimized by a genetic algorithm, 0-7803-2461-7/95, IEEE, 1995.

  5. Clark, P. and Niblett, T.: Induction in noisy domains, in: Proc. of the 2nd European Machine Learning Conf. (EWSL-87), 1987, pp. 11–30.

  6. Dubrawski, A. and Crowley, J.: Self-supervised neural system for reactive navigation, in: IEEE Internat. Conf. on Robotics and Automation, Vol. 3, 1994, pp. 2076–2081.

    Google Scholar 

  7. Dubrawski, A. and Crowley, J.: Learning locomotion reflexes: A self-supervise neural system for a mobile robot, Robotic Autonom. Systems 12 (1994), 133–142.

    Google Scholar 

  8. Elomaa, T. and Rousu, J.: Finding optimal multi-splits for numerical attributes in decision tree learning, NeuroCOLT, Technical Report Series, NC-Tr-96-041, March 1996.

  9. Hickey, R. J.: Noise modelling and evaluating learning from examples, Artificial Intelligence 82 (1996), 157–179.

    Google Scholar 

  10. Kaiser, M., Klingspor, V., Millan, J., and Accame, M.: Using machine learning techniques in real-world mobile robots, in: Intelligent Robot Systems, IEEE Expert, 0885-9000/95, 1995.

  11. Lawton, D. T., Arkin, R. C., and Cameron, J.M.: Qualitative spatial understanding and reactive control for autonomous robots, in: IEEE Internat. Workshop on Intelligent Robots and Systems, Vol. 2, 1990, pp. 709–714.

    Google Scholar 

  12. Maes, P. and Brooks, R. A.: Learning to co-ordinate behaviours, in: Proc. of AAAI '91, Boston, MA, 1991, pp. 796–802.

  13. Mataric, M. J.: Behaviour-based control: Main properties and implications, in: Proc. of IEEE Internat. Conf. on Robotics and Automation, Workshop on Architectures for Intelligent Control Systems, Nice, France, May 1992.

  14. Quinlan, J. R.: Decision trees and decisionmaking, IEEE Trans. Systems Man Cybernet. 20(2) (1990).

  15. Quinlan, J. R.: C4.5: Programming For Machine Learning, Morgan Kaufmann, Los Altos, CA, 1992.

    Google Scholar 

  16. Quinlan, J. R.: Using C5.0: An informal tutorial, Available to download on WWW at:http://www.rulequest.com/tutorial.html.

  17. Quinlan, J. R.: Improved use of continuous attributes in C4.5, J. Artificial Intell. Res. 4 (1996), 77–90.

    Google Scholar 

  18. Reignier, P.: Fuzzy logic techniques for mobile robots obstacle avoidance, Robotics Autonom. Systems 12 (1994), 143–153.

    Google Scholar 

  19. Salganicoff, M. and Kunin, L. G.: Active exploration based ID-3 learning for robot grasping, in: Proc. MLC-COLT Workshop on Robot Learning, New Brunswick, NJ, July 10, 1994.

  20. Salichs, M. A., Puente, E. A., Gachet, D., and Pimente, J. R.: Learning behavioural control by reinforcement for an autonomous mobile robot, in: Proc. of IECON '93, Vol. 3, 1993, pp. 1436–1441.

    Google Scholar 

  21. Shah Hamzei, G. H. and Mulvaney, D. J.: Behaviour-driven decision tree switching to identify and resolve system instability in reactive robot control, in: Proc. of the 5th Internat. Workshop on Advanced Robotics and Intelligent Machines, Manchester, UK, April 1997.

  22. Shah Hamzei, G. H. and Mulvaney, D. J.: Local minima and oscillation resolution in reactive robotics using decision tree learning, in: IASTED Internat. Conf. on Artificial Intelligence and Soft Computing, Banff, Canada, July 27–August 1, 1997.

  23. Shah Hamzei, G. H., Mulvaney, D. J., and Sillitoe, I. P. W.: Batch-mode decision tree learning applied to intelligent reactive robot control, in: IEEE Internat. Conf. on Emerging Technologies and Factory Automation (ETFA '97), Los Angeles, USA, September 9–12, 1997.

  24. Shibata, T., Abe, T., Tanie, K., and Nose, M.: Motion planning of a redundant manipulatorcriteria of skilled operators by fuzzy-ID3 and GMDH and optimisation by GA; 0-7803-2461-7/95, IEEE, 1995.

  25. Sillitoe, I. and Elomaa, T.: Learning decision tress for mapping the local environment in mobile robot navigation, in: Proc.MLC-COLTWorkshop on Robot Learning, NewBrunswick, NJ, July 1994.

  26. Surmann, H., Huser, J. and Peters, L.: A fuzzy system for indoor mobile robot navigation, 0-7803-2461-7/95, IEEE, 1995.

  27. Tani, J. and Fukumura, N.: Learning goal-directed sensory-based navigation of a mobile robot, Neural Networks 7(3) (1994), 553–563.

    Google Scholar 

  28. Utgoff, P. E.: Decision tree induction based on efficient tree restructuring, Technical Report 95-18, March 17, 1995.

  29. Utgoff, P. E. and Clouse, J. A.: A Kolmogorov–Smirnoff metric for decision tree induction, Technical Report 96-3, January 10, 1996.

  30. Utgoff, P. E.: Incremental induction of decision trees, Machine Learning 4 (1989).

  31. Wu, C. J.: Fuzzy robot navigation in unknown environments, in: IEEE Internat. Workshop on Emerging Technology and Factory Automation, August 11–14, 1992.

  32. Zrimec, T. and Mowforth, P.: Learning by an autonomous agent in the pushing domain, Robotics Autonom. Systems 0921-8830/91, 1991.

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Shah Hamzei, G.H., Mulvaney, D.J. & Sillitoe, I.P. Multi-Layer Hierarchical Rule Learning in Reactive Robot Control Using Incremental Decision Trees. Journal of Intelligent and Robotic Systems 24, 99–124 (1999). https://doi.org/10.1023/A:1008012519312

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008012519312

Navigation