Learning and adaptivity: Enhancing reactive behaviour architectures in real-world interaction systems

  • Miles Pebody
5. Robotics and Emulation of Animal Behavior
Part of the Lecture Notes in Computer Science book series (LNCS, volume 929)


The success of the behaviour-based approach to designing robot control structures has largely been a result of the bottom-up development of a number of fast, tightly coupled control processes. These are specifically designed for a particular agent-environment situation. The onus is on the designers to provide the agent with a suitable response repertoire using their own knowledge of the proposed agent-environment interaction. A need for learning and adaptivity to be built into robot systems from the lowest levels is identified. An enhancement to basic reactive robot control architectures is proposed that enables processes to learn and subsequently adapt their input-output mapping. This results in both a local and global increase in robustness as well as a simplification of the design process. An implementation of the proposed mechanism is demonstrated in a real-world situated system: the control of an active laser scanning sensor.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Arkin90: The Impact of Cybernetics on the Design of a Mobile Robot System: A Case Study. Ronald C. Arkin, IEEE Transactions on Systems, Man and Cybernetics, Vol 20, no 6, November/December 1990.Google Scholar
  2. Brooks86. A Robust Layered Control System For A Mobile Robot, Rodney A. Brooks, IEEE Journal of robotics and automation. Vol. RA-2, No 1, March 1986.Google Scholar
  3. Brooks89: Fast Cheap and Out of Control: A Robot Invasion of the Solar System. Rodney A. Brooks and Anita M. Flynn. Journal of the British Interplanetary Society. Vol 42 1989.Google Scholar
  4. Brooks 91: Intelligence without reason. AI memo 1293, Massachusetts Institute of Technology AI laboratory.Google Scholar
  5. Clark, Arkin and Ram 92: Learning Momentum: On-Line Performance Enhancement for Reactive Systems. Russell J. Clark, Ronald C. Arkin, Ashwin Ram. Proceedings of 1992 IEEE International Conference on Robotics and Automation. Nice, France.Google Scholar
  6. Dorf 92: Modem Control Systems. Richard C. Dorf. Published by Addison-Wesley 1992.Google Scholar
  7. Edelman89. The Remembered Present: A Biological Theory of Consciousness. New York: Basic Books.Google Scholar
  8. Gat et al 94: Behaviour Control for Robotic Exploration of Planetary Surfaces. Erann Gat, Rajiv Desai, Robert Ivlev, John Loch and David P. Miller. IEEE Transactions on Robotics and Automation, Vol 10, No. 4, August 1994.Google Scholar
  9. Gaussier and Zrehen 94: Complex Neural Architectures for Emerging Cognitive Abilities in an Autonomous System. Conference proceedings: From Perception to Action 94. IEEE Computer Society Press 1994.Google Scholar
  10. Grossberg69: Some networks that can learn, remember and reproduce any number of complicated space-time patterns. Journal of Mathematics and Mechanics 19:53–91. 1969.Google Scholar
  11. Harris94: Advances in Intelligent Control. Edited by C.J. Harris. Published by Taylor and Francis 1994.Google Scholar
  12. IAL93: Automatic Inspection Saves Money and Improves Quality. Commercial publication. Image Automation Ltd, Kelvin House, Worsley Bridge Road, Sydenham, London, SE26 5BX., UK.Google Scholar
  13. Kaebling93: Learning in Embedded Systems. Leslie Pack Kaebling, Bradford Books MIT Press 1993.Google Scholar
  14. Kohonen88: Self-Organisation and Associative Memory. Springer-Verlag 1988.Google Scholar
  15. Maes89: How To Do The Right Thing. Pattie Maes, Connection Science, Vol. 1, No 3, 1989.Google Scholar
  16. Maes and Brooks 90: Learning to Coordinate Behaviours. Pattie Maes and Rodney A. Brooks. AAAI 1990 Conference Proceedings.Google Scholar
  17. Mahadevan and Connell 92: Automatic Programming of Behaviour Based Robots Using Reinforcement Learning. Sridhar Mahadevan and Jonathan Connell, Artificial Intelligence 55, Elsevier Science Publishers 1992.Google Scholar
  18. Mataric94: Reward Functions for Accelerated Learning. Maja J. Mataric. MIT Artificial Intelligence Laboratory. 545 Technology Square, Cambridge MA 02139 USA.Google Scholar
  19. McFarland85: Animal Behaviour, section 2.3 Animal Learning. David McFarland. Publishers Longman Scientific and Technical. 1985.Google Scholar
  20. Nehmzow and Smithers 90: Mapbuilding using Self-Organising Networks in “Really Useful Robots”. Ulrich Nehmzow and Tim Smithers. University of Edinburgh Department of Artificial Intelligence Research Paper No. 489.Google Scholar
  21. Pebody94: Acting to Sense: The lowest levels of a Subsumption Architecture. Miles Pebody. Conference proceedings: From Perception to Action 94. IEEE Computer Society Press 1994.Google Scholar
  22. Pfeifer93: Studying Emotions: Fungus Eaters. Rolf Pfeifer. Proceedings 2nd European Conference of Artificial Life 1993.Google Scholar
  23. Pfeifer and Verschure 93: Categorisation, Representations and the Dynamics of System-Environment Interaction: A case study in autonomous systems. Paul F.M.J. Verschure and Rolf Pfeifer. Proceeding of the Second International Conference on the Simulation of Adaptive Behaviour, Bradford books MIT Press 1993.Google Scholar
  24. Smithers94: What the Dynamics of Adaptive Behaviour and Cognition Might Look Like in Agent-Environment Interaction Systems. Tim Smithers. Workshop proceedings: On the Role of Dynamics and Representation in Adaptive Behaviour and Cognition. 9 and 10 December, 1994, Hosted by University of the Basque Country (UPV/EHU) Faculty of Informatics.Google Scholar
  25. Steels93: Building Agents Out Of Autonomous Behaviours. Luc Steels in The Artificial Life Route To Artificial Intelligence: Building Situated Embodied Agents. L Steels and R. Brooks (eds) 1993. New Haven: Lawrence Erlbaum Ass.Google Scholar
  26. Wasserman89: Neural Computing: Theory and Practice. Philip D. Wasserman. Van Nostrand Reinhold. 1989.Google Scholar

Copyright information

© Springer-Verlag 1995

Authors and Affiliations

  • Miles Pebody
    • 1
  1. 1.Department Of Computer ScienceUniversity College LondonLondonUK

Personalised recommendations