From Reactive Robotics to Situated Multiagent Systems

A Historical Perspective on the Role of Environment in Multiagent Systems
  • Danny Weyns
  • Tom Holvoet
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3963)


Historically, the idea of situated multiagent systems—in which the environment gets a prominent role—originates from the domain of reactive robotics. In this paper, we give a historical perspective of research on agency that devotes pertinent attention to the environment, and show how the role of the environment evolved along with subsequent evolutions of agent systems. Today, it is quite obvious that the environment offers opportunities and challenges for all types of agency. We discuss recent research in this area, which advocates that the environment is not only an essential part of every multiagent system, but also provides an exploitable design abstraction to build multiagent systems. The notion of environment exceeds specific types of agency, and as such offers opportunities for synergetic research in the interest of multiagent systems in general.


Virtual Environment Multiagent System Agent System Software Architecture Automate Guide Vehicle 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Weyns, D., Van Dyke Parunak, H., Michel, F., Holvoet, T., Ferber, J.: Environments for multiagent systems state-of-the-art and research challenges. In: Weyns, D., Van Dyke Parunak, H., Michel, F. (eds.) E4MAS 2004. LNCS, vol. 3374, pp. 1–47. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  2. 2.
    Weyns, D., Vizzari, G., Holvoet, T.: Environments for situated multi-agent systems: Beyond infrastructure. In: Weyns, D., Van Dyke Parunak, H., Michel, F. (eds.) E4MAS 2005. LNCS, vol. 3830, pp. 1–17. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  3. 3.
    AgentLink III Technical Forum Group on Environments for Multiagent Systems,
  4. 4.
    Weyns, D., Schumacher, M., Ricci, A., Viroli, M., Holvoet, T.: Environment in Multiagent Systems. Knowledge Engineering Review 20 (2005)Google Scholar
  5. 5.
    Brooks, R.A.: Achieving Artificial Intelligence through Building Robots. In: AI Memo 899. MIT Lab, Cambridge (1986)Google Scholar
  6. 6.
    Agre, P.E., Chapman, D.: Pengi: An Implementation of a Theory of Activity. In: Proceedings of National Conference on Artificial Intelligence, Seattle, WA (1987)Google Scholar
  7. 7.
    Rosenschein, S.J., Kaelbling, L.P.: The Synthesis of Digital Machines With Provable Epistemic Properties. In: Proceedings of the First Conference on Theoretical Aspects of Reasoning about Knowledge, Monterey, CA (1986)Google Scholar
  8. 8.
    Brooks, R.A.: Intelligence Without Reason. In: Proceedings of 12th International Joint Conference on Artificial Intelligence, Sydney, Australia (1991)Google Scholar
  9. 9.
    Maes, P.: Situated Agents Can Have Goals. Designing Autonomous Agents. MIT Press, Cambridge (1990)Google Scholar
  10. 10.
    Pylyshyn, Z.: The Robot’s Dilemma. The Frame Problem in Artificial Intelligence. Ablex Publishing Corp., Norwood (1987)Google Scholar
  11. 11.
    Kaelbling, L.P., Rosenschein, S.J.: Action and Planning in Embedded Agents. In: Designing Autonomous Agents. MIT Press, Cambridge (1990)Google Scholar
  12. 12.
    Arkin, R.C.: Motor Schema-Based Mobile Robot Navigation. International Journal of Robotics Research 8 (1989)Google Scholar
  13. 13.
    Rosenblatt, J.: DAMN: A Distributed Architecture for Mobile Navigation. In: Proceedings of the Spring Symposium on Lessons Learned from Implemented Software Architectures for Physical Agents. AAAI Press, Menlo Park (1995)Google Scholar
  14. 14.
    Rosenblatt, K., Payton, D.: A Fine Grained Alternative to the Subsumption Architecture for Mobile Robot Control. In: Proceedings of the International Joint Conference on Neural Networks. IEEE, Los Alamitos (1989)Google Scholar
  15. 15.
    Tyrrell, T.: Computational Mechanisms for Action Selection. University of Edinburgh, Edinburgh (1993)Google Scholar
  16. 16.
    Arbib, M.A.: Schema Theory. Encyclopedia of Artificial Intelligence (1992)Google Scholar
  17. 17.
    Custers, R.: The Agent Network Architecture Extended for Cooperating Robots. Master Thesis, Katholieke Universiteit Leuven, Belgium (2004)Google Scholar
  18. 18.
    Kaelbling, L.P.: Goals as Parallel Program Specifications. In: Proceedings of the Seventh National Conference on Artifical Intelligence, Minneapolis, Minnesota (1988)Google Scholar
  19. 19.
    Steels, L.: Exploiting Analogicl Representations. Designing Autonomous Agents (1990)Google Scholar
  20. 20.
    Arkin, R.: Integrating Behavioral, Perceptual, and World Knowledge in Reactive Navigation. Designing Autonomous Agents. MIT Press, Cambridge (1990)Google Scholar
  21. 21.
    Agre, P.E., Chapman, D.: What are Plans for? Designing Autonomous Agents. MIT Press, Cambridge (1990)Google Scholar
  22. 22.
    Nilsson, N.J.: Teleo-Reactive Programs for Agent Control. Journal of Artificial Intelligence Research 1 (1994)Google Scholar
  23. 23.
    Bryson, J.J.: Intelligence by Design, Principles of Modularity and Coordination for Engineering Complex Adaptive Agents. PhD Dissertation: MIT (2001)Google Scholar
  24. 24.
    Malcolm, C., Smithers, T.: Symbol Grounding via a Hybrid Architecture in an Autonomous Assembly System. Designing Autonomous Agents. MIT Press, Cambridge (1990)Google Scholar
  25. 25.
    Arkin, R.: Bahavior-Based Robotics. MIT Press, Cambridge (1998)Google Scholar
  26. 26.
    Reynolds, C.: Flocks, Herds and Schools: A Distributed Behavior Model. Computer Graphics 21 (1996)Google Scholar
  27. 27.
    Mataric, M.: Leaning to Behave Socially. In: From Animals to Animats, Proceedings of the 3th International Conference on Simulation of Adaptive Behavior. MIT Press, Cambridge (1994)Google Scholar
  28. 28.
    Zeghal, K., Ferber, J.: CRAASH: A Coordinated Collision Avoidance System. In: Proceedings of European Simulation Conference, Lyon, France (1993)Google Scholar
  29. 29.
    Arkin, R.: Behavior-Based Robotics, Massachusetts Institute of Technology. MIT Press, Cambridge (1998)Google Scholar
  30. 30.
    Wavish, P.R., Connah, D.M.: Representing Multiagent Worlds in ABLE. Technical Note, TN2964, Philips Research Laboratories (1990)Google Scholar
  31. 31.
    Grassé, P.P.: La Reconstruction du nid et les Coordinations Inter-Individuelles chez Bellicositermes Natalensis et Cubitermes sp. La theorie de la Stigmergie. Essai d’interpretation du Comportement des Termites Constructeurs. Insectes Sociaux 6 (1959)Google Scholar
  32. 32.
    Deneubourg, J.L., Goss, S.: Collective Patterns and Decision Making. Ecology, Ethology and Evolution 1 (1989)Google Scholar
  33. 33.
    Steels, L.: Cooperation between Distributed Agents through Self-Organization. Decentralized Artificial Intelligence (1989)Google Scholar
  34. 34.
    Parunak, V.: Go to the Ant: Engineering Principles from Natural Agent Systems. Annals of Operations Research 75 (1997)Google Scholar
  35. 35.
    Dorigo, M., Gambardella, L.: Ant Colony System: A Cooperative Learning Approach to the Traveling Salesman Problem. IEEE Transactions on Evolutionary Computation 1 (1997)Google Scholar
  36. 36.
    Bonabeau, E., Henaux, F., Guérin, S., Snyers, D., Kuntz, P., Theraulaz, G.: Routing in Telecommunications Networks with Ant-Like Agents. In: Albayrak, Ş., Garijo, F.J. (eds.) IATA 1998. LNCS, vol. 1437, p. 60. Springer, Heidelberg (1998)CrossRefGoogle Scholar
  37. 37.
    Sauter, J., Parunak, H.: ANTS in the Supply Chain. In: Agent based Decision Support for Managing the Internet-Enabled Supply Chain, Seattle, WA (1999)Google Scholar
  38. 38.
    Brueckner, S.: Return from the Ant, Synthetic Ecosystems for Manufacturing Control. Ph.D Dissertation, Humboldt University, Berlin, Germany (2000)Google Scholar
  39. 39.
    Babaoglu, O., Meling, H., Montresor, A.: Anthill: A Framework for the Development of Agent-Based Peer-to-Peer systems. In: Proceedings of the 22nd International Conference on Distributed Computing Systems, Vienna, Austria. IEEE Computer Society, Los Alamitos (2002)Google Scholar
  40. 40.
    Mamei, M., Zambonelli, F.: Co-Fields: A Physically Inspired Approach to Distributed Motion Coordination. IEEE Pervasive Computing 3 (2004)Google Scholar
  41. 41.
    Parunak, V.: home page,
  42. 42.
    Mamei, M., Zambonelli, F., Leonardi, L.: Distributed Motion Coordination with Co-Fields: A Case Study in Urban Traffic Management. In: 6th IEEE Symposium on Autonomous Decentralized Systems, Pisa, Italy. IEEE Press, Los Alamitos (2003)Google Scholar
  43. 43.
    Mamei, M., Zambonelli, F.: Motion Coordination in the Quake 3 Arena Environment: A Field-Based Approach. In: Weyns, D., Van Dyke Parunak, H., Michel, F. (eds.) E4MAS 2004. LNCS, vol. 3374, pp. 264–278. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  44. 44.
    Bandini, S., Manzoni, S., Simone, C.: Dealing with Space in Multiagent Systems: A Model for Situated Multiagent Systems. In: Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems. ACM Press, New York (2002)Google Scholar
  45. 45.
    Bandini, S., Manzoni, S., Vizzari, G.: Multi Agent Approach to Localization Problems: the Case of Multilayered Multi Agent Situated System. Web Intelligence and Agent Systems 2 (2004)Google Scholar
  46. 46.
    Bandini, S., Federici, M.L., Manzoni, S., Vizzari, G.: Towards a methodology for situated cellular agent based crowd simulations. In: Dikenelli, O., Gleizes, M.-P., Ricci, A. (eds.) ESAW 2005. LNCS, vol. 3963, pp. 203–220. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  47. 47.
    Ferber, J., Muller, J.: Influences and Reaction: a Model of Situated Multiagent Systems. In: Second International Conference on Multi-agent Systems. AAAI Press, Japan (1996)Google Scholar
  48. 48.
    Genesereth, M.R., Nilsson, N.: Logical Foundations of Artificial Intelligence. Morgan Kaufmann, San Francisco (1997)Google Scholar
  49. 49.
    Ferber, J.: An Introduction to Distributed Artificial Intelligence. Addison-Wesley, Reading (1999)Google Scholar
  50. 50.
    Helleboogh, A., Holvoet, T., Berbers, Y.: Simulating actions in dynamic environments. In: Dittmann, J., Katzenbeisser, S., Uhl, A. (eds.) CMS 2005. LNCS, vol. 3677. Springer, Heidelberg (2005)Google Scholar
  51. 51.
    Weyns, D., Helleboogh, A., Holvoet, T.: The Packet-World: A Test Bed for Investigating Situated Multiagent Systems. In: Software Agent-Based Applications, Platforms and Development Kits. Whitestein Series in Software Agent Technology (2005)Google Scholar
  52. 52.
  53. 53.
    Helsen, E., Deschacht, K.: The DELTA Framework for Situated Multiagent Systems. Master Thesis, Katholieke Universiteit Leuven, Belgium (2005)Google Scholar
  54. 54.
  55. 55.
    Weyns, D., Steegmans, E., Holvoet, T.: Towards Active Perception in Situated Multi-Agent Systems. Journal on Applied Artificial Intelligence 18 (2004)Google Scholar
  56. 56.
    Weyns, D., Steegmans, E., Holvoet, T.: Integrating Free-Flow Architectures with Role Models Based on Statecharts. In: Weyns, D., Van Dyke Parunak, H., Michel, F. (eds.) E4MAS 2004. LNCS, vol. 3374. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  57. 57.
    Steegmans, E., Weyns, D., Holvoet, T., Berbers, Y.: A Design Process for Adaptive Behavior of Situated Agents. In: Odell, J.J., Giorgini, P., Müller, J.P. (eds.) AOSE 2004. LNCS, vol. 3382, pp. 109–125. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  58. 58.
    Weyns, D., Steegmans, E., Holvoet, T.: Protocol Based Communication for Situated Multiagent Systems. In: 3th Joint Conference on Autonomous Agents and Multi-Agent Systems, New York (2004)Google Scholar
  59. 59.
    Weyns, D., Holvoet, T.: Formal Model for Situated Multi-Agent Systems. Fundamenta Informaticae 63 (2004)Google Scholar
  60. 60.
    Weyns, D., Holvoet, T.: Regional Synchronization for Situated Multi-agent Systems. In: Mařík, V., Müller, J.P., Pěchouček, M. (eds.) CEEMAS 2003. LNCS, vol. 2691, p. 497. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  61. 61.
    EMC2: Egemin Modular Controls Concept,
  62. 62.
    Weyns, D., Schelfthout, K., Holvoet, T.: Exploiting a Virtual Environment in a Real-World Application. In: 2nd International Workshop on Environments for Multiagent Systems, Utrecht (2005)Google Scholar
  63. 63.
    Tummolini, L., Castelfranchi, C., Ricci, A., Viroli, M., Omicini, A.: “Exhibitionists” and “Voyeurs” Do It Better: A Shared Environment for Flexible Coordination with Tacit Messages. In: Weyns, D., Van Dyke Parunak, H., Michel, F. (eds.) E4MAS 2004. LNCS, vol. 3374, pp. 215–231. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  64. 64.
    Platon, E., Sabouret, N., Honiden, S.: Oversensing with a Softbody in the Environment: Another Dimension of Observation. In: Proceedings of Modeling Others from Observation at International Joint Conference on Artificial Intelligence, Edinburgh, Scotland (2005)Google Scholar
  65. 65.
    Ferber, J., Michel, F., Baez, J.: AGRE: Integrating environments with organizations. In: Weyns, D., Van Dyke Parunak, H., Michel, F. (eds.) E4MAS 2004. LNCS, vol. 3374, pp. 48–56. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  66. 66.
    Zambonelli, F., Jennings, N., Wooldridge, M.: Developing Multiagent Systems: The Gaia Methodology. ACM Transactions on Software Engineering and Methodology 12 (2003)Google Scholar
  67. 67.
    Julien, C., Roman, G.C.: Egocentric Context-Aware Programming in Ad-Hoc Mobile Environments. In: Proceedings of the 10th Symposium on Foundations of Software Engineering, Charleston, South Carolina, USA. ACM Press, New York (2002)Google Scholar
  68. 68.
    Schelfthout, K., Holvoet, T.: Views: Customizable Abstractions for Context-Aware Applications in MANETs. In: Software Engineering for Large-Scale Multi-Agent Systems, St. Louis, USA (2005)Google Scholar
  69. 69.
    Chang, P.H.-M., Chen, K.-T., Chien, Y.-H., Kao, E.C.-C., Soo, V.-W.: From Reality to Mind: A Cognitive Middle Layer of Environment Concepts for Believable Agents. In: Weyns, D., Van Dyke Parunak, H., Michel, F. (eds.) E4MAS 2004. LNCS, vol. 3374, pp. 57–73. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  70. 70.
    Minsky, N., Ungureanu, V.: Law-Governed Interaction: A Coordination and Control Mechanism for Heterogeneous Distributed Systems. ACM Transactions on Software Engineering Methodologies 9 (2000)Google Scholar
  71. 71.
    Noriega, P., Sierra, C.: Electronic Institutions: Future Trends and Challenges. In: Klusch, M., Ossowski, S., Shehory, O. (eds.) CIA 2002. LNCS, vol. 2446, pp. 14–17. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  72. 72.
    Weyns, D., Schelfthout, K., Holvoet, T., Lefever, T.: Decentralized control of E’GV transportation systems. In: 4th Joint Conference on Autonomous Agents and Multiagent Systems, Industry Track, Utrecht, The Netherlands. ACM Press, New York (2005)Google Scholar
  73. 73.
    Weyns, D., Van Dyke Parunak, H., Michel, F., Holvoet, T., Ferber, J.: Environments for Multiagent Systems State-of-the-Art and Research Challenges. In: Weyns, D., Van Dyke Parunak, H., Michel, F. (eds.) E4MAS 2004. LNCS, vol. 3374, pp. 1–47. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  74. 74.
    Bass, L., Clements, P., Kazman, R.: Software Architecture in Practice. Addison Wesley Publishing Comp., Reading (2003)Google Scholar
  75. 75.
    Shaw, M., Garlan, D.: Software architecture: perspectives on an emerging discipline. Prentice-Hall, Englewood Cliffs (1996)MATHGoogle Scholar
  76. 76.
    Valckenaers, P., Van Brussel, H.: Holonic Manufacturing Execution Systems. CIRP Annals-Manufacturing Technology 54, 427–432 (2005)CrossRefGoogle Scholar
  77. 77.
    Viroli, M., Omicini, A., Ricci, A.: Engineering MAS Environment with Artifacts. In: Weyns, D., Parunak, V., Michel, F. (eds.) 2nd International Workshop Environments for Multi-Agent Systems, AAMAS 2005, Utrecht, The Netherlands (2005)Google Scholar
  78. 78.
    Molesini, A., Omicini, A., Denti, E., Ricci, A.: SODA: A Roadmap to Artifacts. In: 6th International Workshop on Engineering Societies in the Agents World, ESAW (2005)Google Scholar
  79. 79.
    Kendall, E., Jiang, C.: Multiagent System Design Based on Object Oriented Patterns. Journal of Object Oriented Programming (1997)Google Scholar
  80. 80.
    Schelfthout, K., Coninx, T., Helleboogh, A., Holvoet, T., Steegmans, E., Weyns, D.: Agent Implementation Patterns. In: OOPSLA Workshop on Agent-oriented Methodologies, Seattle, WA USA (2002)Google Scholar
  81. 81.
    Murphy, A., Picco, G., Roman, G.: LIME: a Middleware for Physical and Logical Mobility. In: 21th International Conference on Distributed Computing Systems (2001)Google Scholar
  82. 82.
    Omicini, A., Ossowski, S., Ricci, A.: Coordination infrastructures in the engineering of multiagent systems. In: Bergenti, F., Gleizes, M.P., Zambonelli, F. (eds.) Methodologies and Software Engineering for Agent Systems: The Agent-Oriented Software Engineering Handbook. Multiagent Systems, Artificial Societies, and Simulated Organizations, vol. 11, pp. 273–296. Kluwer Academic Publishers, Dordrecht (2004)CrossRefGoogle Scholar
  83. 83.
    Mamei, M., Zambonelli, F.: Programming pervasive and mobile computing applications with the tota middleware. In: 2nd IEEE International Conference on Pervasive Computing and Communication (2004)Google Scholar
  84. 84.
    Schelfthout, K., Weyns, D., Holvoet, T.: Middleware for Protocol-based Coordination in Dynamic Networks. In: Proceedings of the 3rd International Workshop on Middleware for Pervasive and Ad-hoc Computing, Grenoble, France. ACM Press, New York (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Danny Weyns
    • 1
  • Tom Holvoet
    • 1
  1. 1.AgentWise, DistriNet, Katholieke Universiteit LeuvenLeuvenBelgium

Personalised recommendations