Skip to main content

Offline Norm Evolution

  • Conference paper
  • First Online:
Agents and Artificial Intelligence (ICAART 2015)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9494))

Included in the following conference series:

  • 538 Accesses

Abstract

An approach to the pre-runtime design of normative systems for a class of problem-solving norm-regulated multi-agent systems is suggested. The basic idea is to employ evolutionary mechanisms to evolve efficient normative systems for so-called norm-regulated Dalmases, as part of the design process. The Dalmas architecture uses an algebraic approach to normative systems, in which normative consequences are based on an extended set of one-agent types of normative positions, which is given a semantics in terms of prohibition of certain types of state transitions. To illustrate the approach, a genetic algorithm is used to evolve norms for an example system. Furthermore, some approaches to reducing the algorithm’s search space, including to employ a notion of ‘operational equivalence’ of norms, are discussed. It is demonstrated that an evolutionary algorithm may be a useful tool when designing norms for problem-solving multi-agent systems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.robocup.org.

  2. 2.

    The free variables in \(c(x_{1} ,...,x_{p})\) must be the same, and in the same order, as the free variables in \(d(x_{1},...,x_{q})\), but it is not necessary that c and d have the same arity. Cf. [20, p.146].

  3. 3.

    Cf. [19, Sect. 1.8.3].

  4. 4.

    In [9], such a tuple is called a transition system situation.

  5. 5.

    Cf. the remark in [10, p. 84].

  6. 6.

    The ‘move operator’ \(M_{\kappa }\), where \(\kappa \) is less than or equal to the arity of the condition to which it is applied, identifies the agent to which the normative condition applies with the moving agent x in the situation \(\langle x,s\rangle \), as well as with the \(\kappa \)th agent in the argument sequence \(X_{\nu }\). For example, \(M_{1}Lap_{0}(x_{1},x_{2},x_{3};x,s)\) holds if and only if \(Lap_{0}(x_{1},x_{2};s)\) holds, and \(x_{1}=x_{3}\), and \(x_{3}=x\). See, e.g., [9] for an explanation.

  7. 7.

    This is due to the fact that \(Lap_{6} \,R\,Lap_{9}^{\prime }\) and \(Lap_{9}\,R\,Lap_{6}^{\prime }\). Thus, if a certain type of normative position holds regarding \(Lap_{9}\), then this completely determines the type of normative position regarding \(Lap_{6}\), or vice versa. For example, when \(Lap_{9}\) holds, if \(P_{7}Lap_{6}\), then it must follow that \(P_{5}Lap_{9}\).

  8. 8.

    http://watchmaker.uncommons.org/.

  9. 9.

    The source code is available for download via http://drpa.se/norms/nrtssit, together with a log of a run of the algorithm.

References

  1. Alechina, N., Bassiliades, N., Dastani, M., Vos, M.D., Logan, B., Mera, S., Morris-Martin, A., Schapachnik, F.: Computational models for normative multi-agent systems. In: Andrighetto, G., Governatori, G., Noriega, P., van der Torre, L.W.N. (eds.) Normative Multi-Agent Systems, Dagstuhl Follow-Ups, vol. 4, pp. 71–92. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, Dagstuhl, Germany (2013). http://drops.dagstuhl.de/opus/volltexte/2013/4000

    Google Scholar 

  2. Andrighetto, G., Castelfranchi, C., Mayor, E., McBreen, J., Lopez-Sanchez, M., Parsons, S.: (Social) Norm dynamics. In: Andrighetto, G., Governatori, G., Noriega, P., van der Torre, L.W.N. (eds.) Normative Multi-Agent Systems, Dagstuhl Follow-Ups, vol. 4, pp. 135–170. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, Dagstuhl, Germany (2013). http://drops.dagstuhl.de/opus/volltexte/2013/4002

    Google Scholar 

  3. Andrighetto, G., Governatori, G., Noriega, P., van der Torre, L.W.: Normative multi-agent systems. Dagstuhl Follow-Ups. vol. 4. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik (2013). http://www.dagstuhl.de/dagpub/978-3-939897-51-4

  4. Balke, T., Cranefield, S., Tosto, G.D., Mahmoud, S., Paolucci, M., Savarimuthu, B.T.R., Verhagen, H.: Simulation and NorMAS. In: Andrighetto, G., Governatori, G., Noriega, P., van der Torre, L.W.N. (eds.) Normative Multi-Agent Systems, Dagstuhl Follow-Ups, vol. 4, pp. 171–189. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, Dagstuhl, Germany (2013). http://drops.dagstuhl.de/opus/volltexte/2013/4003

    Google Scholar 

  5. Darwen, P.: Computationally intensive and noisy tasks: co-evolutionary learning and temporal difference learning on backgammon. In: Proceedings of the 2000 Congress on Evolutionary Computation, vol. 2, pp. 872–879 (2000)

    Google Scholar 

  6. Di Pietro, A., While, R.L., Barone, L.: Learning in robocup keepaway using evolutionary algorithms. GECCO 2, 1065–1072 (2002)

    Google Scholar 

  7. Hjelmblom, M.: Deontic action-logic multi-agent systems in Prolog. Technical report 30, University of Gävle, Division of Computer Science (2008). http://urn.kb.se/resolve?urn=urn:nbn:se:hig:diva-1475

  8. Hjelmblom, M.: State transitions and normative positions within normative systems. Technical report 37, University of Gävle, Department of Industrial Development, IT and Land Management (2011). http://urn.kb.se/resolve?urn=urn:nbn:se:hig:diva-10595

  9. Hjelmblom, M.: Norm-regulated transition system situations. In: Filipe, J., Fred, A. (eds.) Proceedings of the 5th International Conference on Agents and Artificial Intelligence, ICAART 2013, pp. 109–117. SciTePress, Portugal (2013). http://urn.kb.se/resolve?urn=urn:nbn:se:hig:diva-13987

    Google Scholar 

  10. Hjelmblom, M.: Instrumentalization of norm-regulated transition system situations. In: Filipe, J., Fred, A. (eds.) ICAART 2013. CCIS, vol. 449, pp. 80–94. Springer, Heidelberg (2014). http://dx.doi.org/10.1007/978-3-662-44440-5_5

    Google Scholar 

  11. Hjelmblom, M.: Normative positions within norm-regulated transition system situations. In: 2014 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT), vol. 3, pp. 238–245, August 2014

    Google Scholar 

  12. Hjelmblom, M.: Normative positions in multi-agent systems (2015). Submitted to Web Intelligence and Agent Systems: An International Journal (WIAS)

    Google Scholar 

  13. Hjelmblom, M., Odelstad, J.: jDALMAS: A java/prolog framework for deontic action-logic multi-agent systems. In: Håkansson, A., Nguyen, N.T., Hartung, R.L., Howlett, R.J., Jain, L.C. (eds.) KES-AMSTA 2009. LNCS, vol. 5559, pp. 110–119. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  14. Kanger, S.: Law and logic. Theoria 38(3), 105–132 (1972). http://dx.doi.org/10.1111/j.1755-2567.1972.tb00928.x

    Article  MathSciNet  MATH  Google Scholar 

  15. Lindahl, L.: Position and change: a study in law and logic. Synthese library, D. Reidel Pub. Co. (1977). http://www.google.com/books?id=_QwWhOK8aY0C

  16. Lindahl, L., Odelstad, J.: The theory of joining-systems. In: Gabbay, D., Horthy, J., Parent, X., van der Meyden, R., van der Torre, L. (eds.) Handbook of Deontic Logic, Chap. 9, vol. 1, pp. 545–634. College Publications, London (2013)

    Google Scholar 

  17. Luke, S., Hohn, C., Farris, J., Jackson, G., Hendler, J.: Co-evolving soccer softbot team coordination with genetic programming. In: Kitano, H. (ed.) RoboCup 1997. LNCS, vol. 1395, pp. 398–411. Springer, Heidelberg (1998). http://dx.doi.org/10.1007/3-540-64473-3_76

    Chapter  Google Scholar 

  18. Nakashima, T., Takatani, M., Udo, M., Ishibuchi, H.: An evolutionary approach for strategy learning in robocup soccer. In: 2004 IEEE International Conference on Systems, Man and Cybernetics, vol. 2, pp. 2023–2028. IEEE (2004)

    Google Scholar 

  19. Odelstad, J.: Many-Sorted Implicative Conceptual Systems. Ph.D. thesis, Royal Institute of Technology, Sweden (2008). qC 20100901

    Google Scholar 

  20. Odelstad, J., Boman, M.: Algebras for agent norm-regulation. Ann. Math. Artif. Intell. 42, 141–166 (2004). doi:10.1023/B:AMAI.0000034525.49481.4a

    Article  MathSciNet  MATH  Google Scholar 

  21. Verhagen, H., Boman, M.: Norms can replace plans. In: IJCAI 1999 Workshop on Adjustable, Autonomous Systems (1999)

    Google Scholar 

  22. Whitley, D.: An overview of evolutionary algorithms: practical issues and common pitfalls. Inf. Softw. Technol. 43(14), 817–831 (2001). http://www.sciencedirect.com/science/article/pii/S0950584901001884

    Article  Google Scholar 

Download references

Acknowledgements

The author is very grateful to Jan Odelstad and Magnus Boman for valuable ideas and suggestions, to participants of ICAART 2015 for discussions in relation to this paper, and to the organizers of the conference for the opportunity to expand the conference paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Magnus Hjelmblom .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Hjelmblom, M. (2015). Offline Norm Evolution. In: Duval, B., van den Herik, J., Loiseau, S., Filipe, J. (eds) Agents and Artificial Intelligence. ICAART 2015. Lecture Notes in Computer Science(), vol 9494. Springer, Cham. https://doi.org/10.1007/978-3-319-27947-3_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-27947-3_17

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-27946-6

  • Online ISBN: 978-3-319-27947-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics