Skip to main content

Toward a Practical Method for Introducing and Evaluating Trust Learning Models in Open Multi-agent Systems

  • Conference paper
  • First Online:
Advances in Ubiquitous Networking 2 (UNet 2016)

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 397))

Included in the following conference series:

Abstract

In multi-agent systems, agents often interact with each others to achieves their own goals. In open dynamic systems, trust between agents become a critical challenge to make such interactions effective. Many trust models have been proposed to formalise this concept. These models are such good for dealing with trust by proposing components that present a computational form of this concept and a learning strategies to manage it. Components and learning strategies differs from one model to another. This diversity may influence the decision of a user about the best trust model to use in his system. A comparative study is needed to evaluate each trust model and to show the prediction quality of each one. Several testbeds for the evaluation of trust models have been proposed. However, those testbeds are not flexible enough to handle different scenarios in various contexts. In this paper we formulate a practical method based on a framework that introduce the trust concept into open distributed systems, and a testbed that can be used to evaluate trust models in different contexts.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Notes

  1. 1.

    https://github.com/mifmif/JADETrustTestbed.

References

  1. Al-Mutaz, M., Malott, L., Chellappan, S.: Detecting Sybil attacks in vehicular networks. J. Trust Manage. 1–19 (2014)

    Google Scholar 

  2. Pinyol, I., Sabater, J.: Computational trust and reputation models for open multi-agent systems: a review. Artif. Intell. Rev. 40, 1–25 (2013)

    Google Scholar 

  3. Teacy, W.T.L., Patel, J., Jennings, N.R., Luck, M.: Travos: Trust and reputation in the context of inaccurate information sources. Auton. Agents Multi-Agent Syst. (AAMAS), 12(2), 183–198 (2006)

    Google Scholar 

  4. Audun, J., Roslan, I.: The beta reputation system. In: Proceedings of the 15th Bled Electronic Commerce Conference, pp. 324–337 (2002)

    Google Scholar 

  5. Victor, P., Cornelis, C., De Cock, M.: Trust Networks for Recommender Systems, vol. 4 (2011)

    Google Scholar 

  6. Sabater, J., Paolucci, M., Conte, R.: Repage: reputation and image among limited autonomous partners. J. Artif. Soc. Soc. Simul. 9(2) (2006)

    Google Scholar 

  7. Patel, J., Teacy, W.L., Jennings, N.R., Luck, M.: A probabilistic trust model for handling inaccurate reputation sources. In: Trust Management, pp. 193–209. Springer, Berlin, Heidelberg (2005)

    Google Scholar 

  8. Massa, P., Avesani, P.: Trust-aware collaborative filtering for recommender systems. In: Proceedings of the Federated International Conference on the Move to Meaningful Internet, pp. 492–508 (2004)

    Google Scholar 

  9. Fullam, K., Klos, T., Muller, G., Sabater, J., Topol, Z., Barber, K.S., Rosenschein, J., Vercouter, L.: The agent reputation and trust (ART) testbed architecture. In: Proceedings of Workshop on Trust in Agent Societies, (AAMAS-05), pp. 50–62 (2005)

    Google Scholar 

  10. Kerr, R., Cohen, R.: TREET: The trust and reputation experimentation and evaluation testbed. Electron. Commerce Res. 10(3–4), 271–290 (2010)

    Google Scholar 

  11. Jelenc, D., Hermoso, R., Sabater-Mir, J., Trček, D.: Decision making matters: a better way to evaluate trust models. Knowl.-Based Syst. 147–164 (2013)

    Google Scholar 

  12. Zhang, L., Jiang, S., Zhang, J., Ng, W.K.: Robustness of trust models and combinations for handling unfair ratings. In: Trust Management VI, pp. 36–51. Springer, Berlin, Heidelberg (2012)

    Google Scholar 

  13. Mifrah, Y., En-Nouaary, A., Dahchour, M.: An abstract framework for introducing computational trust models in JADE-based multi-agent systems. In: Advances in Ubiquitous Networking, pp. 513–523. Springer, Singapore (2015)

    Google Scholar 

  14. The JAVA Agent DEvelopment Framework. http://jade.tilab.com/

  15. Multiagent Development Kit. http://www.madkit.net

  16. Tryllian’s Agent Development Kit. http://www.tryllian.com/adk.html

  17. Kirn, S., Herzog, O., Lockemann, P., Spaniol, O.: Multiagent Engineering, Theory and Applications in Enterprises, pp. 503–530 (2006)

    Google Scholar 

  18. Parker, C.: An analysis of performance measures for binary classifiers. In: 2011 IEEE 11th International Conference on Data Mining (ICDM), pp. 517–526, Dec 2011

    Google Scholar 

  19. Jurman, G., Riccadonna, S., Furlanello, C.: A Comparison of MCC and CEN Error Measures in Multi-class Prediction (2012)

    Google Scholar 

  20. Huang, J., Ling, C.X.: Constructing new and better evaluation measures for machine learning. In: IJCAI, pp. 859–864, Jan 2007

    Google Scholar 

  21. Hernández-Orallo, J., Flach, P., Ferri, C.: A unified view of performance metrics: translating threshold choice into expected classification loss. J. Mach. Learn. Res. 13(1), 2813–2869 (2012)

    Google Scholar 

  22. Jonker, C.M., Treur, J.: A dynamic perspective on an agent’s mental states and interaction with its environment. In: Proceedings of the First International Joint Conference on Autonomous Agents and Multi-Agent Systems, AAMAS’02, 2002, pp. 865–872. ACM Press (2002)

    Google Scholar 

  23. Burete, R., Bădică, A., Bădică, C.: Reputation model with forgiveness factor for semi-competitive e-business agent societies. In: Networked Digital Technologies, pp. 402–416. Springer, Berlin, Heidelberg (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Youssef Mifrah .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Science+Business Media Singapore

About this paper

Cite this paper

Mifrah, Y., En-Nouaary, A., Dahchour, M. (2017). Toward a Practical Method for Introducing and Evaluating Trust Learning Models in Open Multi-agent Systems. In: El-Azouzi, R., Menasche, D.S., Sabir, E., De Pellegrini, F., Benjillali, M. (eds) Advances in Ubiquitous Networking 2. UNet 2016. Lecture Notes in Electrical Engineering, vol 397. Springer, Singapore. https://doi.org/10.1007/978-981-10-1627-1_45

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-1627-1_45

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-1626-4

  • Online ISBN: 978-981-10-1627-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics