Machine Learning

, Volume 82, Issue 2, pp 191–209 | Cite as

Statistical relational learning of trust

Article

Abstract

The learning of trust and distrust is a crucial aspect of social interaction among autonomous, mentally-opaque agents. In this work, we address the learning of trust based on past observations and context information. We argue that from the truster’s point of view trust is best expressed as one of several relations that exist between the agent to be trusted (trustee) and the state of the environment. Besides attributes expressing trustworthiness, additional relations might describe commitments made by the trustee with regard to the current situation, like: a seller offers a certain price for a specific product. We show how to implement and learn context-sensitive trust using statistical relational learning in form of a Dirichlet process mixture model called Infinite Hidden Relational Trust Model (IHRTM). The practicability and effectiveness of our approach is evaluated empirically on user-ratings gathered from eBay. Our results suggest that (i) the inherent clustering achieved in the algorithm allows the truster to characterize the structure of a trust-situation and provides meaningful trust assessments; (ii) utilizing the collaborative filtering effect associated with relational data does improve trust assessment performance; (iii) by learning faster and transferring knowledge more effectively we improve cold start performance and can cope better with dynamic behavior in open multiagent systems. The later is demonstrated with interactions recorded from a strategic two-player negotiation scenario.

Keywords

Relational learning Computational trust Social computing Infinite hidden relational models Initial trust 

References

  1. Ashri, R., Ramchurn, S. D., Sabater, J., Luck, M., & Jennings, N. R. (2005). Trust evaluation through relationship analysis. In AAMAS ’05: Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems (pp. 1005–1011). New York, NY, USA, 2005. New York: ACM Press. CrossRefGoogle Scholar
  2. Chadwick, D. W. (2005). Operational models for reputation servers. In P. Herrmann, V. Issarny, & S. Shiu (Eds.), Lecture notes in computer science : Vol. 3477. Third international conference, iTrust 2005, Proceedings (pp. 108–115). Paris, France, May 23–26, 2005. Berlin: Springer. Google Scholar
  3. Endriss, U. (2006). Monotonic concession protocols for multilateral negotiation. In AAMAS ’06: Proceedings of the fifth international joint conference on autonomous agents and multiagent systems (pp. 392–399). New York, NY, USA, 2006. New York: ACM Press. CrossRefGoogle Scholar
  4. Fullam, K. K., Klos, T. B., Muller, G., Sabater, J., Topol, Z., Barber, K. S., Rosenschein, J. S., & Vercouter, L. (2005). The agent reputation and trust (art) testbed architecture. In The eighth workshop on trust in agent societies (TRUST 2005), at the fourth international joint conference on autonomous agents and multiagent systems. Utrecht, The Netherlands, July 2005. Google Scholar
  5. Golbeck, J. (2008). Computer science: Weaving a web of trust. Science, 321(5896), 1640–1641. CrossRefGoogle Scholar
  6. Golbeck, B. P. J., & Hendler, J. (2003). Trust networks on the semantic web. In Proceedings of cooperative intelligent agents. Google Scholar
  7. Hassell, L. (2005). Affect and trust. In P. Herrmann, V. Issarny, & S. Shiu (Eds.), Lecture notes in computer science : Vol. 3477. Third international conference, iTrust 2005, Proceedings (pp. 131–145). Paris, France, May 23–26, 2005. Berlin: Springer. Google Scholar
  8. Heckerman, D., Meek, C., & Koller, D. (2004). Probabilistic models for relational data (Technical Report MSR-TR-2004-30). Microsoft Research. Google Scholar
  9. Hendrix, P., Gal, Y., & Pfeffer, A. (2009). Learning whom to trust: using graphical models for learning about information providers. In AAMAS ’09: Proceedings of the 8th international conference on autonomous agents and multiagent systems (pp. 1261–1262). Richland, SC, 2009. International Foundation for Autonomous Agents and Multiagent Systems. Google Scholar
  10. Huynh, T. D., Jennings, N. R., & Shadbolt, N. (2004). Developing an integrated trust and reputation model for open multi-agent systems. In Proceedings of the 7th international workshop on trust in agent societies. Google Scholar
  11. Jøsang, A., Keser, C., & Dimitrakos, T. (2005). Can we manage trust? In P. Herrmann, V. Issarny, & S. Shiu (Eds.), Lecture notes in computer science : Vol. 3477. Third international conference, iTrust 2005, Proceedings (pp. 93–107). Paris, France, May 23–26, 2005. Berlin: Springer. Google Scholar
  12. Kamvar, S. D., Schlosser, M. T., & Garcia-Molina, H. (2003). The EigenTrust algorithm for reputation management in P2P networks. In Proceedings of the twelfth international World Wide Web conference. Google Scholar
  13. Kemp, C., Tenenbaum, J. B., Griffiths, T. L., Yamada, T., & Ueda, N. (2006). Learning systems of concepts with an infinite relational model. In Poceedings of the national conference on artificial intelligence (AAAI). Google Scholar
  14. Kinateder, M., Baschny, E., & Rothermel, K. (2005). Towards a generic trust model—comparison of various trust update algorithms. In P. Herrmann, V. Issarny, & S. Shiu (Eds.), Lecture notes in computer science : Vol. 3477. Third international conference, iTrust 2005, Proceedings (pp. 177–192). Paris, France, May 23–26, 2005. Berlin: Springer. Google Scholar
  15. Krogel, M.-A. (2005). On propositionalization for knowledge discovery in relational databases. PhD thesis, die Fakultät für Informatik der Otto-von-Guericke-Universität Magdeburg. Google Scholar
  16. Marsh, S., & Dibben, M. R. (2005). Trust, untrust, distrust and mistrust—an exploration of the dark(er) side. In P. Herrmann, V. Issarny, & S. Shiu (Eds.), Lecture notes in computer science : Vol. 3477. Third international conference, iTrust 2005, Proceedings (pp. 17–33). Paris, France, May 23–26, 2005. Berlin: Springer. Google Scholar
  17. Mauá, D., & Cozman, F. (2008). Managing trust in virtual communities with Markov logic. In Proceedings of WTDIA ’08: The IV workshop on MSc dissertation and PhD thesis in artificial intelligence. Google Scholar
  18. Maximilien, E. M., & Singh, M. P. (2005). Agent-based trust model involving multiple qualities. In Proceedings of the 4th international joint conference on autonomous agents and multiagent systems (AAMAS). Google Scholar
  19. Moranz, C. (2004). Initiales Vertrauen in der virtuellen Anbahnung geschäftlicher Kooperationen. PhD thesis, Technische Universtität München, Lehrstuhl für Psychologie. Google Scholar
  20. Pandit, S., Chau, D. H., Wang, S., & Faloutsos, C. (2007). Netprobe: a fast and scalable system for fraud detection in online auction networks. In WWW ’07: Proceedings of the 16th international conference on World Wide Web (pp. 201–210). New York, NY, USA, 2007. New York: ACM Press. CrossRefGoogle Scholar
  21. Ramchurn, S. D., Huynh, D., & Jennings, N. R. (2004). Trust in multi-agent systems. The Knowledge Engineering Review, 19(1), 1–25. CrossRefGoogle Scholar
  22. Ramchurn, S. D., Sierra, C., Godo, L., & Jennings, N. R. (2004). Devising a trust model for multi-agent interactions using confidence and reputation. Journal of Applied Artificial Intelligence, 18(9–10), 833–852. CrossRefGoogle Scholar
  23. Rehak, M., & Pechoucek, M. (2007). Trust modeling with context representation and generalized identities. In M. Klusch, K. V. Hindriks, M. P. Papazoglou, & L. Sterling (Eds.), Lecture notes in computer science : Vol. 4676. CIA (pp. 298–312). Berlin: Springer. Google Scholar
  24. Rehak, M., Pechoucek, M., Benda, P., & Foltyn, L. (2005). Trust in coalition environment: Fuzzy number approach. In The eighth workshop on trust in agent societies (TRUST 2005), at the fourth international joint conference on autonomous agents and multiagent systems. Utrecht, The Netherlands, July 2005. Google Scholar
  25. Richardson, M., Agrawal, R., & Domingos, P. (2003). Trust management for the semantic Web. In Proceedings of the 2nd international semantic Web conference (ISWC). Sanibel Island, FL. Google Scholar
  26. Ruohomaa, S., & Kutvonen, L. (2005). Trust management survey. In P. Herrmann, V. Issarny, & S. Shiu (Eds.), Lecture notes in computer science : Vol. 3477. Third international conference, iTrust 2005, Proceedings (pp. 77–92). Paris, France, May 23–26, 2005. Berlin: Springer. Google Scholar
  27. Sabater, J., & Sierra, C. (2001). REGRET: reputation in gregarious societies. In J. P. Müller, E. Andre, S. Sen, & C. Frasson (Eds.), Proceedings of the fifth international conference on autonomous agents (pp. 194–195). Montreal, Canada, 2001. New York: ACM Press. CrossRefGoogle Scholar
  28. Sabater, J., & Sierra, C. (2002). Reputation and social network analysis in multi-agent systems. In M. Gini, T. Ishida, C. Castelfranchi, & W. L. Johnson (Eds.), Proceedings of the 1st international joint conference on autonomous agents and multiagent systems (AAMAS) (pp. 475–482). New York: ACM Press. CrossRefGoogle Scholar
  29. Shi, G. V. B. J., & Adams, C. (2005). Dealing with recommendations in a statistical trust model. In Proceedings of the workshop on trust in agent societies (held in conjunction with the 4th international joint conference on autonomous agents and multi agent systems (AAMAS)). Google Scholar
  30. Sun, L., Jiao, L., Wang, Y., Cheng, S., & Wang, W. (2005). An adaptive group-based reputation system in peer-to-peer networks. In X. Deng & Y. Ye (Eds.), Lecture notes in computer science : Vol. 3828. WINE (pp. 651–659). Berlin: Springer. Google Scholar
  31. Teacy, W. T. L. (2006). Agent-based trust and reputation in the context of inaccurate information sources. PhD thesis, Electronics and Computer Science, University of Southampton. Google Scholar
  32. Teacy, L., Patel, J., Jennings, N. R., & Luck, M. (2005). Coping with inaccurate reputation sources: Experimental analysis of a probabilistic trust model. In Proceedings of the 4th international joint conference on autonomous agents and multiagent systems (AAMAS). Utrecht, The Netherlands. Google Scholar
  33. Tresp, V. (2006). Dirichlet processes and nonparametric Bayesian modelling. Tutorial at the Machine Learning Summer School 2006 in Canberra, Australia. Google Scholar
  34. Vasalou, A., & Pitt, J. (2005). Reinventing forgiveness: A formal investigation of moral facilitation. In P. Herrmann, V. Issarny, & S. Shiu (Eds.), Lecture notes in computer science : Vol. 3477. Third international conference, iTrust 2005, Proceedings (pp. 146–160). Paris, France, May 23–26, 2005. Berlin: Springer. Google Scholar
  35. Witkowski, M., Artikis, A., & Pitt, J. (2001). Experiments in building experiential trust in a society of objective-trust based agents. In Proceedings of the workshop on deception, fraud, and trust in agent societies held during the autonomous agents conference (pp. 111–132). London, UK, 2001. Berlin: Springer. Google Scholar
  36. Witten, I. H., & Frank, E. (2002). Data mining: practical machine learning tools and techniques with java implementations. SIGMOD Rec., 31(1), 76–77. CrossRefGoogle Scholar
  37. Wu, D., & Sun, Y. (2001). The emergence of trust in multi-agent bidding: A computational approach. In HICSS ’01: Proceedings of the 34th annual Hawaii international conference on system sciences (HICSS-34) (vol. 1, p. 1041). Washington, DC, USA, 2001. New York: IEEE Computer Society. Google Scholar
  38. Xu, Z., Tresp, V., Yu, K., & Kriegel, H.-P. (2006). Infinite hidden relational models. In Uncertainty in artificial intelligence (UAI). Google Scholar
  39. Xu, Z., Tresp, V., Rettinger, A., & Kersting, K. (2009). Social network mining with nonparametric relational models. In M. S. H. Zhang, L. Giles, & J. Yen (Eds.), LNCS advances in social network mining and analysis. Berlin: Springer. Google Scholar
  40. Zanero, S. (2005). Security and trust in the Italian legal digital signature framework. In P. Herrmann, V. Issarny, & S. Shiu (Eds.), Lecture notes in computer science : Vol. 3477. Third international conference, iTrust 2005, Proceedings (pp. 34–44). Paris, France, May 23–26, 2005. Berlin: Springer. Google Scholar

Copyright information

© The Author(s) 2010

Authors and Affiliations

  • Achim Rettinger
    • 1
  • Matthias Nickles
    • 2
  • Volker Tresp
    • 3
  1. 1.Institute AIFBKarlsruhe Institute of TechnologyKarlsruheGermany
  2. 2.Department of Computer ScienceTechnical University of MunichGarchingGermany
  3. 3.Corporate Technology, Siemens AGMunichGermany

Personalised recommendations