Advertisement

KI - Künstliche Intelligenz

, Volume 28, Issue 1, pp 21–27 | Cite as

Transfer for Automated Negotiation

  • Siqi ChenEmail author
  • Haitham Bou Ammar
  • Karl Tuyls
  • Gerhard Weiss
Technical Contribution
  • 137 Downloads

Abstract

Learning in automated negotiation is a difficult problem because the target function is hidden and the available experience for learning is rather limited. Transfer learning is a branch of machine learning research concerned with the reuse of previously acquired knowledge in new learning tasks, for example, in order to reduce the amount of learning experience required to attain a certain level of performance. This paper proposes a novel strategy based on a variation of TrAdaBoost—a classic instance transfer technique—that can be used in a multi-issue negotiation setting. The experimental results show that the proposed method is effective in a variety of application domains against the state-of-the-art negotiating agents.

Keywords

Automated negotiation Transfer learning Opponent modeling 

References

  1. 1.
    Ammar HB, Tuyls K, Taylor ME, Driessens K, Weiss G (2012) Reinforcement learning transfer via sparse coding. In: Proceedings of the 11th Int. Joint Conf. on Automomous Agents and Multi-Agent Systems. ACM, Valencia, p 383–390Google Scholar
  2. 2.
  3. 3.
    Chen S, Ammar HB, Tuyls K, Weiss G (2013) Optimizing complex automated negotiation using sparse pseudo-input Gaussian processes. In: Proceedings of the 12th Int. Joint Conf. on Automomous Agents and Multi-Agent Systems. ACM, Saint Paul, p 707–714Google Scholar
  4. 4.
    Chen S, Weiss G (2012) An efficient and adaptive approach to negotiation in complex environments. In: Proceedings of the 20th European Conference on Artificial Intelligence. IOS Press, Montpellier, France, p 228–233Google Scholar
  5. 5.
    Chen S, Weiss G (2013) An efficient automated negotiation strategy for complex environments. Eng Appl Artif Intell 26(10):2613–2623CrossRefGoogle Scholar
  6. 6.
    Coehoorn RM, Jennings NR (2004) Learning on opponent’s preferences to make effective multi-issue negotiation trade-offs. In: Proceedings of the 6th Int. conf. on Electronic commerce, ICEC ’04. ACM, New York p 59–68Google Scholar
  7. 7.
    Dai W, Yang Q, Xue GR, Yu Y (2007) Boosting for transfer learning. In: Proceedings of the 24th international conference on Machine learning. ACM, New York, pages 193–200.Google Scholar
  8. 8.
    Hao J, Leung H (2012) ABiNeS: an adaptive bilateral negotiating strategy over multiple items. In: Proceedings of the 2012 IEEE/WIC/ACM International Conference on Intelligent Agent Technology (IAT 2012), Macau, ChinaGoogle Scholar
  9. 9.
    Hindriks K, Jonker C, Kraus S, Lin R, Tykhonov D (2009) Genius: negotiation environment for heterogeneous agents. In: Proceedings of the 8th Int. Joint Conf. on Automomous Agents and Multi-Agent Systems, p 1397–1398Google Scholar
  10. 10.
    Jennings NR, Faratin P, Lomuscio AR, Parsons S, Sierra C, Wooldridge M (2001) Automated negotiation: prospects, methods and challenges. Int J Group Decis Negot 10(2):199–215CrossRefGoogle Scholar
  11. 11.
    Lau RY, Li Y, Song D, Kwok RCW (2008) Knowledge discovery for adaptive negotiation agents in e-marketplaces. Decis Support Syst 45(2):310–323CrossRefGoogle Scholar
  12. 12.
    Pan SJ, Yang Q (1010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359CrossRefGoogle Scholar
  13. 13.
    Park S, Yang S (2008) An efficient multilateral negotiation system for pervasive computing environments. Eng Appl Artif Intell 21(4):633–643CrossRefGoogle Scholar
  14. 14.
    Ponka I (2009) Commitment models and concurrent bilateral negotiation strategies in dynamic service markets. PhD thesis, University of Southampton, School of Electronics and Computer ScienceGoogle Scholar
  15. 15.
    Raiffa H (1982) The art and science of negotiation. Harvard University Press Cambridge, CambridgeGoogle Scholar
  16. 16.
    Rasmussen CE (2006) Gaussian Processes for Machine Learning. MIT Press, CambridgezbMATHGoogle Scholar
  17. 17.
    Rubinstein A (1982) Perfect equilibrium in a bargaining model. Econometrica 50(1):97–109CrossRefzbMATHMathSciNetGoogle Scholar
  18. 18.
    Taylor ME, Stone P (2009) Transfer learning for reinforcement learning domains. A survey J Mach Learn Res 10:1633–1685zbMATHMathSciNetGoogle Scholar
  19. 19.
    Wang M, Wang H, Vogel D, Kumar K, and Chiu DK (2009) Agent-based negotiation and decision making for dynamic supply chain formation. Eng Appl Artif Intell 22(7):1046–1055CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Siqi Chen
    • 1
    Email author
  • Haitham Bou Ammar
    • 1
  • Karl Tuyls
    • 2
  • Gerhard Weiss
    • 1
  1. 1.Department of Knowledge EngineeringMaastricht UniversityMaastrichtThe Netherlands
  2. 2.Department of Computer ScienceUniversity of LiverpoolLiverpoolUK

Personalised recommendations