Skip to main content
SpringerLink
Log in

A novel method for coevolving PS-optimizing negotiation strategies using improved diversity controlling EDAs

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

In agent-mediated negotiation systems, the majority of the research focused on finding negotiation strategies for optimizing price only. However, in negotiation systems with time constraints (e.g., resource negotiations for Grid and Cloud computing), it is crucial to optimize either or both price and negotiation speed based on preferences of participants for improving efficiency and increasing utilization. To this end, this work presents the design and implementation of negotiation agents that can optimize both price and negotiation speed (for the given preference settings of these parameters) under a negotiation setting of complete information. Then, to support negotiations with incomplete information, this work deals with the problem of finding effective negotiation strategies of agents by using coevolutionary learning, which results in optimal negotiation outcomes. In the coevolutionary learning method used here, two types of estimation of distribution algorithms (EDAs) such as conventional EDAs (S-EDAs) and novel improved dynamic diversity controlling EDAs (ID2C-EDAs) were adopted for comparative studies. A series of experiments were conducted to evaluate the performance for coevolving effective negotiation strategies using the EDAs. In the experiments, each agent adopts three representative preference criteria: (1) placing more emphasis on optimizing more price, (2) placing equal emphasis on optimizing exact price and speed and (3) placing more emphasis on optimizing more speed. Experimental results demonstrate the effectiveness of the coevolutionary learning adopting ID2C-EDAs because it generally coevolved effective converged negotiation strategies (close to the optimum) while the coevolutionary learning adopting S-EDAs often failed to coevolve such strategies within a reasonable number of generations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Ahn CW, Ramakrishna RS (2008) On the scalability of real-coded Bayesian optimization algorithm. IEEE Trans Evol Comput 12(3):307–322

    Article  Google Scholar 

  2. Ardaiz O, Artigas P, Eymann T, Freitag F, Navarro L, Reinicke M (2006) The catallaxy approach for decentralized economic-based allocation in grid resource and service markets. Appl Intell 25(2):131–145

    Article  Google Scholar 

  3. Axelrod R (1987) The evolution of strategies in the iterated prisoner’s dilemma. In: Davis L (ed) Genetic algorithms and simulated annealing. Morgan Kaufmann, Los Altos

    Google Scholar 

  4. Faratin P, Sierra C, Jennings NR (1998) Negotiation decision functions for autonomous agents. Robot Auton Syst 24(3):159–182

    Article  Google Scholar 

  5. Fatima S, Wooldridge M, Jennings NR (2005) Bargaining with incomplete information. Ann Math Artif Intell 44(3):207–232

    Article  MathSciNet  MATH  Google Scholar 

  6. Gatti N, Giunta FD, Marino S (2008) Alternating-offers bargaining with one-sided uncertain deadlines: an efficient algorithm. Artif Intell 172(8–9):1119–1157

    Article  MATH  Google Scholar 

  7. Goldberg DE (1989) Genetic algorithms in search, optimization and machine learning. Addison-Wesley Longman, Reading

    MATH  Google Scholar 

  8. Gwak J, Sim KM (2010) Novel dynamic diversity controlling EDA and its application to automated bilateral negotiation. In: Proceedings of the IEEE 5th international conference of bio-inspired computing: theories and applications (BIC-TA’10), pp 536–544

    Google Scholar 

  9. Gwak J, Sim KM (2011) Coevolving negotiation strategies for p-s-optimizing agents. In: Ao S-I, Castillo O, Huang X (eds) Intelligent control and computer engineering. LNEE, vol 70. Springer, Berlin, pp 119–135

    Chapter  Google Scholar 

  10. Gwak J, Sim KM Novel dynamic diversity controlling EAs for coevolving optimal negotiation strategies. Inf Sci (to be submitted)

  11. Jennings NR, Faratin P, Lomuscio AR, Parsons S, Sierra C, Wooldridge M (2001) Automated negotiation: prospects, methods and challenges. Group Decis Negot 10(2):199–215

    Article  Google Scholar 

  12. Jin N (2005) Equilibrium selection by co-evolution for bargaining problems under incomplete information about time preferences. In: Corne D, et al (eds) Proceedings of the 2005 IEEE congress on evolutionary computation (CEC’05), vol 3, pp 2661–2668

    Chapter  Google Scholar 

  13. Jin N, Tsang E (2005) Co-evolutionary strategies for an alternating-offer bargaining problem. In: Proceedings of the IEEE 2005 symposium on computational intelligence and games (CIG’05), pp 211–217

    Google Scholar 

  14. Jonker CM, Robu V, Treur J (2007) An agent architecture for multi-attribute negotiation using incomplete preference information. Auton Agents Multi-Agent Syst 15(2):221–252

    Article  Google Scholar 

  15. Kraus S (2001) Strategic negotiation in multi-agent environments. MIT Press, Cambridge

    Google Scholar 

  16. Lai G, Sycara K (2009) A generic framework for automated multi-attribute negotiation. Group Decis Negot 18:169–187

    Article  Google Scholar 

  17. Larrañaga P, Lozano JA (2002) Estimation of distribution algorithms: a new tool for evolutionary computation. Kluwer, Norwell

    Book  MATH  Google Scholar 

  18. Lau R (2006) An evolutionary learning approach for adaptive negotiation agents. Int J Intell Syst 21(1):41–72

    Article  MATH  Google Scholar 

  19. Lewis PR, Marrow P, Yao X (2010) Resource allocation in decentralised computational systems: an evolutionary market-based approach. Auton Agents Multi-Agent Syst 21(2):143–171

    Article  Google Scholar 

  20. Li C, Li L (2006) Multi economic agent interaction for optimizing the aggregate utility of grid users in computational grid. Appl Intell 25(2):147–158

    Article  MATH  Google Scholar 

  21. Li C, Giampapa JA, Sycara K (2006) Bilateral negotiation decisions with uncertain dynamic outside options. IEEE Trans Syst Man Cybern, Part C, Appl Rev 36(1):31–44

    Article  Google Scholar 

  22. Lomuscio A, Wooldridge M, Jennings NR (2003) A classification scheme for negotiation in electronic commerce. Group Decis Negot 12(1):31–56

    Article  Google Scholar 

  23. Matos N, Sierra C, Jennings NR (1998) Determining successful negotiation strategies: an evolutionary approach. In: Proceedings of 3rd international conference of multi-agent systems, pp 182–189

    Google Scholar 

  24. Oliver JR (1996) A machine-learning approach to automated negotiation and prospects for electronic commerce. J Manag Inf Syst 13(3):83–112

    Google Scholar 

  25. Pelikan M, Goldberg DE, Lobo FG (2002) A survey of optimization by building and using probabilistic models. Comput Optim Appl 21(1):5–20

    Article  MathSciNet  MATH  Google Scholar 

  26. Rubinstein A (1985) A bargaining model with incomplete information about time preferences. Econometrica 53(5):1151–1172

    Article  MathSciNet  MATH  Google Scholar 

  27. Schnizler B, Neumann D, Veit D, Weinhardt C (2008) Trading grid services—a multi-attribute combinatorial approach. Eur J Oper Res 187(3):943–961

    Article  MATH  Google Scholar 

  28. Sim KM (2002) A market-driven model for designing negotiation agents. Comput Intell 18(4):618–637

    Article  MathSciNet  Google Scholar 

  29. Sim KM (2005) Equilibria, prudent compromises, and the “waiting” game. IEEE Trans Syst Man Cybern, Part B, Cybern 35(4):712–724

    Article  MathSciNet  Google Scholar 

  30. Sim KM (2006) G-commerce, market-driven G-negotiation agents and grid resource management. IEEE Trans Syst Man Cybern, Part B, Cybern 36(6):1381–1394

    Article  Google Scholar 

  31. Sim KM (2006) Guest editorial: agent-based grid computing. Appl Intell 25(2):127–129

    Article  Google Scholar 

  32. Sim KM (2008) An evolutionary approach for p-s-optimizing negotiation. In: Proceedings of the 2008 IEEE congress on evolutionary computation (CEC’08), pp 1364–1371

    Google Scholar 

  33. Sim KM (2009) Agent-based cloud commerce. In: Proceedings of the IEEE international conference on industrial engineering and engineering management (IEEM’09), pp 717–721

    Chapter  Google Scholar 

  34. Sim KM (2010) Grid resource negotiation: survey and new directions. IEEE Trans Syst Man Cybern, Part C, Appl Rev 40(3):245–257

    Article  MathSciNet  Google Scholar 

  35. Sim KM (2010) Towards complex negotiation for Cloud economy. In: Proceedings of the 5th international conference on grid and pervasive computing (GPC’10). LNCS, vol 6104, pp 395–406

    Chapter  Google Scholar 

  36. Sim KM (2011) Agent-based cloud computing. IEEE Trans Serv Comput. doi:10.1109/TSC.2011.52 (Special Issue on Cloud Computing). http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6042853

    Google Scholar 

  37. Sim KM, Choi CY (2003) Agents that react to changing market situations. IEEE Trans Syst Man Cybern, Part B, Cybern 33(2):188–201

    Article  Google Scholar 

  38. Sim KM, Shi B (2010) Concurrent negotiation and coordination for controlling grid resource co-allocation. IEEE Trans Syst Man Cybern, Part B, Cybern 40(2):753–766

    Google Scholar 

  39. Sim KM, Guo Y, Shi B (2007) Adaptive bargaining agents that negotiate optimally and rapidly. In: Proceedings of the IEEE congress on evolutionary computation (CEC’07), pp 1007–1014

    Google Scholar 

  40. Sim KM, Guo Y, Shi B (2009) BLGAN: Bayesian learning and genetic algorithm for supporting negotiation with incomplete information. IEEE Trans Syst Man Cybern, Part B, Cybern 39(1):198–211

    Article  Google Scholar 

  41. Venugopal S, Chu X, Buyya R (2008) A negotiation mechanism for advance resource reservation using the alternate offers protocol. In: Proceedings 16th international workshop on quality of service (IWQoS, pp 40–49

    Google Scholar 

  42. Xing H, Qu R (2012) A compact genetic algorithm for the network coding based resource minimization problem. Appl Intell 36(4):809–823

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Information and Mechatronics, Gwangju Institute of Science and Technology, 261 Cheomdan-gwagiro (Oryong-dong), Buk-gu, Gwangju, 500-712, Republic of Korea

    Jeonghwan Gwak

  2. School of Computing, The University of Kent, Chatham Maritime, Chatham, Kent, ME4 4AG, UK

    Kwang Mong Sim

Authors
  1. Jeonghwan Gwak
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kwang Mong Sim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kwang Mong Sim.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gwak, J., Sim, K.M. A novel method for coevolving PS-optimizing negotiation strategies using improved diversity controlling EDAs. Appl Intell 38, 384–417 (2013). https://doi.org/10.1007/s10489-012-0378-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-012-0378-4

Keywords

Search

Navigation