The Effect of Preference Representation on Learning Preferences in Negotiation

  • Reyhan Aydoğan
  • Pınar Yolum
Part of the Studies in Computational Intelligence book series (SCI, volume 383)


In online and dynamic e-commerce environments, it is beneficial for parties to consider each other’s preferences in carrying out transactions. This is especially important when parties are negotiating, since considering preferences will lead to faster closing of deals. However, in general may not be possible to know other participants’ preferences. Thus, learning others’ preferences from the bids exchanged during the negotiation becomes an important task. To achieve this, the producer agent may need to make assumptions about the consumer’s preferences and even its negotiation strategy. Nevertheless, these assumptions may become inconsistent with a variety of preference representations. Therefore, it is more desired to develop a learning algorithm, which is independent from the participants’ preference representations and negotiation strategies. This study presents a negotiation framework in which the producer agent learns an approximate model of the consumer’s preferences regardless of the consumer’s preference representation. For this purpose, we study our previously proposed inductive learning algorithm, namely Revisable Candidate Elimination Algorithm (RCEA). Our experimental results show that a producer agent can learn the consumer’s preferences via RCEA when the consumer represents its preferences using constraints or CP-nets. Further, in both cases, learning speeds up the negotiation considerably.


Parking Area Producer Agent Service Node Learn Preference Negotiation Strategy 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aydoğan, R., Taşdemir, N., Yolum, P.: Reasoning and Negotiating with Complex Preferences Using CP-nets. In: Ketter, W., La Poutré, H., Sadeh, N., Shehory, O., Walsh, W. (eds.) AMEC 2008. LNBIP, vol. 44, pp. 15–28. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  2. 2.
    Aydoğan, R., Yolum, P.: Learning opponent s preferences for effective negotiation: an approach based on concept learning. Autonomous Agents and Multi-Agent Systems (in Press)Google Scholar
  3. 3.
    Boutilier, C., Brafman, R.I., Domshlak, C., Hoos, H.H., Poole, D.: Cp-nets: A tool for representing and reasoning with conditional ceteris paribus preference statements. J. Artif. Intell. Res. (JAIR) 21, 135–191 (2004)MathSciNetzbMATHGoogle Scholar
  4. 4.
    Dolan, E.D., Moré, J.J.: Benchmarking optimization software with performance profiles. Mathematical Programming 91, 201–213 (2002)MathSciNetzbMATHCrossRefGoogle Scholar
  5. 5.
    Faratin, P., Sierra, C., Jennings, N.R.: Using similarity criteria to make issue trade-offs in automated negotiations. Artificial Intelligence 142, 205–237 (2002)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Hansson, S.O.: What is ceteris paribus preference? Journal of Philosophical Logic 25(3), 307–332 (1996)MathSciNetzbMATHCrossRefGoogle Scholar
  7. 7.
    Hindriks, K., Tykhonov, D.: Opponent modelling in automated multi-issue negotiation using bayesian learning. In: 7th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS), pp. 331–338 (2008)Google Scholar
  8. 8.
    Jonker, C.M., Robu, V., Treur, J.: An agent architecture for multi-attribute negotiation using incomplete preference information. Autonomous Agents and Multi-Agent Systems 15(2), 221–252 (2007)CrossRefGoogle Scholar
  9. 9.
    Luo, X., Jennings, N.R., Shadbolt, N., Fung Leung, H., Man Lee, J.H.: A fuzzy constraint based model for bilateral, multi-issue negotiations in semi-competitive environments. Artifical Intelligence 148(1-2), 53–102 (2003)zbMATHCrossRefGoogle Scholar
  10. 10.
    Mitchell, T.M.: Machine Learning. McGraw-Hill, New York (1997)zbMATHGoogle Scholar
  11. 11.
    Raiffa, H.: The Art and Science of Negotiation. Harvard University Press, Cambridge (1982)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  1. 1.Department of Computer EngineeringBoğaziçi UniversityBebekTurkey

Personalised recommendations