Abstract
Opponent modeling is an important technique in automated negotiations. Many of the existing opponent modeling methods are focusing on predicting the opponent’s private information to improve the agent’s benefits. However, these modeling methods overlook an ability to improve the negotiation outcomes by adapting to different types of private information about the opponent when they are available beforehand. This availability may be provided by some prediction algorithms, or be prior knowledge of the agent. In this paper, we name the above ability as Information Adaptation, and propose a novel Opponent Modeling method with Information Adaptation (OMIA). Specifically, the future concessions of the opponent will firstly be learned based on the opponent’s historical offers. Then, an expected utility calculation function is introduced to adaptively guide the agent’s negotiation strategy by considering the availability and value of the opponent’s private information. The experimental results show that OMIA can adapt to different types of information, helping the agent reach agreements with the opponent and achieve higher utility values comparing to those which lack the information adaptation ability.
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Baarslag, T., Hendrikx, M.J., Hindriks, K.V., Jonker, C.M.: Learning about the opponent in automated bilateral negotiation: a comprehensive survey of opponent modeling techniques. Auton. Agents Multi-Agent Syst. 30(5), 849–898 (2016)
Baarslag, T., Hendrikx, M.J., Hindriks, K.V., Jonker, C.M.: A survey of opponent modeling techniques in automated negotiation. In: Proceedings of the 2016 International Conference on Autonomous Agents and Multiagent Systems, pp. 575–576. International Foundation for Autonomous Agents and Multiagent Systems (2016)
Broekens, J., Jonker, C.M., Meyer, J.J.C.: Affective negotiation support systems. J. Ambient Intell. Smart Environ. 2(2), 121–144 (2010)
Carbonneau, R., Kersten, G.E., Vahidov, R.: Predicting opponent’s moves in electronic negotiations using neural networks. Expert Syst. Appl. 34(2), 1266–1273 (2008)
Coehoorn, R.M., Jennings, N.R.: Learning on opponent’s preferences to make effective multi-issue negotiation trade-offs. In: Proceedings of the 6th International Conference on Electronic Commerce, pp. 59–68. ACM (2004)
Deisenroth, M.P., Fox, D., Rasmussen, C.E.: Gaussian processes for data-efficient learning in robotics and control. IEEE Trans. Pattern Anal. Mach. Intell. 37(2), 408–423 (2015)
Fatima, S.S., Wooldridge, M., Jennings, N.R.: Multi-issue negotiation under time constraints. In: Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems: Part 1, pp. 143–150. ACM (2002)
Gal, Y., van der Wilk, M., Rasmussen, C.E.: Distributed variational inference in sparse Gaussian process regression and latent variable models. In: Advances in Neural Information Processing Systems, pp. 3257–3265 (2014)
Ji, S.J., Zhang, C.J., Sim, K.M., Leung, H.F.: A one-shot bargaining strategy for dealing with multifarious opponents. Appl. Intell. 40(4), 557–574 (2014)
Kersten, G.E., Lai, H.: Negotiation support and E-negotiation systems: an overview. Group Decis. Negot. 16(6), 553–586 (2007)
Lin, R., Kraus, S., Baarslag, T., Tykhonov, D., Hindriks, K., Jonker, C.M.: Genius: an integrated environment for supporting the design of generic automated negotiators. Computat. Intell. 30(1), 48–70 (2014)
Moosmayer, D.C., Chong, A.Y.L., Liu, M.J., Schuppar, B.: A neural network approach to predicting price negotiation outcomes in business-to-business contexts. Expert Syst. Appl. 40(8), 3028–3035 (2013)
Oshrat, Y., Lin, R., Kraus, S.: Facing the challenge of human-agent negotiations via effective general opponent modeling. In: Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems-Volume 1, pp. 377–384. International Foundation for Autonomous Agents and Multiagent Systems (2009)
Ren, F., Zhang, M.: Predicting partners’ behaviors in negotiation by using regression analysis. In: Zhang, Z., Siekmann, J. (eds.) KSEM 2007. LNCS (LNAI), vol. 4798, pp. 165–176. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-76719-0_19
Ren, F., Zhang, M.: A single issue negotiation model for agents bargaining in dynamic electronic markets. Decis. Support Syst. 60, 55–67 (2014)
Williams, C.R., Robu, V., Gerding, E.H., Jennings, N.R.: Using Gaussian processes to optimise concession in complex negotiations against unknown opponents (2011)
Yu, C., Ren, F., Zhang, M.: An adaptive bilateral negotiation model based on Bayesian learning. In: Ito, T., Zhang, M., Robu, V., Matsuo, T. (eds.) Complex Automated Negotiations: Theories, Models, and Software Competitions. SCI, vol. 435, pp. 75–93. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-30737-9_5
Zhang, J., Ren, F., Zhang, M.: Bayesian-based preference prediction in bilateral multi-issue negotiation between intelligent agents. Knowl. Based Syst. 84, 108–120 (2015)
Acknowledgments
This research is supported by a DECRA Project (DP140100007) from Australia Research Council (ARC), a UPA and an IPTA scholarships from University of Wollongong, Australia.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Wang, Y., Ren, F., Zhang, M. (2017). Opponent Modeling with Information Adaptation (OMIA) in Automated Negotiations. In: Sukthankar, G., Rodriguez-Aguilar, J. (eds) Autonomous Agents and Multiagent Systems. AAMAS 2017. Lecture Notes in Computer Science(), vol 10642. Springer, Cham. https://doi.org/10.1007/978-3-319-71682-4_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-71682-4_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-71681-7
Online ISBN: 978-3-319-71682-4
eBook Packages: Computer ScienceComputer Science (R0)