Abstract
As the world gets increasingly networked, business and political negotiations take place between people of different cultures. Cross-cultural negotiations have been mainly studied empirically and there is a dearth of computational models of negotiation that incorporate the culture of the negotiators. In this chapter, we take the first steps towards building a partially observable Markov decision process (POMDP) based automated negotiation (PAN) agent, that takes the culture of the negotiators into account. We move away from the offer-counteroffer paradigm that is usually used in computational modeling of negotiation. We assume that apart from making offers, the agents can take other actions for seeking/providing information during negotiation. Our approach is motivated by the experimental findings that (a) during negotiation, people communicate their preferences and justification of their preferences apart from making direct offers and (b) cultural distinctions can be made between negotiating agents based on an abstract coding of their conversation. We show that in accordance with an existing cognitive theory of inter-cultural negotiation from behavioral psychology literature, we can construct a POMDP model of negotiation. A key challenge in developing the PAN agent is in obtaining the state transition function for the POMDP. We demonstrate that the state transition function can be built from transcripts of actual negotiations between people.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Adair, W., & Brett, J. M. (2005). The negotiation dance: Time, culture, and behavioral sequences in negotiations. In Organization Science, 16(1), 33–51.
Adair, W. L., Taylor, M. S., & Tinsley, C. H. (2009) Starting out on the right foot: Negotiation schemas when cultures collide. Negotiation and Conflict Management Research, 2(2), 138–163.
Atran, S., & Axelrod, R. (2008, July) Reframing sacred values. Negotiation Journal, 24(3), 221–246.
Braun, P., Brzostowski, J., Kersten, G., Kim, B., Kowalczyk, R., Strecker, S., & Vahidov, R. (2007). e-negotiation systems and software agents: Methods, models, and applications. In Intelligent decision-making support systems (pp. 271–300). London: Springer.
Brett, J. M. (2000). Culture and negotiation. International Journal of Psychology, 35(2), 97–104.
Brett, J. M., & Okamura, T. (1998). Inter- and intra-cultural negotiations: US and Japanese negotiators. Academy of Management Journal, 41, 495–510.
Camerer, C. (2003). Behavioral game theory: Experiments in strategic interactions. Princeton, NJ: Princeton University Press.
Drake, L. E. (2001). The culture-negotiation link: Integrative and distributive bargaining through an intercultural communication lens. Human Communication Research, 27(3), 317–349.
Druckman, D. (1986). Stages, turning points and crises: Negotiating military base rights, Spain and the United States. The Journal of Conflict Resolution, 30(2), 327–360.
Faratin, P., Sierra, C., & Jennings, N. R. (1998). Negotiation decision functions for autonomous agents. International Journal of Robotics and Autonomous Systems, 24(3–4), 159–182.
Gelfand, M. J., & Brett, J. M. (Eds.). (2004). The handbook of negotiation and culture: Theoretical advances and cultural perspectives. Stanford, CA: Stanford Business Books.
Hilbe, J. M. (2009). Logistic regression models. Boca Raton, FL: CRC Press.
Hofstede, G. J., Jonker, C. M., & Verwaart, D. (2008). An agent model for the influence of culture on bargaining. In HUCOM 2008, first international working conference on human factors and computational models in negotiation (pp. 39–46).
Kaelbling, L. P., Littman, M. L., & Cassandra, A. R. (1998). Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101, 99–134.
Kagel, J., & Roth, A. (Eds.). (1995). The handbook of experimental economics. Princeton, NJ: Princeton University Press.
Kraus, S. (1997, July). Negotiation and cooperation in multi-agent environments. Artificial Intelligence, 92(1–2), 79–97.
Kraus, S. (2001). Strategic negotiation in multiagent environments. Cambridge, MA: MIT Press.
Leung, K., & Tjosvold, D. (Eds.). Conflict management in the Asia Pacific. Singapore: Wiley.
Myerson, R. B. (1977). Two-person bargaining problems and comparable utility. Econometrica, 45(7), 1631–1637.
Napel, S. (2002). Bilateral bargaining: theory and applications. Berlin, The Netherlands: Springer.
Pineau, J., Gordon, G., & Thrun, S. (2003). Point-based value iteration: An anytime algorithm for POMDPs. In IJCAI.
Pruitt, D. G. (1981). Negotiation behavior. New York: Academic Press.
Pynadath, D. V., & Marsella, S. C. (2005). PsychSim: Modeling theory of mind with decision-theoretic agents. In Proceedings of the international joint conference on artificial intelligence (pp. 1181–1186).
Ray, D., King-Casas, B., Montague, P. R., & Dayan, P. (2008). Bayesian model of behaviour in economic games. In NIPS.
Rubinstein, A. (1982, January). Perfect equilibrium in a bargaining model. Econometrica, 50(1), 97–109.
Tenbrunsel, A. E., & Bazerman, M. H. (1995). Working women. In Teaching manual. Evanston, IL: Dispute Resolution Research Center, Northwestern University.
Tinsley, C. H. (1998). Models of conflict resolution in Japanese, German, and American cultures. Journal of Applied Psychology, 83, 316–323.
Tinsley, C. H. (2001). How negotiators get to yes: Predicting the constellation of conflict management strategies used across cultures. Journal of Applied Psychology, 86(4), 583–593.
von Neumann, J., & Morgenstern, O. (1944). The theory of games and economic behavior (2nd ed., 1947 edition). Princeton, NJ: Princeton University Press.
Weingart, L. R., Brett, J. M., Olekalns, M., & Smith, P. L. (2007). Conflicting social motives in negotiating groups. Journal of Personality and Social Psychology, 93(6), 994–1010.
Witten, I. H., & Frank, E. (2005). Data Mining: Practical machine learning tools and techniques. Boston, MA: Morgan Kaufman.
Zeng, D., & Sycara, K. (1998, January). Bayesian learning in negotiation. International Journal of Human-Computer Studies, 48(1), 125–141.
Acknowledgements
We would like to thank Miraslov Dudik for providing the initial insight that a first order model indeed performs better on this data set. This research was funded by a MURI award through ARO grant number W911NF-08-1-0301.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Paruchuri, P., Chakraborty, N., Gordon, G., Sycara, K., Brett, J., Adair, W. (2013). Inter-cultural opponent behavior modeling in a POMDP based Automated Negotiating Agent. In: Sycara, K., Gelfand, M., Abbe, A. (eds) Models for Intercultural Collaboration and Negotiation. Advances in Group Decision and Negotiation, vol 6. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-5574-1_9
Download citation
DOI: https://doi.org/10.1007/978-94-007-5574-1_9
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-007-5573-4
Online ISBN: 978-94-007-5574-1
eBook Packages: Computer ScienceComputer Science (R0)