Abstract
We present the problem of automatic co-niching in which potential suppliers of some product or service need to determine which offers to make to the marketplace at the same time as potential buyers need to determine which offers (if any) to purchase. Because both groups typically face incomplete or uncertain information needed for these decisions, participants in repeated market interactions engage in a learning process, making tentative decisions and adjusting these in the light of experiences they gain. Perhaps surprisingly, real markets typically then exhibit a form of parallel clustering: buyers cluster into segments of similar preferences and buyers into segments of similar offers. For computer scientists, the interesting question is whether such co-niching behaviours can be automated. We report on the first simulation experiments showing automated co-niching is possible using reinforcement learning in a multi-attribute product model. The work is of relevance to designers of online marketplaces, of computational resource allocation systems, and of automated software trading agents.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bichler, M., Kalagnanam, J.: Configurable offers and winner determination in multi-attribute auctions. European Journal of Operational Research 160(2), 380–394 (2005)
Cai, K., Gerding, E., McBurney, P., Niu, J., Parsons, S., Phelps, S.: Overview of CAT: A Market Design Competition (version 2.0). Technical Report ULCS-09-005, Department of Computer Science, University of Liverpool, Liverpool, UK, Version 2.0 (2009)
Cai, K., Niu, J., Parsons, S.: On the Economic Effects of Competition between Double Auction Markets. In: Ketter, W., La Poutré, H., Sadeh, N., Shehory, O., Walsh, W. (eds.) AMEC 2008. LNBIP, vol. 44, pp. 88–102. Springer, Heidelberg (2010)
Cliff, D., Bruten, J.: Zero is Not Enough: On The Lower Limit of Agent Intelligence For Continuous Double Auction Markets. Technical Report HPL 97-141, HP Laboratories Bristol (1997)
Hemming, P., Shuker, D., McBurney, P.: Innovative PCS Marketing: How to Build and Execute a Winning Marketing Plan. Redwing Consulting Ltd., Dallas (1996)
Hotelling, H.: Stability in competition. The Economic Journal XXXIX, 41–57 (1929)
Keeney, R.L., Raiffa, H.: Decisions with Multiple Objectives: Preferences and Value Tradeoffs. John Wiley & Sons, NY (1976)
Lilien, G.L., Kotler, P., Moorthy, K.S.: Marketing Models. Prentice-Hall, Englewood Cliffs (1992)
Niu, J., Cai, K., Parsons, S., McBurney, P., Gerding, E.: What the 2007 TAC Market Design Game tells us about effective auction mechanisms. Autonomous Agents and Multi-Agent Systems 21(2), 172–203 (2010)
Porter, M.E.: Competitive Advantage: Creating and Sustaining Superior Performance. Free Press, New York (1985)
Robbins, H.: Some aspects of the sequential design of experiments. Bulletin of the American Mathematical Society 58(5), 527–535 (1952)
Roberts, J.H., Lilien, G.L.: Explanatory and predictive models of consumer behavior. In: Eliashberg, J., Lilien, G.L. (eds.) Handbooks in Operations Research and Management Science. Marketing, vol. 5, pp. 27–82. North-Holland (1993)
Robinson, E., McBurney, P., Yao, X.: How Specialised are Specialists? Generalisation Properties of Entries from the 2008 and 2009 TAC Market Design Competitions. In: David, E., Gerding, E., Sarne, D., Shehory, O. (eds.) AMEC 2009. LNBIP, vol. 59, pp. 178–194. Springer, Heidelberg (2010)
Robinson, E., McBurney, P., Yao, X.: Market niching in multi-attribute computational resource allocation systems. In: Ketter, W., Lang, K.R., Lee, K.J. (eds.) Proc. 13th International Conference on Electronic Commerce (ICEC 2011) (2011)
Robinson, E.R.: Resource Allocation via Competing Marketplaces. PhD, University of Birmingham, UK, Birmingham, UK (2011), http://bit.ly/kumsfc
Sutton, R., Barto, A.: Reinforcement learning: An introduction. The MIT press (1998)
Whittle, P.: Restless bandits: Activity allocation in a changing world. Journal of Applied Probability, 287–298 (1988)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Robinson, E., McBurney, P., Yao, X. (2012). Co-learning Segmentation in Marketplaces. In: Vrancx, P., Knudson, M., Grześ, M. (eds) Adaptive and Learning Agents. ALA 2011. Lecture Notes in Computer Science(), vol 7113. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28499-1_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-28499-1_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-28498-4
Online ISBN: 978-3-642-28499-1
eBook Packages: Computer ScienceComputer Science (R0)