Skip to main content

Abstract

We describe a model-free approach to bidding in the Ad-Auctions Trading Agents Competition: First, a simple and robust yet high-performing agent using a Regret Minimization optimization algorithm for the 2010 competition, followed by our top performing agent for the 2011 competition, still using simplified modeling and optimization methods. Specifically, we model the user populations using particle filters, but base the observations on a Nearest Neighbor estimator (instead of game specific parameters). We implement a simple and effective bid optimization algorithm by applying the equimarginal principle combined with perplexity-based regularization. The implementation of our 2011 agent also remains model-free in the sense that we do not attempt to model the competing agents behavior for estimating costs and associated game parameters.

This research was supported in part by the Google Inter-university center for Electronic Markets and Auctions, by a grant from the Israel Science Foundation, by a grant from United States-Israel Binational Science Foundation (BSF), by a grant from the Israeli Ministry of Science (MoS), and by the Israeli Centers of Research Excellence (I-CORE) program, (Center No. 4/11).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 49.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Berg, J., Greenwald, A., Naroditskiy, V., Sodomka, E.: A First Approach to Autonomous Bidding in Ad Auctions. In: ACM EC 2010 Workshop on Trading Agent Design and Analysis (2010)

    Google Scholar 

  2. Pardoe, D., Chakraborty, D., Stone, P.: TacTex09: A Champion Bidding Agent for Ad Auctions. In: Proceedings of the Ninth International Conference on Autonomous Agents and Multiagent Systems, Toronto, Canada (2010)

    Google Scholar 

  3. Pardoe, D., Stone, P.: A Particle Filter for Bid Estimation in Ad Auctions with Periodic Ranking Observations. In: EC 2010 Workshop on Trading Agent Design and Analysis (TADA), Cambridge, Massachusetts (2010)

    Google Scholar 

  4. Jordan, P.R., Wellman, M.P.: Designing an ad auctions game for the trading agent competition. In: David, E., Gerding, E., Sarne, D., Shehory, O. (eds.) AMEC 2009. LNBIP, vol. 59, pp. 147–162. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  5. Blum, A., Mansour, Y.: Learning, Regret minimization, and Equilibria. In: Algorithmic Game Theory, ch. 4 (2007)

    Google Scholar 

  6. Littlestone, N., Warmuth, M.: The weighted majority algorithm. Info. and Computation 108(2), 212–261 (1994)

    Article  MathSciNet  MATH  Google Scholar 

  7. Freund, Y., Schapire, R.: A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Comp. and System Sciences 55(1), 119–139 (1997)

    Article  MathSciNet  MATH  Google Scholar 

  8. Cesa-Bianchi, N., Lugosi, G.: Prediction, learning, and games. Cambridge University Press (2006)

    Google Scholar 

  9. Vorobeychik, Y.: A Game Theoretic Bidding Agent for the Ad Auction Game. In: Third International Conference on Agents and Articial Intelligence (2011)

    Google Scholar 

  10. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The WEKA Data Mining Software: An Update. SIGKDD Explorations 11(1) (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Schain, M., Hertz, S., Mansour, Y. (2013). A Model-Free Approach for a TAC-AA Trading Agent. In: David, E., Kiekintveld, C., Robu, V., Shehory, O., Stein, S. (eds) Agent-Mediated Electronic Commerce. Designing Trading Strategies and Mechanisms for Electronic Markets. AMEC TADA 2012 2012. Lecture Notes in Business Information Processing, vol 136. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40864-9_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-40864-9_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-40863-2

  • Online ISBN: 978-3-642-40864-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics