Advertisement

Learning the Empirical Hardness of Optimization Problems: The Case of Combinatorial Auctions

  • Kevin Leyton-Brown
  • Eugene Nudelman
  • Yoav Shoham
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2470)

Abstract

We propose a new approach for understanding the algorithm-specific empirical hardness of Open image in new window -Hard problems. In this work we focus on the empirical hardness of the winner determination problem—an optimization problem arising in combinatorial auctions—when solved by ILOG’s CPLEX software. We consider nine widely-used problem distributions and sample randomly from a continuum of parameter settings for each distribution. We identify a large number of distribution-nonspecific features of data instances and use statistical regression techniques to learn, evaluate and interpret a function from these features to the predicted hardness of an instance.

Keywords

Root Mean Square Error Problem Instance Cluster Coefficient Edge Density Subset Selection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    D. Achlioptas, C. Gomes, H. Kautz, and B. Selman. Generating satisfiable instances. In AAAI-00, 2000.Google Scholar
  2. [2]
    A. Anderson, M. Tenhunen, and F. Ygge. Integer programming for combinatorial auction winner determination. In ICMAS, 2000.Google Scholar
  3. [3]
    P. Cheeseman, B. Kanefsky, and W. M. Taylor. Where the Really Hard Problems Are. In IJCAI-91, 1991.Google Scholar
  4. [4]
    S. de Vries and R. Vohra. Combinatorial auctions: A brief survey. Unpublished, 2000.Google Scholar
  5. [5]
    J. Friedman. Multivariate adaptive regression splines. Annals of Statistics, 19, 1991.Google Scholar
  6. [6]
    Y. Fujishima, K. Leyton-Brown, and Y. Shoham. Taming the computational complexity of combinatorial auctions: Optimal and approximate approaches. In IJCAI-99, 1999.Google Scholar
  7. [7]
    Carla P. Gomes and Bart Selman. Problem structure in the presence of perturbations. In AAAI/IAAI, 1997.Google Scholar
  8. [8]
    R. Gonen and D. Lehmann. Optimal solutions for multi-unit combinatorial auctions: Branch and bound heuristics. In ACM Conference on Electronic Commerce, 2000.Google Scholar
  9. [9]
    T. Hastie, R. Tibshirani, and J. Friedman. Elements of Statistical Learning. Springer, 2001.Google Scholar
  10. [10]
    R. C. Holte. Combinatorial auctions, knapsack problems, and hill-climbing search. In Canadian Conference on AI, 2001.Google Scholar
  11. [11]
    H. H. Hoos and C. Boutilier. Solving combinatorial auctions using stochastic local search. In AAAI-00, 2000.Google Scholar
  12. [12]
    E. Horvitz, Y. Ruan, C. Gomes, H. Kautz, B. Selman, and M. Chickering. A bayesian approach to tackling hard computational problems, 2001.Google Scholar
  13. [13]
    R. Kastner, C. Hsieh, M. Potkonjak, and M. Sarrafzadeh. On the sensitivity of incremental algorithms for combinatorial auctions, 2002. UCLA CS Tech. Report 020000.Google Scholar
  14. [14]
    R. Korf and M. Reid. Complexity analysis of admissible heuristic search. AAAI-98, 1998.Google Scholar
  15. [15]
    K. Leyton-Brown, M. Pearson, and Y. Shoham. Towards a universal test suite for combinatorial auction algorithms. In ACM Conference on Electronic Commerce, 2000.Google Scholar
  16. [16]
    K. Leyton-Brown, Yoav Shoham, and Moshe Tennenholtz. An algorithm for multi-unit combinatorial auctions. In Proceedings of AAAI-00, 2000.Google Scholar
  17. [17]
    R. Monasson, R. Zecchina, S. Kirkpatrick, B. Selman, and L. Troyansky. Determining computational complexity for characteristic ‘phase transitions‘. Nature, 400, 1998.Google Scholar
  18. [18]
    N. Nisan. Bidding and allocation in combinatorial auctions. In ACM Conference on Electronic Commerce, 2000.Google Scholar
  19. [19]
    D. C. Parkes. iBundle: An efficient ascending price bundle auction. In ACM Conference on Electronic Commerce, 1999.Google Scholar
  20. [20]
    M. H. Rothkopf, A. Pekec, and R. M. Harstad. Computationally manageable combinatorial auctions. Management Science, 44(8), 1998.Google Scholar
  21. [21]
    T. Sandholm. An algorithm for optimal winner determination in combinatorial auctions. In IJCAI-99, 1999.Google Scholar
  22. [22]
    T. Sandholm, S. Suri, A. Gilpin, and D. Levine. Cabob: A fast optimal algorithm for combinatorial auctions. In IJCAI-01, 2001.Google Scholar
  23. [23]
    Dale Schuurmans, Finnegan Southey, and Robert C. Holte. The exponentiated subgradient algorithm for heuristic boolean programming. In IJCAI-01, 2001.Google Scholar
  24. [24]
    J. Slaney and T. Walsh. Backbones in optimization and approximation. In IJCAI-01, 2001.Google Scholar
  25. [25]
    W. Zhang. State-Space Search: Algorithms, Complexity, Extensions, and Applications. Springer, 1999.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Kevin Leyton-Brown
    • 1
  • Eugene Nudelman
    • 1
  • Yoav Shoham
    • 1
  1. 1.Computer Science DepartmentStanford UniversityStanford

Personalised recommendations