Abstract
Bundle methods have been used frequently to solve nonsmooth optimization problems. In these methods, subgradient directions from past iterations are accumulated in a bundle, and a trial direction is obtained by performing quadratic programming based on the information contained in the bundle. A line search is then performed along the trial direction, generating a serious step if the function value is improved by ∈ or a null step otherwise. Bundle methods have been used to maximize the nonsmooth dual function in Lagrangian relaxation for integer optimization problems, where the subgradients are obtained by minimizing the performance index of the relaxed problem. This paper improves bundle methods by making good use of near-minimum solutions that are obtained while solving the relaxed problem. The bundle information is thus enriched, leading to better search directions and less number of null steps. Furthermore, a simplified bundle method is developed, where a fuzzy rule is used to combine linearly directions from near-minimum solutions, replacing quadratic programming and line search. When the simplified bundle method is specialized to an important class of problems where the relaxed problem can be solved by using dynamic programming, fuzzy dynamic programming is developed to obtain efficiently near-optimal solutions and their weights for the linear combination. This method is then applied to job shop scheduling problems, leading to better performance than previously reported in the literature.
Similar content being viewed by others
References
GEOFFRION, M., Lagrangian Relaxation for Integer Programming, Mathematical Programming Studies, North Holland, Amsterdam, Netherlands, pp. 82-114, 1974.
BERTSEKAS, D. P., Nonlinear Programming, 2nd Edition, Athena Scientific, Belmont, Massachusetts, 1999.
ZHAO, X., LUH, P. B., and WANG, J., Surrogate Gradient Algorithm for Lagrangian Relaxation, Journal of Optimization Theory and Applications, Vol. 100, pp. 699-712, 1999.
KASKAVELIS, C. A., and CARAMANIS, M. C., Efficient Lagrangian Relaxation Algorithms for Industry Size Job-Shop Scheduling Problems, IIE Transactions, Vol. 30, pp. 1085-1097, 1998.
HIRIART-URRUTY, J. B., and LEMARECHAL, C., Convex Analysis and Minimization Algorithms, Vols. 1 and 2, Springer Verlag, Berlin, Germany, 1993.
NEMHAUSER, G., and WOLSEY, L., Integer and Combinatorial Optimization, John Wiley and Sons, New York, NY, 1988.
HELD, M., WOLFE, P., and CROWDER, H., Validation of Subgradient Optimization, Mathematical Programming, Vol. 6, pp. 62-88, 1974.
KIWIEL, K. C., Restricted Step and Levenberg-Marquardt Techniques in Proximal Bundle Methods for Nonconvex Nondifferentiable Optimization, SIAM Journal on Optimization, Vol. 6, pp. 227-249, 1996.
KOHL, N. and MADSEN, O. B. G., An Optimization Algorithm for the Vehicle Routing Problem with Time Windows Based on Lagrangian Relaxation, Operations Research, Vol. 45, pp. 395-406, 1997.
MIFFLIN, R., SUN, D., and QI, L., Quasi-Newton Bundle-Type Methods for Nondifferentiable Convex Optimization, SIAM Journal on Optimization, Vol. 8, pp. 583-603, 1998.
WANG, J., LUH, P. B., ZHAO, X., and WANG, J., An Optimization-Based Algorithm for Job Shop Scheduling, Sadhana, Vol. 22, pp. 241-256, 1997.
BELLMAN, R., Applied Dynamic Programming, Princeton University Press, Princeton, New Jersey, 1957.
KIWIEL, K. C., Proximal Level Bundle Methods for Convex Nondifferentiable Optimization, Saddle-Point Problems, and Variational Inequalities, Mathematical Programming, Vol. 69, pp. 89-109, 1995.
HOITOMT, D. J., LUH, P. B., and PATTIPATI, K. R., A Practical Approach to Job Shop Scheduling Problems, IEEE Transactions on Robotics and Automation, Vol. 9, pp. 1-13, 1993.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Zhao, X., Luh, P. New Bundle Methods for Solving Lagrangian Relaxation Dual Problems. Journal of Optimization Theory and Applications 113, 373–397 (2002). https://doi.org/10.1023/A:1014839227049
Issue Date:
DOI: https://doi.org/10.1023/A:1014839227049