Skip to main content

Entropic Perturbation Approach to Mathematical Programming

  • Chapter
Entropy Optimization and Mathematical Programming

Abstract

The barrier and penalty function methods for solving mathematical programming problems have been widely used for both theoretical and computational purposes. In a penalty approach, any point outside of the feasible region is assigned a penalty while, in a barrier approach, those feasible solutions near the boundary of the feasible region are subject to a penalty. Both approaches are designed to prevent the search process for an optimal solution from wondering away from the feasible region. They can be considered as an objective-perturbation approach. This chapter studies the objective-perturbation approach by using the entropic function, \(\sum {_j x_j \ln x_j } \) for solving four classes of problems, namely, linear programming problems in Karmarkar’s form, linear programming programs in standard form, convex quadratic programming problems, and linear and convex quadratic semi-infinite programming problems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Anderson, E. J., and Nash, P., Linear Programming in Infinite-Dimensional Spaces, John Wiley, Chichester, New York, 1987.

    Google Scholar 

  2. Ben-Tal, A., Melman, A., and Zowe, J., “Curved Search Methods for Unconstrained Optimization,” Optimization, Vol. 21, 1990, pp. 669–695.

    Article  Google Scholar 

  3. Dennis, J.E., and Schnabel, R.B., Numerical Methods for Unconstrained Optimization and Nonlinear Equations, Prentice Hall, Englewood Cliffs, New Jersey, 1983.

    Google Scholar 

  4. Duffin, R.J., Peterson, E.L., and Zener, C., Geometric Programming: Theory And Applications, John Wiley, New York, 1967.

    Google Scholar 

  5. Erickson, J.R., “Algorithms for Entropy and Mathematical Programming,” Ph.D. Thesis, Department of Mathematics, Linkoping University, Sweden, 1981.

    Google Scholar 

  6. Erickson, J.R., “An Iterative Primal-Dual Algorithm for Linear Programming,” Report LitH-MAT-R-1985-10, Department of Mathematics, Linkoping University, Linkoping, Sweden, 1985.

    Google Scholar 

  7. Erlander, S., “Entropy in Linear Programming,” Mathematical Programming, Vol. 21, 1981, pp. 137–151.

    Article  Google Scholar 

  8. Fang, S.-C., “A New Unconstrained Convex Programming Approach to Linear Programming,” Zeitschrift fur Operations Research, Vol. 36, 1992, pp. 149–161.

    Google Scholar 

  9. Fang, S.-C., Lin, C.-J., and Wu, S.-Y., “On Solving Convex Quadratic Semi-Infinite Programming Problems,” Optimization, Vol. 31, 1994, pp. 107–125.

    Article  Google Scholar 

  10. Fang, S.-C., and Puthenpura, S., Linear Optimization and Extensions: Theory and Algorithms, Prentice Hall, Englewood Cliffs, New Jersey, 1993.

    Google Scholar 

  11. Fang, S.-C., and Tsao, H.-S.J., “Linear Programming with Entropic Perturbation,” Zeitschrift fur Operations Research, Vol. 37, 1993, pp. 171–186.

    Google Scholar 

  12. Fang, S.-C., and Tsao, H.-S.J., “An Unconstrained Convex Programming Approach to Solving Convex Quadratic Programming Problems,” Optimization, Vol. 27, 1993, pp. 235–243.

    Article  Google Scholar 

  13. Fang, S.-C., and Tsao, H.-S.J., “On the Entropic Perturbation and Exponential Penalty Methods for Linear Programming,” Journal of Optimization Theory and Applications, Vol. 89, 1996, pp. 461–466.

    Article  Google Scholar 

  14. Fang, S.-C., and Wu, S.-Y., “An Inexact Approach to Solving Linear Semi-Infinite Programming Problems,” Optimization, Vol. 28, 1994, pp. 291–299.

    Article  Google Scholar 

  15. Ferris, M.C., and Philpott, A.B., “An Interior Point Algorithm for Semi-Infinite Linear Programming,” Mathematical Programming, Vol. 43, 1989, pp. 257–276.

    Article  Google Scholar 

  16. Ferris, M.C., and Philpott, A.B., “On the Affine Scaling and Semi-Infinite Programming,” Mathematical Programming, Vol. 56, 1992, pp. 361–364.

    Article  Google Scholar 

  17. Fiacco, A.V., and McCormick, G.P., Nonlinear Programming: Sequential Unconstrained Minimization Techniques, John Wiley, New York, 1968.

    Google Scholar 

  18. Gill, P.E., Murray, W., Saunders, M.A., Tomlin, J.A., and Wright, M.H., “On Projected Barrier Methods for Linear Programming and an Equivalence to Karmarkar’s Projective Method,” Mathematical Programming, Vol. 36, 1986, pp. 183–209.

    Article  Google Scholar 

  19. Glashoff, K., and Gustafson, S.A., Linear Optimization and Approximation, Springer-Verlag, New York, 1982.

    Google Scholar 

  20. Goldfarb, D., and Todd, M.J., “Linear Programming,” Cornell University, School of OR and IE, Tech. Report No. 777, 1988.

    Google Scholar 

  21. Gustafson, S.A., and Kortanek, K.O., “Numerical Treatment of a Class of Semi-Infinite Programming Problems,” Naval Research Logistics Quarterly, Vol. 20, 1973, pp. 473–504.

    Article  Google Scholar 

  22. Den Hertog, D., Roos, C., and Terlaky, T., “Inverse Barrier Methods for Linear Programming,” Report of the Faculty of Technical Mathematics and Informatics, No. 91-27, Delft University of Technology, The Netherlands, 1991.

    Google Scholar 

  23. Hettich, R., and Kortanek, K.O., “Semi-Infinite Programming: Theory, Method and Applications,” SIAM Review, Vol. 35, 1993, pp. 380–429.

    Article  Google Scholar 

  24. Karmarkar, N., “A New Polynomial Time Algorithm for Linear Programming,” Combinatorica, Vol. 4, 1984, pp. 373–395.

    Article  Google Scholar 

  25. Lagarias, J.C., and Bayer, D.A., “Karmarkar’s Linear Programming Method and Newton’s Method,” Bell Laboratories Technical Report, 11218-870810-22TM, AT&T Bell Laboratories, Murray Hill, New Jersey, Aug 10, 1987.

    Google Scholar 

  26. Lai, H.C., and Wu, S.Y., “On Linear Semi-Infinite Programming Problems, an Algorithm,” Numerical Functional Analysis and Optimization, Vol. 13, 1992, pp. 287–304.

    Article  Google Scholar 

  27. Lin, C.J., Fang, S.-C., and Wu, S.Y., “An Unconstrained Convex Programming Approach to Linear Semi-Infinite Programming,” OR Technical Report No. 296, North Carolina State University, Raleigh, North Carolina, 1994, to appear in SIAM Journal on Optimization.

    Google Scholar 

  28. Lin, C.-J., Yang, E.K., Fang, S.-C., and Wu, S.-Y., “Implementation of an Inexact Approach to Solving Linear Semi-Infinite Programming Problems,” Journal of Computational and Applied Mathematics, Vol. 61, 1995, pp. 87–103.

    Article  Google Scholar 

  29. Minoux, M., Mathematical Programming, Wiley-Interscience, New York, 1986.

    Google Scholar 

  30. Murtagh, B.A., and Saunders, M.A., MINOS 5.1 User’s Guide, Technical Report SOL 83-20R, Stanford University, Stanford, California, 1983.

    Google Scholar 

  31. Peterson, E.L., “Geometric Programming,” SIAM Review, Vol. 19, 1976, pp. 1–45.

    Article  Google Scholar 

  32. Rajasekera, J.R., and Fang, S.-C., “On the Convex Programming Approach to Linear Programming,” Operations Research Letters, Vol. 10, 1991, pp. 309–312.

    Article  Google Scholar 

  33. Rajasekera, J. R., and Fang, S.-C., “Deriving an Unconstrained Convex Program for Linear Programming,” Journal of Optimization Theory and Applications, Vol. 75, 1992, pp. 603–612.

    Article  Google Scholar 

  34. Renegar, J., “A Polynomial-time Algorithm Based on Newton’s Method for Linear Programming,” Mathematical Programming, Vol. 40, 1988, pp. 59–93.

    Article  Google Scholar 

  35. Rockafellar, R.T., Convex Analysis, Princeton University Press, Princeton, New Jersey, 1970.

    Google Scholar 

  36. Saigal, R., Linear Programming: A Modern Integrated Analysis, Kluwer Academic Publishers, Norwell, Massachusetts, 1995.

    Google Scholar 

  37. Shanno, D.F., and Bagchi, A., “Unified View of Interior Point Methods for Linear Programming,” Rutcor Research Report No. 35-88, Rutgers University, New Brunswick, New Jersey, July 1988.

    Google Scholar 

  38. Sheu, R.-L., and Fang, S.-C., “Insights into Interior-Point Methods,” Zeitschrift fur Operations Research, Vol. 36, 1992, pp. 227–257.

    Google Scholar 

  39. Vanderbei, R.J., LOQO User’s Manual, Princeton University Press, Princeton, New Jersey, 1992.

    Google Scholar 

  40. Wang, D., “Experiments on the Unconstrained Convex Programming Approach to Linear Programming,” IE Report No. 90-12, North Carolina State University, Raleigh, North Carolina, 1990.

    Google Scholar 

  41. Xu, Z.K., and Fang, S.-C., “Unconstrained Convex Programming Approach to Linear Programming,” Journal of Optimization Theory and Applications, Vol. 86, 1993, pp. 745–752.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 1997 Springer Science+Business Media New York

About this chapter

Cite this chapter

Fang, SC., Rajasekera, J.R., Tsao, HS.J. (1997). Entropic Perturbation Approach to Mathematical Programming. In: Entropy Optimization and Mathematical Programming. International Series in Operations Research & Management Science, vol 8. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-6131-6_5

Download citation

  • DOI: https://doi.org/10.1007/978-1-4615-6131-6_5

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4613-7810-5

  • Online ISBN: 978-1-4615-6131-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics