Abstract
The problem of calculating a point x that satisfies a given system of linear inequalities, A x #x2265; b, arises in many applications. Yet often the system to be solved turns out to be inconsistent due to measurement errors in the data vector, b. In such a case it is useful to find the smallest perturbation of b that recovers feasibility. This motivates our interest in the least correction problem and its properties.
Let A x #x2265; b be an inconsistent system of linear inequalities. Then it is always possible to find a correction vector y such that the modified system A x #x2265; b #x2212; y is solvable. The smallest correction vector of this type is obtained by solving the least correction problem \(\begin{gathered} {\text{minimize}}\quad P\left( {{\text{x,y}}} \right) = \frac{1}{2}\left\| {\text{y}} \right\|_2^2 \hfill \\ {\text{subject}}{\text{ to}}\quad {\text{Ax}}{\text{ + }}{\text{ y}} \geqslant {\text{b}}{\text{.}} \hfill \\ \end{gathered}\)Let \(\mathbb{U}\) denote the convex cone which consists of all the points \(\mathbb{R}^m \) for which the system A x #x2265; u is solvable. Let \(\mathbb{Y}\) denote the polar cone of \(\mathbb{U}\). It is shown that the least correction problem has a simple geometric interpretation which is based on the polar decomposition of \(\mathbb{R}^m\) into \(\mathbb{U}\) and \(\mathbb{Y}\). A further insight into the least correction concept is gained by exploring the duality relations that characterize such problems.
Similar content being viewed by others
References
P. Amaral, M.W. Trosset, and P. Barahona, “Correcting an inconsistent system of linear inequalities by nonlinear programming,” Technical Report TR00-27, DCAM, Rice University, 2000.
A. Ben-Israel, “Linear equations and inequalities on finite dimensional, real or complex, vector spaces: A unified theory,” Journal of Mathematical Analysis and Applications vol. 27, pp. 367–389, 1969.
A. Bjorck, Numerical Methods for Least Squares Problems, SIAM: Philadelphia, 1996.
Y. Censor, “Row-action methods for huge and sparse systems and their applications,” SIAM Review vol. 23, pp. 444–466, 1981.
Y. Censor and S. Zenios, Parallel Optimization, Theory, Algorithms, and Applications, Oxford University Press: Oxford, 1997.
P. G. Ciarlet, Introduction to Numerical Linear Algebra and Optimisation, Cambridge University Press: Cambridge, 1989.
A. Dax, “On minimum norm solutions,” Journal of Optimization Theory and Applications vol. 76, pp. 183–193, 1993a.
A. Dax, “The relationship between theorems of the alternative, least norm problems, steepest descent directions, and degeneracy: A review,” Annals of Operations Research vol. 46, pp. 11–60, 1993b.
A. Dax, “Loss and retention of accuracy in affine scaling methods,” Optimization Methods and Software vol. 15, pp. 121–151, 2001a.
A. Dax, “On theory and practice of row relaxation methods,” in Inherently Parallel Algorithms in Feasibility and Optimization and Their Applications, D. Butnariu, Y. Censor, and S. Reich, eds., A volume in the series Studies in Computational Mathematics, Elsevier Science: Amsterdam, 2001b.
A. Dax and V. P. Sreedharan, “On theorems of the alternative and duality,” Journal of Optimization Theory and Applications vol. 94, pp. 561–590, 1997.
D. Gale, The Theory of Linear Economic Models, McGraw-Hill: New York, 1960.
G. H. Golub and C. F. Van Loan, “An analysis of the total least squares problem,” SIAM J. Num. Anal. vol. 17, pp. 883–893, 1980.
G. H. Golub and C. F. Van Loan, Matrix Computations, Johns Hopkins University Press: Baltimore, 1983.
G. T. Herman, “A relaxation method for reconstructing objects from noisy x-rays,” Math. Prog. vol. 8, pp. 1–19, 1975.
J.-B. Hiriart-Urruty and C. Lemarechal, Convex Analysis and Minimization Algorithms I, Springer-Verlag: Berlin Heidelberg, 1993.
A. S. Householder, The Theory of Matrices in Numerical Analysis, Blaisdell Publishing Company: New York, 1964.
C. L. Lawson and R. J. Hanson, Solving Least Squares Problems, 2nd edn., SIAM: Philadelphia, 1995.
D. G. Luenberger, Optimization by Vector Space Methods, Wiley: New York, 1969.
O. L. Mangasarian, Nonlinear Programming, McGraw-Hill: New York, 1969.
J. J. Moreau, “Decomposition orthogonale d'un espace hilbertien selon deux cones mutuellement polaires,” C.R. Acad. Sci. Paris vol. 255, pp. 238–240, 1962.
J. J. Moreau, “Convexity and duality,” in Fundamental Analysis and Optimization, E.R. Caianiello, ed., Academic Press: New York, pp. 145–169, 1966.
L. Nirenberg, “Functional analysis,” Lectures given in 1960–1961, Notes by Lesley Sibner, New York University, 1961.
M. R. Osborne, Finite Algorithms in Optimization and Data Analysis, John Wiley and Sons: Chichester, 1985.
R. T. Rockafellar, Convex Analysis, Princeton University Press: Princeton, 1970.
V. P. Sreedharan, “An algorithm for non-negative norm minimal solutions,” Numerical Functional Analysis and Optimization vol. 9, pp. 193–232, 1987.
G. W. Stewart, Introduction to Matrix Computation, Academic Press: New York, 1973.
J. Stoer and C. Witzgall, Convexity and Optimization in Finite Dimensions, Part 1, Springer: Berlin, 1970.
G. Strang, Linear Algebra and its Applications, 3rd edn., Harcourt Brace: Orlando, 1986.
S. Van Huffel and J. Vandewalle, The Total Least Squares Problem: Computational Aspects and Analysis, SIAM: Philadelphia, 1991.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Dax, A. The Smallest Correction of an Inconsistent System of Linear Inequalities. Optimization and Engineering 2, 349–359 (2001). https://doi.org/10.1023/A:1015370617219
Issue Date:
DOI: https://doi.org/10.1023/A:1015370617219