Abstract
In nonlinear least-square problems with nonlinear constraints, the function \(\left. {(1/2)} \right\|\left. {f_2 (x)} \right\|_2^2\), where f 2 is a nonlinear vector function, is to be minimized subject to the nonlinear constraints f 1(x)=0. This problem is ill-posed if the first-order KKT conditions do not define a locally unique solution. We show that the problem is ill-posed if either the Jacobian of f 1 or the Jacobian of J is rank-deficient (i.e., not of full rank) in a neighborhood of a solution satisfying the first-order KKT conditions. Either of these ill-posed cases makes it impossible to use a standard Gauss–Newton method. Therefore, we formulate a constrained least-norm problem that can be used when either of these ill-posed cases occur. By using the constant-rank theorem, we derive the necessary and sufficient conditions for a local minimum of this minimum-norm problem. The results given here are crucial for deriving methods solving the rank-deficient problem.
Similar content being viewed by others
References
Walker, H. F., Newton-Like Methods for Underdetermined Systems, Lectures in Applied Mathematics, Vol. 26, pp. 679–699, 1990.
Bates, D., and Watts, D., Nonlinear Regression Analysis and Its Applications, John Wiley, New York, New York, 1988.
Van Huffel, S., and Vandewalle, J., The Total Least-Square Problem: Computational Aspects and Analysis, SIAM, Philadelphia, Pennsylvania, 1991.
Eriksson, J., Gulliksson, M., LindstrÖm, P., and Wedin, P. Å., Regularization Tools for Training Feed-Forward Neural Networks, Part 2: Large-Scale Problems, Technical Report UMINF 96.06, Department of Computing Science, Umeå University, Umeå, Sweden, 1996.
Hansen, P. C., Rank-Deficient and Discrete Ill-Posed Problems, Technical Report, Department of Mathematical Modelling, Section for Numerical Analysis, Technical University of Denmark, Lyngby, Denmark, 1997.
Eriksson, J., and Gulliksson, M., Local Results for the Gauss-Newton Method on Constrained Exactly Rank-Deficient Nonlinear Least Squares, Technical Report UMINF 97.12, Department of Computing Science, Umeå University, Umeå, Sweden, 1997.
Eriksson, J., Optimization and Regularization of Nonlinear Least-Square Problems, Technical Report UMINF 96.09 (PhD Thesis), Department of Computing Science, Umeå University, Umeå, Sweden, 1996.
Hanson, R. J., and Lawson, C. L., Solving Least-Square Problems, Prentice Hall, Englewood Cliffs, New Jersey, 1974.
Conlar, L., Differential Manifolds: A First Course, Birkhäuser Advanced Texts, Boston, Massachusetts, 1993.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Gulliksson, M. KKT Conditions for Rank-Deficient Nonlinear Least-Square Problems with Rank-Deficient Nonlinear Constraints. Journal of Optimization Theory and Applications 100, 145–160 (1999). https://doi.org/10.1023/A:1021721132282
Issue Date:
DOI: https://doi.org/10.1023/A:1021721132282