Abstract
This paper studies non-convex programming problems. It is known that, in statistical inference, many constrained estimation problems may be expressed as convex programming problems. However, in many practical problems, the objective functions are not convex. In this paper, we give a definition of a semi-convex objective function and discuss the corresponding non-convex programming problems. A two-step iterative algorithm called the alternating iterative method is proposed for finding solutions for such problems. The method is illustrated by three examples in constrained estimation problems given in Sasabuchi et al. (Biometrika, 72, 465–472 (1983)), Shi N. Z. (J. Multivariate Anal., 50, 282–293 (1994)) and El Barmi H. and Dykstra R. (Ann. Statist., 26, 1878–1893 (1998)).
Similar content being viewed by others
References
Avriel, M.: Nonlinear programming: analysis and methods, PrenticeHall Inc., New York, 1976
Peressini, A. L., Sullivan, F. E., Uhl, J. J.: The mathematics of nonlinear programming, Springer-Verlag, New York, 1988
Stoer, J., Witzgall, C.: Convexity and Optimization in Finite Dimension, I. Springer-Verlag Berlin, Heidelberg, New York, 1970
Li, D., Sun, X. L.: Local convexification of the lagrangian function in non-convex optimization. Journal of Optimization Theory and Applications, 104, 109–120 (2000)
Mifflin, R.: Semismooth and semiconvex functions in constrained optimization. SIAM J. Control and Optimization, 15, 959–972 (1977)
Sasabuchi, S., Inutsuka, M., Kulatunga, D. D. S.: A Multivariate version of isotonic regression. Biometrika, 72, 465–472 (1983)
Shi, N. Z.: Order isotonic and maximum likelihood estimation. Chinese Journal of Applied Probability and Statistics, 9(2), 411–419 (1993)
Shi, N. Z.: Maximum likelihood estimations of means and variances from normal populations under simultaneous order restrictions. J. Multivariate Anal., 50, 282–293 (1994)
El Barmi, H., Dykstra, R.: Maximum likelihood estimates via duality for log-convex models when cell probabilities are subject to convex constraints. Ann. Statist., 26, 1878–1893 (1998)
Shi, N. Z., Jiang, H.: Maximum likelihood estimation of isotonic normal means with unknown variances. J. Multivariate Anal., 64, 183–195 (1998)
Zhong, S. S.: Fixed Point Theory and Its Application (in Chinese), Chongqing Press, Chongqing, 1984
Author information
Authors and Affiliations
Corresponding author
Additional information
Supported by the National Natural Science Foundation of China (Nos. 10431010, 10501005) and Science Foundation for Young Teachers of NENU (No. 20070103)
Rights and permissions
About this article
Cite this article
Shi, N.Z., Hu, G.R. & Cui, Q. An alternating iterative method and its application in statistical inference. Acta. Math. Sin.-English Ser. 24, 843–856 (2008). https://doi.org/10.1007/s10114-007-1017-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10114-007-1017-6
Keywords
- semi-convex function
- alternating iterative method
- accumulation point
- maximum likelihood estimation
- order restriction