Abstract
This paper developed the dynamic feedback neural network model to solve the convex nonlinear programming problem proposed by Leung et al. and introduced subgradient-based dynamic feedback neural networks to solve non-differentiable convex optimization problems. For unconstrained non-differentiable convex optimization problem, on the assumption that the objective function is convex coercive, we proved that with arbitrarily given initial value, the trajectory of the feedback neural network constructed by a projection subgradient converges to an asymptotically stable equilibrium point which is also an optimal solution of the primal unconstrained problem. For constrained non-differentiable convex optimization problem, on the assumption that the objective function is convex coercive and the constraint functions are convex also, the energy functions sequence and corresponding dynamic feedback subneural network models based on a projection subgradient are successively constructed respectively, the convergence theorem is then obtained and the stopping condition is given. Furthermore, the effective algorithms are designed and some simulation experiments are illustrated.
Similar content being viewed by others
References
Hopfield J J, Tank D W. Neural computation of decisions in optimization problems. Biol Cybern, 1985, 52: 141–152
Tank D W, Hopfield J J. Simple neural optimization network: An A/D converter, signal decision circuit, and a linear programming circuit. IEEE Trans Circuits Syst, 1986, 33: 533–541
Kennedy M P, Chua L O. Neural networks for nonlinear programming. IEEE Trans Circuits Syst, 1988, 35: 554–562
Rodríguez-Vázquez A, Rueda R, Huertas J L, et al. Nonlinear switched-capacitor neural networks for optimization problems. IEEE Trans Circuits Syst, 1990, 37: 384–397
Bouzerdoum A, Pattison T R. Neural network for quadratic optimization with bound constraints. IEEE Trans Neural Networks, 1993, 4: 293–304
Sudharsanan S, Sundareshan M. Exponential stability and a systematic synthesis of a neural network for quadratic minimization. Neural Networks, 1991, 4: 599–613
Leung Y, Chen K Z, Gao X B. A high-performance feedback neural network for solving convex nonlinear programming problems. IEEE Trans Neural Networks, 2003, 14: 1469–1477
Aubin J P, Cellina A. Differential Inclusions. Berlin: Springer-Verlag, 1984
Ortega J M, Rheinboldt W C. Iterative Solution of Nonlinear Equation in Several Variables. New York: Academic, 1970
Dimitri P B. Nonlinear Programming. 2nd ed. Belmont: Athena Scientific, 1999
Filippov A F. Differential Equations with Discontinuous Righthand Sides. Dordrecht: Kluwer Academic, 1988
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Li, G., Song, S. & Wu, C. Subgradient-based feedback neural networks for non-differentiable convex optimization problems. SCI CHINA SER F 49, 421–435 (2006). https://doi.org/10.1007/s11432-006-2007-5
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/s11432-006-2007-5