Abstract
Iterative methods for solving non-regular nonlinear operator equations in a Hilbert space under random noise are constructed and examined. The methods use the averaging of the input data. It is not assumed that the noise dispersion is known. An iteratively regularized method of order zero for equations with monotone operators and iteratively regularized methods of the Gauss–Newton type for equations with arbitrary smooth operators are used as the basic procedures. It is shown that the generated approximations converge in the mean-square sense to the desired solution or stabilize (again in the mean-square sense) in a small neighborhood of the solution.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
M. T. Wasan, Stochastic Approximation (Cambridge Univ. Press, Cambridge, 1969; Mir, Moscow, 1972).
M. V. Nevel’son and R. Z. Has’minskii, Stochastic Approximation and Recursive Estimation (Nauka, Moscow, 1972; Am. Math. Soc., Providence, R.I., 1973).
H. J. Kushner and G. G. Yin, Stochastic Approximation and Recursive Algorithms and Applications (Springer, New York, 2003).
G. I. Salov, “On a stochastic approximation theorem in a Hilbert space and its applications,” Theor. Probab. Appl.24(2), 413–419 (1979).
A. B. Bakushinskii and M. Yu. Kokurin, Iterative Methods for Solving Ill-Posed Operator Equations with Smooth Operators (Editorial URSS, Moscow, 2002) [in Russian].
A. M. Fedotov, Ill-Posed Problems with Random Errors in Data (Nauka, Novosibirsk, 1990) [in Russian].
J. Kaipio and E. Somersalo, Statistical and Computational Inverse Problems (Springer, New York, 2005).
F. Bauer, T. Hohage, and A. Munk, “Iteratively regularized Gauss–Newton method for nonlinear inverse problems with random noise,” SIAM J. Numer. Anal.47(3), 1827–1846 (2009).
Ya. Z. Tsypkin, Fundamentals of the Theory of Learning Systems (Nauka, Moscow, 1970) [in Russian].
A. B. Bakushinskii and A. V. Goncharskii, Iterative Methods for Solving Ill-Posed Problems (Nauka, Moscow, 1989) [in Russian].
A. B. Bakushinskii, “On the construction of a regularizing algorithm with random disturbances,” Dokl. Akad. Nauk SSSR189(2), 231–233 (1969).
A. B. Bakushinskii and A. S. Apartsyn, “Methods of stochastic approximation type for solving linear ill-posed problems,” Sib. Mat. Zh.16(1), 12–18 (1975).
R. E. Bruck, “On the weak convergence of an ergodic iteration for the solution of variational inequalities for monotone operators in Hilbert space,” J. Math. Anal. Appl.61(1), 159–164 (1977).
A. S. Nemirovsky and D. B. Yudin, Problem Complexity and Method Efficiency in Optimization (Nauka, Moscow, 1979; Wiley-Interscience, New York, 1983).
B. T. Polyak, “A new method of stochastic approximation type,” Autom. Remote Control51(7), 937–946 (1990).
R. Schwabe, “On Bather’s stochastic approximation algorithm,” Kybernetika30(3), 301–306 (1994).
N. N. Vakhaniya, V. I. Tarieladze, and S. A. Chobanyan, Probability Distributions on Banach Spaces (Nauka, Moscow, 1985; Reidel, Dordrecht, 1987).
J.-P. Kahane, Some Random Series of Functions (Cambridge Univ. Press, Cambridge, 1968; Mir, Moscow, 1973).
M. Yu. Kokurin, Operator Regularization and Study of Nonlinear Monotone Problems (Mar. Gos. Univ., YoshkarOla, 1998).
S. Gan and D. Qui, “On the Hajek–Renyi inequality,” Wuhan Univ. J. Nat. Sci.12(6), 971–974 (2007).
Y. Miao, “Hajek–Renyi inequality for dependent random variables in Hilbert space and applications,” Rev. Un. Mat. Argentina53(1), 101–112 (2012).
V. V. Petrov, Limit Theorems for Sums of Independent Random Variables (Nauka, Moscow, 1987; Clarendon, Oxford, 1995).
A. B. Bakushinskii, M. Yu. Kokurin, and A. I. Kozlov, Stabilizing Gradient-Type Methods for Solving Irregular Nonlinear Operator Equations (LKI, Moscow, 2007) [in Russian].
A. B. Bakushinskii and M. Yu. Kokurin, Iterative Methods for Solving Irregular Equations (LENAND, Moscow, 2006) [in Russian].
Author information
Authors and Affiliations
Corresponding author
Additional information
Original Russian Text © A.B. Bakushinskii, M.Yu. Kokurin, 2015, published in Zhurnal Vychislitel’noi Matematiki i Matematicheskoi Fiziki, 2015, Vol. 55, No. 10, pp. 1637–1645.
Rights and permissions
About this article
Cite this article
Bakushinskii, A.B., Kokurin, M.Y. Iterative methods of stochastic approximation for solving non-regular nonlinear operator equations. Comput. Math. and Math. Phys. 55, 1597–1605 (2015). https://doi.org/10.1134/S096554251510005X
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S096554251510005X