Summary
A sufficient condition for the limit of a martingale transform to posses a continuous distribution is given. The result is used to show that for a stochastic approximation procedure, if the adjustment rate is too small then it would not converge to the target value a.s. Furthermore, if the adjustment rate is taken to be 1/n as usual but the derivative of the regression function at the target value is 0, then the convergence rate is shown to be logn instead of\(\sqrt n\), the rate obtained when the derivative is non-zero.
References
Barlow, W.J.: Coefficient properties of random variable sequences. Ann. Probab.3, 840–848 (1975)
Burkholder, D.J.: Independent sequences with the Stein property. Ann. Math. Stat.39, 1282–1288 (1968)
Chow, Y.S., Teicher, H.: Probability theory: Independence, interchangeability, martingales. Berlin Heidelberg New York: Springer 1978
Chow, Y.S.: Local convergence of martingales and the law of large numbers. Ann. Math. Stat36, 552–558 (1965)
Feller, W.: An introduction to probability theory and its application, 3rd. edn. New York: Wiley 1968
Kersting, G.: Some results on the asymptotic behavior of the Robbins-Monro Procedure. Bull. Int. Stat. Inst.XLVII, 327–335 (1977)
Lai, T.L., Robbins, H.: Adaptive design in regression and control. Proc. Nat. Acad. Sci. USA75, 586–587 (1978)
Lai, T.L., Robbins, H.: Adaptive design and stochastic approximation. Ann. Stat.7, 1196–1221 (1979)
Lai, T.L., Wei, C.Z.: A note on martingale difference sequences satisfying the local Marcinkiewicz-Zygmund condition. Bull. Inst. Math., Acad. Sin.11, 1–13 (1983a)
Lai, T.L., Wei, C.Z.: Asymptotic properties of general autoregressive models and strong consistency of least-squares estimates of their parameters. J. Multivariate Anal.13, 1–23 (1983b)
Robbins, H., Monro, S.: A stochastic approximation method. Ann. Math. Stat.22, 400–407 (1951)
Robbins, H., Siegmund, D.: A convergence theorem for non-negative almost supermartingales and some applications. In: Rustagi, J. (ed.) Optimizing methods in statistics, pp. 233–257. New York: Academic Press 1971
Wei, C.Z.: Multivariate adaptive stochastic approximation. Ann. Stat.15, 1115–1130 (1987)
Author information
Authors and Affiliations
Additional information
Research supported by the National Science Council, R.O.C.
Rights and permissions
About this article
Cite this article
Wei, C.Z. Martingale transforms with non-atomic limits and stochastic approximation. Probab. Th. Rel. Fields 95, 103–114 (1993). https://doi.org/10.1007/BF01197340
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF01197340
Mathematics Subject Classifications (1980)
- 60 G 42
- 62 L 20