Abstract
We consider a method to select an optimal M-estimator over a family of M-estimators of a parameter. Assuming that there exists an estimate of the mean square error for each element of this family of estimators, a natural estimator to consider is the M-estimator in the class which minimizes the considered estimates of the mean square errors. It is shown that under regularity conditions, this M-estimator is asymptotically normal and its asymptotic mean square error is equal to the infimum of the asymptotic mean square errors of the M-estimators in the class. We see how this method works in two different situations. In order to tackle the former problem, we present sufficient conditions for the weak convergence of a class of M-estimators.
Similar content being viewed by others
References
Arcones, M. A. (1999). Weak convergence for the row sums of a triangular array of empirical processes indexed by a manageable triangular array of functions.Electronic Journal of Probability, 4, Paper no. 7:1–17.
Chan, Y. M. andHe, X. (1994). A simple and competitive estimator of location.Statistics & Probability Letters, 19:137–142.
Dodge, Y. (1984). Robust estimation of regression coefficients by minimizing a convex combination of least squares and least absolute deviations.Computational Statistics Quarterly, 1:139–153.
Dodge, Y. andJurečková, J. (1987). Adaptive combination of least squares and least absolute deviations estimators. In Y. Dodge, ed., Statistical Analysis Based onL1-Norm and Related Methods, pp. 275–284. North-Holland, Amsterdam.
Dudley, R. M. (1999).Uniform Central Limit Theorems. Cambridge University Press, Cambridge.
Forsythe, A. B. (1972). Robust estimation of straight line regression coefficients by minimizingp-th power deviations.Technometrics, 14:159–166.
Fraiman, V. J., R., Yohai andZamar, R. H. (2001). Optimal robust M-estimates of location.Annals of Statistics, 29:194–223.
Gentle, T. E. (1977). Least absolute deviation: An introduction.Communications of Statistics, B6:313–328.
Hall, P. (1981). Least absolute deviation: An introduction.Annals of the Institute of Statistical Mathematics, 33:449–462.
Harter, H. L. (1974a). The method of least squares and some alternatives. I.International Statistical Review, 42:147–174.
Harter, H. L. (1974b). The method of least squares and some alternatives. II.International Statistical Review, 42:235–264.
Harter, H. L. (1975a). The method of least squares and some alternatives. III.International Statistical Review, 43:1–44.
Harter, H. L. (1975b). The method of least squares and some alternatives. IV.International Statistical Review, 43:125–190.
Harter, H. L. (1975c). The method of least squares and some alternatives. V.International Statistical Review, 43:269–272.
Hogg, R. V. (1974). Adaptive robust procedures: A partial review and some suggestions for future applications and theory.Journal of the American Statistical Association, 69:909–923.
Huber, P. J. (1964). Robust estimation of a location parameter.Annals of Mathematical Statistics, 35:73–101.
Jaeckel, L. A. (1971). Some flexible estimates of location.Annals of Mathematical Statistics, 42:1540–1552.
Jurečková, J., Koenker, R., andWelsch, A. H. (1994). Adaptive choice of trimming proportions.Annals of the Institute of Statistical Mathematics, 46:737–755.
Marcus, M. B. andPisier, G. (1981).Random Fourier Series with Applications to Harmonic Analysis, vol. 101 ofAnnals of Mathematical Studies. Princeton University Press, Princeton, New Jersey.
Maronna, R. A. andYohai, V. J. (1981). Asymptotic behavior of generalM-estimates for regression and scale with random carriers.Zeitschrift für Wahrscheinlichkeitstheorie und Verwandte Gebiete, 58:7–20.
Rousseeuw, P. andYohai, V. J. (1984). Robust regression by means of S-estimators. In H. W. Franke. J. and R. D. Martin, eds.Robust and Nonlinear Time Series Analysis, vol. 26 ofLecture Notes in Statistics, pp. 256–272. Springer-Verlag, New York.
Sposito, V. A. (1989). Some properties ofLp-estimates. In K. D. Lawrence and J. L. Arthur, eds.,Robust Regression, Analysis and Applications, pp. 23–58. Marcel Dekker, New York.
Stone, C. J. (1975). Adaptive maximum likelihood estimators of a location parameter.Annals of Statistics, 3:267–284.
Talagrand, M. (1996). New concentration inequalities in product spaces.Inventiones Mathematicae, 126:505–563.
Yohai, V. J. (1974). Robust estimation in the linear model.Annals of Statistics, 2:562–567.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Arcones, M.A. Convergence of the optimal M-estimator over a parametric family of M-estimators. Test 14, 281–315 (2005). https://doi.org/10.1007/BF02595407
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF02595407