Skip to main content
Log in

Convergence of the optimal M-estimator over a parametric family of M-estimators

  • Published:
Test Aims and scope Submit manuscript

Abstract

We consider a method to select an optimal M-estimator over a family of M-estimators of a parameter. Assuming that there exists an estimate of the mean square error for each element of this family of estimators, a natural estimator to consider is the M-estimator in the class which minimizes the considered estimates of the mean square errors. It is shown that under regularity conditions, this M-estimator is asymptotically normal and its asymptotic mean square error is equal to the infimum of the asymptotic mean square errors of the M-estimators in the class. We see how this method works in two different situations. In order to tackle the former problem, we present sufficient conditions for the weak convergence of a class of M-estimators.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Arcones, M. A. (1999). Weak convergence for the row sums of a triangular array of empirical processes indexed by a manageable triangular array of functions.Electronic Journal of Probability, 4, Paper no. 7:1–17.

    MathSciNet  Google Scholar 

  • Chan, Y. M. andHe, X. (1994). A simple and competitive estimator of location.Statistics & Probability Letters, 19:137–142.

    Article  MATH  MathSciNet  Google Scholar 

  • Dodge, Y. (1984). Robust estimation of regression coefficients by minimizing a convex combination of least squares and least absolute deviations.Computational Statistics Quarterly, 1:139–153.

    MATH  Google Scholar 

  • Dodge, Y. andJurečková, J. (1987). Adaptive combination of least squares and least absolute deviations estimators. In Y. Dodge, ed., Statistical Analysis Based onL1-Norm and Related Methods, pp. 275–284. North-Holland, Amsterdam.

    Google Scholar 

  • Dudley, R. M. (1999).Uniform Central Limit Theorems. Cambridge University Press, Cambridge.

    MATH  Google Scholar 

  • Forsythe, A. B. (1972). Robust estimation of straight line regression coefficients by minimizingp-th power deviations.Technometrics, 14:159–166.

    Article  MATH  Google Scholar 

  • Fraiman, V. J., R., Yohai andZamar, R. H. (2001). Optimal robust M-estimates of location.Annals of Statistics, 29:194–223.

    Article  MATH  MathSciNet  Google Scholar 

  • Gentle, T. E. (1977). Least absolute deviation: An introduction.Communications of Statistics, B6:313–328.

    MathSciNet  Google Scholar 

  • Hall, P. (1981). Least absolute deviation: An introduction.Annals of the Institute of Statistical Mathematics, 33:449–462.

    Article  MATH  MathSciNet  Google Scholar 

  • Harter, H. L. (1974a). The method of least squares and some alternatives. I.International Statistical Review, 42:147–174.

    MathSciNet  Google Scholar 

  • Harter, H. L. (1974b). The method of least squares and some alternatives. II.International Statistical Review, 42:235–264.

    MathSciNet  Google Scholar 

  • Harter, H. L. (1975a). The method of least squares and some alternatives. III.International Statistical Review, 43:1–44.

    Article  MathSciNet  Google Scholar 

  • Harter, H. L. (1975b). The method of least squares and some alternatives. IV.International Statistical Review, 43:125–190.

    MathSciNet  Google Scholar 

  • Harter, H. L. (1975c). The method of least squares and some alternatives. V.International Statistical Review, 43:269–272.

    MathSciNet  Google Scholar 

  • Hogg, R. V. (1974). Adaptive robust procedures: A partial review and some suggestions for future applications and theory.Journal of the American Statistical Association, 69:909–923.

    Article  MATH  MathSciNet  Google Scholar 

  • Huber, P. J. (1964). Robust estimation of a location parameter.Annals of Mathematical Statistics, 35:73–101.

    MathSciNet  MATH  Google Scholar 

  • Jaeckel, L. A. (1971). Some flexible estimates of location.Annals of Mathematical Statistics, 42:1540–1552.

    MathSciNet  MATH  Google Scholar 

  • Jurečková, J., Koenker, R., andWelsch, A. H. (1994). Adaptive choice of trimming proportions.Annals of the Institute of Statistical Mathematics, 46:737–755.

    Article  MathSciNet  MATH  Google Scholar 

  • Marcus, M. B. andPisier, G. (1981).Random Fourier Series with Applications to Harmonic Analysis, vol. 101 ofAnnals of Mathematical Studies. Princeton University Press, Princeton, New Jersey.

    Google Scholar 

  • Maronna, R. A. andYohai, V. J. (1981). Asymptotic behavior of generalM-estimates for regression and scale with random carriers.Zeitschrift für Wahrscheinlichkeitstheorie und Verwandte Gebiete, 58:7–20.

    Article  MATH  MathSciNet  Google Scholar 

  • Rousseeuw, P. andYohai, V. J. (1984). Robust regression by means of S-estimators. In H. W. Franke. J. and R. D. Martin, eds.Robust and Nonlinear Time Series Analysis, vol. 26 ofLecture Notes in Statistics, pp. 256–272. Springer-Verlag, New York.

    Google Scholar 

  • Sposito, V. A. (1989). Some properties ofLp-estimates. In K. D. Lawrence and J. L. Arthur, eds.,Robust Regression, Analysis and Applications, pp. 23–58. Marcel Dekker, New York.

    Google Scholar 

  • Stone, C. J. (1975). Adaptive maximum likelihood estimators of a location parameter.Annals of Statistics, 3:267–284.

    MATH  MathSciNet  Google Scholar 

  • Talagrand, M. (1996). New concentration inequalities in product spaces.Inventiones Mathematicae, 126:505–563.

    Article  MATH  MathSciNet  Google Scholar 

  • Yohai, V. J. (1974). Robust estimation in the linear model.Annals of Statistics, 2:562–567.

    MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Miguel A. Arcones.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Arcones, M.A. Convergence of the optimal M-estimator over a parametric family of M-estimators. Test 14, 281–315 (2005). https://doi.org/10.1007/BF02595407

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02595407

Key Words

AMS subject classification

Navigation