Skip to main content
SpringerLink
Log in

Large deviations for M-estimators

  • Published:
Annals of the Institute of Statistical Mathematics Aims and scope Submit manuscript

Abstract

We study the large deviation principle for M-estimators (and maximum likelihood estimators in particular). We obtain the rate function of the large deviation principle for M-estimators. For exponential families, this rate function agrees with the Kullback–Leibler information number. However, for location or scale families this rate function is smaller than the Kullback–Leibler information number. We apply our results to obtain confidence regions of minimum size whose coverage probability converges to one exponentially. In the case of full exponential families, the constructed confidence regions agree with the ones obtained by inverting the likelihood ratio test with a simple null hypothesis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Arcones M.A. (2003a). The large deviation principle for empirical processes. In: Hoffmann-Jorgensen J., Marcus M.B., Wellner J.A. (eds) In High Dimensional Probability III. Birkhäuser, Boston, pp. 205–223

    Google Scholar 

  • Arcones M.A. (2003b). The large deviation principle for stochastic processes I. Theory of Probability & Its Applications 47:567–583

    Article  MATH  MathSciNet  Google Scholar 

  • Aczél J., Dhombres J. (1989). Functional Equations in Several Variables. Cambridge University Press, Cambridge, UK

    MATH  Google Scholar 

  • Bahadur R.R. (1967). Rates of convergence of estimates and test statistics. Annals of Mathematical Statistics 38:303–324

    MathSciNet  Google Scholar 

  • Bahadur R.R. (1971). Some Limit Theorems in Statistics. SIAM, Philadelphia, PA

    MATH  Google Scholar 

  • Bahadur R.R., Zabell S.L., Gupta J.C. (1979). Large deviations, tests, and estimates. Asymptotic Theory of Statistical Tests and Estimation, (pp. 33–64). New York: Academic Press.

  • Borovkov A.A., Mogulskii A.A. (1992). Large deviations and testing statistical hypotheses II: Large deviations of maximum points of random fields. Siberian Advances in Mathematics 2(4):43–72

    MathSciNet  Google Scholar 

  • Brown, L.D. (1986). Fundamentals of Statistical Exponential Families with Applications in Statistical Decision Theory. Institute of Mathematical Statistics Lecture Notes—Monograph Series, 9, Hayward, CA.

  • Brown L.D., Cai T.T., DasGupta A. (2003). Interval estimation in exponential families. Statistica Sinica 13:19–49

    MATH  MathSciNet  Google Scholar 

  • Casella G., Berger R.L. (2002). Statistical Inference. Duxbury, Pacific Grove, CA

    Google Scholar 

  • Chernoff H. (1952). A measure of asymptotic efficiency for tests of hypothesis based on the sum of observations. Annals of Mathematical Statistics 23:493–507

    MathSciNet  Google Scholar 

  • Dembo A., Zeitouni O. (1998). Large Deviations Techniques and Applications (2nd ed). Springer, New York

    MATH  Google Scholar 

  • Deuschel J.D., Stroock D.W. (1989). Large Deviations. Academic Press, Boston, MA

    MATH  Google Scholar 

  • Dudley R.M. (1999). Uniform Central Limit Theorems. Cambridge University Press, Cambridge

    MATH  Google Scholar 

  • Ferguson T.S. (1962). Location and scale parameters in exponential families of distributions. Annals of Mathematical Statistics 33:986–1001

    MathSciNet  Google Scholar 

  • Fu J.C. (1975). The rate of convergence of consistent point estimators. Annals of Statistics 3:234–240

    MATH  MathSciNet  Google Scholar 

  • Fu J.C., Li G., Zhao L.C. (1993). On large deviation expansion of distribution of maximum likelihood estimator and its application in large sample estimation. Annals of the Institute of Statistical Mathematics 45:477–498

    Article  MATH  MathSciNet  Google Scholar 

  • Jensen J.L., Wood A.T.A. (1998). Large deviation and other results for minimum contrast estimators. Annals of the Institute of Statistical Mathematics 50:673–695

    Article  MATH  MathSciNet  Google Scholar 

  • Joutard C. (2004). Large deviations for M-estimators. Mathematical Methods of Statistics 13:179–200

    MATH  MathSciNet  Google Scholar 

  • Kester A.D.M. Kallenberg W.C.M. (1986). Large deviations of estimators. Annals of Statistics 14:648–664

    MathSciNet  Google Scholar 

  • Kester A.D.M. (1985). Some Large Deviation Results in Statistics. Centre for Mathematics and Computer Science, Amsterdam, The Netherlands

    MATH  Google Scholar 

  • Léonard C., Najim J. (2002). An extension of Sanov’s theorem. Application to the Gibbs conditioning principle. Bernoulli 18:721–743

    Google Scholar 

  • Nikitin Y. (1995). Asymptotic Efficiency of Nonparametric Tests. Cambridge University Press, Cambridge, UK

    MATH  Google Scholar 

  • Rao M.M., Ren Z.D. (1991). Theory of Orlicz Spaces. Marcel Dekker, New York

    MATH  Google Scholar 

  • Rubin H., Rukhin A.L. (1983). Convergence rates of large deviations probabilities for point estimators. Statistics and Probability Letters 1:197–202

    Article  MATH  MathSciNet  Google Scholar 

  • Serfling R.J. (1980). Approximation Theorems of Mathematical Statistics. Wiley, New York

    MATH  Google Scholar 

  • Sievers G.L. (1978). Estimates of location: A large deviation comparison. Annals of Statistics 6:610–618

    MATH  MathSciNet  Google Scholar 

  • Skovgaard I.M. (1990). On the density of minimum contrast estimators. Annals of Statistics 18:779–789

    MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mathematical Sciences, Binghamton University, Binghamton, NY, 13902, USA

    Miguel A. Arcones

Authors
  1. Miguel A. Arcones
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Miguel A. Arcones.

About this article

Cite this article

Arcones, M.A. Large deviations for M-estimators. Ann Inst Stat Math 58, 21–52 (2006). https://doi.org/10.1007/s10463-005-0017-5

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10463-005-0017-5

Keywords

Search

Navigation