Skip to main content
Log in

Notes on consistency of some minimum distance estimators with simulation results

  • Published:
Metrika Aims and scope Submit manuscript

Abstract

We focus on the minimum distance density estimators \({\widehat{f}}_n\) of the true probability density \(f_0\) on the real line. The consistency of the order of \(n^{-1/2}\) in the (expected) L\(_1\)-norm of Kolmogorov estimator (MKE) is known if the degree of variations of the nonparametric family \(\mathcal {D}\) is finite. Using this result for MKE we prove that minimum Lévy and minimum discrepancy distance estimators are consistent of the order of \(n^{-1/2}\) in the (expected) L\(_1\)-norm under the same assumptions. Computer simulation for these minimum distance estimators, accompanied by Cramér estimator, is performed and the function \(s(n)=a_0+a_1\sqrt{n}\) is fitted to the L\(_1\)-errors of \({\widehat{f}}_n\) leading to the proportionality constant \(a_1\) determination. Further, (expected) L\(_1\)-consistency rate of Kolmogorov estimator under generalized assumptions based on asymptotic domination relation is studied. No usual continuity or differentiability conditions are needed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Berlinet A, Hobza T, Vajda I (2002) Generalized piecewise linear histograms. Stat Neerl 56(3):301–313

    Article  MathSciNet  MATH  Google Scholar 

  • Broniatowski M (2014) Minimum divergence estimators, maximum likelihood and exponential families. Stat Prob Lett 93:27–33

    Article  MathSciNet  MATH  Google Scholar 

  • de Bruijn NG (1958) Asymptotic methods in analysis. North-Holland Publishing co., Amsterdam

    MATH  Google Scholar 

  • Devroye L, Györfi L (1985) Nonparametric density estimation: the \(L_1\)-view. Wiley, New York

    MATH  Google Scholar 

  • Dvoretzky A, Kiefer A, Wolfowitz J (1956) Asymptotic minimax character of a sample distribution function and the clasical multinomial estimator. Ann Math Stat 33:642–669

    Article  MATH  Google Scholar 

  • Frýdlová I, Vajda I, Kůs V (2012) Modified power divergence estimators in normal model—simulation and comparative study. Kybernetika 48(4):795–808

    MathSciNet  MATH  Google Scholar 

  • Gibbs AL, Su FE (2002) On choosing and bounding probability metrics. Int Stat Rev 70:419–435

    Article  MATH  Google Scholar 

  • Györfi L, Vajda I, van der Meulen EC (1996) Minimum Kolmogorov distance estimates of parameters and parametrized distributions. Metrika 43(3):237–255

    Article  MathSciNet  MATH  Google Scholar 

  • Hrabáková J, Kůs V (2013) The consistency and robustness of modified Cramér–Von Mises and Kolmogorov–Cramér estimators. Commun Stat Theory Methods 42(20):3665–3677

    Article  MATH  Google Scholar 

  • Kozek AS (1998) On minimum distance estimation using Kolmogorov Lévy type metrics. Aust N Z J Stat 40(3):317–333

    Article  MathSciNet  MATH  Google Scholar 

  • Kůs V (2004) Nonparametric density estimates consistent of the order of \(n^{-1/2}\) in the \(L_1 \)-norm. Metrika 60:1–14

    Article  MathSciNet  Google Scholar 

  • Massart P (1990) The tight constant in the Dvoretzky-Kiefer-Wolfowitz inequality. Ann Prob 18:1269–1283

    Article  MathSciNet  MATH  Google Scholar 

  • Parr WC, Schucany WR (1980) Minimum distance and robust estimation. J Am Stat Assoc 75:616–624

    Article  MathSciNet  MATH  Google Scholar 

  • Silverman BW (1986) Density estimation for statistics and data analysis. Chapman & Hall, London

    Book  MATH  Google Scholar 

  • Taleb NN (2010) The black swan: the impact of the highly improbable. Random House, New York

    Google Scholar 

  • Wolfovitz J (1957) The minimum distance method. Ann Math Stat 28:75–88

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgments

We thank both referees for very careful readings of the manuscript and their considerable contributions concerning the overall exposition of the paper and also its practical aspects in Sect. 5.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Václav Kůs.

Additional information

This work was supported by the grants GA16-09848S (GACR), LG15047 (MYES), and SGS15/214/OHK4/3T/14 (CTU).

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hrabáková, J., Kůs, V. Notes on consistency of some minimum distance estimators with simulation results. Metrika 80, 243–257 (2017). https://doi.org/10.1007/s00184-016-0601-0

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00184-016-0601-0

Keywords

Mathematics Subject Classification

Navigation