Abstract
We focus on the minimum distance density estimators \({\widehat{f}}_n\) of the true probability density \(f_0\) on the real line. The consistency of the order of \(n^{-1/2}\) in the (expected) L\(_1\)-norm of Kolmogorov estimator (MKE) is known if the degree of variations of the nonparametric family \(\mathcal {D}\) is finite. Using this result for MKE we prove that minimum Lévy and minimum discrepancy distance estimators are consistent of the order of \(n^{-1/2}\) in the (expected) L\(_1\)-norm under the same assumptions. Computer simulation for these minimum distance estimators, accompanied by Cramér estimator, is performed and the function \(s(n)=a_0+a_1\sqrt{n}\) is fitted to the L\(_1\)-errors of \({\widehat{f}}_n\) leading to the proportionality constant \(a_1\) determination. Further, (expected) L\(_1\)-consistency rate of Kolmogorov estimator under generalized assumptions based on asymptotic domination relation is studied. No usual continuity or differentiability conditions are needed.
Similar content being viewed by others
References
Berlinet A, Hobza T, Vajda I (2002) Generalized piecewise linear histograms. Stat Neerl 56(3):301–313
Broniatowski M (2014) Minimum divergence estimators, maximum likelihood and exponential families. Stat Prob Lett 93:27–33
de Bruijn NG (1958) Asymptotic methods in analysis. North-Holland Publishing co., Amsterdam
Devroye L, Györfi L (1985) Nonparametric density estimation: the \(L_1\)-view. Wiley, New York
Dvoretzky A, Kiefer A, Wolfowitz J (1956) Asymptotic minimax character of a sample distribution function and the clasical multinomial estimator. Ann Math Stat 33:642–669
Frýdlová I, Vajda I, Kůs V (2012) Modified power divergence estimators in normal model—simulation and comparative study. Kybernetika 48(4):795–808
Gibbs AL, Su FE (2002) On choosing and bounding probability metrics. Int Stat Rev 70:419–435
Györfi L, Vajda I, van der Meulen EC (1996) Minimum Kolmogorov distance estimates of parameters and parametrized distributions. Metrika 43(3):237–255
Hrabáková J, Kůs V (2013) The consistency and robustness of modified Cramér–Von Mises and Kolmogorov–Cramér estimators. Commun Stat Theory Methods 42(20):3665–3677
Kozek AS (1998) On minimum distance estimation using Kolmogorov Lévy type metrics. Aust N Z J Stat 40(3):317–333
Kůs V (2004) Nonparametric density estimates consistent of the order of \(n^{-1/2}\) in the \(L_1 \)-norm. Metrika 60:1–14
Massart P (1990) The tight constant in the Dvoretzky-Kiefer-Wolfowitz inequality. Ann Prob 18:1269–1283
Parr WC, Schucany WR (1980) Minimum distance and robust estimation. J Am Stat Assoc 75:616–624
Silverman BW (1986) Density estimation for statistics and data analysis. Chapman & Hall, London
Taleb NN (2010) The black swan: the impact of the highly improbable. Random House, New York
Wolfovitz J (1957) The minimum distance method. Ann Math Stat 28:75–88
Acknowledgments
We thank both referees for very careful readings of the manuscript and their considerable contributions concerning the overall exposition of the paper and also its practical aspects in Sect. 5.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by the grants GA16-09848S (GACR), LG15047 (MYES), and SGS15/214/OHK4/3T/14 (CTU).
Rights and permissions
About this article
Cite this article
Hrabáková, J., Kůs, V. Notes on consistency of some minimum distance estimators with simulation results. Metrika 80, 243–257 (2017). https://doi.org/10.1007/s00184-016-0601-0
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00184-016-0601-0