Abstract
We study minimum Hellinger distance estimation (MHDE) based on kernel density estimators for bivariate time series, such that various commonly used regression models and parametric time series such as nonlinear regressions with conditionally heteroscedastic errors and copula-based Markov processes, where copula densities are used to model the conditional densities, can be treated. It is shown that consistency and asymptotic normality of the MHDE basically follow from the uniform consistency of the density estimate and the validity of the central limit theorem for its integrated version. We also provide explicit sufficient conditions both for the i.i.d. case and the case of strong mixing series. In addition, for the case of i.i.d. data, we briefly discuss the asymptotics under local alternatives and relate the results to maximum likelihood estimation.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Beran R (1977) Minimum Hellinger distance estimates for parametric models. Ann Stat 5(3):445–463
Bosq D (1998) Nonparametric statistics for stochastic processes: estimation and prediction. Lecture notes in statistics, 2nd edn. Springer, New York
Chen X, Fan Y (2006) Estimation of copula-based semiparametric time series models. J Econ 130(2):307–335
Cheng A, Vidyashankar AN (2006) Minimum Hellinger distance estimation for randomized play the winner design. J Stat Plan Inference 136(6):1875–1910
Devroye LP, Wagner TJ (1980) The strong uniform consistency of kernel density estimates. In: Multivariate analysis V. North-Holland, Amsterdam, pp. 59–77
Devroye LP, Györfi L (1985) Nonparametric density estimation: the \(L{_{1}}\) view. Wiley, New York
Diaconis P, Freedman D (1999) Iterated random functions. SIAM Rev 41(1):45–76
Donoho DL, Liu RC (1988) The “automatic” robustness of minimum distance functionals. Ann Stat 16(2):552–586
Doukhan P (1994) Mixing: properties and examples. Lecture notes in statistics vol 85. Springer, New York
Francq C, Zakoïan J (2010) GARCH models: structure, statistical inference and financial applications. Wiley, Chichester
Hall P (1984) Central limit theorem for integrated square error of multivariate nonparametric density estimators. J Multivar Anal 14(1):1–16
Hall P, Heyde CC (1980) Martingale limit theory and its application. Academic Press, New York-London
Hansen B (2008) Uniform convergence rates for kernel estimation with dependent data. Econ Theory 24(3):726–748
Kim B, Lee S (2013) Robust estimation for copula parameter in SCOMDY models. J Time Ser Anal 34(3):302–314
Liebscher E (1996) Central limit theorems for sums of \(\alpha \)-mixing random variables. Stochastics 59(3–4):241–258
Lu Z, Hui YV, Lee AH (2003) Minimum Hellinger distance estimation for finite mixtures of Poisson regression models and its applications. Biometrics 59(4):1016–1026
Parzen E (1962) On estimation of a probability density function and mode. Ann Math Stat 33:1065–1076
Patton AJ (2012) A review of copula models for economic time series. J Multivar Anal 110:4–18
Rémillard B, Papageorgiou N, Soustra F (2012) Copula-based semiparametric models for multivariate time series. J Multivar Anal 110:30–42
Rieder H (1994) Robust asymptotic statistics. Springer, New York
Rosenblatt M (1956) Remarks on some nonparametric estimates of a density function. Ann Math Stat 27:832–837
Silverman BW (1986) Density estimation for statistics and data analysis. Monographs on statistics and applied probability. Chapman & Hall, London
Simpson DG (1987) Minimum Hellinger distance estimation for the analysis of count data. J Am Stat Assoc 82(399):802–807
Sriram TN, Vidyashankar AN (2000) Minimum Hellinger distance estimation for supercritical Galton–Watson processes. Stat Probab Lett 50(4):331–342
Steland A (2012) Financial statistics and mathematical finance. Wiley, Chichester
Takada T (2009) Simulated minimum Hellinger distance estimation of stochastic volatility models. Comput Stat Data Anal 53(6):2390–2403
Tamura RN, Boos DD (1986) Minimum Hellinger distance estimation for multivariate location and covariance. J Am Stat Assoc 81(393):223–229
Toma A (2008) Minimum Hellinger distance estimators for multivariate distributions from the Johnson system. J Stat Plan Inference 138(3):803–816
Van der Vaart AW (1998) Asymptotic statistics.Cambridge series in statistical and probabilistic mathematics. Cambridge University Press, Cambridge
Wu J, Karunamuni RJ (2012) Efficient Hellinger distance estimates for semiparametric models. J Multivar Anal 107:1–23
Wu WB (2007) \(M\)-estimation of linear models with dependent errors. Ann Stat 35(2):495–521
Acknowledgments
The authors would like to thank the anonymous reviewers for their constructive comments and especially Prof. Dr. Norbert Henze for carefully proof-reading the final manuscript.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Prause, A., Steland, A. & Abujarad, M. Minimum Hellinger distance estimation for bivariate samples and time series with applications to nonlinear regression and copula-based models. Metrika 79, 425–455 (2016). https://doi.org/10.1007/s00184-015-0561-9
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00184-015-0561-9