Skip to main content
SpringerLink
Log in

Nonparametric Estimation of Multivariate Density and its Derivative by Dependent Data Using Gamma Kernels

  • Published:
Journal of Mathematical Sciences Aims and scope Submit manuscript

Abstract

We consider the nonparametric estimation of the multivariate probability density function and its partial derivative with a support on nonnegative axis by dependent data. We use the class of kernel estimators with asymmetric gamma kernel functions. The gamma kernels are nonnegative; they may change their shape depending on the position on the semi-axis and possess good boundary properties for a wide class of densities. Asymptotic estimates of the multivariate density and of its partial derivatives such as biases, variances, and covariances are derived. The optimal bandwidth of both estimates is obtained as a minimum of the mean integrated squared error (MISE) by dependent data with a strong mixing. Optimal convergence rates of the MISE both for the density and its derivative are found.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. H. Aksoy, “Use of gamma distribution in hydrological analysis,” Turk. J. Eng. Environ. Sci., 24, 419–428 (2000).

    Google Scholar 

  2. D. W. K. Andrews, First Order Autoregressive Processes and Strong Mixing, Yale University, Cowles Foundation Discussion Paper 66 (1983).

  3. P. K. Bhattacharya, “Estimation of a probability density function and its derivatives,” Indian J. Stat., A29, 373–382 (1967).

    MathSciNet  MATH  Google Scholar 

  4. S. Bosq, Nonparametric Statistics for Stochastic Processes. Estimation and Prediction, Springer, New York (1996).

    Book  Google Scholar 

  5. T. Bouezmarni and J. V. K. Rombouts, “Nonparametric density estimation for multivariate bounded data,” J. Stat. Planning Infer., 140, No. 1, 139–152 (2007).

    Article  MathSciNet  Google Scholar 

  6. T. Bouezmarni and J. V. K. Rombouts, “Nonparametric density estimation for positive times series,” Comput. Stat. Data Anal., 54, No. 2, 245–261 (2010).

    Article  MathSciNet  Google Scholar 

  7. T. Bouezmarni and O. Scaillet, “Consistency of asymmetric kernel density estimators and smoothed histograms with application to income data,” Econometric Theory, 21, No. 2, 390–412 (2005).

    Article  MathSciNet  Google Scholar 

  8. K. de Brabanter, J. de Brabanter, and B. de Moor, “Nonparametric derivative estimation,” in: Proc. of the 23rd Benelux Conf. on Artificial Intelligence (BNAIC), Gent, Belgium (2011), pp. 75–81.

  9. B. M. Brown and S. X. Chen, “Beta-Bernstein smoothing for regression curves with compact support,” Scand. J. Stat., 26, No. 1, 47–59 (1999)

    Article  MathSciNet  Google Scholar 

  10. S. X. Chen, “Probability density function estimation using gamma kernels,” Ann. Inst. Stat. Math., 54, 471–480 (2000).

    Article  MathSciNet  Google Scholar 

  11. A. V. Dobrovidov and G. M. Koshkin, “Data-based nonparametric signal filtration,” Aust. J. Stat., 40, No. 1, 15–24 (2011).

    Google Scholar 

  12. A. V. Dobrovidov and G. M. Koshkin, “Regularized data-based nonparametric filtration of stochastic signals,” in: Proc. of the World Congress on Engineering 2011, Vol. 1 (2011), pp. 333–337.

  13. A. V. Dobrovidov, G. M. Koshkin, and V. A. Vasiliev, Non-Parametric State Space Models, Kendrick Press (2012).

  14. A. V. Dobrovidov and L. A. Markovich, “Data-driven bandwidth choice for gamma kernel estimates of density derivatives on the positive semi-axis,” IFAC Proc. Volumes, 46, No. 11, 500–505 (2013).

    Article  Google Scholar 

  15. A. V. Dobrovidov and L. A. Markovich, “Nonparametric gamma kernel estimators of density derivatives on positive semi-axis,” IFAC Proc. Volumes, 46, No. 9, 910–915 (2013).

    Article  Google Scholar 

  16. G. Igarashi and Y. Kakizawa, “Bias corrections for some asymmetric kernel estimators,” J. Stat. Planning Infer., 159, 37–63 (2015).

    Article  MathSciNet  Google Scholar 

  17. B. Funke and R. Kawka, “Nonparametric density estimation for multivariate bounded data using two non-negative multiplicative bias correction methods,” Comput. Stat. Data Anal., 92, 148–162 (2015).

    Article  MathSciNet  Google Scholar 

  18. E. Furman, “On a multivariate gamma distribution,” Stat. Probab. Lett., 78, 2353–2360 (2008).

    Article  MathSciNet  Google Scholar 

  19. P. Hall and T. E. Wehrly, “A geometrical method for removing edge effects from kernel-type nonparametric regression estimators,” J. Am. Stat. Assoc., 86, 665–672 (1991).

    Article  MathSciNet  Google Scholar 

  20. W. Hürlimann, “Analytical evaluation of economic risk capital for portfolios of gamma risks,” Turkish J. Eng. Environ. Sci., 31, 107–122 (2001).

    MathSciNet  MATH  Google Scholar 

  21. M. C. Jones, “Simple boundary correction for density estimation kernel,” Stat. Comput., 3, 135–146 (1993).

    Article  Google Scholar 

  22. A. F. Kushnir, “Asymptotically optimal tests for a regression problem of testing hypotheses,” Theory Probab. Its Appl., 13, No. 4, 647–666 (1967).

    Article  Google Scholar 

  23. M. Lejeune and P. Sarda, “Smooth estimators of distribution and density functions,” Comput. Stat. Data Anal., 14, 457–471 (1992).

    Article  MathSciNet  Google Scholar 

  24. L. A. Markovich, “Inferences from optimal filtering equation,” Lithuan. Math. J., 55, No. 3, 413–432 (2015).

    Article  MathSciNet  Google Scholar 

  25. L. A. Markovich, “Gamma kernel estimation of the density derivative on the positive semi-axis by dependent data,” REVSTAT-Stat. J. Stat. Portugal, 14, No. 3, 327–348 (2016).

    MathSciNet  MATH  Google Scholar 

  26. A. M. Mathal and P. G. Moschopoulos, “A form of multivariate gamma distribution,” Ann. Inst. Stat. Math., 44, 97–106 (1992).

    Article  MathSciNet  Google Scholar 

  27. H. G. Müller, “Smooth optimum kernel estimators near endpoints,” Biometrika, 78, No. 3, 521–530 (1991).

    Article  MathSciNet  Google Scholar 

  28. S. Nadarajah, “Reliability for some bivariate gamma distributions,” Math. Probl. Eng., 2, 151–163 (2005).

    Article  MathSciNet  Google Scholar 

  29. S. Nadarajah and A. K. Gupta, “Some bivariate gamma distributions,” Appl. Math. Lett., 19, 767–774 (2006).

    Article  MathSciNet  Google Scholar 

  30. É. A. Nadaraya, “On Non-parametric estimates of density functions and regression curves,” Theory Probab. Its Appl., 10, No. 1, 186–190 (1964).

    Article  Google Scholar 

  31. E. Parzen, “On estimation of a probability density function and mode,” Ann. Math. Stat., 33, No. 3, 1065–1076 (1962).

    Article  MathSciNet  Google Scholar 

  32. M. Rosenblatt, “Remarks on some nonparametric estimates of a density function,” Ann. Math. Stat., 27, No. 3, 832–837 (1956).

    Article  MathSciNet  Google Scholar 

  33. H. Sasaki, A. Hyvärinen, and M. Sugiyama, “Clustering via mode seeking by direct estimation of the gradient of a log-density,” in: Calders T., Esposito F., Hüllermeier E., and Meo R., eds., Machine Learning and Knowledge Discovery in Databases. ECML PKDD 2014, Lect. Notes Comput. Sci., Vol. 8726, Springer, Berlin (2014).

  34. O. Scaillet, “Density estimation using inverse and reciprocal inverse Gaussian kernels,” J. Nonparam. Stat., 16, 217–226 (2004).

    Article  MathSciNet  Google Scholar 

  35. E. F. Schuster, “Incorporating support constraints into nonparametric estimators of densities,” Commun. Stat. Theory Methods, 14, 1123–1136 (1985).

    Article  MathSciNet  Google Scholar 

  36. E. F. Schuster, “Estimation of a probability function and its derivatives,” Ann. Math. Stat., 40, 1187–1195 (1969).

    Article  MathSciNet  Google Scholar 

  37. B. W. Silverman, Density Estimation for Statistics and Data Analysis, Chapman and Hall, London (1986).

    Book  Google Scholar 

  38. Ya. Z. Tsypkin, “Optimality in adaptive control systems,” in: J. Ackermann, ed., Uncertainty and Control, Lect. Notes Control Information Sci., Vol. 70, Springer, Berlin (1985), pp. 153–214.

  39. B. A. Turlach, Bandwidth Selection in Kernel Density Estimation: A Review, CORE and Institut de Statistique (1993).

  40. M. P. Wand and M. C. Jones, Kernel Smoothing, Chapman and Hall, London (1995).

    Book  Google Scholar 

  41. S. Zhang, “A note on the performance of the gamma kernel estimators at the boundary,” Stat. Probab. Lett., 80, 548–557 (2010).

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Control Sciences, RAS, Moscow, Russia

    L. A. Markovich

  2. Institute for Information Transmission Problems, RAS, Moscow, Russia

    L. A. Markovich

Authors
  1. L. A. Markovich
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to L. A. Markovich.

Additional information

Translated from Fundamentalnaya i Prikladnaya Matematika, Vol. 22, No. 3, pp. 145–177, 2018.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Markovich, L.A. Nonparametric Estimation of Multivariate Density and its Derivative by Dependent Data Using Gamma Kernels. J Math Sci 254, 550–573 (2021). https://doi.org/10.1007/s10958-021-05325-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10958-021-05325-2

Search

Navigation