Probability Theory and Related Fields

, Volume 155, Issue 1–2, pp 201–229 | Cite as

Asymptotic equivalence for nonparametric regression with non-regular errors

  • Alexander MeisterEmail author
  • Markus Reiß


Asymptotic equivalence in Le Cam’s sense for nonparametric regression experiments is extended to the case of non-regular error densities, which have jump discontinuities at their endpoints. We prove asymptotic equivalence of such regression models and the observation of two independent Poisson point processes which contain the target curve as the support boundary of its intensity function. The intensity of the point processes is of order of the sample size n and involves the jump sizes as well as the design density. The statistical model significantly differs from regression problems with Gaussian or regular errors, which are known to be asymptotically equivalent to Gaussian white noise models.


Extreme value statistics Frontier estimation Le Cam distance Le Cam equivalence Poisson point processes 

Mathematics Subject Classification (2010)

62B15 62G08 62M30 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Brown L.D., Low M.: Asymptotic equivalence of nonparametric regression and white noise. Ann. Stat. 24, 2384–2398 (1996)MathSciNetzbMATHCrossRefGoogle Scholar
  2. 2.
    Brown L., Cai T., Low M., Zhang C.-H.: Asymptotic equivalence theory for nonparametric regression with random design. Ann. Stat. 30, 688–707 (2002)MathSciNetzbMATHCrossRefGoogle Scholar
  3. 3.
    Brown L., Cai T., Zhou H.H.: Nonparametric regression in exponential families. Ann. Stat. 38, 2005–2046 (2010)MathSciNetzbMATHCrossRefGoogle Scholar
  4. 4.
    Brown M.: Discrimination of Poisson processes. Ann. Math. Stat. 42, 773–776 (1971)zbMATHCrossRefGoogle Scholar
  5. 5.
    Carter A.: A continuous Gaussian approximation to a nonparametric regression in two dimensions. Bernoulli 12, 143–156 (2006)MathSciNetzbMATHGoogle Scholar
  6. 6.
    Carter A.: Asymptotic approximation of nonparametric regression experiments with unknown variances. Ann. Stat. 35, 1644–1673 (2007)zbMATHCrossRefGoogle Scholar
  7. 7.
    Carter, A.: Asymptotically sufficient statistics in nonparametric regression experiments with correlated noise. J. Prob. Stat. 2009, 19 (2009) (ID 275308)Google Scholar
  8. 8.
    Chernozhukov V., Hong H.: Likelihood estimation and inference in a class of nonregular econometric models. Econometrica 72, 1445–1480 (2004)MathSciNetzbMATHCrossRefGoogle Scholar
  9. 9.
    DeVore R.A., Lorentz G.G.: Constructive Approximation, Grundlehren Series vol. 303. Springer, Berlin (1993)Google Scholar
  10. 10.
    Gijbels I., Mammen E., Park B., Simar L.: On estimation of monotone and concave frontier functions. J. Am. Stat. Assoc. 94, 220–228 (1999)MathSciNetzbMATHCrossRefGoogle Scholar
  11. 11.
    Grama I., Nussbaum M.: Asymptotic equivalence for nonparametric generalized linear models. Prob. Theor. Rel. Fields 111, 167–214 (1998)MathSciNetzbMATHCrossRefGoogle Scholar
  12. 12.
    Grama I., Nussbaum M.: Asymptotic equivalence for nonparametric regression. Math. Methods Stat. 11(1), 1–36 (2002)MathSciNetzbMATHGoogle Scholar
  13. 13.
    Hall P., van Keilegom I.: Nonparametric “regression” when errors are positioned at end-points. Bernoulli 15, 614–633 (2009)MathSciNetzbMATHCrossRefGoogle Scholar
  14. 14.
    Ibragimov, I.A., Hasminskii, R.Z.: Statistical Estimation. Asymptotic Theory. Springer, New York (1981) (translated from the Russian by S. Kotz)Google Scholar
  15. 15.
    Janssen A., Marohn D.M.: On statistical information of extreme order statistics, local extreme value alternatives and Poisson point processes. J. Multivar. Anal. 48, 1–30 (1994)MathSciNetzbMATHCrossRefGoogle Scholar
  16. 16.
    Karr A.F.: Point Processes and Their Statistical Inference. 2nd edn. Marcel Dekker, New York (1991)zbMATHGoogle Scholar
  17. 17.
    Knight K.: Limiting distributions of linear programming estimators. Extremes 4, 87–103 (2001)MathSciNetzbMATHCrossRefGoogle Scholar
  18. 18.
    Korostelev A.P., Tsybakov A.B.: Minimax Theory of Image Reconstruction. In: Lecture Notes in Statistics, vol. 82. Springer, New York (1993)CrossRefGoogle Scholar
  19. 19.
    Kutoyants Y.A.: Statistical Inference for Spatial Poisson Processes. In: Lecture Notes in Statistics, vol. 134. Springer, New York (1998)CrossRefGoogle Scholar
  20. 20.
    Le Cam L.M.: Sufficiency and approximate sufficiency. Ann. Math. Stat. 35, 1419–1455 (1964)MathSciNetzbMATHCrossRefGoogle Scholar
  21. 21.
    Le Cam L.M., Yang G.L.: Asymptotics in Statistics, Some Basic Concepts. 2nd edn. Springer, New York (2000)zbMATHGoogle Scholar
  22. 22.
    Liese F.: Eine informationstheoretische Bedingung für die Äquivalenz unbegrenzt teilbarer Punktprozesse. Math. Nachr. 70, 183–196 (1975)MathSciNetzbMATHCrossRefGoogle Scholar
  23. 23.
    Liese F., Vajda I.: Convex Statistical Distances. Teubner, Leipzig (1987)zbMATHGoogle Scholar
  24. 24.
    Müller U.U., Wefelmeyer W.: Estimation in nonparametric regression with nonregular errors. Comm. Stat. Theor. Methods 39, 1619–1629 (2010)zbMATHCrossRefGoogle Scholar
  25. 25.
    Nussbaum M.: Asymptotic equivalence of density estimation and Gaussian white noise. Ann. Stat. 24, 2399–2430 (1996)MathSciNetzbMATHCrossRefGoogle Scholar
  26. 26.
    Reiß M.: Asymptotic equivalence for nonparametric regression with multivariate and random design. Ann. Stat. 36, 1957–1982 (2008)zbMATHCrossRefGoogle Scholar
  27. 27.
    Reiß R.-D.: A Course on Point Processes. Springer, New York (1993)zbMATHCrossRefGoogle Scholar
  28. 28.
    Tsybakov A.B.: Introduction to Nonparametric Estimation. Springer Series in Statistics, Berlin (2009)zbMATHCrossRefGoogle Scholar
  29. 29.
    van de Geer S.A.: Empirical Processes in M-Estimation. Reprint, Cambridge University Press, New York (2006)Google Scholar

Copyright information

© Springer-Verlag 2011

Authors and Affiliations

  1. 1.Institut für MathematikUniversität RostockRostockGermany
  2. 2.Institut für MathematikHumboldt-Universität zu BerlinBerlinGermany

Personalised recommendations