Skip to main content
Log in

On the estimation of a monotone conditional variance in nonparametric regression

  • Published:
Annals of the Institute of Statistical Mathematics Aims and scope Submit manuscript

Abstract

A monotone estimate of the conditional variance function in a heteroscedastic, nonparametric regression model is proposed. The method is based on the application of a kernel density estimate to an unconstrained estimate of the variance function and yields an estimate of the inverse variance function. The final monotone estimate of the variance function is obtained by an inversion of this function. The method is applicable to a broad class of nonparametric estimates of the conditional variance and particularly attractive to users of conventional kernel methods, because it does not require constrained optimization techniques. The approach is also illustrated by means of a simulation study.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Akritas M., Van Keilegom I. (2001). Nonparametric estimation of the residual distribution. Scandinavian Journal of Statistics 28, 549–567

    Article  MATH  MathSciNet  Google Scholar 

  • Box G.E.P. (1988). Signal to noise ratios, performance criteria and transformation. Technometrics (with discussions) 30, 1–40

    Article  MATH  MathSciNet  Google Scholar 

  • Brunk H.D. (1955). Maximum likelihood estimates of monotone parameters. The Annals of Mathematical Statistics 26, 607–616

    Article  MATH  MathSciNet  Google Scholar 

  • Carroll R.J. (1982). Adapting for heteroscedasticity in linear models. The Annals of Statistics 10, 1224–1233

    Article  MATH  MathSciNet  Google Scholar 

  • Carroll R.J. (1987). The effect of variance function estimation on prediction-intervals. In: Berger J.O., Gupta S.S.(eds) Proceedings of the 4th purdue symposium statistical decision theory and related topics, Vol. II. Heidelberg, Springer

    Google Scholar 

  • Dette H., Munk A. (1998). Testing heteroscedasticity in nonparametric regression. Journal of the Royal Statistical Society, Series B, 60, 693–708

    Article  MATH  MathSciNet  Google Scholar 

  • Dette H., Munk A., Wagner T. (1998). Estimating the variance in nonparametric regression—what is a reasonable choice?. Journal of the Royal Statistical Society, Series B 60, 751–764

    Article  MATH  MathSciNet  Google Scholar 

  • Dette H., Neumeyer N., Pilz K.F. (2006). A simple nonparametric estimator of a monotone regression function. Bernoulli 12, 469–490

    Article  MATH  MathSciNet  Google Scholar 

  • Fan J., Gijbels I. (1995). Data driven bandwidth selection in local polynomial fitting: variable bandwidth and spatial adaption. Journal of the Royal Statistical Society, Series B 57, 371–394

    MATH  MathSciNet  Google Scholar 

  • Fan J., Gijbels I. (1996). Local polynomial modelling and its applications. London, Chapman and Hall

    MATH  Google Scholar 

  • Fan J., Yao Q. (1998). Efficient estimation of conditional variance functions in stochastic regression. Biometrika 85, 645–660

    Article  MATH  MathSciNet  Google Scholar 

  • Gasser T., Sroka L., Jennen-Steinmetz G. (1986). Residual variance and residual pattern in nonlinear regression. Biometrika 73, 626–633

    Article  MathSciNet  Google Scholar 

  • Hall P., Carroll R.J. (1989). Variance estimation in regression: the effect of estimating the mean. Journal of the Royal Statistical Society, Series B 51, 3–14

    MATH  MathSciNet  Google Scholar 

  • Hall P., Huang L.S. (2001). Nonparametric kernel regression subject to monotonicity constraints. The Annals of Statistics 29, 624–647

    Article  MATH  MathSciNet  Google Scholar 

  • Hall P., Kay J.W., Titterington D.M. (1990). Asymptotically optimal difference-based estimation of variance in nonparametric regression. Biometrika 77, 521–528

    Article  MathSciNet  Google Scholar 

  • Hall P., Marron J.S. (1990). On variance estimation in nonparametric regression. Biometrika77, 415–419

    Article  MATH  MathSciNet  Google Scholar 

  • Mack Y.P., Silverman B.W. (1982). Weak and strong uniform consistency of kernel regression estimates. Zeitschrift Wahrscheinlichkeitstheorie verwandte Gebiete 61, 405–415

    Article  MATH  MathSciNet  Google Scholar 

  • Mammen E. (1991). Estimating a smooth monotone regression function. The Annals of Statistics 19, 724–740

    Article  MATH  MathSciNet  Google Scholar 

  • Mukerjee R. (1988). Monotone nonparametric regression. The Annals of Statistics 16, 741–750

    Article  MATH  MathSciNet  Google Scholar 

  • Müller H.G., Stadtmüller U. (1987). Estimation of heteroscedasticity in regression analysis. The Annals of Statistics 15, 610–625

    Article  MATH  MathSciNet  Google Scholar 

  • Müller H.G., Stadtmüller U. (1993). On variance function estimation with quadratic forms. Journal of Statistical Planning and Inference 35, 213–231

    Article  MATH  MathSciNet  Google Scholar 

  • Nash, W. J., Sellers, T. L., Talbot, S. R., Cawthorn, A. J., Ford, W. B. (1994). The population biology of abalone (Haliotis) in Tasmania. I. Blacklip abalone (H.rubra) from the north coast and islands of Bass Strait. Sea Fisheries Division, Technical Report No. 48.

  • Orey S. (1958). A central limit theorem for m-dependent random variables. Duke Mathematical Journal 25, 543–546

    Article  MATH  MathSciNet  Google Scholar 

  • Rice J. (1984). Bandwidth choice for nonparametric regression. The Annals of Statistics 12, 1215–1230

    Article  MATH  MathSciNet  Google Scholar 

  • Ruppert D., Wand M.P., Holst U., Hössjer O. (1997). Local polynomial variance-function estimation. Technometrics 39, 262–273

    Article  MATH  MathSciNet  Google Scholar 

  • Sacks J., Ylvisaker D. (1970). Designs for regression problems for correlated errors. The Annals of Mathematical Statistics 41, 2057–2074

    Article  MATH  MathSciNet  Google Scholar 

  • Yu K., Jones M.C. (2004). Likelihood-based local linear estimation of the conditional variance function. Journal of the American Statistical Association 99, 139–155

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Holger Dette.

About this article

Cite this article

Dette, H., Pilz, K. On the estimation of a monotone conditional variance in nonparametric regression. Ann Inst Stat Math 61, 111–141 (2009). https://doi.org/10.1007/s10463-007-0126-4

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10463-007-0126-4

Keywords

Navigation