Skip to main content

Advertisement

SpringerLink
Log in
Menu
Find a journal Publish with us
Search
Cart
  1. Home
  2. Probability Theory and Related Fields
  3. Article
Optimal rates of convergence for estimating Toeplitz covariance matrices
Download PDF
Download PDF
  • Published: 14 March 2012

Optimal rates of convergence for estimating Toeplitz covariance matrices

  • T. Tony Cai1,
  • Zhao Ren2 &
  • Harrison H. Zhou2 

Probability Theory and Related Fields volume 156, pages 101–143 (2013)Cite this article

  • 780 Accesses

  • 55 Citations

  • Metrics details

Abstract

Toeplitz covariance matrices are used in the analysis of stationary stochastic processes and a wide range of applications including radar imaging, target detection, speech recognition, and communications systems. In this paper, we consider optimal estimation of large Toeplitz covariance matrices and establish the minimax rate of convergence for two commonly used parameter spaces under the spectral norm. The properties of the tapering and banding estimators are studied in detail and are used to obtain the minimax upper bound. The results also reveal a fundamental difference between the tapering and banding estimators over certain parameter spaces. The minimax lower bound is derived through a novel construction of a more informative experiment for which the minimax lower bound is obtained through an equivalent Gaussian scale model and through a careful selection of a finite collection of least favorable parameters. In addition, optimal rate of convergence for estimating the inverse of a Toeplitz covariance matrix is also established.

Download to read the full article text

Working on a manuscript?

Avoid the common mistakes

References

  1. Bentkus R.Yu., Rudzkis R.A.: On the distributions of some statistical estimates of spectral density. Theory Probab. Appl. 27, 795–814 (1982)

    Article  MathSciNet  MATH  Google Scholar 

  2. Bickel P.J., Levina E.: Regularized estimation of large covariance matrices. Ann. Stat. 36, 199–227 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  3. Bickel P.J., Levina E.: Covariance regularization by thresholding. Ann. Stat. 36, 2577–2604 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  4. Böttcher A., Silbermann B.: Introduction to Large Truncated Toeplitz Matrices. Springer, New York (1999)

    Book  MATH  Google Scholar 

  5. Brockwell P.J., Davis R.A.: Time Series: Theory and Methods, 2nd edn. Springer, New York (1991)

    Book  Google Scholar 

  6. Cai, T.T., Liu, W.: Adaptive thresholding for sparse covariance matrix estimation. J. Am. Stat. Assoc. (2011, to appear)

  7. Cai, T.T., Liu, W., Luo, X.: A constrained â„“ 1 minimization approach to sparse precision matrix estimation. J. Am. Stat. Assoc. (2010, to appear)

  8. Cai, T.T., Liu, W., Zhou, H.H.: Optimal estimation of large sparse precision matrices (2010, manuscript)

  9. Cai T.T., Zhang C.-H., Zhou H.H.: Optimal rates of convergence for covariance matrix estimation. Ann. Stat. 38, 2118–2144 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  10. Cai, T.T., Zhou, H.H.: Optimal rates of convergence for sparse covariance matrix estimation. Technical report (2010)

  11. Cai, T.T., Zhou, H.H.: Minimax estimation of large covariance matrices under â„“ 1 norm. Statistica Sinica (2011, to appear)

  12. Christensen, L.P.B.: An EM-algorithm for band-toeplitz covariance matrix estimation. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Honolulu (2007)

  13. El Karoui N.: Operator norm consistent estimation of large dimensional sparse covariance matrices. Ann. Stat. 36, 2717–2756 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  14. Fuhrmann D.R.: Application of Toeplitz covariance estimation to adaptive beamforming and detection. IEEE Trans. Signal Process. 39, 2194–2198 (1991)

    Article  Google Scholar 

  15. Golubev G.K., Nussbaum M., Zhou H.H.: Asymptotic equivalence of spectral density estimation and Gaussian white noise. Ann. Stat. 38, 181–214 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  16. Lam C., Fan J.: Sparsistency and rates of convergence in large covariance matrices estimation. Ann. Stat. 37, 4254–4278 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  17. Parzen E.: On consistent estimates of the spectrum of a stationary time series. Ann. Math. Stat. 28, 329–348 (1957)

    Article  MathSciNet  MATH  Google Scholar 

  18. Petrov V.V.: Sums of Independent Random Variables. Springer, New York (1975)

    Book  Google Scholar 

  19. Politis D.N., Romano J.P.: Bias-corrected nonparametric spectral estimation. J. Time Ser. Anal. 16, 67–103 (1995)

    Article  MathSciNet  MATH  Google Scholar 

  20. Priestley M.B.: Basic considerations in the estimation of spectra. Technometrics 4, 551–564 (1962)

    Article  MathSciNet  MATH  Google Scholar 

  21. Ravikumar, P., Wainwright, M.J., Raskutti, G., Yu, B.: High-dimensional covariance estimation by minimizing l 1 -penalized log-determinant divergence. Technical Report, UC Berkeley (2008)

  22. Roberts W.J., Ephraim Y.: Hidden Markov modeling of speech using Toeplitz covariance matrices. Speech Commun. 31, 1–14 (2000)

    Article  Google Scholar 

  23. Samarov A.: Lower bound for the risk of spectral density estimates. Probl. Inform. Transm. 13, 67–72 (1977)

    MathSciNet  MATH  Google Scholar 

  24. Snyder D.L, O’Sullivan J.A., Miller M.I.: The use of maximum-likelihood estimation for forming images of diffuse radar-targets from delay-Doppler data. IEEE Trans. Inform. Theory 35, 536–548 (1989)

    Article  MathSciNet  Google Scholar 

  25. Tsybakov A.B.: Introduction to Nonparametric Estimation. Springer, New York (2009)

    Book  MATH  Google Scholar 

  26. Woodroofe M.B., Van Ness J.W.: The maximum deviation of sample spectral densities. Ann. Math. Stat. 38, 1558–1569 (1967)

    Article  MathSciNet  MATH  Google Scholar 

  27. Yuan M.: Sparse inverse covariance matrix estimation via linear programming. J. Mach. Learn. Res. 11, 2261–2286 (2010)

    MathSciNet  MATH  Google Scholar 

  28. Zygmund A.: Trigonometric series. vols. I, II. Cambridge Mathematical Library, 3rd edn., Cambridge University Press, Cambridge (2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Statistics Department, The Wharton School, University of Pennsylvania, Philadelphia, PA, 19104, USA

    T. Tony Cai

  2. Department of Statistics, Yale University, New Haven, CT, 06511, USA

    Zhao Ren & Harrison H. Zhou

Authors
  1. T. Tony Cai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhao Ren
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Harrison H. Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to T. Tony Cai.

Additional information

The research of T. Cai was supported in part by NSF FRG Grant DMS-0854973 and the research of Z. Ren and H. Zhou was supported in part by NSF Career Award DMS-0645676 and NSF FRG Grant DMS-0854975.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Cai, T.T., Ren, Z. & Zhou, H.H. Optimal rates of convergence for estimating Toeplitz covariance matrices. Probab. Theory Relat. Fields 156, 101–143 (2013). https://doi.org/10.1007/s00440-012-0422-7

Download citation

  • Received: 17 June 2011

  • Revised: 23 December 2011

  • Accepted: 01 March 2012

  • Published: 14 March 2012

  • Issue Date: June 2013

  • DOI: https://doi.org/10.1007/s00440-012-0422-7

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Keywords

  • Banding
  • Covariance matrix
  • Minimax lower bound
  • Optimal rate of convergence
  • Spectral norm
  • Tapering
  • Toeplitz covariance matrix

Mathematics Subject Classification

  • Primary 62H12
  • Secondary 62F12
  • 62G09
Download PDF

Working on a manuscript?

Avoid the common mistakes

Advertisement

Search

Navigation

  • Find a journal
  • Publish with us

Discover content

  • Journals A-Z
  • Books A-Z

Publish with us

  • Publish your research
  • Open access publishing

Products and services

  • Our products
  • Librarians
  • Societies
  • Partners and advertisers

Our imprints

  • Springer
  • Nature Portfolio
  • BMC
  • Palgrave Macmillan
  • Apress
  • Your US state privacy rights
  • Accessibility statement
  • Terms and conditions
  • Privacy policy
  • Help and support

167.114.118.210

Not affiliated

Springer Nature

© 2023 Springer Nature