Abstract
This paper establishes the large-sample accuracy properties of two nonlinear least-squares estimators (NLSE) of sine-wave parameters: the basic NLSE, which ignores the possible correlation of the noise, and the optimal NLSE, which, besides the sine-wave parameters, also estimates the noise correlation (appropriately parametrized). It is shown that these two NLS estimators have thesame accuracy in large samples. This result provides complete justification for preferring the computationally less expensive basic NLSE over the “optimal” NLSE. Both estimators are shown to achieve the Cramér-Rao Bound (CRB) as the sample size increases. A simple explicit expression for the CRB matrix is provided, which should be useful in studying the performance of sine-wave parameter estimators designed to work in the colored-noise case.
Similar content being viewed by others
References
U. Grenander and M. Rosenblatt,Statistical Analysis of Stationary Time Series, Stockholm: Almquist och Wiskel, 1956.
P. V. Kabaila, On Output-Error Methods for System Identification,IEEE Trans. Automat. Control, Vol. 28, pp. 12–23, 1983.
T. Söderström and P. Stoica,System Identification, London: Prentice-Hall, 1988.
P. Stoica, R. Moses, B. Friedlander, and T. Söderström, Maximum Likelihood Estimation of the Parameters of Multiple Sinusoids from Noisy Measurements,Proc. Third ASSP Workshop on Spectrum Estimation and Modeling, Boston, MA, pp. 157–160, November 1986.
Y. Bresler and A. Macovski, Exact Maximum Likelihood Parameter Estimation of Superimposed Exponential Signals in Noise,IEEE Trans. Acoust. Speech Signal Process. Vol. 34, pp. 1081–1089, October 1986.
R. Kumaresan, L. L. Scharf, and A. K. Shaw, An Algorithm for Pole-Zero Modeling and Spectral Analysis,IEEE Trans. Acoust. Speech Signal Process., Vol. 34, pp. 637–640, June 1986.
D. W. Tufts and R. Kumaresan, Estimation of Frequencies of Multiple Sinusoids: Making Linear Prediction Perform Like Maximum Likelihood,Proc. IEEE, Vol. 70, pp. 975–989, September 1982.
L. Ljung and P. E. Caines, Asymptotic Normality of Prediction Error Estimation for Approximate System Models,Stochastics, Vol. 3, pp. 29–46, 1979.
D. C. Rife and R. R. Boorstyn, Multiple Tone Parameter Estimation from Discrete-Time Observations,Bell Syst. Tech. J., Vol. 55, pp. 1389–1410, November 1976.
H. Sakai, Estimation of Frequencies of Sinusoids in Colored Noise,Proc. International Conference on Acoustics, Speech, and Signal Processing, Tokyo, pp. 177–180, April 1986.
D. W. U. Ebong, Some Properties of the Least Squares Estimator of the Parameters of the Hidden Periodicity Model,J. Japan Statist. Soc., Vol. 16, pp. 145–152, 1986.
E. J. Hannan, Non-linear Time Series Regression,J. Appl. Probab., Vol. 8, pp. 767–780, 1971.
D. Starer and A. Nehorai, Maximum Likelihood Estimation of Exponential Signals in Noise Using a Newton Algorithm,Proc. Fourth ASSP Workshop on Spectrum Estimation and Modeling, Minneapolis, MN, pp. 240–245, August 1988.
A. Nehorai and P. Stoica, Adaptive Notch Filtering in the Presence of Colored Noise,Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing, New York, NY, pp. 1604–1607, April 1988.
Author information
Authors and Affiliations
Additional information
The work of A. Nehorai was supported by the Air Force Office of Scientific Research, under Grant No. AFOSR-88-0080.
Rights and permissions
About this article
Cite this article
Stoica, P., Nehorai, A. Statistical analysis of two nonlinear least-squares estimators of sine-wave parameters in the colored-noise case. Circuits Systems and Signal Process 8, 3–15 (1989). https://doi.org/10.1007/BF01598742
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF01598742