Computational Statistics

, Volume 29, Issue 5, pp 931–943 | Cite as

Second-order least-squares estimation for regression models with autocorrelated errors

  • Dedi RosadiEmail author
  • Shelton Peiris
Original Paper


In their recent paper, Wang and Leblanc (Ann Inst Stat Math 60:883–900, 2008) have shown that the second-order least squares estimator (SLSE) is more efficient than the ordinary least squares estimator (OLSE) when the errors are independent and identically distributed with non zero third moments. In this paper, we generalize the theory of SLSE to regression models with autocorrelated errors. Under certain regularity conditions, we establish the consistency and asymptotic normality of the proposed estimator and provide a simulation study to compare its performance with the corresponding OLSE and generalized least square estimator (GLSE). It is shown that the SLSE performs well giving relatively small standard error and bias (or the mean square error) in estimating parameters of such regression models with autocorrelated errors. Based on our study, we conjecture that for less correlated data, the standard errors of SLSE lie between those of the OLSE and GLSE which can be interpreted as adding the second moment information can improve the performance of an estimator.


Second-order least square Asymptotic normality Regression model Autocorrelated errors Ordinary least square Generalized least square Consistency 



The financial support from DIKTI Indonesia via Program Academic Recharging (PAR) had greatly helped D. Rosadi to initiate this project in 2011. The financial support from Hibah Kompetensi in 2012 and 2013 is also gratefully acknowledged. This work has been completed while D. Rosadi was visiting the School of Mathematics and Statistics, The University of Sydney in 2011 and 2012. The authors would like to thank the anonymous referee and the editor of this journal for their constructive comments and useful suggestions to improve the quality and readability of this manuscript.


  1. Abarin T (2008) Second-order least squares estimation in regression models with application to measurement error problems. Dissertation, Department of Statistics University of Manitoba, WinnipegGoogle Scholar
  2. Abarin T, Wang L (2006) Comparison of GMM with second-order least squares estimator in nonlinear models. Far East J Theor Stat 20:179–196MathSciNetzbMATHGoogle Scholar
  3. Abarin T, Wang L (2009) Second-order least squares estimation of censored regression models. J Stat Plan Inference 139:125–135MathSciNetCrossRefzbMATHGoogle Scholar
  4. Amemiya T (1973) Regression analysis when the dependent variable is truncated normal. Econometrica 41:997–1016MathSciNetCrossRefzbMATHGoogle Scholar
  5. Chen X, Tsao M, Zhou J (2011) Robust second-order least-squares estimator for regression models. Stat Pap. doi: 10.1007/s00362-010-0343-4
  6. Chipman J (1979) Efficiency of least squares estimation of linear trend when residuals are autocorrelated. Econometrica 47:115–128MathSciNetCrossRefzbMATHGoogle Scholar
  7. Gallant AR, Goebel JJ (1976) Nonlinear regression with autocorrelated errors. J Am Stat Assoc 71(356):961–967CrossRefzbMATHGoogle Scholar
  8. Kim M, Ma Y (2011) The efficiency of the second-order nonlinear least squares estimator and its extension. Ann Inst Stat Math. doi: 10.1007/s10463-011-0332-y Google Scholar
  9. Krämer W (1980) Finite sample efficiency of ordinary least squares in the linear regression model with autocorrelated errors. J Am Stat Assoc 75:1005–1009zbMATHGoogle Scholar
  10. Krämer W, Marmol F (2002) OLS-based asymptotic inference in linear regression models with trending regressors and AR(p)-disturbances. Commun Stat Theory Methods 31:261–270CrossRefzbMATHGoogle Scholar
  11. Li H (2011) Second-order least squares estimation in generalized linear mixed models. Dissertation, Department of Statistics, University of Manitoba, WinnipegGoogle Scholar
  12. Li H, Wang L (2011) A consistent simulation-based estimator in generalized linear mixed models. J Stat Comput Simul. doi: 10.1080/00949655.2011.569721
  13. Prais SJ, Winsten CB (1954) Trend estimators and serial correlation. Cowless Commission discussion paper, Statistics no 383Google Scholar
  14. Ullah A, Srivastava VK, Magee L, Srivastava A (1983) Estimation of linear regression model with autocorrelated disturbances. J Time Ser Anal 4(2):127–135MathSciNetCrossRefzbMATHGoogle Scholar
  15. Wang L (2003) Estimation of nonlinear Berkson-type measurement error models. Stat Sin 13:1201–1210zbMATHGoogle Scholar
  16. Wang L (2004) Estimation of nonlinear models with Berkson measurement errors. Ann Stat 32:2559–2579CrossRefzbMATHGoogle Scholar
  17. Wang L, Leblanc A (2008) Second-order nonlinear least squares estimation. Ann Inst Stat Math 60:883–900MathSciNetCrossRefzbMATHGoogle Scholar
  18. White H (1980) Nonlinear regression on cross-section data. Econometrica 48:721–746MathSciNetCrossRefzbMATHGoogle Scholar
  19. White H, Domowitz I (1984) Nonlinear regression with dependent observations. Econometrica 52:143–161MathSciNetCrossRefzbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  1. 1.Department of MathematicsGadjah Mada UniversityYogyakartaIndonesia
  2. 2.School of Mathematics and StatisticsThe University of SydneySydneyAustralia

Personalised recommendations