Numerical Algorithms

, Volume 71, Issue 1, pp 59–75 | Cite as

An efficient generalized least squares algorithm for periodic trended regression with autoregressive errors

Original Paper


Time series data with periodic trends like daily temperatures or sales of seasonal products can be seen in periods fluctuating between highs and lows throughout the year. Generalized least squares estimators are often computed for such time series data as these estimators have minimum variance among all linear unbiased estimators. However, the generalized least squares solution can require extremely demanding computation when the data is large. This paper studies an efficient algorithm for generalized least squares estimation in periodic trended regression with autoregressive errors. We develop an algorithm that can substantially simplify generalized least squares computation by manipulating large sets of data into smaller sets. This is accomplished by coining a structured matrix for dimension reduction. Simulations show that the new computation methods using our algorithm can drastically reduce computing time. Our algorithm can be easily adapted to big data that show periodic trends often pertinent to economics, environmental studies, and engineering practices.


Big data Dimension reduction GLS estimation Model with autocorrelated errors Periodic trended time series regression 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bergland, G.D.: A fast Fourier transform algorithm for real-valued series. Commun. ACM 11, 703–710 (1968)CrossRefMATHGoogle Scholar
  2. 2.
    Brockwell, P.J., Davis, R.A.: Time Series: Theory and Methods, 2nd edn. Springer, New York (1991)CrossRefGoogle Scholar
  3. 3.
    Ghysels, E., Osborn, D.: The Econometric Analysis of Seasonal Time Series. Cambridge University Press, Cambridge (2001)CrossRefMATHGoogle Scholar
  4. 4.
    Grenander, U., Rosenblatt, M.: Statistical Analysis of Stationary Time Series. Wiley, New York (1957)MATHGoogle Scholar
  5. 5.
    Judge, G.G., Hill, R.C., Griffiths, W.E., Lütkepohl, H., Lee, T.C.: Introduction to the Theory and Practice of Econometrics, 2nd edn. Wiley, New York (1988)MATHGoogle Scholar
  6. 6.
    Kay, S.M.: Maximum likelihood estimation of signals in autoregressive noise. Amer. Statist. 42, 88–101 (1994)CrossRefGoogle Scholar
  7. 7.
    Lee, J.: A reformulation of weighted least squares estimators. Amer. Statist. 63, 49–55 (2009)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Li, S., Lund, R.: Multiple change point detection via Genetic Algorithms. J. Climate 25, 674–686 (2012)CrossRefGoogle Scholar
  9. 9.
    Malik, W.Q., Schummers, J., Sur, M., Brown, E.N.: Denoising two-photon calcium imaging data. PLoS ONE 6, e20490 (2011). doi:10.1371/journal.pone.0020490 CrossRefGoogle Scholar
  10. 10.
    Mann, M.E., Lees, J.M.: Robust estimation of background noise and signal detection in climate time series. Clim. Chang. 33, 409–445 (1996)CrossRefGoogle Scholar
  11. 11.
    Piegorsch, W.W., Bailer, A.J.: Analyzing Environmental Data. Wiley, Chichester (2005)CrossRefGoogle Scholar
  12. 12.
    Purdon, P.L., Solo, V., Weisskoff, R.M., Brown, E.N.: Locally regularized spatiotemporal modeling and model comparison for functional MRI. NeuroImage 14, 912–923 (2001)CrossRefGoogle Scholar
  13. 13.
    Shumway, R.H., Stoffer, D.S.: Time Series Analysis and its Applications with R Examples, 3rd edn. Springer, New York (2011)CrossRefMATHGoogle Scholar
  14. 14.
    Sorensen, H.V., Jones, D.L., Heideman, M.T., Burrus, C.S.: Real-valued fast Fourier transform algorithms. IEEE Trans. Acoust. Speech Signal Processing 35, 849–863 (1987)CrossRefGoogle Scholar
  15. 15.
    Yang, R., Su, Z.: Analyzing circadian expression data by harmonic regression based on autoregressive spectral estimation. Bioinformatics 26, i168–i174 (2010). doi:10.1093/bioinformatics/btq189 MathSciNetCrossRefGoogle Scholar
  16. 16.
    Zinde-Walsh, V., Galbraith, J.W.: Estimation of a linear regression model with stationary ARMA(p,q) errors. J. Economet. 47, 333–357 (1991)MathSciNetCrossRefMATHGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  1. 1.Department of MathematicsBoise State UniversityBoiseUSA
  2. 2.Department of Civil EngineeringBoise State UniversityBoiseUSA

Personalised recommendations