Householder-Based RLS Algorithms

  • Athanasios A. RontogiannisEmail author
  • Sergios Theodoridis


This chapter presents recursive least-squares (RLS) algorithms, which are based on numerically robust Householder transformations. Section 7.1 introduces the conventional orthogonal Householder transform and provides its geometrical interpretation. The hyperbolic Householder and the row (orthogonal and hyperbolic) Householder transforms are also briefly described. In Section 7.2, the Householder RLS (HRLS) algorithm is presented, its relation with the other known square-root RLS algorithms is discussed, and two applications, where the HRLS algorithm has been successfully applied, are presented. By considering a block-by-block update approach to the RLS problem, the block exact Householder QRD-RLS algorithm is developed in Section 7.3, which constitutes a generalization of the conventional QRD-RLS algorithm. Section 7.4 presents an inverse QRD-RLS algorithm, which employs block updating via the application of appropriate row orthogonal Householder transformations. Finally, a sliding window block RLS algorithm, which comprises a pair of row Householder transforms, is introduced in Section 7.5.


Orthogonal Matrix Independent Component Analysis Blind Source Separation Cholesky Factor Wideband Code Division Multiple Access 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    A. O. Householder, The Theory of Matrices in Numerical Analysis. Dover Publications Inc., New York, NY, USA (1964)zbMATHGoogle Scholar
  2. 2.
    A. O. Steinhardt, Householder transforms in signal processing. IEEE Signal Processing Magazine, vol. 5, pp. 4–12 (July 1988)Google Scholar
  3. 3.
    C. M. Rader and A. O. Steinhardt, Hyperbolic Householder transformations. IEEE Transactions on Acoustics Speech and Signal Processing, vol. 34, no. 6, pp. 1859–1602 (December 1986)Google Scholar
  4. 4.
    A. W. Bojanczyk, G. G. Nagy and R. J. Plemmons, Block RLS using row Householder reflections. Linear Algebra and its Applications, vol. 188–189, pp. 31–61 (1993)CrossRefMathSciNetGoogle Scholar
  5. 5.
    S. Haykin, Adaptive Filter Theory. 4th edition, Prentice-Hall Inc., Upper Saddle River, NJ, USA (2002)Google Scholar
  6. 6.
    A. A. Rontogiannis and S. Theodoridis, On inverse factorization adaptive least squares algorithms. Signal Processing (Elsevier), vol. 52, pp. 35–47 (July 1996)Google Scholar
  7. 7.
    A. A. Rontogiannis and S. Theodoridis, An adaptive LS algorithm based on orthogonal Householder transformations. IEEE International Conference on Electronics, Circuits and Systems, ICECS’96, Rhodes, Greece, pp. 860–863 (October 1996)Google Scholar
  8. 8.
    S. C. Douglas, Numerically robust O(N2) RLS algorithms using least-squares prewhitening. IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP ’2000, Istanbul, Turkey (June 2000)Google Scholar
  9. 9.
    S. C. Douglas and R. Losada, Adaptive filters in Matlab: from novice to expert. IEEE Signal Processing Education Workshop, Pine Mountain, USA, pp. 168–173 (October 2002)Google Scholar
  10. 10.
    A. H. Sayed and T. Kailath, A state-space approach to adaptive RLS filtering. IEEE Signal Processing Magazine, vol. 11, pp. 18–60 (July 1994)Google Scholar
  11. 11.
    G. J. Bierman, Factorization Methods for Discrete Sequential Estimation. Academic Press, New York, NY, USA (1977)zbMATHGoogle Scholar
  12. 12.
    G. J. Bierman and C. L. Thronton, Numerical comparison of Kalman filter algorithms: orbit determination case study. Automatica, vol. 13, pp. 13–25 (January 1977)Google Scholar
  13. 13.
    R. Batin, Astronautical Guidance. McGraw-Hill Book Company, New York, NY, USA (1964)Google Scholar
  14. 14.
    L. A. McGee and S. F. Schmidt, Discovery of the Kalman filter as a practical tool for aerospace and industry. NASA Technical Memorandum 86847, USA (November 1985)Google Scholar
  15. 15.
    S. C. Douglas, Blind source separation and independent component analysis: a crossroads of tools and ideas. Fourth International Symposium on Independent Component Analysis and Blind Source Separation, Napa, Japan (April 2003)Google Scholar
  16. 16.
    K. Hooli, M. Latva-aho and M. Juntti, Performance evaluation of adaptive chip-level channel equalizers in WCDMA downlink. IEEE International Conference on Communications, ICC’2001, Helsinki, Finland (June 2001)Google Scholar
  17. 17.
    K. R. Liu, S.-F. Hsieh and K. Yao, Systolic block Householder transformation for RLS algorithm with two-level pipelined implementation. IEEE Transactions on Signal Processing, vol. 40, no. 4, pp. 946–958 (April 1998)Google Scholar
  18. 18.
    G.-O. Glentis, K. Berberidis and S. Theodoridis, Efficient least squares adaptive algorithms for FIR transversal filtering. IEEE Signal Processing Magazine, vol. 16, pp. 13–41 (July 1999)Google Scholar

Copyright information

© Springer-Verlag US 2009

Authors and Affiliations

  • Athanasios A. Rontogiannis
    • 1
    Email author
  • Sergios Theodoridis
    • 2
  1. 1.National Observatory of AthensAthensGreece
  2. 2.University of AthensAthensGreece

Personalised recommendations