Abstract
A complete solution is given to the problem of determining when a certain iteration will converge to the minimum of an important type of quadratic functional. It is shown that convergence occurs whenever the minimum exists, and that the iterates produced by the iteration will be unbounded for every starting point if the minimum does not exist. Applications are given concerning an adaptive filtering algorithm and nonharmonic series expansions.
Similar content being viewed by others
References
H. Bialy, Iterative Behandlung Linearer Funktionalgleichungen,Arch. Rational Mech. Anal., vol. 4, pp. 166–176, 1959.
F. E. Browder, On the iteration of transformations in noncompact minimal dynamical systems,Proceedings of the American Mathematical Society, vol. 9, pp. 773–780, 1958.
F. E. Browder and W. V. Petryshyn, The solution by iteration of linear functional equations in Banach spaces,Bulletin of the American Mathematical Society, vol. 72, no. 3, pp. 566–570, May 1966.
R. J. Duffin and A. C. Schaeffer, A class of nonharmonic series,Transactions of the American Mathematical Society, vol. 72, pp. 341–366, March 1952.
D. Gale,The Theory of Linear Economic Models, New York: McGraw-Hill Book Co., 1960.
S. Haykin,Adaptive Filter Theory, Englewood Cliffs, NJ: Prentice-Hall, 1991.
L. A. Liusternik and V. J. Sobolev,Elements of Functional Analysis, New York: Frederick Ungar Publishing Co., 1961.
D. G. Luenberger,Optimization by Vector Space Methods, New York: John Wiley and Sons, Inc., 1969.
A. Mukherjea and K. Pothoven,Real and Functional Analysis, New York: Plenum Press, 1978.
F. Riesz and B. Sz-Nagy,Functional Analysis, New York: Frederick Ungar Publishing Co., 1955.
I. W. Sandberg, On the properties of systems that distort signals I,Bell System Technical Journal, vol. 42, pp. 2033–2047, September 1963.
B. Widrow and S. D. Sterns,Adaptive Signal Processing, Englewood Cliffs, NJ: Prentice-Hall, 1985.
A. C. Zaanen,Linear Analysis, New York: Interscience Publishers, 1953.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Sandberg, I.W. Iterative minimization of quadratic functional. Circuits Systems and Signal Process 14, 415–425 (1995). https://doi.org/10.1007/BF01189019
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF01189019