Abstract
The least mean square (LMS) algorithm is investigated for stability when implemented with two's complement quantization. The study is restricted to algorithms with periodically varying inputs. Such inputs are common in a variety of applications, and for system identification, they can always be generated as shown with an example. It is shown that the quantized LMS algorithm is just a special case of a quantized periodically shift-varying (PSV) filter. Two different sufficient conditions are obtained for the bounded input bounded output (BIBO) stability of the PSV filter. When the filter is BIBO stable, two different bounds on the filter output are also derived. These conditions and bounds are then applied to the quantized LMS algorithm. The results are illustrated with examples.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
T. Bose,Quantization noise in linear shift variant digital filters, Ph.D dissertation, Southern Illinois University, Carbondale, 1988.
C. Caraiscos and B. Liu, A roundoff error analysis of the LMS adaptive algorithm,IEEE Trans. Acous., Speech, Signal Processing, vol. ASSP-32, pp. 34–41, Feb. 1984.
Y.H Chang, C.K. Tzou, and N.J. Bershad, Postsmoothing for the LMS algorithm and a fixed point roundoff error analysis,IEEE Trans. Signal Processing, vol. 39, pp. 959–962, Apr. 1991.
J.M. Cioffi, Limited-precision effects in adaptive filtering,IEEE Trans. Circuits Syst., vol. CAS-34, pp. 821–833, July 1987.
J.M. Cioffi and T. Kailath, Fast, RLS, transversal filters for adaptive filtering,IEEE Trans. Acous., Speech, Signal Processing, vol. ASSP-32, pp. 304–337, Apr. 1984.
E.R. Ferrara, Jr., Frequency-domain implementations of periodically time-varying filters,IEEE Trans. Acous., Speech, Signal Processing, vol. ASSP-33, pp. 883–892, Aug. 1985.
E.R. Ferrara, Jr. and B. Widrow, The time-sequenced adaptive filter,IEEE Trans. Circuits Syst., vol. CAS-28, pp. 519–523, June 1981.
G.F. Franklin, J.D. Powell, and M.L. Workman,Digital Control of Dynamic Systems, Reading, MA: Addison-Wesley, 1990.
W.A. Gardner and L.E. Franks, Characterization of cyclostationary random signal processes,IEEE Trans. Inform. Theory, vol. IT-21, pp. 4–14, Jan. 1975.
R.A. Horn and C.R. Johnson,Matrix Analysis, Cambridge University Press, London and New York, 1985.
D.T.L. Lee et al., Recursive least squares ladder estimation algorithms,IEEE Trans. Acous., Speech, Signal Processing, vol. ASSP-29, pp. 627–641, June 1981.
H. Leung and S. Haykin, Error bound method and its application to the LMS algorithm,IEEE Trans. Signal Processing, vol. 39, pp. 354–358, Feb. 1991.
J.D. Markel and A.H. Gray, Jr.,Linear Prediction of Speech, New York: Springer-Verlag, 1976.
R.A. Meyer and C.S. Burrus, A unified analysis of multirate and periodically time-varying digital filters,IEEE Trans. Circuits Syst., vol. CAS-22, pp. 162–168, Mar. 1975.
S. Qureshi, Adaptive equalization,Proc. IEEE, vol. 73, pp. 1349–1387, Sept. 1985.
M.M. Sondhi and D.A. Berkley, Silencing echoes on the telephone network,Proc. IEEE, vol. 68, pp. 948–963, Aug. 1980.
J. Treichler, The spectral line enhancer, Ph.D. dissertation, Stanford University, May 1977.
B. Widrow and S.D. Stearns,Adaptive Signal Processing, Prentice-Hall, Englewood Cliffs, NJ., 1985.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Bose, T., Trautman, D.A. Stability of the quantized LMS algorithm. Circuits Systems and Signal Process 14, 587–602 (1995). https://doi.org/10.1007/BF01213956
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF01213956