Abstract
In 1969, J. Massey published a now-famous paper showing, among other things, that an iterative algorithm introduced by Berlekamp for decoding BCH codes also solved the problem of finding a shortest-length feedback shift register circuit for generating a given finite sequence of digits. This nice physical interpretation opened the door to connections with many other problems, including the minimal partial realization problems of linear system theory, Padé approximations and continued fractions, the fast algorithms of Levinson and Schur for Toeplitz matrices, inverse scattering, VLSI implementations, etc. This paper is an informal account of some of the different contexts in which the Berlekamp-Massey algorithm have been encountered in the work of the author and his students.
Article Footnote
*This work was supported in part by the Army Research Office under Grant DAAH04-93-G-0029.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Berlekamp, E.R. Algebraic Coding Theory McGraw-Hill, New York, 1968.
Blahut, R.E., “Algebraic Fields, Signal Processing and Error Control,” Proc. IEEE vol. 73, no. 5, pp. 874–893, May 1985.
Blahut, R.E. Fast Algorithms for Digital Signal Processing Addison-Wesley, 1985.
Bruckstein, A.M., “Scattering Models in Signal Processing,” Ph.D. Dissertation Stanford University, 1984.
Bruckstein, A.M., T.K. Citron, and T. Kailath, “On Inverse Scattering and Partial Realizations,” Int’l. J. Control vol. 48, no. 4, pp. 1537–1550, Oct. 1988.
Bruckstein, A.M. and T. Kailath, “Inverse Scattering for Discrete Transmission-Line Models,” SIAM Review vol. 29, no. 3, pp. 359–389, Sept. 1987.
Bruckstein, A.M. and T. Kailath, “An Inverse Scattering Framework for Several Problems in Signal Processing,” IEEE ASSP Mag. vol. 4, no. 1, pp. 6–20, Jan. 1987.
Cheng, U., “On the Continued Fraction and Berlekamp’s Algorithm,” IEEE Trans. Info. Theory vol. IT-30, no. 3, pp. 541–544, May 1984.
Chun, J. and T. Kailath, “Divide-and-Conquer Solutions of Least-Squares Problems for Matrices with Displacement Structure,” SIAM J. Matrix Anal. Appl. vol. 12, no. 1, pp. 128–145, Jan. 1991.
Citron, T.K., “Algorithms and Architectures for Error Correcting Codes,” Ph.D. Dissertation Stanford University, 1986.
Citron, T.K. and T. Kailath, “Method and Means for Error Detection and Correction in High Speed Data Transmission Codes,” Patent, 1987.
Citron, T.K., A.M. Bruckstein, and T. Kailath, “An Inverse Scattering Approach to the Partial Realization Problem,” 19th CDC Las Vegas, Dec. 1984.
Citron, T.K. and T. Kailath, “Euclid’s Algorithm, Scattering Theory, and a VLSI Architecture for Decoding Reed-Solomon Codes,” presented at 1985 Info. Theory Syrnp.
Dewilde, P., A. Vieira, and T. Kailath, `On a Generalized Szegö-Levinson Realization Algorithm for Optimal Linear Prediction based on a Network Synthesis Approach,“ IEEE Trans. Circ. Sys ., vol. CAS-25, no. 9, pp. 663–675, Sept. 1978.
Dickinson, B., “Properties and Applications of Matrix Fraction Descriptions of Linear Systems ” Ph.D. Dissertation Stanford University, 1974.
Dickinson, B., M. Morf, and T. Kailath, “A Minimal Realization Algorithm for Matrix Sequences,” vol. AC-19, no. 1, pp. 31–38, Feb. 1974.
Gragg, B. and A. Lindquist, “On the Partial Realization Problem,” Linear Algebra Appl. vol. 50, pp. 277–319, 1985.
Ho, B.L. and R.E. Kalman, “Effective Construction of Linear State-Variable Models from Input/Output Descriptions,” Proc. Third Allerton Conf. pp. 449–459, 1965. Also in Regelungsteknik vol. 14, pp. 545–548, 1966.
Householder, A.S. The Theory of Matrices in Numerical Analysis Dover, New York, 1964.
Jagadish, H.V., S.K. Rao, and T. Kailath, “Array Architectures for Iterative Algorithms,” Proc. IEEE vol. 75, no. 9, pp. 1304–1321, Sept. 1987.
Kailath, T. Linear Systems Prentice-Hall, New Jersey, 1980.
Kalman, R.E., “On Partial Realizations, Transfer Functions and Canonical Forms,” Acta Polytech. Scand ., vol. MA-31, pp. 9–32, 1979.
Kung, S.Y., “Multivariable and Multidimensional Systems: Analysis and Design,” Ph.D. Dissertation Stanford University, 1977.
Lanczos, C., “Solution of Systems of Linear Equations by Minimized Iterations,” J. Res. Nat. Bur. Stand no. 49, pp. 35–53, 1952.
Levinson, N., “The Wiener RMS (Root-Mean-Square) Error Criterion in Filter Prediction and Design,” J. Math. Phys. vol. 25, pp. 261–278, 1947.
Magnus, A., “Certain Continued Fractions Associated with the Padé Table,” Math. Zeitschr. vol. 78, pp. 361–374, 1962.
Massey, J.L., “Shift-Register Synthesis and BCH Decoding,” IEEE Trans. Info. Theory vol. IT-15, no. 1, pp. 122–127, Jan. 1969.
Morf, M., “Fast Algorithms for Multivariable Systems,” Ph.D. Dissertation, Stanford University, 1974.
Pal, D. and T. Kailath, “Fast Triangular Factorization and Inversion of Hermitian Toeplitz and Related Matrices With Arbitrary Rank Profile,” SIAM J. Matrix Anal. Appl. vol. 14, no. 4, pp. 1016–1042, Oct. 1993.
Parlett, B.N. The Symmetric Eigenvalue Problem Prentice-Hall, New Jersey, 1980.
Parlett, B.N., “Reduction to Tridiagonal Form and Minimal Realizations,” SIAM J. Matrix Anal. Appl. vol. 13, no. 2, pp. 567–593, April 1992.
Peterson, W.W., “Encoding and Error-Correction Procedures for the Bose-Chaudhuri Codes,” IRE Trans. Info. Theory pp. 459–470, Sept. 1960.
Rao, S.K. and T. Kailath, “Regular Iterative Algorithms and Their Implementation on Processor Arrays,” Proc. IEEE vol. 76, no. 3, pp. 259–282, March 1988.
Rissanen, J., “Recursive Identification of Linear Systems,” SIAM J. Control vol. 9, no. 3, pp. 420–430, 1971.
Rissanen, J., “Solution of Linear Equations with Hankel and Toeplitz Matrices,” Numer. Math. vol. 22, pp. 361–366, 1974.
Schur, I., “über potenzreihen die im innern des Einheitskreises beschränkt sind,” Journal für die Reine Angewandte Mathematik , vol. 147, pp. 202–232, 1917. English translation in I. Schur Methods in Operator Theory and Signal Processing , Operator Theory: Advances and Applications, I. Gohberg (ed.), vol. 18, pp. 31–88, Birkhaüser Verlag, Basel, 1986.
Sugiyama, Y., M. Kasahara, S. Hirasawa, and T. Namekawa, “A Method for Solving Key Equation for Decoding Goppa Codes,” Information and Control vol. 27, pp. 8799, 1975.
Szegö, G. Orthogonal Polynomials Amer. Math. Socy., Rhode Island, 1939. (3rd ed., 1967).
Vieira, A., “Matrix Orthogonal Polynomials, with Applications to Autoregressive Modeling and Ladder Forms,” Ph.D. Dissertation Stanford University, 1977.
Welch, L.R. and R.A. Scholtz, “Continued Fractions and Berlekamp’s Algorithm,” IEEE Trans. Info. Theory vol. IT-25, no. 1, pp. 19–27, Jan. 1979.
Wolf, J.K., “Redundancy, the Discrete Fourier Transform, and Impulse Repsonse Noise Cancellation,” IEEE Trans. Comm ., vol. COM-31, no. 3, pp. 458–461, March 1983.
Xu, G. and T. Kailath, “Fast Estimation of Principal Eigenspace Using Lanczos Algorithm,” SIAM J. Matrix Anal. July 1994.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1994 Springer Science+Business Media New York
About this chapter
Cite this chapter
Kailath, T. (1994). Encounters with the Berlekamp-Massey Algorithm. In: Blahut, R.E., Costello, D.J., Maurer, U., Mittelholzer, T. (eds) Communications and Cryptography. The Springer International Series in Engineering and Computer Science, vol 276. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-2694-0_21
Download citation
DOI: https://doi.org/10.1007/978-1-4615-2694-0_21
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4613-6159-6
Online ISBN: 978-1-4615-2694-0
eBook Packages: Springer Book Archive