Skip to main content
SpringerLink
Log in

Some Topics in Linear Estimation

  • Conference paper
Stochastic Systems: The Mathematics of Filtering and Identification and Applications

Part of the book series: NATO Advanced Study Institutes Series ((ASIC,volume 78))

Abstract

It must be with some trepidation that one ventures to speak about the problems of linear estimation to an audience already well familiar with the overwhelmingly more difficult nonlinear filtering problem. However, perhaps to compensate for this spectacle, the organizers have given me the opportunity to speak first, with considerable latitude in the choice of my topics.

This work was supported in part by the Air Force Office of Scientific Research, Air Force Systems Command, under Contract AF49-620-79-C-0058; by the U.S. Army Command Office under Contract DAAG29-79-C-0215; and by the National Science Foundation, under Grant ENG78-10003.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • V. A. Ambartsumian, “Diffuse Reflection of Light by a Foggy Medium”, Dokl. Acad. Set, SSSR, vol. 38, pp. 229 - 322, 1943.

    Google Scholar 

  • R. Bellman and G. Wing, An Introduction to Invariant Imbedding, J. Wiley, N.Y., 1975.

    MATH  Google Scholar 

  • A. Bryson and M. Frazier, “Smoothing for Linear and Nonlinear Dynamic Systems”, Aeronaut. Syst. Div., Wright-Patterson AFB, Ohio, Tech. Rept. ASD- TDR-63-119, Feb. 1963.

    Google Scholar 

  • J. L. Casti, R. E. Kalman and V. K. Murthy, “A New Initial-Value Method for On-Line Filtering and Estimation”, IEEE Trans, on Inform. Thy., vol. IT-18, pp. 515 - 518, July 1972.

    Google Scholar 

  • S. Chandrasekhar, “On the Radiative Equilibrium of Stellar Atmosphere, Pt. XXI”, Astrophys. J., vol. 106, pp. 152-216, 1947; Pt. XXII, ibid, vol. 107, pp. 48 - 72, 1948.

    Article  MathSciNet  Google Scholar 

  • S. Chandrasekhar, Radiative Transfer, Dover Publications, N.Y., 1960.

    Google Scholar 

  • R. Courant and D. Hilbert, Methods of Mathematical Physics, Vol. I, Interscience, 1953.

    Google Scholar 

  • M. Devinatz and M. Shinbrot, “General Wiener-Hopf Operators”, Trans. Amer. Math. Soc., vol. 145, pp. 47 - 494, Nov. 1967.

    MathSciNet  Google Scholar 

  • C. L. Dolph and H. A. Woodbury, “On the Relation Between Green’s Functions and Covariances of Certain Stochastic Processes and is Applications to Unbiased Linear Prediction”, Trans. Amer. Math. Soc., vol. 72, pp. 519 - 550, 1952.

    MathSciNet  MATH  Google Scholar 

  • J. L. Doob, “The Elementary Gaussian Processes”, Ann. Math. Statit., vol. 15, pp. 229 - 282, 1944.

    Article  MathSciNet  MATH  Google Scholar 

  • J. L. Doob, “Time Series and Harmonic Analysis”, in Proc. Berkeley Symp. Math., Stat., and Probability, pp. 303 - 343, Berkeley, CA, Univ. California Press, 1949.

    Google Scholar 

  • J. L. Doob, Stochastic Processes, J. Wiley, N.Y., 1953.

    MATH  Google Scholar 

  • J. Durbin, “The Fitting of Time-Series Models”, Rev. Inst. Int. Statit., vol. 28, pp. 233 - 243, 1960.

    Article  MATH  Google Scholar 

  • P. Faurre, “Identification par minimisation d’une representation Markovienne de processus aleatoire”, Lecture Notes in Mathematics, vol. 132, pp, 85-106, Springer-Verlag, N.Y., 1970.

    Google Scholar 

  • P. Faurre, M. Clerget and F, Germain Operateurs Rationnels Positifs, Dunod, 1979.

    Google Scholar 

  • B. Friedlander, T. Kailath and L. Ljung, “Scattering Theory and Linear Least Squares-Estimation, Pt. II: Discrete-Time Problems”, J. Franklin Inst., vol. 301, nos. 12, pp. 71–82, Jan. 1976.

    Article  MathSciNet  MATH  Google Scholar 

  • B. Friedlander, T. Kailath and G. Yerghese, Scattering Theory and Linear Least-Squares Estimation, Pt. Ill: The Estimates, Proc. 1977 IEEE Conf. on Decision and Contr., pp. 591-597, New Orleans. LA, Dec. 1977. Also, IEEE Trans. Autom. Contr., vol. AC-25, no. 4, pp. 794 - 802, August 1980.

    Google Scholar 

  • I. C. Gohberg and L. A. Fel’dman, “Convolution Equations and Projections Methods for their Solutions”, Trans, of Math. Monographs, vol. 41, Amer. Math. Soc., 1974.

    Google Scholar 

  • T. Kailath, “An Innovations Approach to Least-Squares Estimation, Pt, I: Linear Filtering in Additive White Noise”, IEEE Trans, on Autom. Contr., vol. AC-13, pp. 646 - 655, Dec. 1968.

    Google Scholar 

  • T. Kailath, “Some Extensions of the Innovations Theorem”, Bell Syst, Tech. J., vol. 50, pp. 1487 - 1494, April 1971.

    MATH  Google Scholar 

  • T. Kailath, “Some New Algorithms for Recursive Estimation in Constant Linear Systems”, IEEE Trans, on Inform. Thy., vol. IT-19, pp. 750 - 760, Nov. 1973.

    Google Scholar 

  • T. Kailath, “A View of Three Decades of Linear Filtering Theory”, IEEE Trans. on Information Theory, vol. IT-20, no. 2, pp. 145 - 181, March 1974.

    Google Scholar 

  • T. Kailath, ed., Benchmark Papers in Linear Least-Squares Estimation, Academic Press, N.Y., 1977.

    Google Scholar 

  • T. Kailath, “Some Alternatives in Recursive Estimation”, Int’l, J. of Control, vol. 32, no. 2, pp. 311 - 328, August 1980.

    Article  MathSciNet  MATH  Google Scholar 

  • T. Kailath, B. Levy, L. Ljung and M. Morf, “Fast Time-Invariant Implementations of Gaussian Signal Detectors”, IEEE Trans. Inform. Thy., vol. IT-24, no. 4, pp. 469 - 477, July 1978.

    Article  MathSciNet  Google Scholar 

  • T. Kailath and R. Geesey, “An Innovations Approach to Least-Squares Estma- tion, Pt. IV: Recursive Estimation Given Lumped Covariance Functions”, IEEE Trans, on Autom. Contr., vol. AC-16, pp. 720 - 72, Dec. 1971.

    Google Scholar 

  • T. Kailath and L. Ljung, “A Scattering Theory Framework for Fast Least- Squares Algorithms”, Proc. Fourth Int’l. Multivariate Analysis Symposium, Dayton, OH, June 1975; North Holland, Amsterdam, 1977.

    Google Scholar 

  • T. Kailath and L. Ljung, “On the Stochastic Realization Problem”, Inform. Systems Lab. Tech. Rept., Stanford Univ., 1981.

    Google Scholar 

  • T. Kailath, L. Ljung and M. Morf, “A New Approach to the Determination of Fredholm Resolvents of Nondisplacement Kernels”, in Topics in Functional Analysis, ed. by I. Gohberg and M. Kac, Academic Press, 1978.

    Google Scholar 

  • T. Kailath, A. Yieira and M. Morf, “Inverses of Toepiitz Operators, Innovations, and Orthogonal Polynomials”, SIAM Review, vol. 20, no. 1, pp. 106 - 119, Jan. 1978.

    Article  MathSciNet  MATH  Google Scholar 

  • R. E. Kalman, “A New Approach to Linear Filtering and Prediction Problems”, J. Basic Engg., vol. 82, pp. 34 - 45, March 1960.

    Google Scholar 

  • R. E. Kalman and R. S. Bucy, “New Results in Linear Filtering and Prediction Theory”, Trans. ASME, Ser. D., J. Basic Engg., vol. 83, pp. 95 - 107, Dec. 1961.

    MathSciNet  Google Scholar 

  • M. G. Krein, “On a New Method of Solving Linear Integral Equations of the First and Second Kinds”, Dokl. Akad. Nauk SSSR, vol. 100, pp. 413 - 416, 1955.

    MathSciNet  Google Scholar 

  • M. G. Krein, “Integral Equations on a Half-Axis with Kernel Depending on the Difference of the Arguments”, Usp. Math. Nauk., vol. 1 & 2, pp. 3 - 120, 1958.

    Google Scholar 

  • H. Laning and R. Battin Random, Processes in Automatic Control, McGraw- Hill Book Co., N.Y., 1958.

    Google Scholar 

  • D. T. L. Lee, Ph.D Dissertation, Dept. of Elec. Engg., Stanford Univ., 1980.

    Google Scholar 

  • H. Lev-Ari, Ph.D. Dissertation, Dept. of Elec. Engg., Stanford, Univ., 1981.

    Google Scholar 

  • N. Levinson, “The Wiener rms (Root-Mean-Square Error in Criterion in Filter Design and Prediction”, J. Math. Phys., vol. 25, pp. 261 - 278, Jan. 1947.

    MathSciNet  Google Scholar 

  • B. Levy, “Scattering Theory and Some Problems of Decentralized Estimation”, MIT Lab. for Inform. & Decision Sciences Tech. Rept., 1981.

    Google Scholar 

  • B. Levy, T. Kailath, L. Ljung and M. Morf, “Fast Time-Invariant Implementations for Linear Least-Squares Smoothing Filters”, IEEE Trans. Autom. Contr., vol. 24, no. 5, pp. 770 - 774, Oct. 1979.

    Article  MathSciNet  MATH  Google Scholar 

  • A. Lindquist and G. Picci, “State Space Models for Gaussian Stochastic Processes”, in Stochastic Systems: The Mathematics of Filtering and Identification Applications, eds. M. Hazewinkel and J. C. Willems, Reidel Publ. Co., 1981.

    Google Scholar 

  • L. Ljung, T. Kailath and B. Friedlander, “Scattering Theory and Linear Least Squares Estimation, Pt. I: Continuous-Time Problems”, Proc. IEEE, vol. 64, no. 1, pp. 131 - 138, Jan. 1976.

    Article  MathSciNet  Google Scholar 

  • J. Meditch, Stochastic Optimal Linear Estimation and Control, McGraw-Hill, N.Y., 1969.

    MATH  Google Scholar 

  • P. A. Meyer, “Sur un problème de filtration”, Seminaire de probabilites, Pt. VII, Lecture Notes in Math, vol. 321, pp. 223-247, Sprnger-Verlag, N.Y., 1973.

    Google Scholar 

  • B. Sz. Nagy and C. Foias, Harmonic Analysis of Operators on Hilbert Space, Academic Press, N.Y., 1970.

    Google Scholar 

  • F. Riesz and B. Sz. Nagy, Functional Analysis, F. Ungar, 1955.

    Google Scholar 

  • G. Ruckebusch, “Theorie geometrique de la representation markovienne”, These de doctorat d’etat, Univ. Paris VI, 1980.

    Google Scholar 

  • M. Shinbrot, “A Generalization of a Method for the Solution of the Integral Equation Arising in Optmization of Time-Varying Linear Systems with Nonstationary Inputs”, IRE Trans. Inform. Thy., vol. IT-3, pp. 220–225, Dec. 1957.

    Google Scholar 

  • V. V. Sobolev, A Treatise on Radiative Transfer, D. Van Nostrand, Princeton, N.J., 1963, (Russian edition 1956 ).

    Google Scholar 

  • V. V. Sobolev, A Treatise on Radiative Transfer, Appendices, D. Van Nostrand Co., Princeton, N.J., 1963.

    Google Scholar 

  • V. V. Solodovnikov, An Introduction to the Statistical Dynamics of Automatic Control Systems, Dover Publications, 1962.

    Google Scholar 

  • R. L. Stratonovich, “On the Theory of Optimal Nonlinear Filtration of Random Functions”, Thy. Prob. Alts Appl., 4, pp. 223 - 225, 1959.

    Google Scholar 

  • R. L. Stratonovich, “Application of the Theory of Markov Processes for Optimum Filtration of Signals”, Radio Engg. Elctron. Phys(USSR), vol. 1, pp. 1 - 19, Nov. 1960.

    Google Scholar 

  • R. L. Stratonovich, “Conditional Markov Processes”, Thy. Prob. Sc Its Appl., 5, pp. 156–178, 1960.

    Article  Google Scholar 

  • M. Wax, ed., Selected Papers in Noise and Stochastic Processes, Dover, 1954.

    Google Scholar 

  • H. Weinert and V. B. Desai, “On Adjoint Models and Fixed-Interval Smoothing”, Tech. Rept. JHU-EE No. 79–8, Johns Hopkins Univ., MD, 1979.

    Google Scholar 

  • P. Whittle, Prediction and Regulation, Van Nostrand Reinhold, N.Y., 1963.

    Google Scholar 

  • N. Wiener, Extrapolation, Interpolation and Smoothing of Stationary Time Series, with Engineering Applications, Technology Press and J. Wiley, N.Y., 1949, (originally issued in Feb. 1942, as a classified Nat. Defense Res. Council Rept. )

    Google Scholar 

  • L. A. Zadeh and J. R. Ragazzini, “An Extension of Wiener’s Theory of Prediction”, Appl. Phys., vol. 21, pp. 645–655, July 1950.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, Stanford University, USA

    Thomas Kailath

Authors
  1. Thomas Kailath
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Erasmus Universiteit, Rotterdam, The Netherlands

    Michiel Hazewinkel

  2. Rijksuniversiteit, Groningen, The Netherlands

    Jan C. Willems

Rights and permissions

Reprints and permissions

Copyright information

© 1981 D. Reidel Publishing Company

About this paper

Cite this paper

Kailath, T. (1981). Some Topics in Linear Estimation. In: Hazewinkel, M., Willems, J.C. (eds) Stochastic Systems: The Mathematics of Filtering and Identification and Applications. NATO Advanced Study Institutes Series, vol 78. Springer, Dordrecht. https://doi.org/10.1007/978-94-009-8546-9_17

Download citation

  • DOI: https://doi.org/10.1007/978-94-009-8546-9_17

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-009-8548-3

  • Online ISBN: 978-94-009-8546-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation