Abstract
The Kalman filter is derived directly from the least-squares estimator, and generalized to accommodate stochastic processes with time variable memory. To complete the link between least-squares estimation and Kalman filtering of first-order Markov processes, a recursive algorithm is presented for the computation of the off-diagonal elements of the a posteriori least-squares error covariance. As a result of the algebraic equivalence of the two estimators, both approaches can fully benefit from the advantages implied by their individual perspectives. In particular, it is shown how Kalman filter solutions can be integrated into the normal equation formalism that is used for intra- and inter-technique combination of space geodetic data.
Similar content being viewed by others
References
Albertella A, Betti B, Sansó F, Tornatore V (2005) Real time and batch navigation solutions: alternative approaches. Bollettino SIFET 4:85–102
Alonso AM, García-Martos C (2012) Time series analysis. Autoregressive, MA and ARMA processes. http://www.etsii.upm.es/ingor/estadistica/Carol/TSAtema4petten.pdf. Accessed 6 July 2016
Bierman GJ (1977) Factorization methods for discrete sequential estimation. Dover, New York
Brockmann E (1997) Combination of solutions for geodetic and geodynamic applications of the Global Positioning System (GPS), Geodätisch-geophysikalische Arbeiten in der Schweiz, vol 55. Schweizerische Geodätische Kommission
Didova O, Gunter B, Riva R, Klees R, Roese-Koerner L (2016) An approach for estimating time-variable rates from geodetic time series. J Geod. doi:10.1007/s00190-016-0918-5
Durbin J, Koopman SJ (2012) Time series analysis by state space methods. Oxford University Press, Oxford
Gelb A (ed) (1974) Applied optimal estimation. MIT Press, Cambridge
Glaser S, Fritsche M, Sósnica K, Rodríguez-Solano CJ, Wang K, Dach R, Hugentobler U, Rothacher M, Dietrich R (2015) A consistent combination of GNSS and SLR with minimum constraints. J Geod. doi:10.1007/s00190-015-0849-6
Hunter JD (2007) Matplotlib: a 2D graphics environment. Comput Sci Eng IEEE Comput Soc 9(3):90–95
Kailath T, Sayed AH, Hassibi B (2000) Linear estimation. Prentice-Hall, New Jersey
Kalman RE (1960) A new approach to linear filtering and prediction problems. J Basic Eng 82D:35–45
Koch KR (1982) Kalman filter and optimal smoothing derived by the regression model. Manuscr Geod 7:133–144
Koch KR (1999) Parameter estimation and hypothesis testing in linear models, 2nd edn. Springer, Berlin, Heidelberg
Koch KR (2010) Introduction to Bayesian statistics, 2nd edn. Springer, Berlin, Heidelberg
Martin WR (2014) Modified Bryson–Frazier smoother cross-covariance. IEEE Trans Autom Control 59(1):233–236
Nilsson T, Soja B, Karbon M, Heinkelmann R, Schuh H (2015) Application of Kalman filtering in VLBI data analysis. Earth Planet Space 67:136
Pittelkau ME (2013) Attitude determination Kalman filter with 1/f flicker noise gyro model. In: Proceedings of the 26th international technical meeting of the ION satellite division, Nashville, Tennessee, pp 2143–2159
Rauch HE, Tung F, Striebel CT (1965) Maximum likelihood estimates of linear dynamic systems. AIAA 3(8):1445–1450
Rutman J (1991) Characterization of frequency stability in precision frequency sources. Proc IEEE 79(6):952–960
Schuh H, Behrend D (2012) VLBI: a fascinating technique for geodesy and astrometry. J Geodyn 61:68–80
Sillard P, Boucher C (2001) A review of algebraic constraints in terrestrial reference fram datum definition. J Geod 75:63–73
Soja B, Nilsson T, Karbon M, Zus F, Dick G, Deng Z, Wickert J, Heinkelmann R, Schuh H (2015) Tropospheric delay determination by Kalman filtering VLBI data. Earth Planet Space 67:144
Sorenson HW (1970a) Comparison of Kalman, Bayesian and maximum likelihood estimation techniques. AGARDograph 139:119–142
Sorenson HW (1970b) Least-squares estimation: from Gauss to Kalman. Spectr IEEE 7(7):63–68
Sovers OJ, Fanselow JL (1987) Observation model and parameter partials for the JPL VLBI parameter estimation software “MASTERFIT”-1987. JPL Publ, Rev. 3, NASA, pp 83–39
Thaller D (2008) Inter-technique combination based on homogeneous normal equation systems including station coordinates. Earth orientation and troposphere parameters, GFZ Potsdam, Scientific Technical Report STR08/15
Thaller D, Dach R, Seitz M, Beutler G, Mareyen M, Richter B (2011) Combination of GNSS and SLR observations using satellite co-locations. J Geod 85:257–272
Williams SDP (2003) The effect of coloured noise on the uncertainties of rates from geodetic time series. J Geod 76:483–494
Acknowledgments
The author thanks colleague Halfdan P. Kierulf for clarifying and stimulating discussions, and project member and colleague Michael Dähnn for feedback which made the work more readable. The author also thanks colleagues and project members Geir Arne Hjelle, Ingrid Fausk and Ann-Silje Kirkvik for their support. The presented work was facilitated by the management at the Geodetic Institute, Norwegian Mapping Authority, as part of its reference frame contribution project. The management is represented by Head of Section Oddgeir Kristiansen, Project Leader Laila Løvhøiden, Director of Geodetic Institute Per Erik Opseth and Assistant Director/Head of Section Reidun Kittelsrud. The computations were performed with Python 3 (www.python.org), using packages NumPy (www.numpy.org) and Matplotlib (Hunter 2007) (www.matplotlib.org).
Author information
Authors and Affiliations
Corresponding author
Additional information
An erratum to this article is available at http://dx.doi.org/10.1007/s00190-017-1007-0.
Rights and permissions
About this article
Cite this article
Mysen, E. On the equivalence of Kalman filtering and least-squares estimation. J Geod 91, 41–52 (2017). https://doi.org/10.1007/s00190-016-0936-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00190-016-0936-3