Skip to main content
Log in

On estimation of nonlinear functionals from discrete noisy measurements

  • Regular Papers
  • Control Theory and Applications
  • Published:
International Journal of Control, Automation and Systems Aims and scope Submit manuscript

Abstract

The principal objective of this paper is to estimate a nonlinear functional of state vector (NFS) in dynamical system. The NFS represents a multivariate functional of state variables which carries useful information of a target system for control. The paper focuses on estimation of the NFS in linear continuous-discrete systems. The optimal nonlinear estimator based on the minimum mean square error approach is derived. The estimator depends on the Kalman estimate of a state vector and its error covariance. Some challenging computational aspects of the optimal nonlinear estimator are solved by usage of the unscented transformation for implementation of the nonlinear estimator. The special quadratic functional of state vector (QFS) is studied in detail. We derive effective matrix formulas for the optimal quadratic estimator and mean square error. The quadratic estimator has a simple closed-form calculation procedure and it is easy to implement in practice. The obtained results we demonstrate on theoretical and practical examples with different types of an nonlinear functionals. Comparison analysis of the optimal and suboptimal estimators is presented. The subsequent application of the proposed optimal nonlinear and quadratic estimators demonstrates their effectiveness.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. M. S. Grewal, A. P. Andrews, and C. G. Bartone, Global Navigation Satellite Systems, Inertial Navigation, and Integration, 3rd Edition, John Wiley & Sons, New Jersey, 2013.

    Google Scholar 

  2. R. G. Brown and P. Y. C. Hwang, Introduction to Random Signals and Applied Kalman Filtering with Matlab Exercises, 4th Edition, John Wiley & Sons, New York, 2012.

    MATH  Google Scholar 

  3. S. S. Haykin, Kalman Filtering and Neural Networks, John Wiley & Sons, New York, 2004.

    Google Scholar 

  4. F. Ding, L. Xu, and Q. Zhu, “Performance analysis of the generalised projection identification for time-varying systems,” IET Control Theory & Applications, vol. 10, no. 18, pp. 2506–02514, 2016.

    Article  MathSciNet  Google Scholar 

  5. L. Xu and F. Ding, “Recursive least squares and multiinnovation stochastic gradient parameter estimation methods for signal modeling,” Circuits Systems and Signal Processing, vol. 36, 2017. [click]

  6. X. K. Wan, Y. Li, C. Xia, M. H. Wu, J. Liang, and N. Wang, “A T-wave alternans assessment method based on least squares curve fitting technique,” Measurement, vol. 86, pp. 93–100, 2016. [click]

    Article  Google Scholar 

  7. J. Pan, X. Jiang, X. K. Wan, and W. F. Ding, “A filtering based multi-innovation extended stochastic gradient algorithm for multivariable control systems,” International Journal of Control, Automation, and Systems, vol. 15, 2017. [click]

  8. Y. Bar-Shalom, X. R. Li, and T. Kirubarajan, Estimation with Applications to Tracking and Navigation, John Wiley & Sons, New York, 2001.

    Book  Google Scholar 

  9. V. S. Pugachev and I. N. Sinitsyn, Stochastic Differential Systems. Analysis and Filtering, John Wiley & Sons, New York, 1987.

    MATH  Google Scholar 

  10. F. L. Lewis, Optimal Estimation with an Introduction to Stochastic Control Theory, John Wiley & Sons, New York, 1986.

    MATH  Google Scholar 

  11. L. Xu, “The damping iterative parameter identification method for dynamical systems based on the sine signal measurement,” Signal Processing, vol. 120, pp. 660–667, 2016. [click]

    Article  Google Scholar 

  12. J. Pan, X. H. Yang, H. F. Cai, and B. X. Mu, “Image noise smoothing using a modified Kalman filter,” Neurocomputing, vol. 173, pp. 1625–1629, 2016. [click]

    Article  Google Scholar 

  13. Y. Mao and F. Ding, “A novel parameter separation based identification algorithm for Hammerstein systems,” Applied Mathematics Letters, vol. 60, pp. 21–27, 2016. [click]

    Article  MathSciNet  MATH  Google Scholar 

  14. J. X. Ma, W. L. Xiong, and F. Ding. “Iterative identification algorithms for input nonlinear output error autoregressive systems,” International Journal of Control, Automation, and Systems, vol. 14, no. 1, pp. 140–147, 2016. [click]

    Article  Google Scholar 

  15. V. I. Arnold, Mathematical Methods of Classical Mechanics, Springer-Verlag, 1989.

    Book  Google Scholar 

  16. D. S. Grebenkov, “Optimal and suboptimal quadratic forms for noncentered Gaussian processes,” Physical Review, E88, 032140, 2013.

    Google Scholar 

  17. L. Laloux, P. Cizeau, J.-P. Bouchaud, and M. Potters, “Noise dressing of financial correlation matrices,” Physical Review Letters, vol. 83, no. 1467, pp. 1–3, 1999. [click]

    MathSciNet  Google Scholar 

  18. B. Laurent and P. Massart, “Adaptive estimation of a quadratic functional by model selection,” The Annals of Statistics, vol. 28, no. 5, pp. 1302–1338, 2000. [click]

    Article  MathSciNet  MATH  Google Scholar 

  19. T. Tony Cai and M. G. Low, “Optimal adaptive estimation of a quadratic functional,” The Annals of Statistics, vol. 34, no. 5, pp. 2298–2325, 2006. [click]

    Article  MathSciNet  MATH  Google Scholar 

  20. D. Boyer, D. S. Dean, C. Mejía-Monasterio, and G. Oshanin, “Optimal estimates of the diffusion coefficient of a single Brownian trajectory,” Physical Review, E85, 031136, 2012. [click]

    Google Scholar 

  21. S. J. Julier and J. K. Uhlmann, “Unscented filtering and nonlinear estimation,” Proceedings IEEE, vol. 92, no. 3, pp. 401–422, 2004. [click]

    Article  Google Scholar 

  22. L. Chang, B. Hu, A. Li, and F. Qin, “Transformed unscented Kalman filter,” IEEE Transactions on Automatic Control, vol. 58, no. 1, pp. 252–257, 2013. [click]

    Article  MathSciNet  MATH  Google Scholar 

  23. Y. M. Zhu, “Multisensor Decision and Estimation Fusion, Kluwer, Boston, 2002.

    Google Scholar 

  24. E. S. Armstrong, and J. S. Tripp, “An application of multivariable design techniques to the control of the National Transonic Facility,” NASA Tech. Paper 1887, 1981.

    Google Scholar 

  25. B. Holmquist, “Expectations of products of quadratic forms in normal variables,” Stochastic Analysis and Applications, no.14, pp. 149–164, 1996. [click]

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Won Choi.

Additional information

Recommended by Associate Editor Juhoon Back under the direction of Editor Duk-Sun Shim. This journal was supported by the Incheon National University Research Grant in 2014–2015.

Il Young Song received the B.S. degree from the Changwon National University, Korea, in 2007, and the M.S. degree from the Gwangju Institute of Science and Technology (GIST), Gwangju, in 2008. He received the Ph.D. degree from the GIST in 2012. He is currently a senior researcher in Hanwha Corporation R&D Center, Pangyo, Korea.

Vladimir Shin received the B.Sc. and M.Sc. degrees in applied mathematics from Moscow State Aviation Institute in 1977 and 1979, respectively. In 1985, he received the Ph.D. degree in mathematics from the Institute of Control Science, Russian Academy of Sciences. He is currently a professor in Gyeongsang National University, Korea. His research interests include estimation, filtering, tracking, and data fusion.

Won Choi received his Ph.D from Sung Kyun Kwan University under the direction of Yeong Don Kim. Since 1993 he has been at the University of Incheon. In 1996 and 2003, he was in Steklov Mathematical Institute of Russia and University of Iowa, respectively. His research interests center on stochastic processes and biomathematics.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Song, I.Y., Shin, V. & Choi, W. On estimation of nonlinear functionals from discrete noisy measurements. Int. J. Control Autom. Syst. 15, 2109–2117 (2017). https://doi.org/10.1007/s12555-016-0382-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12555-016-0382-2

Keywords

Navigation