Abstract
Consideration was given to some problems of estimation (filtering and identification) in the observation systems describing the Markov processes with finite state spaces. The transition intensity matrices and the observation plan are random and have unknown distributions of some class. The conditional expectations of the accessible observations of some quadratic functions of the estimate errors are used as the performance criteria. The estimation problems under study lie in constructing estimates minimizing the conditional mean losses corresponding to the least favorable distribution of the “transition intensity matrix-observation plan matrix” pair from the set of permissible distributions. For the corresponding minimax problems, existence of the saddle points was proved, and the form of the corresponding minimax estimates was established.
Similar content being viewed by others
References
Kalman, R.E. and Bucy, R.S., New Results in Linear Filtering and Prediction Problems, Trans. ASME, 1961, Ser. D, vol. 83, pp. 95–111.
Wonham, W.N., Some Applications of Stochastic Differential Equations to Optimal Nonlinear Filtering, SIAM J. Control, 1965, no. 2, pp. 347–369.
Martin, C.J. and Mintz, M., Robust Filtering and Prediction for Linear Systems with Uncertain Dynamics: A Game-Theoretic Approach, IEEE Trans. Automat. Control, 1983, vol. AC-28, no. 9, pp. 888–896.
Anan’ev, B.I., Minimax Linear Filtering of the Multistep Processes with Uncertain Distribution of Perturbations, Avtom. Telemekh., 1993, no. 10, pp. 131–139.
Kats, I.Ya. and Kurzhanskii, A.B., Minimax Multistep Filtering in Statistically Uncertain Situations, Avtom. Telemekh., 1978, no. 11, pp. 79–87.
Pankov, A.R. and Miller, G.B., Filtering of Random Process in the Statistically Uncertain Linear Stochastic Differential System, Avtom. Telemekh., 2005, no. 1, pp. 59–71.
Siemenikhin, K.V., Lebedev, M.V., and Platonov, E.N., Kalman Filtering by Minimax Criterion with Uncertain Noise Intensity Functions, in Proc. Joint 44th IEEE Conf. Decision and Control Eur. Control Conf. (CDC-ECC’2005), Seville, 2005, pp. 1929–1934.
Elliott, R.J., Aggoun, L., and Moore, J.B., Hidden Markov Models: Estimation and Control, Berlin: Springer, 1995.
Magnus, J.R. and Neudecker, H., Matrix Differential Calculus, New York: Wiley, 1999. Translated under the title Matrichnoe differentsialnoe ischislenie s prilozheniyami k statistike i ekonometrike, Moscow: Fizmatlit, 2002.
Elliott, R., Stochastic Calculus and Applications, New York: Springer, 1982. Translated under the title Stokhasticheskii analiz i ego prilozheniya, Moscow: Mir, 1986.
Ikeda, N. and Watanabe, S., Stochastic Differential Equations and Diffusion Processes, New York: Elsevier, 1981. Translated under the title Stokhasticheskie differentsial’nye uravneniya i diffuzionnye protsessy, Moscow: Nauka, 1986.
Borisov, A.V., Minimax A Posteriori Estimation in the Hidden Markov Models, Avtom. Telemekh., 2007, no. 11, pp. 31–35.
Gikhman, I.I. and Skorokhod, A.V., Teoriya sluchainykh protsessov (A Theory of Random Processes), Moscow: Nauka, 1973, vol. 2.
Martynyuk, A.A., Lakshmikantam, V., and Lila, S., Ustoichivost’ dvizheniya: metod integral’nykh neravenstv (Motion Stability: Method of Integral Inequalities), Kiev: Naukova Dumka, 1989.
Cramer, H. and Leadbetter, M., Stationary and Related Stochastic Processes, New York: Wiley, 1967. Translated under the title Statsionarnye sluchainye protsessy, Moscow: Mir, 1969.
Author information
Authors and Affiliations
Additional information
Original Russian Text © A.V. Borisov, 2008, published in Avtomatika i Telemekhanika, 2008, No. 2, pp. 64–79.
This work was supported in part by the Russian Foundation for Basic Research, project no. 05-01-00508-a, and the Program “Fundamental Algorithms of Information Technologies” of the Department of Information Technologies and Computer Systems, Russian Academy of Sciences, project 1.5.
Rights and permissions
About this article
Cite this article
Borisov, A.V. Minimax a posteriori estimation of the Markov processes with finite state spaces. Autom Remote Control 69, 233–246 (2008). https://doi.org/10.1134/S0005117908020057
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0005117908020057