Abstract
The first part of the paper is devoted to justifying the possibility of the correct description of a controllable stochastic observation system. The state is a Markov jump process, and the observations are a combination of continuous, discrete, and counting processes. A martingale problem of the system under study is solved: it is shown that there exists a canonical probability space with filtration such that under any admissible control, this system is stochastic differential with the martingales on the right-hand side. Further, for this system there exists a solution of the optimal in the mean square sense filtering problem given the compound observations. The filtering estimate is presented in the form of a continuous-discrete stochastic system with the martingales on the right-hand side. The article contains a description of a numerical algorithm implementing both process modeling in the considered observation system and the proposed solution for the filtering problem.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
REFERENCES
I. I. Gikhman and A. V. Skorokhod, The Theory of Stochastic Processes II (Nauka, Moscow, 1973; Springer, Berlin, Heidelberg, 2004).
E. B. Dynkin and A. A. Yushkevich, Controlled Markov Processes and their Applications (Nauka, Moscow, 1975; Springer, Berlin, Heidelberg, 1979).
Stochastic Processes, Optimization, and Control Theory Applications in Financial Engineering, Queueing Networks, and Manufacturing Systems, Ed. by H. Yan, G. Yin, and Q. Zhang (Springer, New York, 2006).
Hidden Markov Models in Finance, Ed. by R. Mamon and R. Elliott (Springer, New York, 2007).
G. Yin and Q. Zhang, Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach (Springer, New York, 2013).
T. L. Saaty, Elements of Queuing Theory with Applications (Sov. Radio, Moscow, 1965; Dover, New York, 1983).
P. P. Bocharov and A. V. Pechinkin, Queuing Theory, Modern Probability and Statistics (RUDN, Moscow, 1995; Walter de Gruyter, Netherlands, 2004).
G. P. Basharin, P. P. Bocharov, and Ya. A. Kogan, Queueing Analysis for Computer Networks: Theory and Computational Methods (Fizmatlit, Moscow, 1989) [in Russian].
R. Srikant and L. Ying, Communication Networks: An Optimization, Control and Stochastic Networks Perspective (Cambridge Univ. Press, New York, 2014).
A. V. Borisov, B. M. Miller, and K. V. Semenikhin, “Filtering of the markov jump process given the observations of multivariate point process,” Autom. Remote Control 76, 219 (2015).
A. V. Borisov, “Application of optimal filtering methods for on-line of queueing network states,” Autom. Remote Control 77, 277 (2016).
A. V. Borisov, A. V. Bosov, and G. B. Miller, “Modeling and monitoring of VoIP connection,” Informatics and Applications 10 (2), 2–13 (2016).
H. Schulzrinne, S. Casner, R. Frederick, and V. Jacobson, RTP: A Transport Protocol for Real-Time Applications, RFC 3550 (2003). https://tools.ietf.org/html/rfc3550.
E. N. Gilbert, “Capacity of a burst-noise channel,” Bell Syst. Tech. J. 39, 1253–1265 (1960).
E. O. Elliott, “Estimates of error rates for codes on burst-noise channels,” Bell Syst. Tech. J. 42, 1977–1997 (1963).
E. Altman, K. Avrachenkov, and C. Barakat, “TCP in presence of bursty losses,” Perform. Evaluat. 42, 129–147 (2000).
G. Haßlinger and O. Hohlfeld, “The Gilbert-Elliott model for packet loss in real time services on the internet,” in Proceedings of the 14th GI/ITG Conference on Measurement, Modelling and Evaluation of Computer and Communication Systems (MMB), Dortmund, Germany, 2008, pp. 269–283.
D. R. Cox, Renewal Theory (Wiley, New York, 1962).
Y. Ishikawa and H. Kunita, “Malliavin calculus on the wiener-poisson space and its application to canonical SDE with jumps,” Stochast. Process. Appl. 116, 1743–1769 (2006).
J. Jacod and A. N. Shiryaev, Limit Theorems for Stochastic Processes (Fizmatlit, Moscow, 1994; Springer, Berlin, Heidelberg, 2002), Vol. 1.
R. Sh. Liptser and A. N. Shiryaev, Theory of Martingales (Fizmatlit, Moscow, 1986; Kluwer academic publishers, Dordrecht, Boston, London, 1989).
W. Wonham, “Some applications of stochastic differential equations to optimal nonlinear filtering,” SIAM J. Control 2, 347–369 (1964).
R. J. Elliott, L. Aggoun, and J. B. Moore, Hidden Markov Models: Estimation and Control (Springer, New York, 2008).
D. Bertsekas and S. Shreve, Stochastic Optimal Control: The Discrete-Time Case (Academic, Orlando, 1978).
N. Bruti-Liberati and E. Platen, “Strong approximations of stochastic differential equations with jumps,” J. Comput. Appl. Math. 205, 982–1001 (2007).
R. Sh. Liptser and A. N. Shiryaev, Statistics of Random Processes (Nauka, Moscow, 1974; Springer, Berlin, Heidelberg, 2001).
Author information
Authors and Affiliations
Corresponding author
Additional information
Translated by A. Kolemesin
Rights and permissions
About this article
Cite this article
Borisov, A.V., Miller, G.B. & Stefanovich, A.I. Controllable Markov Jump Processes. I. Optimum Filtering Based on Complex Observations. J. Comput. Syst. Sci. Int. 57, 890–906 (2018). https://doi.org/10.1134/S1064230718060035
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S1064230718060035