Abstract
Within the framework of a semi-Markov model of engineering system with control depending on a valuating function some algorithms of stochastic operation are investigated. They intend to preserve high serviceability in varying environment (semi-Markov algorithms of search of maximum). Some optimality conditions are found for such an algorithm when it is used observing either a meaning of valuating function itself in a present point of a trajectory or a random value distributed in accordance with this meaning. Optimality of degenerate algorithm is proved when the valuating function is observed with normally and exponentially distributed error.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Dynkin, E. B. and Jushkevich, F. F. (1975). Controlled Markov processes and their applications, Moscow: Nauka (in Russian).
Gikhman, I.I. and Skorokhod, A. V. (1973). Theory of random processes, II, Moscow: Nauka (in Russian).
Harlamov, B. P. (1998). Optimal semi-Markov algorithm of search of maximum. In: Harlamov, B. P. (ed). Reliability for engineering, Preprint 138, IPME RAS, pp 9–29, St. Petersburg (in Russian)
Korolyuk, V. S. and Turbin, A. F. (1976). Semi-Markov processes and their applications, Kiev: Naukova Dumka (in Russian).
Krylov, N. V. (1977). Controlled processes of diffusion type, Moscow: Nauka (in Russian).
Mine, H. and Osaki, Sh. (1970). Markov decision processes, NY: Elsevier.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer Science+Business Media New York
About this chapter
Cite this chapter
Harlamov, B. (2000). Algorithms of Stochastic Activity and Problems of Reliability. In: Limnios, N., Nikulin, M. (eds) Recent Advances in Reliability Theory. Statistics for Industry and Technology. Birkhäuser, Boston, MA. https://doi.org/10.1007/978-1-4612-1384-0_5
Download citation
DOI: https://doi.org/10.1007/978-1-4612-1384-0_5
Publisher Name: Birkhäuser, Boston, MA
Print ISBN: 978-1-4612-7124-6
Online ISBN: 978-1-4612-1384-0
eBook Packages: Springer Book Archive