Abstract

In this chapter, we consider reward processes of an irreducible continuous-time block-structured Markov chain. By using the RG-factorizations, we provide a unified algorithmic framework to derive expressions for conditional distributions and conditional moments of the reward processes. As an important example, we study the reward processes for an irreducible continuous-time level-dependent QBD process with either finitely-many levels or infinitely-many levels. At the same time, we provide a simple introduction to the reward processes of an irreducible discrete-time block-structured Markov chain.

Keywords

stochastic models RG-factorization reward process accumulated reward reward rate the first accumulated time 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Tsinghua University Press, Beijing and Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Quan-Lin Li
    • 1
  1. 1.Department of Industrial EngineeringTsinghua UniversityBeijingP.R. China

Personalised recommendations