Skip to main content

Advertisement

Log in

The Quality of Life Via Semi Markov Reward Modelling

  • Published:
Methodology and Computing in Applied Probability Aims and scope Submit manuscript

Abstract

The quality of life is recognized as an important element which is generally treated at least as primary or secondary criterion in most clinical trials. So, its measurement and statistical analysis remain an issue. In the present, a non-homogeneous semi Markov model is defined for the description of the evolution of a patient’s health status. Also, a stochastic process where the state space elements are the quality of life states of a patient and the transition probabilities are dependent on the health status is considered. A methodology via Markov modelling in order to combine the health and the quality of life status of a patient is provided. Next, we extend the above model by attaching rewards of making transitions between the states of the two kinds for indexing through rewards the quality of life for patients of all health states. The mean, the second non central moment, the variance and the high order moments of a patients interval reward are calculated by means of the basic parameters of the semi Markov chain and the quality status process. The above results provide us with a tool which could operate as a measure for indicating the quality of life status. Finally, the theoretical results are illustrated numerically with synthesized data.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Asadi-Lari M, Tamburini M, Gray D (2004) Patients’ needs, satisfaction and health related quality of life: Towards a comprehensive model. Health Qual Life Outcome 2:32

    Article  Google Scholar 

  • Australian Centre on Quality of Life (2013). Retrieved from http://www.deakin.edu.au/research/acqol/instruments/instrument.phpInstruments

  • Awad L, Zuber E, Mesbah M. (2002) Applying survival data methodology to analyze longitudinal quality of life data. In: Statistical Methods for Quality of Life Studies, by Bernard Cole and Mei-Ling Ting Lee Munir Mesbah. Springer, pp 231–243

  • Balcer Y, Sahin I. (1986) Pension accumulation as a semi-Markov reward process with applications to pension reform. In: Janssen J (ed) Semi-Markov Models. Plenum, New York

  • D’Amico G (2009) Measuring quality of life through Markov Reward processes: Analysis and inference. Envirometrics:208–220

  • De Dominics R, Manca R (1985) Some new results on the transient behavior of semi Markov reward processes. Methods Oper Res Comput 13:823–838

    Google Scholar 

  • Dore G (2012) Health Related Quality of Life in prisoners. Retrieved from http://www.springerreference.com/docs/html/chapterdbid/73526.html

  • Greenfield S, Nelson EC (1992) Recent developments and future issues in the use of health status assessment measures in clinical settings. Med Care 30(5):MS23–MS41

    Google Scholar 

  • Howard R (1972) Dynamic probabilistic sytems, vol II. D Wiley

  • Huber-Carol C, Heutte N (2002) Semi-Markov models for quality of life data with censoring. In: Statistical Methods for Quality of Life Studies: Design, Measurements and Analysis, by Bernard Cole and Mei-Ling Ting Lee Munir Mesbah. Kluwer, Boston

  • Janssen J, Manca R (2007) Semi-Markov risk models for finance insurance and reliability. Springer

  • Jianyong L, Xiaobo Z (2004) On average reward semi-Markov decision processes with a general multichain structure. Math Oper Res 29(1):339–352

    Article  MathSciNet  MATH  Google Scholar 

  • Kaplan RM, Bush JW, Berry CC (1976) Health status types of validity and the index of well being. Health Services and Research, Winter

    Google Scholar 

  • Khorshidian K, Negahdari F, Mardnifard HA (2015) Estimation for discrete-time semi-markov reward processes: Analysis and inference. Methodology and Computing in Applied Probabilities:1–16

  • Lam CLK (1997) What is health-related quality of life (HRQOL)? Hong Kong Pract 19:505–506

    Google Scholar 

  • Limnios N, Mesbah M, Sadek A (2004) A new index for longitudinal quality of life modelling and estimation. Envirometrics 15:483–490

    Article  Google Scholar 

  • Limnios N, Oprisan G (2001) Semi-Markov processes and reliability. Birkhauser, Boston

    Book  MATH  Google Scholar 

  • Masuda Y (1993) Partially observable semi-Markov reward processes. J Appl Prob 30(3):548–560

    Article  MathSciNet  MATH  Google Scholar 

  • Masuda Y, Sumita U (1991) A multivariate reward process defined on a semi-Markov process and its first-passage-time distributions. J Appl Prob 28(1):360–373

    Article  MathSciNet  MATH  Google Scholar 

  • McClean S, Papadopoulou A, Tsaklides G (2004) Discrete time reward models for homogeneous semi-Markov systems. Commun Stat Theory Methods 33(3):623–638

    Article  MathSciNet  MATH  Google Scholar 

  • Mesbah M, Dupuy JF, Heutte N, Awad L (2004) Joint analysis of longitudinal quality of life and survival process. In: Handbook of Statistics. Vol 22, Advances in Survival Analysis, by N. Balakrishnan et C.R. Rao. Amsterdam, North Holland

  • O’Connor’s R (2004) Measuring Quality of Life in Health. Pub. Churchill, Livingstone

    Google Scholar 

  • Papadopoulou A, Tsaklidis G, McClean S, Garg L (2012) On the moments and the distribution of the cost of a semi-markov model for healthcare systems. Methodol Comput Appl Probab 14(3):717–737

    Article  MathSciNet  MATH  Google Scholar 

  • Papadopoulou A (2004) Economic rewards in non homogeneous semi-Markov systems. Commun Stat Theory Methods 33(3):681–696

    Article  MathSciNet  MATH  Google Scholar 

  • Papadopoulou A (2012) Some results on modelling biological sequences and Web navigation with a semi-Markov chain. Commun Stat Theory Methods 42(16):2853–2871

    Article  MATH  Google Scholar 

  • Papadopoulou A, Tsaklidis G (2007) Some reward paths in semi Markov models with stochastic selection of the transition probabilities. Methodol Comput Appl Probab 9:399–411

    Article  MathSciNet  MATH  Google Scholar 

  • Patrick DL, Deyo RA (1989) Generic and disease-specific measures in assessing health status and quality of life. Med Care 27(3):S217–232

    Article  Google Scholar 

  • Reza Soltani A, Khorshidian K (1998) Reward processes for semi-Markov processes asymptotic behaviour. J Appl Prob 35:833–842

    Article  MathSciNet  MATH  Google Scholar 

  • Stenberg F, Manca R, Silvestrov D (2006) Semi Markov reward models for disability insurance. Theory Stoch Proces 12(28):3–4:239–254

    MathSciNet  MATH  Google Scholar 

  • Stenberg F, Silvestrov D, Manca R (2007) An algorithmic approach to discrete time nonhomogeneous backward semi-Markov reward processes with an application to disability insurance. Methodol Comput Appl Probab 9:497–519

    Article  MathSciNet  MATH  Google Scholar 

  • Tan WY (2000) Stochastic Modeling of AIDS Epidemiology and HIV Pathogenesis. World Scientific, Singapore

    MATH  Google Scholar 

  • Vassiliou P-C, Papadopoulou A (1992) Non homogenous Semi Markov systems and maintainability of the state sizes. J Appl Probab 29:519–534

    Article  MathSciNet  MATH  Google Scholar 

  • Wilson IB, Cleary PD (1995) Linking clinical variables with health related quality of life. JAMA 273:59–65

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zacharias Kyritsis.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kyritsis, Z., Papadopoulou, A. The Quality of Life Via Semi Markov Reward Modelling. Methodol Comput Appl Probab 19, 1029–1045 (2017). https://doi.org/10.1007/s11009-016-9516-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11009-016-9516-5

Keywords

Mathematics Subject Classification (2010)

Navigation