Skip to main content

Neyman, Markov Processes and Survival Analysis

  • Conference paper
  • First Online:
Risk Assessment and Evaluation of Predictions

Part of the book series: Lecture Notes in Statistics ((LNSP,volume 215))

  • 1909 Accesses

Abstract

J. Neyman used stochastic processes extensively in his applied work. One example is the Fix and Neyman (F-N) competing risks model (Fix and Neyman, Hum Biol 23(30):205–241, 1951) that uses finite homogeneous Markov processes to analyse clinical trials with breast cancer patients. We revisit the F-N model, and compare it with the Kaplan-Meier (K-M) formulation for right censored data. The comparison offers a way to generalize the K-M formulation to include risks of recovery and relapses in the calculation of a patient’s survival probability. The generalization is to extend the F-N model to a nonhomogeneous Markov process. Closed-form solutions of the survival probability are available in special cases of the nonhomogeneous processes, like the popular multiple decrement model (including the K-M model) and Chiang’s staging model, but these models do not consider recovery and relapses while the F-N model does. An analysis of sero-epidemiology current status data with recurrent events is illustrated. Fix and Neyman used Neyman’s RBAN (regular best asymptotic normal) estimates for the risks, and provided a numerical example showing the importance of considering both the survival probability and the length of time of a patient living a normal life in the evaluation of clinical trials. The said extension would result in a complicated model and it is unlikely to find analytical closed-form solutions for survival analysis. With ever increasing computing power, numerical methods offer a viable way of investigating the problem.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aalen, O.O.: Non-parametric inference for a family of counting processes. Ann. Stat. 6, 701–726 (1978)

    Article  MathSciNet  MATH  Google Scholar 

  2. Aalen, O.O., Johansen, S.: An empirical transition matrix for non-homogeneous Markov chains based on censored observations. Scand. J. Stat. 5, 141–150 (1978)

    MathSciNet  MATH  Google Scholar 

  3. Altshuler, B.: Theory for the measurement of competing risks in animal experiments. Math. Biosci. 6, 1–11 (1970)

    Article  MathSciNet  MATH  Google Scholar 

  4. Andersen, P.K., Borgan, O., Gill, R.R., Keiding, N.: Stat Models Based on Counting Processes. Springer, New York (1993)

    Book  Google Scholar 

  5. Andersen, P.K., Keiding, N.: Multi-state models for event history analysis. Stat. Methods. Med. Res. 11, 91–115 (2002)

    Article  MATH  Google Scholar 

  6. Banerjee, M.: Current status data in the twenty first century: some interesting developments. In: Chen, D-G., Sun, J., Peace, K.E. (eds.) Interval-Censored Time-to-Event Data: Methods and Applications. Chapman and Hall/CRC Biostatistics Series, London (2011)

    Google Scholar 

  7. Chang, I-S., Chuang, Y-C., Hsiung, C.A.: Goodness-of-fit tests for semi-Markov and Markov survival models with one intermediate state. Scand. J. Stat. 28, 505–520 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  8. Chiang, C.L.: Introduction to Stochastic Processes in Biostatistics. R.E. Krieger, New York (1980)

    Google Scholar 

  9. Feller, W.: On the integrodifferential equations of purely discontinuous Markoff processes. Trans. Am. Math. Soc. 48, 488–515 (1940)

    Article  MathSciNet  Google Scholar 

  10. Feller, W.: An Introduction to Probability Theory and Its Applications, vol. I, 2nd edn. Wiley, New York (1966)

    Google Scholar 

  11. Fix, E., Neyman, J.: A simple stochastic model of recovery, relapse, death and loss of patients. Hum. Biol. 23(3), 205–241 (1951)

    Google Scholar 

  12. Frösner, G.G., Papaevangelou, G., Butler, R., Iwarson, S., Lindhol, A., Courouce-Pauty, A., Haas, H., Deinhardt, F.: Comparison of prevalence data in different age groups. Am. J. Epidemiol. 110, 63–69 (1979)

    Google Scholar 

  13. Huang, Y., Wang, M-C.: Frequency of recurrent events at failure time: modeling and inference. J. Am. Stat. Assoc. 98, 663–670 (2003)

    Article  MATH  Google Scholar 

  14. Huang, C-Y., Wang, M-C.: Nonparametric estimation of the bivariate recurrence time distribution. Biometrics 61(2), 392–402 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  15. Kalbfleisch, J.D., Prentice, R.L.: The Statistical Analysis of Failure Time Data, 2nd edn. Wiley, New York (2002)

    Book  MATH  Google Scholar 

  16. Kaplan, E.L., Meier, P.: Nonparametric estimation from incomplete observations. J. Am. Stat. Assoc. 53, 457–481 (1958)

    Article  MathSciNet  MATH  Google Scholar 

  17. Le Cam, L.: On Some Asymptotic Properties of Maximum Likelihood Estimates and Related Bayes’ Estimates, vol. 1, no. 11, pp. 277–330. University of California Publication in Statistics, California (1953)

    Google Scholar 

  18. Neyman, J.: Contribution to the theory of the χ 2 test. In: Proceedings of the Berkeley Symposium on Mathematical Statistics and Probability, pp. 239–273. University of California Press, Berkeley (1949)

    Google Scholar 

  19. Schenzle, D., Dietz, K., Frösner, G.G.: Antibody against hepatitis A in seven European countries. Am. J. Epidemiol. 110, 63–69 (1979)

    Google Scholar 

  20. Sun, J.: The Statistical Analysis of Interval-Censored Failure Time Data. Springer, New York (2006)

    MATH  Google Scholar 

  21. Yang, G.L., Chang, M.: A stochastic model for prevalence of hepatitis A antibody. Math. Biosci. 98, 157–169 (1990)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

G. Yang was supported in part by NSF grant DMS 1209111. The author thanks the referees and the Associate Editor for their helpful comments and suggestions that led to an improved presentation and an extension of the original manuscript. The original version of this article has previously been published in Lifetime Data Analysis in 2013.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Grace Yang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this paper

Cite this paper

Yang, G. (2013). Neyman, Markov Processes and Survival Analysis. In: Lee, ML., Gail, M., Pfeiffer, R., Satten, G., Cai, T., Gandy, A. (eds) Risk Assessment and Evaluation of Predictions. Lecture Notes in Statistics, vol 215. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8981-8_5

Download citation

Publish with us

Policies and ethics