Skip to main content
Log in

Multinomial Logistic Functions in Markov Chain Models of Sleep Architecture: Internal and External Validation and Covariate Analysis

  • Research Article
  • Published:
The AAPS Journal Aims and scope Submit manuscript

Abstract

Mixed-effect Markov chain models have been recently proposed to characterize the time course of transition probabilities between sleep stages in insomniac patients. The most recent one, based on multinomial logistic functions, was used as a base to develop a final model combining the strengths of the existing ones. This final model was validated on placebo data applying also new diagnostic methods and then used for the inclusion of potential age, gender, and BMI effects. Internal validation was performed through simplified posterior predictive check (sPPC), visual predictive check (VPC) for categorical data, and new visual methods based on stochastic simulation and estimation and called visual estimation check (VEC). External validation mainly relied on the evaluation of the objective function value and sPPC. Covariate effects were identified through stepwise covariate modeling within NONMEM VI. New model features were introduced in the model, providing significant sPPC improvements. Outcomes from VPC, VEC, and external validation were generally very good. Age, gender, and BMI were found to be statistically significant covariates, but their inclusion did not improve substantially the model’s predictive performance. In summary, an improved model for sleep internal architecture has been developed and suitably validated in insomniac patients treated with placebo. Thereafter, covariate effects have been included into the final model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Mai E, Buysse D. Insomnia: prevalence, impact, pathogenesis, differential diagnosis, and evaluation. Sleep Med Clin. 2008;3(2):167–74.

    Article  PubMed  Google Scholar 

  2. Gimenez S, Clos S, Romero S, Grasa E, Morte A, Barbanoj MJ. Effects of olanzapine, risperidone and haloperidol on sleep after a single oral morning dose in healthy volunteers. Psychopharmacology. 2007;190:507–16.

    Article  PubMed  CAS  Google Scholar 

  3. Penzel T, Kesper K. Physiology of sleep and dreaming. Sleep Apnea. 2006;35:13–20.

    Article  Google Scholar 

  4. Rechtschaffen A, Kales A. A manual of standardized terminology, techniques and scoring system for sleep stages of human subjects. Washington, DC: Public Health Service, US Government Printing Office; 1968.

    Google Scholar 

  5. Karlsson MO, Schoemaker RC, Kemp B, Cohen AF, van Gerven JMA, Tuk B, et al. A pharmacodynamic Markov mixed-effects model for the effect of temazepam on sleep. Clin Pharmacol Ther. 2000;68:175–88.

    Article  PubMed  CAS  Google Scholar 

  6. Kjellsson MC, Ouellet D, Corrigan B, Karlsson MO. Modeling sleep data for a new drug in development using Markov mixed-effects models. Acta Universitatis Upsaliensis. Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Pharmacy 59; 2008.

  7. Bizzotto R, Zamuner S, De Nicolao G, Karlsson MO, Gomeni R. Multinomial logistic estimation of Markov-chain models for modeling sleep architecture in primary insomnia patients. J Pharmacokinet Pharmacodyn. 2010;37:137–55.

    Article  PubMed  Google Scholar 

  8. Bergstrand M, Hooker AC, Karlsson MO. Visual predictive checks for censored and categorical data (abstract). 2009. p. 18, Abstr 1604. www.page-meeting.org/?abstract=1604.

  9. Redline S, Kirchner HL, Quan SF, Gottlieb DJ, Kapur V, Newman A. The effects of age, sex, ethnicity, and sleep-disordered breathing on sleep architecture. Arch Int Med. 2004;164:406–18.

    Article  Google Scholar 

  10. Vitiello MV. Sleep in normal aging. Sleep Med Clin. 2006;1:171–6.

    Article  Google Scholar 

  11. Sahlin C, Franklin KA, Stenlund H, Lindberg E. Sleep in women: normal values for sleep stages and position and the effect of age, obesity, sleep apnea, smoking, alcohol and hypertension. Sleep Med. 2009;10:1025–30.

    Article  PubMed  Google Scholar 

  12. Van Cauter E, Leproult R, Plat L. Age-related changes in slow wave sleep and REM sleep and relationship with growth hormone and cortisol levels in healthy men. JAMA. 2000;284(7):861–8.

    Article  PubMed  Google Scholar 

  13. Rao MN, Blackwell T, Redline S, Stefanick ML, Ancoli-Israel S, Stone KL. Association between sleep architecture and measures of body composition. Sleep. 2009;32(4):483–90.

    PubMed  Google Scholar 

  14. Kohatsu ND, Tsai R, Young T, Van Gilder R, Burmeister LF, Stromquist AM, et al. Sleep duration and body mass index in a rural population. Arch Int Med. 2006;166:1701–5.

    Article  Google Scholar 

  15. Van Cauter E, Knutson KL. Sleep and the epidemic of obesity in children and adults. Eur J Endocrinol. 2008;159 Suppl 1:S59–66.

    Article  PubMed  Google Scholar 

  16. Beal SL, Sheiner LB. NONMEM user’s guides. San Francisco: NONMEM Project Group; 1998.

    Google Scholar 

  17. Holford N. VPC, the visual predictive check—superiority to standard diagnostic (Rorschach) plots (abstract). 2005; p. 14, Abstr 738. www.page-meeting.org/?abstract=738.

  18. Jönsson S, Kjellsson MC, Karlsson MO. Estimating bias in population parameters for some models for repeated measures ordinal data using NONMEM and NLMIXED. J Pharmacokinet Pharmacodyn. 2004;31(4):299–320.

    Article  PubMed  Google Scholar 

  19. Duval V, Karlsson MO. Impact of omission or replacement of data below the limit of quantification on parameter estimates in a two-compartment model. Pharm Res. 2002;19(12):1835–40.

    Article  PubMed  CAS  Google Scholar 

  20. Jonsson EN, Karlsson MO. Automated covariate model building within NON-MEM. Pharm Res. 1998;15:1463–8.

    Article  PubMed  CAS  Google Scholar 

  21. Savic RM, Karlsson MO. Importance of shrinkage in empirical Bayes estimates for diagnostics: problems and solutions. AAPS J. 2009;11(3):558–69.

    Article  PubMed  Google Scholar 

  22. Carskadon MA, Dement WC. Normal human sleep: an overview. In: Kryger MH, Roth T, Dement WC, editors. Principles and practice of sleep medicine. Philadelphia: W.B. Saunders; 1989. p. 3–13.

    Google Scholar 

  23. Kjellsson MC. Methodological studies on models and methods for mixed-effects categorical data analysis. Acta Universitatis Upsaliensis. Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Pharmacy 83; 2008.

  24. Ribbing J, Jonsson EN. Power, selection bias and predictive performance of the population pharmacokinetic covariate model. J Pharmacokinet Pharmacodyn. 2004;31(2):109–34.

    Article  PubMed  CAS  Google Scholar 

Download references

Acknowledgments

This project was partially supported by a grant from “Fondazione Ing. Aldo Gini.”

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Roberto Bizzotto.

Electronic Supplementary Materials

Below is the link to the electronic supplementary material.

Table I

Statistics on age, BMI and gender in study A and B subjects. (DOC 26 kb)

Table II

Model parameter values estimated from study B. (DOC 311 kb)

Appendices

Appendix 1

NONMEM model file for sub-model AW:

figure afigure afigure afigure a

Appendix 2

Some Lines from the Dataset Used with Sub-model AW (the Whole Dataset Can Be Found as ESM Table II)

ID

TIME

STAG

MDV0

MDV

STT

SL

IS

142

52

0

0

0

51

0

55

142

53

0

0

0

52

0

55

142

54

1

0

0

53

0

55

142

55

1

1

0

1

1

55

142

56

1

1

0

2

1

55

126

343

2

1

0

10

1

71

126

344

2

1

0

11

1

71

126

345

0

1

0

12

1

71

126

346

1

0

0

1

1

71

126

347

0

1

0

1

1

71

126

348

1

0

0

1

1

71

126

349

1

1

0

1

1

71

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bizzotto, R., Zamuner, S., Mezzalana, E. et al. Multinomial Logistic Functions in Markov Chain Models of Sleep Architecture: Internal and External Validation and Covariate Analysis. AAPS J 13, 445–463 (2011). https://doi.org/10.1208/s12248-011-9287-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1208/s12248-011-9287-4

Key words

Navigation