Skip to main content
Log in

A New Exact Test for the Evaluation of Population Pharmacokinetic and/or Pharmacodynamic Models Using Random Projections

  • Research Paper
  • Published:
Pharmaceutical Research Aims and scope Submit manuscript

ABSTRACT

Purpose

Within-subject dependency of observations has a strong impact on the evaluation of population pharmacokinetic (PK) and/or pharmacodynamic (PD) models. To our knowledge, none of the current model evaluation tools correctly address this issue. We present a new method with a global test and easy diagnostic plot which relies on the use of a random projection technique that allows the analysis of dependent data.

Methods

For each subject, the vector of standardised residuals is calculated and projected onto many random directions drawn uniformly from the unit sphere. Our test compares the empirical distribution of projections with their distribution under the model. Simulation studies assess the level of the test and compare its performance with common metrics including normalised prediction distribution errors and different types of weighted residuals. An application to real data is performed.

Results

In contrast to other evaluated methods, our test shows adequate level for all models and designs investigated, which confirms its good theoretical properties. The weakness of other methods is demonstrated and discussed.

Conclusions

This new test appears promising and could be used in combination with other tools to drive model evaluation in population PK/PD analyses.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Abbreviations

KS:

Kolmogorov-Smirnov

VPC:

visual predictive check

GUD:

global uniform distance

REFERENCES

  1. Jochemsen R, Laveille C, Breimer DD. Application of pharmacokinetic/pharmacodynamic modelling and population approaches to drug development. Int J Pharm Med. 1999;13:243–51.

    Google Scholar 

  2. Aarons L, Karlsson MO, Mentré F, Rombout F, Steimer JL, van Peer A. Role of modelling and simulation in Phase I drug development. Eur J Pharm Sci. 2001;13(2):115–22.

    Article  PubMed  CAS  Google Scholar 

  3. Zhang L, Sinha V, Forgue ST, Callies S, Ni L, Peck R, et al. Model-based drug development: the road to quantitative pharmacology. J Pharmacokinet Pharmacodyn. 2006;33(3):369–93.

    Article  PubMed  CAS  Google Scholar 

  4. Williams PJ, Ette EI. The role of population pharmacokinetics in drug development in light of the Food and Drug Administration’s ‘Guidance for Industry: population pharmacokinetics’. Clin Pharmacokinet. 2000;39(6):385–95.

    Article  PubMed  CAS  Google Scholar 

  5. US Food and Drug Administration. Guidance for Industry: Population Pharmacokinetics; 1999 February. Available from: http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/UCM072137.pdf.

  6. Committee for Medicinal Products for Human use (CHMP). Guideline on reporting the results of population pharmacokinetic analyses; 2007 June 21. Available from: http://www.tga.gov.au/DOCS/pdf/euguide/ewp/18599006en.pdf.

  7. Duan JZ. Applications of population pharmacokinetics in current drug labelling. J Clin Pharm Ther. 2007;32(1):57–79.

    Article  PubMed  CAS  Google Scholar 

  8. Vozeh S, Uematsu T, Hauf GF, Follath F. Performance of Bayesian feedback to forecast lidocaine serum concentration: evaluation of the prediction error and the prediction interval. J Pharmacokinet Biopharm. 1985;13(2):203–12.

    Article  PubMed  CAS  Google Scholar 

  9. Hooker AC, Staatz CE, Karlsson MO. Conditional weighted residuals (CWRES): a model diagnostic for the FOCE method. Pharm Res. 2007;24(12):2187–97.

    Article  PubMed  CAS  Google Scholar 

  10. Karlsson MO, Savic RM. Diagnosing model diagnostics. Clin Pharmacol Ther. 2007;82(1):17–20.

    Article  PubMed  CAS  Google Scholar 

  11. Brendel K, Comets E, Laffont C, Laveille C, Mentré F. Metrics for external model evaluation with an application to the population pharmacokinetics of gliclazide. Pharm Res. 2006;23(9):2036–49.

    Article  PubMed  CAS  Google Scholar 

  12. Lavielle M. MONOLIX (MOdèles Non LInéaires à effets miXtes) Version 3.1 Users Guide; 2009 September. Available from: http://software.monolix.org/download-31/Monolix31_UsersGuide.pdf.

  13. Bauer RJ. NONMEM Users Guide Introduction to NONMEM 7. ICON Development Solutions, Ellicott City, Maryland; 2009

  14. Brendel K, Comets E, Laffont C, Mentré F. Evaluation of different tests based on observations for external model evaluation of population analyses. J Pharmacokinet Pharmacodyn. 2010;37(1):49–65.

    Article  PubMed  Google Scholar 

  15. Silber HE, Kjellsson MC, Karlsson MO. The impact of misspecification of residual error or correlation structure on the type I error rate for covariate inclusion. J Pharmacokinet Pharmacodyn. 2009;36(1):81–99.

    Article  PubMed  Google Scholar 

  16. Comets E, Brendel K, Mentré F. Computing normalised prediction distribution errors to evaluate nonlinear mixed-effect models: the npde add-on package for R. Comput Methods Programs Biomed. 2008;90(2):154–66.

    Article  PubMed  Google Scholar 

  17. Vempala SS. The random projection method, dimacs series in discrete mathematics and theoretical computer science, volume 65. American Mathematical Society; 2004.

  18. Majumdar A, Ward RK. Robust classifiers for data reduced via random projections. IEEE Trans Syst Man Cybern B Cybern. 2010;40(5):1359–71.

    Article  PubMed  Google Scholar 

  19. Avogadri R, Valentini G. Fuzzy ensemble clustering based on random projections for DNA microarray data analysis. Artif Intell Med. 2009;45(2–3):173–83.

    Article  PubMed  Google Scholar 

  20. Quera V. RAP: a computer program for exploring similarities in behavior sequences using random projections. Behav Res Methods. 2008;40(1):21–32.

    Article  PubMed  Google Scholar 

  21. Li W, Bebis G, Bourbakis NG. 3-D object recognition using 2-D views. IEEE Trans Image Process. 2008;17(11):2236–55.

    Article  PubMed  Google Scholar 

  22. Boeckmann AJ, Sheiner LB, Beal SL. NONMEM user’s guide, part V, introductory guide. San Francisco: University of California; 1994.

    Google Scholar 

  23. Dvoretzky A, Kiefer J, Wolfowitz J. Asymptotic minimax character of the sample distribution function and of the classical multinomial estimator. Ann Math Statist. 1956;27(3):642–69.

    Article  Google Scholar 

  24. Yano Y, Beal SL, Sheiner LB. Evaluating pharmacokinetic/pharmacodynamic models using the posterior predictive check. J Pharmacokinet Pharmacodyn. 2001;28(2):171–92.

    Article  PubMed  CAS  Google Scholar 

  25. Sheiner LB. Learning versus confirming in clinical drug development. Clin Pharmacol Ther. 1997;61(3):275–91.

    Article  PubMed  CAS  Google Scholar 

Download references

ACKNOWLEDGMENTS

We kindly thank the two anonymous reviewers for their useful comments which have improved the quality of the paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Celine Marielle Laffont.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Laffont, C.M., Concordet, D. A New Exact Test for the Evaluation of Population Pharmacokinetic and/or Pharmacodynamic Models Using Random Projections. Pharm Res 28, 1948–1962 (2011). https://doi.org/10.1007/s11095-011-0422-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11095-011-0422-9

KEY WORDS

Navigation