ABSTRACT
Purpose
Within-subject dependency of observations has a strong impact on the evaluation of population pharmacokinetic (PK) and/or pharmacodynamic (PD) models. To our knowledge, none of the current model evaluation tools correctly address this issue. We present a new method with a global test and easy diagnostic plot which relies on the use of a random projection technique that allows the analysis of dependent data.
Methods
For each subject, the vector of standardised residuals is calculated and projected onto many random directions drawn uniformly from the unit sphere. Our test compares the empirical distribution of projections with their distribution under the model. Simulation studies assess the level of the test and compare its performance with common metrics including normalised prediction distribution errors and different types of weighted residuals. An application to real data is performed.
Results
In contrast to other evaluated methods, our test shows adequate level for all models and designs investigated, which confirms its good theoretical properties. The weakness of other methods is demonstrated and discussed.
Conclusions
This new test appears promising and could be used in combination with other tools to drive model evaluation in population PK/PD analyses.
Similar content being viewed by others
Abbreviations
- KS:
-
Kolmogorov-Smirnov
- VPC:
-
visual predictive check
- GUD:
-
global uniform distance
REFERENCES
Jochemsen R, Laveille C, Breimer DD. Application of pharmacokinetic/pharmacodynamic modelling and population approaches to drug development. Int J Pharm Med. 1999;13:243–51.
Aarons L, Karlsson MO, Mentré F, Rombout F, Steimer JL, van Peer A. Role of modelling and simulation in Phase I drug development. Eur J Pharm Sci. 2001;13(2):115–22.
Zhang L, Sinha V, Forgue ST, Callies S, Ni L, Peck R, et al. Model-based drug development: the road to quantitative pharmacology. J Pharmacokinet Pharmacodyn. 2006;33(3):369–93.
Williams PJ, Ette EI. The role of population pharmacokinetics in drug development in light of the Food and Drug Administration’s ‘Guidance for Industry: population pharmacokinetics’. Clin Pharmacokinet. 2000;39(6):385–95.
US Food and Drug Administration. Guidance for Industry: Population Pharmacokinetics; 1999 February. Available from: http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/UCM072137.pdf.
Committee for Medicinal Products for Human use (CHMP). Guideline on reporting the results of population pharmacokinetic analyses; 2007 June 21. Available from: http://www.tga.gov.au/DOCS/pdf/euguide/ewp/18599006en.pdf.
Duan JZ. Applications of population pharmacokinetics in current drug labelling. J Clin Pharm Ther. 2007;32(1):57–79.
Vozeh S, Uematsu T, Hauf GF, Follath F. Performance of Bayesian feedback to forecast lidocaine serum concentration: evaluation of the prediction error and the prediction interval. J Pharmacokinet Biopharm. 1985;13(2):203–12.
Hooker AC, Staatz CE, Karlsson MO. Conditional weighted residuals (CWRES): a model diagnostic for the FOCE method. Pharm Res. 2007;24(12):2187–97.
Karlsson MO, Savic RM. Diagnosing model diagnostics. Clin Pharmacol Ther. 2007;82(1):17–20.
Brendel K, Comets E, Laffont C, Laveille C, Mentré F. Metrics for external model evaluation with an application to the population pharmacokinetics of gliclazide. Pharm Res. 2006;23(9):2036–49.
Lavielle M. MONOLIX (MOdèles Non LInéaires à effets miXtes) Version 3.1 Users Guide; 2009 September. Available from: http://software.monolix.org/download-31/Monolix31_UsersGuide.pdf.
Bauer RJ. NONMEM Users Guide Introduction to NONMEM 7. ICON Development Solutions, Ellicott City, Maryland; 2009
Brendel K, Comets E, Laffont C, Mentré F. Evaluation of different tests based on observations for external model evaluation of population analyses. J Pharmacokinet Pharmacodyn. 2010;37(1):49–65.
Silber HE, Kjellsson MC, Karlsson MO. The impact of misspecification of residual error or correlation structure on the type I error rate for covariate inclusion. J Pharmacokinet Pharmacodyn. 2009;36(1):81–99.
Comets E, Brendel K, Mentré F. Computing normalised prediction distribution errors to evaluate nonlinear mixed-effect models: the npde add-on package for R. Comput Methods Programs Biomed. 2008;90(2):154–66.
Vempala SS. The random projection method, dimacs series in discrete mathematics and theoretical computer science, volume 65. American Mathematical Society; 2004.
Majumdar A, Ward RK. Robust classifiers for data reduced via random projections. IEEE Trans Syst Man Cybern B Cybern. 2010;40(5):1359–71.
Avogadri R, Valentini G. Fuzzy ensemble clustering based on random projections for DNA microarray data analysis. Artif Intell Med. 2009;45(2–3):173–83.
Quera V. RAP: a computer program for exploring similarities in behavior sequences using random projections. Behav Res Methods. 2008;40(1):21–32.
Li W, Bebis G, Bourbakis NG. 3-D object recognition using 2-D views. IEEE Trans Image Process. 2008;17(11):2236–55.
Boeckmann AJ, Sheiner LB, Beal SL. NONMEM user’s guide, part V, introductory guide. San Francisco: University of California; 1994.
Dvoretzky A, Kiefer J, Wolfowitz J. Asymptotic minimax character of the sample distribution function and of the classical multinomial estimator. Ann Math Statist. 1956;27(3):642–69.
Yano Y, Beal SL, Sheiner LB. Evaluating pharmacokinetic/pharmacodynamic models using the posterior predictive check. J Pharmacokinet Pharmacodyn. 2001;28(2):171–92.
Sheiner LB. Learning versus confirming in clinical drug development. Clin Pharmacol Ther. 1997;61(3):275–91.
ACKNOWLEDGMENTS
We kindly thank the two anonymous reviewers for their useful comments which have improved the quality of the paper.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Laffont, C.M., Concordet, D. A New Exact Test for the Evaluation of Population Pharmacokinetic and/or Pharmacodynamic Models Using Random Projections. Pharm Res 28, 1948–1962 (2011). https://doi.org/10.1007/s11095-011-0422-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11095-011-0422-9