Abstract
The aim of the study was to evaluate the nonparametric estimation methods available in NONMEM VI in comparison with the parametric first-order method (FO) and the first-order conditional estimation method (FOCE) when applied to real datasets. Four methods for estimating model parameters and parameter distributions (FO, FOCE, nonparametric preceded by FO (FO-NONP) and nonparametric preceded by FOCE (FOCE-NONP)) were compared for 25 models previously developed using real data and a parametric method. Numerical predictive checks were used to test the appropriateness of each model. Up to 1000 new datasets were simulated from each model and with each method to construct 90% and 50% prediction intervals. The mean absolute error and the mean error of the different outcomes investigated were computed as indicators of imprecision and bias respectively and formal statistical tests were performed. Overall, less imprecision and less bias were observed with nonparametric methods than with parametric methods. Across the 25 models, t-tests revealed that imprecision and bias were significantly lower (P < 0.05) with FOCE-NONP than with FOCE for half of the NPC outcomes investigated. Improvements were even more pronounced with FO-NONP in comparison with FO. In conclusion, when applied to real datasets and evaluated by numerical predictive checks, the nonparametric estimation methods in NONMEM VI performed better than the corresponding parametric methods (FO or FOCE).
Similar content being viewed by others
References
Jelliffe R, Schumitzky A, Van Guilder M (2000) Population pharmacokinetics/pharmacodynamics modeling: parametric and nonparametric methods. Ther Drug Monit 22(3):354–365. doi:10.1097/00007691-200006000-00019
Mallet A, Mentre F, Steimer JL, Lokiec F (1988) Nonparametric maximum likelihood estimation for population pharmacokinetics, with application to cyclosporine. J Pharmacokinet Biopharm 16(3):311–327. doi:10.1007/BF01062140
Leary RH, Jelliffe R, Schumitzky A, Van Guilder M (2002) A unified parametric/nonparametric approach to PK/PD population modeling, Abstr 302, p 11. www.page-meeting.org/?abstract=302
Bustad A, Terziivanov D, Leary R et al (2006) Parametric and nonparametric population methods: their comparative performance in analysing a clinical dataset and two Monte Carlo simulation studies. Clin Pharmacokinet 45(4):365–383. doi:10.2165/00003088-200645040-00003
Leary RH, Jelliffe R, Schumitzky A, Van Guilder M (2001) An adaptive grid non-parametric approach to pharmacokinetic and dynamic (PK/PD) models. 14th institute of electrical and electronics engineers symposium on computer-based medical systems, IEEE, Bethesda, MD, pp 389–394
Mallet A (1986) A maximum likelihood estimation method for random coefficient regression models. Biometrika 3:645–656. doi:10.1093/biomet/73.3.645
Savic RM, Kjellsson MC, Karlsson MO (2009) Evaluation of the nonparametric estimation method in NONMEM VI. Eur J Pharm Sci 37(1):27–35. doi:10.1016/j.ejps.2008.12.014
Wilkins JJ, Karlsson MO, Jonsson EN (2006) Patterns and power for the visual predictive check, Abstr 1029, p 15. www.page-meeting.org/?abstract=1029
Lindbom L, Ribbing J, Jonsson EN (2004) Perl-speaks-NONMEM (PsN)––a Perl module for NONMEM related programming. Comput Method Program Biomed 75(2):85–94. doi:10.1016/j.cmpb.2003.11.003
Sheiner LB, Beal SL (1981) Some suggestions for measuring predictive performance. J Pharmacokinet Biopharm 9(4):503–512. doi:10.1007/BF01060893
R Development Core Team (2006) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. http://www.R-project.org
Hastie T GAM (2006) Generalized additive models. R package version 0.98
Hooker AC, Staatz CE, Karlsson MO (2007) Conditional weighted residuals (CWRES): a model diagnostic for the FOCE method. Pharm Res 24(12):2187–2197. doi:10.1007/s11095-007-9361-x
Dartois C, Lemenuel-Diot A, Laveille C et al (2007) Evaluation of uncertainty parameters estimated by different population PK software and methods. J Pharmacokinet Pharmacodyn 34(3):289–311. doi:10.1007/s10928-006-9046-9
White DB, Walawander CA, Tung Y, Grasela TH (1991) An evaluation of point and interval estimates in population pharmacokinetics using NONMEM analysis. J Pharmacokinet Biopharm 19(1):87–112
Garrido MJ, Cendrós J, Ramis J et al (2008) Simultaneous population pharmacodynamic modelling of the growth hormone and insulin-like growth factor-I effects after deep subcutaneous administration of Lanreotide Autogel® in acromegalic patients. Application of nonparametric estimation method in NONMEM, Abstr 1366, p 17. www.page-meeting.org/?abstract=1366
Hamren B, Ericsson H, Samuelsson O, Karlsson MO (2008) Mechanistic modelling of tesaglitazar pharmacokinetic data in subjects with various degrees of renal function––evidence of interconversion. Br J Clin Pharmacol 65(6):855–863. doi:10.1111/j.1365-2125.2008.03110.x
Savic RM, Wilkins JJ, Karlsson MO (2006) (Un)informativeness of empirical bayes estimate-based diagnostics. AAPS J Am Assoc Pharm Sci
Antic J, Laffont CM, Chafaï D, Concordet D (2009) Comparison of nonparametric methods in nonlinear mixed effects models. Comput Stat Data Anal 53:642–656. doi:10.1016/j.csda.2008.08.021
Savic RM, Karlsson MO (2007) Evaluation of extended grid methods for estimation using nonparametric distribution. AAPS J 9(S2): Abstr W4536
Savic RM, Baverel PG, Karlsson MO (2008) A novel bootstrap method for obtaining uncertainty measurement around the nonparametric distribution, Abstr 1390, p 17. www.page-meeting.org/?abstract=1390
Lindemalm S, Savic RM, Karlsson MO et al (2005) Application of population pharmacokinetics to cladribine. BMC Pharmacol 5(1):4. doi:10.1186/1471-2210-5-4
Bruno R, Iliadis MC, Lacarelle B et al (1992) Evaluation of Bayesian estimation in comparison to NONMEM for population pharmacokinetic data analysis: application to pefloxacin in intensive care unit patients. J Pharmacokinet Biopharm 20(6):653–669. doi:10.1007/BF01064424
Rydberg T, Jonsson A, Karlsson MO, Melander A (1997) Concentration-effect relations of glibenclamide and its active metabolites in man: modelling of pharmacokinetics and pharmacodynamics. Br J Clin Pharmacol 43(4):373–381. doi:10.1111/j.1365-2125.1997.00571.x
Savic RM, Jonker DM, Kerbusch T, Karlsson MO (2007) Implementation of a transit compartment model for describing drug absorption in pharmacokinetic studies. J Pharmacokinet Pharmacodyn 34(5):711–726. doi:10.1007/s10928-007-9066-0
Osterberg O, Savic RM, Karlsson MO et al (2006) Pharmacokinetics of desmopressin administrated as an oral lyophilisate dosage form in children with primary nocturnal enuresis and healthy adults. J Clin Pharmacol 46(10):1204–1211. doi:10.1177/0091270006291838
Jonsson EN, Antila S, McFadyen L, Lehtonen L, Karlsson MO (2003) Population pharmacokinetics of levosimendan in patients with congestive heart failure. Br J Clin Pharmacol 55(6):544–551. doi:10.1046/j.1365-2125.2003.01778.x
Zingmark PH, Edenius C, Karlsson MO (2004) Pharmacokinetic/pharmacodynamic models for the depletion of Vbeta5.2/5.3 T cells by the monoclonal antibody ATM-027 in patients with multiple sclerosis, as measured by FACS. Br J Clin Pharmacol 58(4):378–389. doi:10.1111/j.1365-2125.2004.02177.x
Karlsson MO, Jonsson EN, Wiltse CG, Wade JR (1998) Assumption testing in population pharmacokinetic models: illustrated with an analysis of moxonidine data from congestive heart failure patients. J Pharmacokinet Biopharm 26(2):207–246. doi:10.1023/A:1020561807903
Hempel G, Karlsson MO, de Alwis DP et al (1998) Population pharmacokinetic-pharmacodynamic modeling of moxonidine using 24-hour ambulatory blood pressure measurements. Clin Pharmacol Ther 64(6):622–635. doi:10.1016/S0009-9236(98)90053-4
Li J, Karlsson MO, Brahmer J et al (2006) CYP3A phenotyping approach to predict systemic exposure to EGFR tyrosine kinase inhibitors. J Natl Cancer Inst 98(23):1714–1723
Cullberg M, Wåhlander K, Lundström T et al (2006) Ximelagatran in extended secondary prevention of venous thromboembolism: pharmacokinetics, pharmacodynamics and relationships to clinical events. Doctoral thesis of Marie Cullberg from the Division of Pharmacokinetics and Drug Therapy, Department of Pharmaceutical Sciences, Uppsala University, Sweden
Wilkins JJ, Langdon G, McIlleron H et al (2006) Variability in the population pharmacokinetics of pyrazinamide in South African tuberculosis patients. Eur J Clin Pharmacol 62(9):727–735. doi:10.1007/s00228-006-0141-z
Karlsson MO, Sheiner LB (1993) The importance of modeling interoccasion variability in population pharmacokinetic analyses. J Pharmacokinet Biopharm 21(6):735–750. doi:10.1007/BF01113502
Mandema JW, Verotta D, Sheiner LB (1992) Building population pharmacokinetic–pharmacodynamic models. I. Models for covariate effects. J Pharmacokinet Biopharm 20(5):511–528. doi:10.1007/BF01061469
Aarons L, Vozeh S, Wenk M, Weiss P, Follath F (1989) Population pharmacokinetics of tobramycin. Br J Clin Pharmacol 28(3):305–314
Lindemalm S, Liliemark J, Gruber A et al (2001) Antiproliferative activity in relation to levels of phosphorylated 2-chloro-2’-deoxyadenosine and 2-chloro-2’-arabino-fluoro-2’-deoxyadenosine and levels of activating enzymes in leukaemia cells. Doctoral thesis of Synnöve Lindemalm from the Department of Medicine Division of Clinical Pharmacology Karolinska Institute and Hospital Stockholm, Sweden
Friberg LE, Henningsson A, Maas H, Nguyen L, Karlsson MO (2002) Model of chemotherapy-induced myelosuppression with parameter consistency across drugs. J Clin Oncol 20(24):4713–4721. doi:10.1200/JCO.2002.02.140
Troconiz IF, Naukkarinen TH, Ruottinen HM et al (1998) Population pharmacodynamic modeling of levodopa in patients with Parkinson’s disease receiving entacapone. Clin Pharmacol Ther 64(1):106–116. doi:10.1016/S0009-9236(98)90028-5
Brynne L, McNay JL, Schaefer HG et al (2001) Pharmacodynamic models for the cardiovascular effects of moxonidine in patients with congestive heart failure. Br J Clin Pharmacol 51(1):35–43. doi:10.1046/j.1365-2125.2001.01320.x
Hamren B, Björk E, Karlsson MO (2006) Mechanism-based pharmacokinetic and pharmacodynamic modeling of tesaglitazar in type 2 diabetes patients, Abstr 961, p 15. www.page-meeting.org/?abstract=961
Hornestam B, Jerling M, Karlsson MO, Held P (2003) Intravenously administered digoxin in patients with acute atrial fibrillation: a population pharmacokinetic/pharmacodynamic analysis based on the digitalis in acute atrial fibrillation trial. Eur J Clin Pharmacol 58(11):747–755
Acknowledgments
We would like to acknowledge Kajsa Harling for computational assistance and the Resource Facility for Population Kinetics at http://www.rfpk.washington.edu and the National Institutes of Health grant EB-01975 for sharing the dataset of tobramycin.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Baverel, P.G., Savic, R.M., Wilkins, J.J. et al. Evaluation of the nonparametric estimation method in nonmem VI: application to real data. J Pharmacokinet Pharmacodyn 36, 297–315 (2009). https://doi.org/10.1007/s10928-009-9122-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10928-009-9122-z