Application of Resampling Techniques to Estimate Exact Significance Levels for Covariate Selection During Nonlinear Mixed Effects Model Building: Some Inferences
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.Get Access
Purpose. One of the main objectives of the nonlinear mixed effects modeling is to provide rational individualized dosing strategies by explaining the interindividual variability using intrinsic and/or extrinsic factors (covariates). The aim of the current study was to evaluate, using computer simulations and real data, methods for estimating the exact significance level for including or excluding a covariate during model building.
Methods. Original data were simulated using a simple one-compartment pharmacokinetic model with (full model) or without (null model) covariates (one or two). The covariate values in the original data were resampled (using either permutations or parametric bootstrap methods) to generate data under the null hypothesis that there is no covariate effect. The original and permuted data were fitted to null and full models, using first-order and first-order condition estimation (with or without interaction) methods in NONMEM, to compare the asymptotic and conditional p-value. Target log-likelihood ratio cutoffs for assessing covariate effects were derived.
Results. The simulations showed that for sparse as well as dense data, the first-order condition estimation methods yielded the best results while the first-order method performs somewhat better for sparse data. Depending on the modeling objective, the appropriate asymptotic p-value can be substituted for the conditional significance level. Target log-likelihood ratio cutoffs should be determined separately for each covariate when exact p-values are important.
Conclusions. Resampling methods can be employed to estimate the exact significance level for including a covariate during nonlinear mixed effects model building. Some reasonable inferences can be drawn for potential application to design future population analyses.
- Guidance for Industry: Population Pharmacokinetics. Center for Drug Evaluation and Research, United States Food and Drug Administration, http://www.fda.gov/cder/guidance/index.htm (1999).
- E. Samara and R. Granneman. Role of population pharmacokinetics in drug development. A pharmaceutical industry perspective. Clin Pharmacokinet. 32:294–312 (1997).
- B. Efron and Tibshirani R. J. An introduction to the bootstrap. Chapman & Hill New York (1993).
- Good P. Permutation tests: A practical guide to resampling methods for testing hypotheses. Springer, 2nd ed., 2000.
- S. L. Beal and L. B. Sheiner (eds). NONMEM user's guides. San Francisco, CA: NONMEM Project Group, University of California (1992).
- M. J. Anderson and P. Legendre. An empirical comparison of permuatation methods for tests of partial regression coefficients in a linear model. J. Statist. Comp. Simul. 62:271–303 (1999).
- C. J. F. ter Braak. Permuation versus bootstrap significance tests in multiple regression and ANOVA. In: K. H. Jockel, G. Rothe, and W. Sendler (eds), Bootstrapping and related techniques. Springer-Verlag, Berlin, pp. 79–82 (1992).
- D. Freedman and D. Lane. Nonstochastic interpretation of reported significance levels. J. Bus. Econ. Stat. 1:292–298 (1983).
- U. Wählby, E. N. Jonsson, and M. O. Karlsson. Assessment of actual significance levels for covariate effects in NONMEM. J. Pharmacokinet. Pharmacodyn. 28:231–252 (2000).
- L. Banken. Evaluating the properties of statistical tests through simulations. Presented at the Basel Biometric Society (BBS) Meeting on Resampling and Simulation in Medical Research, June 6, 2001.
- J. V. S. Gobburu and P. J. Marroum. Utilization of PK/PD modeling and simulation in regulatory considerations. Clin. Pharmacokinet. 40:883–892 (2001).
- Application of Resampling Techniques to Estimate Exact Significance Levels for Covariate Selection During Nonlinear Mixed Effects Model Building: Some Inferences
Volume 19, Issue 1 , pp 92-98
- Cover Date
- Print ISSN
- Online ISSN
- Kluwer Academic Publishers-Plenum Publishers
- Additional Links
- mixed effects modeling
- covariate selection
- hypothesis testing
- Industry Sectors
- Author Affiliations
- 1. Pharmacometrics, Division of Pharmaceutical Evaluation—1, Office of Clinical Pharmacology and Biopharmaceutics, Center for Drug Evaluation and Research, Food and Drug Administration, Rockville, Maryland
- 2. Biometrics, Office of Biostatistics, Center for Drug Evaluation and Research, Food and Drug Administration, Rockville, Maryland