Abstract
To get informative studies for nonlinear mixed effect models (NLMEM), design optimization can be performed based on Fisher Information Matrix (FIM) using the D-criterion. Its computation requires knowledge about models and parameters, which are often prior guesses. Thus, adaptive designs composed of several stages may be used. Robust approach can also be used to account for various candidate models. In the estimation step of a given stage, model selection (MS) or model averaging (MA) can be performed. In this work we propose a new two-stage adaptive design strategy, based on the robust expected FIM and MA over several candidate models. The methodology is applied to a clinical trial simulation in ophthalmology to optimize doses and time measurements. A set of dose-response candidate models is defined, and one-stage designs are compared to two-stage 50/50 designs (i.e., each stage performed with half of the available subjects), using either local optimal design or robust design, and performing analysis with one model, MS or MA. Performing a two-stage design with MS at the interim analysis can correct the choice of a wrong model for designing the first stage. Overall, starting from a robust design (1- or 2-stage) is valuable and leads to reasonable bias and precision. The proposed robust adaptive design strategy is a new tool to design longitudinal studies that could be used in different therapeutic areas.
Graphical abstract
Similar content being viewed by others
References
Mould DR, Upton RN. Basic concepts in population modeling, simulation, and model-based drug development. CPT: Pharmacometrics & Systems Pharmacology. 2012;1:e6.
Mould DR, Upton RN. Basic concepts in population modeling, simulation, and model-based drug development - Part 2: Introduction to Pharmacokinetic Modeling Methods. CPT: Pharmacometrics & Systems Pharmacology. 2013;2:e38.
Mould DR, Upton RN. Basic concepts in population modeling, simulation, and model-based drug development - Part 3: Introduction to Pharmacodynamic Modeling Methods. CPT: Pharmacometrics & Systems Pharmacology. 2014;3:e88.
Jonsson EN, Wade JR, Karlsson MO. Comparison of some practical sampling strategies for population pharmacokinetic studies. Journal of Pharmacokinetics and Biopharmaceutics. 1996;24(2):245–63.
Ogungbenro K, Gueorguieva I, Majid O, Graham G, Aarons L. Optimal design for multiresponse pharmacokinetic-pharmacodynamic models-dealing with unbalanced designs. Journal of Pharmacokinetics and Pharmacodynamics. 2007;34(3):313–31.
Sheiner LB, Hashimoto Y, Beal SL. A simulation study comparing designs for dose ranging. Stat Medic. 1991;10(3):303–21.
Mentré F, Mallet A, Baccar D. Optimal design in random effect regression models. Biometrika. 1997;84:429–42.
Thorlund K, Haggstrom J, Park JJ, Mills EJ. Key design considerations for adaptive clinical trials: a primer for clinicians. British Medic J. 2018;360: k698.
Pallmann P, Bedding AW, Choodari-Oskooei B, Dimairo M, Flight L, Hampson LV, et al. Adaptive designs in clinical trials: why use them, and how to run and report them. BMC Medic. 2018;16(1):1–15.
Dumont C, Chenel M, Mentré F. Two-stage adaptive designs in nonlinear mixed effects models: application to pharmacokinetics in children. Communications in Statistics-Simulation and Computation. 2016;45(5):1511–25.
Pierrillas PB, Fouliard S, Chenel M, Hooker AC, Friberg LF, Karlsson MO. Model-based adaptive optimal design (MBAOD) improves combination dose finding designs: an example in oncology. AAPS J. 2018;20(2):1–11.
Lestini G, Dumont C, Mentré F. Influence of the size of cohorts in adaptive design for nonlinear mixed effects models: an evaluation by simulation for a pharmacokinetic and pharmacodynamic model for a biomarker in oncology. Pharmaceutical Res. 2015;32(10):3159–69.
Chen TT. Optimal three-stage designs for phase II cancer clinical trials. Stat Medic. 1997;16(23):2701–11.
Jahn-Eimermacher A, Hommel G. Performance of adaptive sample size adjustment with respect to stopping criteria and time of interim analysis. Stat Medic. 2007;26(7):1450–61.
Foo LK, McGree J, Eccleston J, Duffull S. Comparison of robust criteria for D-optimal designs. Journal of Biopharmaceutical Statistics. 2012;22(6):1193–205.
Loingeville F, Nguyen TT, Riviere MK, Mentré F. Robust designs in longitudinal studies accounting for parameter and model uncertainties-application to count data. Journal of Biopharmaceutical Statistics. 2020;30(1):31–45.
Seurat J, Nguyen TT, Mentré F. Robust designs accounting for model uncertainty in longitudinal studies with binary outcomes. Stat Methods Medic Res. 2020;29(3):934–52.
Buatois S, Ueckert S, Frey N, Retout S, Mentré F. Comparison of model averaging and model selection in dose finding trials analyzed by nonlinear mixed effect models. The AAPS Journal. 2018;20(3):1–9.
Aoki Y, Röshammar D, Hamrén B, Hooker AC. Model selection and averaging of nonlinear mixed-effect models for robust phase III dose selection. Journal of Pharmacokinetics and Pharmacodynamics. 2017;44(6):581–97.
Atkinson A, Donev A, Tobias R. Optimum experimental designs, with SAS. vol. 34. OUP Oxford; 2007.
Pukelsheim F, Rieder S. Efficient rounding of approximate designs. Biometrika. 1992;79(4):763–70.
Leroux R, Seurat J, Le Nagard H, Mentré F, on behalf of the PFIM group. Design evaluation and optimisation in nonlinear mixed effects models with the R package PFIM. PAGE 30. 2022;Abstr 10183.
Comets E, Lavenu A, Lavielle M. Parameter estimation in nonlinear mixed effect models using saemix, an R implementation of the SAEM algorithm. J Stat Softw. 2017;80:1–41.
Bretz F, Pinheiro JC, Branson M. Combining multiple comparisons and modeling techniques in dose-response studies. Biometrics. 2005;61(3):738–48.
Pinheiro J, Bornkamp B, Glimm E, Bretz F. Model-based dose finding under model uncertainty using general parametric models. Stat Medic. 2014;33(10):1646–61.
Holland-Letz T. On the combination of c-and D-optimal designs: General approaches and applications in dose-response studies. Biometrics. 2017;73(1):206–13.
Wong WK, Chen RB, Huang CC, Wang W. A modified particle swarm optimization technique for finding optimal designs for mixture models. PLoS One. 2015;10(6): e0124720.
Le Nagard H, Chao L, Tenaillon O. The emergence of complexity and restricted pleiotropy in adapting networks. BMC Evolutionary Biology. 2011;11(1):1–15.
Seurat J, Tang Y, Mentré F, Nguyen TT. Finding optimal design in nonlinear mixed effect models using multiplicative algorithms. Computer Methods and Programs in Biomedicine. 2021;207:106–26.
Acknowledgements
The authors thank Lionel de la Tribouille for the use of the CATIBioMed calculus facility.
Funding
The authors declare no specific sponsorship or funding related to this project.
Author information
Authors and Affiliations
Contributions
Conceptualization: FM, JS Analysis: LF, RL Supervision: FM, JS Writing-original draft: LF, JS Writing-review and editing: LF, FM, JS
Corresponding author
Ethics declarations
Conflicts of interest
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix A: Multiplicative Algorithm for Robust Approach
The multiplicative algorithm is an iterative algorithm which can be used to computed the weights \(\alpha _{q}\) to attribute to the individual designs in order to optimize the D-criterion or the CD-criterion in case of \(\Xi _{Robust}\). [29]
The derivative of these criteria in case of one-stage and K-stage designs, which are required for the optimization process, are computed in the following.
CD-derivative for one-stage design
In the multiplicative algorithm, an expression for \(\dfrac{\partial \phi _{D}(\Xi )}{\partial \alpha _{q}}\) is needed. Therefore let denote:
We have,
According to Jacobi’s formula,
and we have: \(\dfrac{dA(\alpha _{q})}{d\alpha _{q}} = N \mathcal {M}_{F}(\xi _{q}) \), which leads to:
Thus,
For the robust approach, we need expressions for derivatives of \(\phi _{CD}(\Xi ) = \displaystyle \prod _{m=1}^{M} \left( \phi _{D,m}(\Xi ) \right) ^{w_{m}} \).
Recall that
Thus,
which writes:
The robust version was implemented using PFIM and the new MultiplicativeAlgorithmRobust class.
CD-derivative for K -Stage Design In the general setting of robust and adaptive design with K stages, the first stage of the study is designed and conducted according to previous information and accounting for model uncertainty. Then each following stage is planned leveraging the data obtained in the previous stages. Indeed the FIM at stage k depends on the design of the \(k^{th}\) stage, but also on those of all previous stages, from 1 to \(k-1\). Thus, for a given model m (index m is omitted in the following equations for the sake of simplicity), the total FIM \(\mathcal {M}_{F}^{(k)}(\hat{\psi }^{(k-1)}, \Xi )\) at stage k, for a design \(\Xi \) and given estimated parameters \(\hat{\psi }^{(k-1)}\) from stage \(k-1\), writes:
where \(\Xi _{CD,j}\) is the \(\Xi _{Robust}\) computed at stage j.
Thus, only \(\mathcal {M}_{F}(\hat{\psi }^{(k-1)}, \Xi )\) depends on \(\Xi \), the design on which optimization is performed. Therefore, at stage k, let denote the previous FIM:
which leads to write:
As previously and with \( A(\alpha _{q}) = \mathcal {M}_{F}^{(k)}(\hat{\psi }^{(k-1)}, \Xi ) \), we have:
which writes:
Thus, in robust approach, the derivative of \(\phi _{CD}\) keeps the same expression:
Appendix B: Two-stage design: designs for the first stage and relative efficiency
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Fayette, L., Leroux, R., Mentré, F. et al. Robust and Adaptive Two-stage Designs in Nonlinear Mixed Effect Models. AAPS J 25, 71 (2023). https://doi.org/10.1208/s12248-023-00810-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1208/s12248-023-00810-9