Skip to main content

Advertisement

Log in

Robust and Adaptive Two-stage Designs in Nonlinear Mixed Effect Models

  • Research Article
  • Published:
The AAPS Journal Aims and scope Submit manuscript

Abstract

To get informative studies for nonlinear mixed effect models (NLMEM), design optimization can be performed based on Fisher Information Matrix (FIM) using the D-criterion. Its computation requires knowledge about models and parameters, which are often prior guesses. Thus, adaptive designs composed of several stages may be used. Robust approach can also be used to account for various candidate models. In the estimation step of a given stage, model selection (MS) or model averaging (MA) can be performed. In this work we propose a new two-stage adaptive design strategy, based on the robust expected FIM and MA over several candidate models. The methodology is applied to a clinical trial simulation in ophthalmology to optimize doses and time measurements. A set of dose-response candidate models is defined, and one-stage designs are compared to two-stage 50/50 designs (i.e., each stage performed with half of the available subjects), using either local optimal design or robust design, and performing analysis with one model, MS or MA. Performing a two-stage design with MS at the interim analysis can correct the choice of a wrong model for designing the first stage. Overall, starting from a robust design (1- or 2-stage) is valuable and leads to reasonable bias and precision. The proposed robust adaptive design strategy is a new tool to design longitudinal studies that could be used in different therapeutic areas.

Graphical abstract

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Mould DR, Upton RN. Basic concepts in population modeling, simulation, and model-based drug development. CPT: Pharmacometrics & Systems Pharmacology. 2012;1:e6.

  2. Mould DR, Upton RN. Basic concepts in population modeling, simulation, and model-based drug development - Part 2: Introduction to Pharmacokinetic Modeling Methods. CPT: Pharmacometrics & Systems Pharmacology. 2013;2:e38.

  3. Mould DR, Upton RN. Basic concepts in population modeling, simulation, and model-based drug development - Part 3: Introduction to Pharmacodynamic Modeling Methods. CPT: Pharmacometrics & Systems Pharmacology. 2014;3:e88.

  4. Jonsson EN, Wade JR, Karlsson MO. Comparison of some practical sampling strategies for population pharmacokinetic studies. Journal of Pharmacokinetics and Biopharmaceutics. 1996;24(2):245–63.

    Article  CAS  PubMed  Google Scholar 

  5. Ogungbenro K, Gueorguieva I, Majid O, Graham G, Aarons L. Optimal design for multiresponse pharmacokinetic-pharmacodynamic models-dealing with unbalanced designs. Journal of Pharmacokinetics and Pharmacodynamics. 2007;34(3):313–31.

    Article  PubMed  Google Scholar 

  6. Sheiner LB, Hashimoto Y, Beal SL. A simulation study comparing designs for dose ranging. Stat Medic. 1991;10(3):303–21.

    Article  CAS  Google Scholar 

  7. Mentré F, Mallet A, Baccar D. Optimal design in random effect regression models. Biometrika. 1997;84:429–42.

    Article  Google Scholar 

  8. Thorlund K, Haggstrom J, Park JJ, Mills EJ. Key design considerations for adaptive clinical trials: a primer for clinicians. British Medic J. 2018;360: k698.

    Article  Google Scholar 

  9. Pallmann P, Bedding AW, Choodari-Oskooei B, Dimairo M, Flight L, Hampson LV, et al. Adaptive designs in clinical trials: why use them, and how to run and report them. BMC Medic. 2018;16(1):1–15.

    Google Scholar 

  10. Dumont C, Chenel M, Mentré F. Two-stage adaptive designs in nonlinear mixed effects models: application to pharmacokinetics in children. Communications in Statistics-Simulation and Computation. 2016;45(5):1511–25.

    Article  Google Scholar 

  11. Pierrillas PB, Fouliard S, Chenel M, Hooker AC, Friberg LF, Karlsson MO. Model-based adaptive optimal design (MBAOD) improves combination dose finding designs: an example in oncology. AAPS J. 2018;20(2):1–11.

    Article  CAS  Google Scholar 

  12. Lestini G, Dumont C, Mentré F. Influence of the size of cohorts in adaptive design for nonlinear mixed effects models: an evaluation by simulation for a pharmacokinetic and pharmacodynamic model for a biomarker in oncology. Pharmaceutical Res. 2015;32(10):3159–69.

    Article  CAS  Google Scholar 

  13. Chen TT. Optimal three-stage designs for phase II cancer clinical trials. Stat Medic. 1997;16(23):2701–11.

    Article  CAS  Google Scholar 

  14. Jahn-Eimermacher A, Hommel G. Performance of adaptive sample size adjustment with respect to stopping criteria and time of interim analysis. Stat Medic. 2007;26(7):1450–61.

    Article  Google Scholar 

  15. Foo LK, McGree J, Eccleston J, Duffull S. Comparison of robust criteria for D-optimal designs. Journal of Biopharmaceutical Statistics. 2012;22(6):1193–205.

    Article  PubMed  Google Scholar 

  16. Loingeville F, Nguyen TT, Riviere MK, Mentré F. Robust designs in longitudinal studies accounting for parameter and model uncertainties-application to count data. Journal of Biopharmaceutical Statistics. 2020;30(1):31–45.

    Article  PubMed  Google Scholar 

  17. Seurat J, Nguyen TT, Mentré F. Robust designs accounting for model uncertainty in longitudinal studies with binary outcomes. Stat Methods Medic Res. 2020;29(3):934–52.

    Article  Google Scholar 

  18. Buatois S, Ueckert S, Frey N, Retout S, Mentré F. Comparison of model averaging and model selection in dose finding trials analyzed by nonlinear mixed effect models. The AAPS Journal. 2018;20(3):1–9.

    Article  Google Scholar 

  19. Aoki Y, Röshammar D, Hamrén B, Hooker AC. Model selection and averaging of nonlinear mixed-effect models for robust phase III dose selection. Journal of Pharmacokinetics and Pharmacodynamics. 2017;44(6):581–97.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  20. Atkinson A, Donev A, Tobias R. Optimum experimental designs, with SAS. vol. 34. OUP Oxford; 2007.

  21. Pukelsheim F, Rieder S. Efficient rounding of approximate designs. Biometrika. 1992;79(4):763–70.

    Article  Google Scholar 

  22. Leroux R, Seurat J, Le Nagard H, Mentré F, on behalf of the PFIM group. Design evaluation and optimisation in nonlinear mixed effects models with the R package PFIM. PAGE 30. 2022;Abstr 10183.

  23. Comets E, Lavenu A, Lavielle M. Parameter estimation in nonlinear mixed effect models using saemix, an R implementation of the SAEM algorithm. J Stat Softw. 2017;80:1–41.

    Article  Google Scholar 

  24. Bretz F, Pinheiro JC, Branson M. Combining multiple comparisons and modeling techniques in dose-response studies. Biometrics. 2005;61(3):738–48.

    Article  CAS  PubMed  Google Scholar 

  25. Pinheiro J, Bornkamp B, Glimm E, Bretz F. Model-based dose finding under model uncertainty using general parametric models. Stat Medic. 2014;33(10):1646–61.

    Article  Google Scholar 

  26. Holland-Letz T. On the combination of c-and D-optimal designs: General approaches and applications in dose-response studies. Biometrics. 2017;73(1):206–13.

    Article  CAS  PubMed  Google Scholar 

  27. Wong WK, Chen RB, Huang CC, Wang W. A modified particle swarm optimization technique for finding optimal designs for mixture models. PLoS One. 2015;10(6): e0124720.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Le Nagard H, Chao L, Tenaillon O. The emergence of complexity and restricted pleiotropy in adapting networks. BMC Evolutionary Biology. 2011;11(1):1–15.

    Article  Google Scholar 

  29. Seurat J, Tang Y, Mentré F, Nguyen TT. Finding optimal design in nonlinear mixed effect models using multiplicative algorithms. Computer Methods and Programs in Biomedicine. 2021;207:106–26.

    Article  Google Scholar 

Download references

Acknowledgements

The authors thank Lionel de la Tribouille for the use of the CATIBioMed calculus facility.

Funding

The authors declare no specific sponsorship or funding related to this project.

Author information

Authors and Affiliations

Authors

Contributions

Conceptualization: FM, JS Analysis: LF, RL Supervision: FM, JS Writing-original draft: LF, JS Writing-review and editing: LF, FM, JS

Corresponding author

Correspondence to Jérémy Seurat.

Ethics declarations

Conflicts of interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix A: Multiplicative Algorithm for Robust Approach

The multiplicative algorithm is an iterative algorithm which can be used to computed the weights \(\alpha _{q}\) to attribute to the individual designs in order to optimize the D-criterion or the CD-criterion in case of \(\Xi _{Robust}\). [29]

The derivative of these criteria in case of one-stage and K-stage designs, which are required for the optimization process, are computed in the following.

CD-derivative for one-stage design

In the multiplicative algorithm, an expression for \(\dfrac{\partial \phi _{D}(\Xi )}{\partial \alpha _{q}}\) is needed. Therefore let denote:

$$\begin{aligned} \phi _{D}(\Xi )= & {} Det\left( A(\alpha _{q}) \right) ^{1/P} \quad \text {with} \nonumber \\ \mathcal {M}_{F}(\Xi )= & {} A(\alpha _{q}) = N \sum _{q^{\prime }=1}^{Q} \alpha _{q^{\prime }} \mathcal {M}_{F}(\xi _{q^{\prime }}) \end{aligned}$$
(A1)

We have,

$$\begin{aligned} \dfrac{\partial \phi _{D}(\Xi )}{\partial \alpha _{q}} = \dfrac{1}{P} \left( \dfrac{d}{d\alpha _{q}}Det\left( A(\alpha _{q})\right) \right) Det(A(\alpha _{q}) )^{1/P-1} \end{aligned}$$
(A2)

According to Jacobi’s formula,

$$\begin{aligned} \dfrac{d}{d\alpha _{q}}Det\left( A(\alpha _{q})\right) = tr \left[ A(\alpha _{q})^{-1} \dfrac{dA(\alpha _{q})}{d\alpha _{q}} \right] Det\left( A(\alpha _{q})\right) \end{aligned}$$
(A3)

and we have: \(\dfrac{dA(\alpha _{q})}{d\alpha _{q}} = N \mathcal {M}_{F}(\xi _{q}) \), which leads to:

$$\begin{aligned} \dfrac{d}{d\alpha _{q}}Det\!\left( A(\alpha _{q})\right) \!=\! N tr\! \left[ \mathcal {M}_{F}(\Xi )^{\!-1} \mathcal {M}_{F}(\xi _{q}) \right] \! Det\!\left( \mathcal {M}_{F}(\Xi )\right) \end{aligned}$$
(A4)

Thus,

$$\begin{aligned} \dfrac{\partial \phi _{D}(\Xi )}{\partial \alpha _{q}}\!= & {} \! \dfrac{N}{P}\! \left( \dfrac{d}{d\alpha _{q}}\!Det\left( A(\alpha _{q})\right) \right) \!Det(A(\alpha _{q}) )^{1/P-1} \\= & {} \dfrac{N}{P} tr \left[ \mathcal {M}_{F}(\Xi )^{-1} \mathcal {M}_{F}(\xi _{q}) \right] Det(\mathcal {M}_{F}(\Xi ) )^{1/P} \nonumber \end{aligned}$$
(A5)

For the robust approach, we need expressions for derivatives of \(\phi _{CD}(\Xi ) = \displaystyle \prod _{m=1}^{M} \left( \phi _{D,m}(\Xi ) \right) ^{w_{m}} \).

Recall that

$$\begin{aligned} \frac{\mathrm d}{\mathrm dx}\prod _{i=1}^{n}f_{i}(x)=\sum _{i=1}^{n}\left( \frac{\mathrm d}{\mathrm dx}f_{i}(x)\prod _{j\ne i}f_{j}(x)\right) \end{aligned}$$
(A6)

Thus,

$$\begin{aligned} \dfrac{\partial \phi _{CD}(\Xi )}{\partial \alpha _{q}}= & {} \sum _{m=1}^{M} \Bigg ( w_{m} \dfrac{ \partial \phi _{D,m}(\Xi )}{\partial \alpha _{q}} \left( \phi _{D,m}(\Xi ) \right) ^{w_{m}-1} \nonumber \\{} & {} \times \prod _{m^{\prime } \ne m} \left( \phi _{D,m^{\prime }}(\Xi ) \right) ^{w_{m^{\prime }}} \Bigg ) \end{aligned}$$
(A7)

which writes:

$$\begin{aligned} \dfrac{\partial \phi _{CD}(\Xi )}{\partial \alpha _{q}} = \phi _{CD}(\Xi ) \sum _{m=1}^{M} \left( w_{m} \dfrac{1}{\phi _{D,m}(\Xi )} \dfrac{ \partial \phi _{D,m}(\Xi )}{\partial \alpha _{q}} \right) \end{aligned}$$
(A8)

The robust version was implemented using PFIM and the new MultiplicativeAlgorithmRobust class.

CD-derivative for K -Stage Design In the general setting of robust and adaptive design with K stages, the first stage of the study is designed and conducted according to previous information and accounting for model uncertainty. Then each following stage is planned leveraging the data obtained in the previous stages. Indeed the FIM at stage k depends on the design of the \(k^{th}\) stage, but also on those of all previous stages, from 1 to \(k-1\). Thus, for a given model m (index m is omitted in the following equations for the sake of simplicity), the total FIM \(\mathcal {M}_{F}^{(k)}(\hat{\psi }^{(k-1)}, \Xi )\) at stage k, for a design \(\Xi \) and given estimated parameters \(\hat{\psi }^{(k-1)}\) from stage \(k-1\), writes:

$$\begin{aligned} \mathcal {M}_{F}^{(k)}(\hat{\psi }^{(k-1)}, \Xi )= & {} \mathcal {M}_{F}(\hat{\psi }^{(k-1)}, \Xi _{CD,1}) + \mathcal {M}_{F}(\hat{\psi }^{(k-1)}, \Xi _{CD,2}) \nonumber \\{} & {} + ... + \mathcal {M}_{F}(\hat{\psi }^{(k-1)}, \Xi _{CD,k-1}) \nonumber \\{} & {} + \mathcal {M}_{F}(\hat{\psi }^{(k-1)}, \Xi ) \end{aligned}$$
(A9)

where \(\Xi _{CD,j}\) is the \(\Xi _{Robust}\) computed at stage j.

Table IV Optimal First Stage Designs, \(N_{1}=150\)
Table V Relative D-Efficiencies between designs, \(N_{1}=150\).

Thus, only \(\mathcal {M}_{F}(\hat{\psi }^{(k-1)}, \Xi )\) depends on \(\Xi \), the design on which optimization is performed. Therefore, at stage k, let denote the previous FIM:

$$\begin{aligned} \mathcal {M}_{F}^{(k), prev}(\hat{\psi }^{(k-1)})= & {} \mathcal {M}_{F}(\hat{\psi }^{(k-1)}, \Xi _{CD,1}) + \mathcal {M}_{F}(\hat{\psi }^{(k-1)}, \Xi _{CD,2}) \nonumber \\{} & {} + ... + \mathcal {M}_{F}(\hat{\psi }^{(k-1)}, \Xi _{CD,k-1}) \end{aligned}$$
(A10)

which leads to write:

$$\begin{aligned} \mathcal {M}_{F}^{(k)}(\hat{\psi }^{(k-1)}, \Xi )= & {} \mathcal {M}_{F}^{(k), prev}(\hat{\psi }^{(k-1)}) + \mathcal {M}_{F}(\hat{\psi }^{(k-1)}, \Xi ) \nonumber \\= & {} \mathcal {M}_{F}^{(k), prev}(\hat{\psi }^{(k-1)}) \nonumber \\{} & {} + N_{k} \sum _{q=1}^{Q} \alpha _{q} \mathcal {M}_{F}(\hat{\psi }^{(k-1)}, \xi _{q}) \end{aligned}$$
(A11)

As previously and with \( A(\alpha _{q}) = \mathcal {M}_{F}^{(k)}(\hat{\psi }^{(k-1)}, \Xi ) \), we have:

$$\begin{aligned} \dfrac{\partial \phi _{D}(\Xi )}{\partial \alpha _{q}} = \dfrac{1}{P} \left( \dfrac{d}{d\alpha _{q}}Det\left( A(\alpha _{q})\right) \right) Det(A(\alpha _{q}) )^{1/P-1} \end{aligned}$$
(A12)

which writes:

$$\begin{aligned} \dfrac{\partial \phi _{D}(\Xi )}{\partial \alpha _{q}}= & {} \dfrac{N_{k}}{P} tr \left[ \mathcal {M}_{F}^{(k)}(\hat{\psi }^{(k-1)}, \Xi )^{-1} \mathcal {M}_{F}(\xi _{q}) \right] \nonumber \\{} & {} \times Det(\mathcal {M}_{F}^{(k)}(\hat{\psi }^{(k-1)}, \Xi ) )^{1/P} \end{aligned}$$
(A13)

Thus, in robust approach, the derivative of \(\phi _{CD}\) keeps the same expression:

$$\begin{aligned} \dfrac{\partial \phi _{CD}(\Xi )}{\partial \alpha _{q}} = \phi _{CD}(\Xi ) \sum _{m=1}^{M} \left( w_{m} \dfrac{1}{\phi _{D,m}(\Xi )} \dfrac{ \partial \phi _{D,m}(\Xi )}{\partial \alpha _{q}} \right) \end{aligned}$$
(A14)

Appendix B: Two-stage design: designs for the first stage and relative efficiency

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fayette, L., Leroux, R., Mentré, F. et al. Robust and Adaptive Two-stage Designs in Nonlinear Mixed Effect Models. AAPS J 25, 71 (2023). https://doi.org/10.1208/s12248-023-00810-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1208/s12248-023-00810-9

Keywords

Navigation