Skip to main content

Assessment of Incurred Sample Reanalysis for Macromolecules to Evaluate Bioanalytical Method Robustness: Effects from Imprecision

Abstract

Incurred sample reanalysis (ISR) is recommended by regulatory agencies to demonstrate reproducibility of validated methods and provide confidence that methods used in pharmacokinetic and toxicokinetic assessments give reproducible results. For macromolecules to pass ISR, regulatory recommendations require that two thirds of ISR samples be within 30% of the average of original and reanalyzed values. A modified Bland–Altman (mBA) analysis was used to evaluate whether total error (TE), the sum of precision and accuracy, was predictive of a method’s passing ISR and to identify potential contributing parameters for ISR success. Simulated studies determined minimum precision requirements for methods to have successful ISR and evaluated the relationship between precision and the probability of a method’s passing ISR acceptance criteria. The present analysis evaluated ISRs conducted for 37 studies involving ligand-binding assays (LBAs), with TEs ranging from 15% to 30%. An mBA approach was used to assess accuracy and precision of ISR, each with a threshold of 30%. All ISR studies met current regulatory criteria; using mBA, all studies met the accuracy threshold of 30% or less, but two studies (5%) failed to meet the 30% precision threshold. Simulation results showed that when an LBA has ≤15% imprecision, the ISR criteria for both the regulatory recommendation and mBA would be met in 99.9% of studies. Approximately 71% of samples are expected to be within 1.5 times the method imprecision. Therefore, precision appears to be a critical parameter in LBA reproducibility and may also be useful in identifying methods that have difficulty passing ISR.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

REFERENCES

  1. Fast DM, Kelley M, Viswanathan CT, et al. Workshop report and follow-up—AAPS workshop on current topics in GLP bioanalysis: assay reproducibility for incurred samples—implications of Crystal City recommendations. AAPS J. 2009;11(2):238–41.

    PubMed  Article  Google Scholar 

  2. Timmerman P, Luedtke S, Amsterdam P, et al. Incurred sample reanalysis: views and recommendations by the European Bioanalysis Forum. Bioanalysis. 2009;1(6):1049–56.

    PubMed  Article  CAS  Google Scholar 

  3. Ray C, DeSimone D, Thway T. Report on AAPS workshop on current topics in GLP bioanalysis: assay reproducibility for incurred samples—implication of Crystal City recommendations. Ligand Binding Assay Bioanalytical Focus Group Newsletter. 2008;2(2).

  4. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–10.

    PubMed  Article  CAS  Google Scholar 

  5. Rocci ML Jr, Devanarayan V, Haughey DB, et al. Confirmatory reanalysis of incurred bioanalytical samples. AAPS J. 2007;9(3):E336–43.

    PubMed  Article  CAS  Google Scholar 

  6. Thway T, Macaraeg CR, et al. Bioanalytical method requirements and the statistical considerations in incurred sample reanalysis for macromolecules. Bioanalysis. 2010;2(9):1587–96.

    PubMed  Article  CAS  Google Scholar 

  7. DeSilva B, Smith W, Weiner R, et al. Recommendations for the bioanalytical method validation of ligand-binding assays to support pharmacokinetic assessments of macromolecules. Pharm Res. 2003;20:1885–900.

    PubMed  Article  CAS  Google Scholar 

  8. Thway T, Macaraeg CR, et al. Application of a planar electrochemiluminescence platform to support regulated studies of macromolecules: benefits and limitations in assay range. J Pharm Biomed Anal. 2010;51:626–32.

    PubMed  Article  CAS  Google Scholar 

Download references

ACKNOWLEDGMENTS

Financial support for this study was provided by Amgen Inc. We would like to thank Ramak Pourvasei, Jennifer Tsoi, Kinnari Pandya, Laura Brunner, Jessica Manlongat, Liana Zhang, Judy Shih, Lennie Uy, Danielle DeSimone, Teresa Wong, and Beth Johnson for their contributions to preclinical and clinical studies. We also thank Dr. Michael Hall (Amgen Inc.) for critical review of the manuscript and Scott Silbiger (Amgen Inc.) for editorial support.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Theingi M. Thway.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Thway, T.M., Eschenberg, M., Calamba, D. et al. Assessment of Incurred Sample Reanalysis for Macromolecules to Evaluate Bioanalytical Method Robustness: Effects from Imprecision. AAPS J 13, 291–298 (2011). https://doi.org/10.1208/s12248-011-9271-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1208/s12248-011-9271-z

KEY WORDS

  • incurred sample reanalysis
  • LBA
  • sample size selection
  • statistical analysis
  • total error