Fit-for-Purpose Method Development and Validation for Successful Biomarker Measurement
Despite major advances in modern drug discovery and development, the number of new drug approvals has not kept pace with the increased cost of their development. Increasingly, innovative uses of biomarkers are employed in an attempt to speed new drugs to market. Still, widespread adoption of biomarkers is impeded by limited experience interpreting biomarker data and an unclear regulatory climate. Key differences preclude the direct application of existing validation paradigms for drug analysis to biomarker research. Following the AAPS 2003 Biomarker Workshop (J. W. Lee, R. S. Weiner, J. M. Sailstad, et al. Method validation and measurement of biomarkers in nonclinical and clinical samples in drug development. A conference report. Pharm Res 22:499–511, 2005), these and other critical issues were addressed. A practical, iterative, “fit-for-purpose” approach to biomarker method development and validation is proposed, keeping in mind the intended use of the data and the attendant regulatory requirements associated with that use. Sample analysis within this context of fit-for-purpose method development and validation are well suited for successful biomarker implementation, allowing increased use of biomarkers in drug development.
Key Wordsassay validation biomarkers drug development fit-for-purpose method development and validation
American Association of Pharmaceutical Sciences
below quantifiable limit
Center for Drug Evaluation and Research
Centers for Medicare and Medicaid Services
Clinical Ligand Assay Society
Clinical Laboratory Improvement Amendments
Clinical and Laboratory Standards Institute
Good Laboratory Practices
Ligand Binding Assay Bioanalytical Focus Group
lower limit of detection
lower limit of quantification
minimum required dilution
National Committee for Clinical Laboratory Standards
upper limit of quantification
vascular endothelial growth factor
The authors are grateful to Ronald R. Bowsher, PhD (Linco Diagnostic Services), for providing encouragement and critical review on the manuscript. We also thank Wesley Tanaka, PhD, and Omar Laterza, PhD (Merck & Co.) for providing input and suggestions.
GlossaryThe following definitions are meant to be valid in the context of bioanalytical methods. Not all definitions will be consistent with terminology from other disciplines
Per the FDA Guidance on Bioanalytical Method Validation (May, 2001), Accuracy of an analytical method describes the closeness of mean test results obtained by the method to the true value (concentration) of the analyte. This is sometimes referred to as Trueness or Bias.
A method validation that requires more rigor and thorough investigation, both in validation tasks and documentation, to support pivotal studies or critical decisions; e.g., differentiating subtle graded drug effects, monitoring drug safety, or for submission to regulatory agencies for drug approval.
A characteristic that is objectively measured and evaluated as an indicator of normal biologic processes, pathogenic processes, or pharmacologic response to a therapeutic intervention.
A characteristic or variable that reflects how a patient feels, functions, or survives.
The evidentiary and statistical process linking biologic, pathologic and clinical endpoints to the drug effect, or linking a biomarker to biologic and/or clinical endpoints.
An assay with well-characterized reference standards, which represents the endogenous biomarker, and uses a response–concentration standardization function to calculate the absolute quantitative values for unknown samples.
A test to demonstrate that the analyte of interest, when present in concentrations above the range of quantification, can be diluted to bring the analyte concentrations into the validated range for analysis by the method. Samples used for this test are, in general, the ones containing high concentrations of spiked analyte, not endogenous analyte.
The range of the assay that is demonstrated from the prestudy validation experiments to be reliable for quantifying the analyte levels with acceptable levels of bias, precision, and total error.
Method validation that is less rigorous but adequate to meet study needs; e.g., looking for big effects in drug candidate screen, mechanism exploration, or internal decision with relatively minor impact to the final product, and not used for submission to regulatory agencies.
(1) Analytical interference: presence of entities in samples that causes a difference in the measured concentration from the true value. (2) Physicochemical interference (matrix interference): A change in measured physical chemical property of the specimen (e.g., excess bilirubin or hemoglobin, ionic strength, and pH) that causes a difference between the population mean and an accepted reference value.
Closeness of agreement of results measured under changed operating conditions within a laboratory; e.g., different runs, analysts, equipments, or plates, etc. This is one of the three types of Precision.
A concentration resulting in a signal that is significantly different (higher or lower) from that of background. Limit of detection is commonly calculated from mean signal at background ± 2 or 3 standard deviations. This is often described as the analytical “sensitivity” of the assay in a diagnostic kit.
Highest and lowest concentrations of analyte that have been demonstrated to be measurable with acceptable levels of bias, precision, and total error. The highest concentration is termed the Upper Limit of Quantification, and the lowest concentration is termed the Lower Limit of Quantification.
The minimum dilution required to dilute out matrix interference in the sample for acceptable analyte recovery.
Relative accuracy from recovery tests on the biological matrix, incurred study samples, or diluted matrix against the calibrator calibrators in a substitute matrix. It is commonly assessed with multiple dilutions of actual study samples or samples that represent the same matrix and analyte combination of the study samples.
The relationship between drug concentrations and biochemical and physiological effects of drugs and mechanisms of drug action.
Precision is a quantitative measure (usually expressed as standard deviation and coefficient of variation) of the random variation between a series of measurements from multiple sampling of the same homogenous sample under the prescribed conditions. If it is not possible to obtain a homogenous sample, it may be investigated using artificially prepared samples or a sample solution. Precision may be considered at three levels: 1. Repeatability, 2. Intermediate Precision, and 3. Reproducibility.
A plot of the coefficient of variation of the calibrated concentration vs. the concentration in log scale. It provides preliminary estimates of the quantification limits and feasibility assessments on the intended range.
A set of stable pools of analyte, prepared in the intended biological matrix with concentrations that span the range claimed for the test method, used in each sample assay run to monitor assay performance for batch acceptance.
The assay readout does not have a continuous proportionality relationship to the amount of analyte in a sample; the data is categorical in nature. Data may be nominal (positive or negative) such as presence or absence of a gene or gene product. Alternatively, data might be ordinal, with discrete scoring scales (1 to 5, −+, +++, etc.), such as immunohistochemistry assays.
(Quasi: “possesses certain attributes”) A method that has no calibrator, has a continuous response, and the analytical result is expressed in terms of a characteristic of the test sample. An example would be an antidrug antibody assay that is express as titer or % bound.
A method which uses calibrators with a response–concentration calibration function to calculate the values for unknown samples. The quantification is considered relative because the reference standard is either not well characterized, not available in a pure form, or is not fully representative of the endogenous biomarker.
For relative quantitative methods, absolute accuracy is not possible to evaluate due to the unknown nature of the endogenous biomarker. Relative accuracy is the recovery (see below) of the reference standard spiked into the study matrix.
The quantified closeness of an observed result to its theoretical true value, expressed as a percent of the nominal (theoretical) concentration. Recovery is often used as a measure of accuracy.
Closeness of agreement between results of successive measurements of the same samples carried out in the same laboratory under the same operating condition within short intervals of time. It is also termed intraassay or intrabatch precision. This is one of the three types of Precision.
Closeness of agreement of results measured under significantly changed conditions; e.g., inter laboratory, alternate vendor of a critical reagent. This is also referred to as cross validation.
A measure of the capacity of a method to remain unaffected by small, but deliberate changes in method parameters and provides an indication of its reliability during normal run conditions.
The ability of a method to determine the analyte unequivocally in the presence of components that may be expected to be present in the sample.
The lowest concentration of analyte that an analytical method can reliably differentiate from background (limit of detection).
The ability of assay reagents (e.g., antibody) to distinguish between the analyte, to which the reagents are intended to detect, and other components.
A biomarker that is intended to substitute for a clinical endpoint. A surrogate endpoint is expected to predict clinical benefit or harm (or lack of benefit or harm) based on epidemiologic, therapeutic, pathophysiologic, or other scientific evidence.
Range of analyte concentrations where the study samples are expected to fall.
The sum of all systematic bias and variance components that affect a result; i.e., the sum of the absolute value of the Bias and Intermediate Precision. This reflects the closeness of the test results obtained by the analytical method to the true value (concentration) of the analyte.
It is the confirmation via extensive laboratory investigations that the performance characteristics of an assay are suitable and reliable for its intended analytical use. It describes in mathematical and quantifiable terms the performance characteristics of an assay.
Test samples in biological matrix mimicking study samples, endogenous and/or spiked, used in prestudy validation to provide characterizations of assay performances; e.g., intra- and inter-run accuracy and precision, and analyte stability.
- 4.FDA Mar 2004 report. Innovation or Stagnation? Challenge and opportunity on the critical path to new medical products. Available at http://www.fda.gov/oc/initiatives/criticalpath/.Google Scholar
- 6.Downing, G. J. eds. 2000Biomarkers and surrogate endpoints: clinical research and applications. Proceedings of the NIH–FDA Conference held on April 15–16, 1999ElsevierNew YorkGoogle Scholar
- 8.Peck, C. C., Barr, W. H., Benet, L. Z., et al. 1992Opportunities for integration of pharmacokinetics, pharmacodynamics, and toxicokinetics in rational drug developmentPharm. Sci.81600610Google Scholar
- 11.Guidance for industry on bioanalytical method validation: availability. Fed. Regist. 66:28526–28527 (2001).Google Scholar
- 12.Code of Federal Regulations, Title 21, Vol. 1. Good Laboratory Practice for Nonclinical Laboratory Studies. Revised April 1, 2001.Google Scholar
- 13.Code of Federal Regulations, Title 42, Vol. 3. Clinical Laboratory Improvement Amendment. Revised October 1, 2001.Google Scholar
- 14.National Committee for Clinical Laboratory Standards (CLSI), Document EP5-A: Evaluation of Precision Performance of Clinical Chemistry Devices: Approved Guideline. 1999. Document EP6-P: Evaluation of the Linearity of Quantitative Analytical Method: Proposed Guideline. 1986. Document EP7-P: Interference Testing in Clinical Chemistry: Proposed Guideline. 1986. Document EP9-A: Method Comparison and Bias Estimation Using Patient Samples: Approved Guideline. 1995.Google Scholar
- 15.Biomarkers Definitions Working Group, Biomarkers and surrogate endpoints: preferred definitions and conceptual framework. Clin. Pharmacol. Ther. 69:89–95 (2001).Google Scholar
- 17.J. A. Wagner. Bridging preclinical and clinical development: biomarker validation and qualification, in R. Krishna and D. Howard (eds.), Dose Optimization in Drug Development, Marcel Dekker, New York, in press.Google Scholar
- 18.Lee, J. W., Smith, W. C., Nordblom, G. D., Bowsher, R. R. 2003
Validation of assays for the bioanalysis of novel biomarkersBloom, C.Dean, R. A. eds. Biomarkers in Clinical Drug DevelopmentMarcel DekkerNew York119149Google Scholar
- 21.Shah, V. P., Midha, K. K., Dighe, S., et al. 1992Analytical methods validation: bioavailability, bioequivalence, and pharmacokinetic studiesPharm. Res.9588592Google Scholar
- 22.ICH Guidelines, Text on validation of analytical procedures, Q2A; International Conference on Harmonization, Geneva, Switzerland, 1994.Google Scholar
- 24.Ray, C. A., Bowsher, R. R., Smith, W. C., et al. 2001Development, validation and implementation of a multiplex immunoassay for the simultaneous determination of five cytokines in human serumJ. Pharm. Biomed. Anal.3610371044Google Scholar
- 26.Feinber, M., Boulanger, B., Dewe, W., et al. 2004New advances in method validation and measurement uncertainty aimed at improving the quality of clinical dataAnal. Bioanal. Chem.380502514Google Scholar
- 27.Rogers, J. A. 2005Statistical limits for assessment of accuracy and precision in immunoassay validation: a reviewJ. Clin. Ligand Assay27256261Google Scholar
- 28.C. A. Ray, C. Dumaual, and M Willey, et al. Optimization of analytical and pre-analytical variables associated with an ex vivo cytokine secretion assay. J. Pharm. Biomed. Anal., In press.Google Scholar
- 29.Carroll, R. J., Ruppert, D. 1988Transformation and Weighting in RegressionChapman & HallNew YorkGoogle Scholar