Summary
Adopting novel biomarkers for use in prostate cancer screening requires rigorous scientific evaluation. The predictive accuracy of the markers must be quantified and compared with other potential markers. In this chapter we focus on the statistical approaches commonly used for evaluating biomarkers in the context of early detection for prostate cancer. We cover statistical methods for estimating accuracy summaries for both disease classification and risk prediction, including the true positive fraction (TPF), false positive fraction (FPF), positive predictive value (PPV), negative predictive value (NPV), receiver-operating characteristic (ROC) curve, and predictiveness curve. We also provide methods for combining multiple biomarker tests and comparing biomarkers. An example from the San Antonio Center of Biomarkers Of Risk for Prostate Cancer (SABOR) cohort is used to illustrate these methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Thompson, I.M., Pauler, D.K., Goodman, P.J., Tangen, C.M., Lucia, S.M., Parnes, H.L., Minasian, L.M., Ford, L.G., Lippman, S.M., Crawford, E.D., Crowley, J.J., and Coltman, C.A., Jr. (2004) Prevalence of prostate cancer among men with a prostate-specific antigen level ≥ 4.0 ng per milliliter New England Journal of Medicine 350, 2239–46.
Thompson I.M., Ankerst D.P., Chi C., Lucia M.S., Goodman P., Crowley J.J., Parnes H.L., and Coltman C.A., Jr. (2005) The operating characteristics of prostate-specific antigen in a population with initial PSA of 3.0 ng/ml or lower Journal of the American Medical Association 294, 66–70.
Thompson, I.M., Ankerst, D.P., Chi, C., Goodman, P.J., Tangen, C.M., Lucia, M.S., Feng, Z., Parnes, H.L., and Coltman, C.A., Jr. (2006) Assessing prostate cancer risk: Results from the Prostate Cancer Prevention Trial Journal of the National Cancer Institute 98, 529–34.
Parekh, D.J., Ankerst D.P., Higgins, B.A., Hernandez, J., Canby-Hagino, E., Brand, T., Troyer, D.A., Leach, R.J., and Thompson, I.M. (2006) External validation of the Prostate Cancer Prevention Trial Risk Calculator in a screened populationUrology 68, 1153–55.
Pepe, M.S. (2003) The statistical evaluation of medical tests for classification and prediction Oxford University Press (Oxford).
Swets, John A. and Pickett, Ronald M. (1982) Evaluation of diagnostic systems: Methods from signal detection theory Academic Press (New York; London).
Hanley, J.A. (1989) Receiver operating characteristic (ROC) methodology: The state of the art Critical Reviews in Diagnostic Imaging, 29, 307–35.
Begg, Colin B. (1991) Advances in statistical methodology for diagnostic medicine in the 1980’s Statistics in Medicine 10, 1887–95.
Zweg, M.H. and Campbell, G. (1993) Receiver-operating characteristic (ROC) plots: A fundamental evaluation tool in clinical medicine Clinical Chemistry 39, 561–77.
DeLong E.R., DeLong D.M., and Clarke-Pearson D.L. (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach Biometrics 44, 837–45.
Efron, B. and Tibshirani, R. (1993) An introduction to the bootstrap Chapman & Hall Ltd (London; New York).
Swets, J.A. (1986) Indices of discrimination or diagnostic accuracy: Their ROCs and implied models Psychological Bulletin, 99, 100–117.
Hanley, J.A. (1996) The use of the ‘binormal’ model for parametric ROC analysis of quantitative diagnostic tests Statistics in Medicine, 15, 1575–85.
Metz, C.E., Herman, B.A., and Shen, J. (1998) Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously-distributed data Statistics in Medicine 17 , 1033–53.
Cai, T. and Moskowitz, C. (2004) Semiparametric Estimation of the Binormal ROC Curve Biostatistics 5, 573–86.
Pepe, M.S. (1997) A regression modelling framework for receiver operating characteristic curves in medical diagnostic testing Biometrika 84 , 595–608.
Pepe, M.S. (2000) An interpretation for the ROC curve and inference using GLM procedures Biometrics 56 , 352–59.
Zheng, Y. and Heagerty, P. (2004) Semi-parametric regression quantile methods for ROC analysis Biostatistics 5, 615–32.
Alonzo, T.A. and Pepe, M.S. (2002) Distribution-free ROC analysis using binary regression techniques Biostatistics 3, 421–32.
Pepe, M.S. and Cai, T. (2004) The analysis of placement values for evaluating discriminatory measures Biometrics 60, 528–35.
Janes, H. and Pepe, M.S. (2008) Matching in studies of classification accuracy: Implications for bias, efficiency, and assessment of incremental value Biometrics 64, 1–9.
Pepe, M.S., Etzioni, R, Feng, Z, Potter, J.D., Thompson, M.L., Thornquist, M., Winget, M., and Yasui, Y. (2001) Phases of biomarker development for early detection of cancer Journal of the National Cancer Institute 93, 1054–61.
Moskowitz, C.S. and Pepe, M.S. (2004) Quantifying and comparing the predictive accuracy of continuous prognostic factors for binary outcomes Biostatistics 5, 113–27.
Gail, M.H. and Pfeiffer, R.M. (2005) On criteria for evaluating models of absolute risk Biostatistics 6, 227–239.
Cook, N. (2007) Use and misuse of the receiver operating characteristic curve in risk prediction Circulation 115, 928–35.
Pepe, M.S., Feng, Z., Huang, Y, Longton, G., Prentice, R., Thompson, I.M., and Zheng, Y. (2007) Integrating the Predictiveness of a Marker with its Performance as a Classifier. Technical Report 283, UW biostatistics Working Paper Series. Available at: http://www.bepress.com/uwbiostat/paper289.
Cook, N.R., Buring, J.E., and Ridker, P.M. (2006) The effect of including C-reactive protein in cardiovascular risk prediction models for women. Annals of Internal Medicine 145, 21–9.
Wang, X., Yu, J., and Sreekumar, A. et al. (2005) Autoantibody signatures in prostate cancer N Engl J Med 353, 1224–35.
Baker, S.G. (2000) Identifying combinations of cancer markers for further study as triggers of early intervention, Biometrics 56, 1082–7.
McIntosh, M.W. and Pepe, M.S. (2002) Combining several screening tests: Optimality of the risk score Biometrics, 58, 657–64.
Pepe, M.S., Cai, T., and Longton, G. (2006) Combining predictors for classification using the area under the ROC curve, Biometrics 62, 221–9.
Copas, J.B. and Corbett, P. (2002) Overestimation of the receiver operating characteristic curve for logistic regression Biometrika 89, 315–31.
Tian, L., Cai, T., Goetghebeur E., and Wei, L.J. (2007) Model Evaluation Based on the Distribution of Estimated Absolute Prediction Error Biometrika 94, 297–311.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Humana Press, a part of Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Zheng, Y., Ankerst, D.P. (2009). Statistical Evaluation of Markers and Risk Tools for Prostate Cancer Classification and Prediction. In: Ankerst, D.P., Tangen, C.M., Thompson, I.M. (eds) Prostate Cancer Screening. Current Clinical Urology. Humana Press. https://doi.org/10.1007/978-1-60327-281-0_22
Download citation
DOI: https://doi.org/10.1007/978-1-60327-281-0_22
Publisher Name: Humana Press
Print ISBN: 978-1-60327-280-3
Online ISBN: 978-1-60327-281-0
eBook Packages: MedicineMedicine (R0)