Abstract
Background
High mammographic density was an independent risk factor for breast cancer and has a higher associated risk than most other known risk factors. The reproducibility remains a major issue in assessment of breast parenchymal patterns. Misclassification of mammographic pattern can lead to significant underestimation of risk estimates. The purpose of this study was to assess the inter-rater and intra-rater reliability based on visual subjective mammographic density measurements.
Method
Three density measures, Wolfe parenchymal pattern, Boyd classification scale, and a percentage of densities in total breast, were investigated. The study included 101 women who were participants of the International Breast Cancer Intervention Study I (IBIS I) for up to 7 years. Seven sets of mammograms were collected for each woman. Left breast mediolateral oblique films were digitized, and the scanned images were independently reviewed by two readers. These images were reassessed by one reader after a year. The agreements of measures were evaluated by Kappa statistics (Wolfe and Boyd scale) and intraclass correlation coefficient (percentage densities).
Results
For the inter-rater agreement, Weighted Kappa for Wolfe scale was 0.89 (P < 0.0001) and for Boyd scale was 0.84 (P < 0.0001). The intraclass correlation coefficient was 0.94 for percentage densities. For the intra-rater agreement, Weighted Kappa for Wolfe scale was 0.87 (P < 0.0001) and for Boyd scale was 0.86 (P < 0.0001). The intraclass correlation coefficient was 0.96 for percentage densities.
Conclusion
The study concludes that both visual qualitative and quantitative measurements on mammographic density are highly reproducible in the breast cancer research studies if appropriate training is provided. The method is appropriate for risk assessment in a prevention trial.
Similar content being viewed by others
References
Harvey JA, Bovbjerg VE (2004) Quantitative assessment of mammographic breast density: relationship with breast cancer risk. Radiology 230(1):29–41
Boyd NF, Lockwood GA, Byng JW, Tritchler DL, Yaffe MJ (1998) Mammographic densities and breast cancer risk. Cancer Epidemiol Biomarkers Prev 7(12):1133–1144
Byrne C, Schairer C, Wolfe J, Parekh N, Salane M, Brinton LA, Hoover R, Haile R (1995) Mammographic features and breast cancer risk: effects with time, age, and menopause status. J Natl Cancer Inst 87(21):1622–1629
Brisson J, Morrison AS, Khalid N (1988) Mammographic parenchymal features and breast cancer in the breast cancer detection demonstration project. J Natl Cancer Inst 80(19):1534–1540
Rossouw JE, Anderson GL, Prentice RL, LaCroix AZ, Kooperberg C, Stefanick ML, Jackson RD, Beresford SA, Howard BV, Johnson KC et al (2002) Risks and benefits of estrogen plus progestin in healthy postmenopausal women: principal results From the Women’s Health Initiative randomized controlled trial. Jama 288(3):321–333
Warren R (2004) Hormones and mammographic breast density. Maturitas 49(1):67–78
Cuzick J, Warwick J, Pinney E, Warren RM, Duffy SW (2004) Tamoxifen and breast density in women at increased risk of breast cancer. J Natl Cancer Inst 96(8):621–628
Grove JS, Goodman MJ, Gilbert FI Jr, Russell H (1985) Wolfe’s mammographic classification and breast cancer risk: the effect of misclassification on apparent risk ratios. Br J Radiol 58(685):15–19
Wolfe JN, Saftlas AF, Salane M (1987) Mammographic parenchymal patterns and quantitative evaluation of mammographic densities: a case-control study. AJR Am J Roentgenol 148(6):1087–1092
Byng JW, Yaffe MJ, Jong RA, Shumak RS, Lockwood GA, Tritchler DL, Boyd NF (1998) Analysis of mammographic density and breast cancer risk from digitized mammograms. Radiographics 18(6):1587–1598
Wolfe JN (1976) Breast patterns as an index of risk for developing breast cancer. AJR Am J Roentgenol 126(6):1130–1137
Boyd NF, Byng JW, Jong RA, Fishell EK, Little LE, Miller AB, Lockwood GA, Tritchler DL, Yaffe MJ (1995) Quantitative classification of mammographic densities and breast cancer risk: results from the Canadian National Breast Screening Study. J Natl Cancer Inst 87(9):670–675
Toniolo P, Bleich AR, Beinart C, Koenig KL (1992) Reproducibility of Wolfe’s classification of mammographic parenchymal patterns. Prev Med 21(1):1–7
Carlile T, Thompson DJ, Kopecky KJ, Gilbert FI, Krook PM, Present AJ, Russell HW, Threatt BA (1983) Reproducibility and consistency in classification of breast parenchymal patterns. AJR Am J Roentgenol 140(1):1–7
Boyd NF, O’Sullivan B, Campbell JE, Fishell E, Simor I, Cooke G, Germanson T (1982) Bias and the association of mammographic parenchymal patterns with breast cancer. Br J Cancer 45(2):179–184
Moskowitz M, Gartside P, McLaughlin C (1980) Mammographic patterns as markers for high-risk benign breast disease and incident cancers. Radiology 134(2):293–295
Boyd NF, Wolfson C, Moskowitz M, Carlile T, Petitclerc C, Ferri HA, Fishell E, Gregoire A, Kiernan M, Longley JD et al (1986) Observer variation in the classification of mammographic parenchymal patterns. J Chronic Dis 39(6):465–472
Threatt B, Norbeck JM, Ullman NS, Kummer R, Roselle P (1980) Association between mammographic parenchymal pattern classification and incidence of breast cancer. Cancer 45(10):2550–2556
Jong R, Fishell E, Little L, Lockwood G, Boyd NF (1996) Mammographic signs of potential relevance to breast cancer risk: the agreement of radiologists’ classification. Eur J Cancer Prev 5(4):281–286
Lee-Han H, Cooke G, Boyd NF (1995) Quantitative evaluation of mammographic densities: a comparison of methods of assessment. Eur J Cancer Prev 4(4):285–292
Cuzick J, Forbes J, Edwards R, Baum M, Cawthorn S, Coates A, Hamed A, Howell A, Powles T (2002) First results from the International Breast Cancer Intervention Study (IBIS-I): a randomised prevention trial. Lancet 360(9336):817–824
Brennan P, Silman A (1992) Statistical methods for assessing observer variability in clinical measures. Bmj 304(6840):1491–1494
Bartko JJ (1966) The intraclass correlation coefficient as a measure of reliability. Psychol Rep 19(1):3–11
Saftlas AF, Hoover RN, Brinton LA, Szklo M, Olson DR, Salane M, Wolfe JN (1991) Mammographic densities and risk of breast cancer. Cancer 67(11):2833–2838
Prevrhal S, Shepherd JA, Smith-Bindman R, Cummings SR, Kerlikowske K (2002) Accuracy of mammographic breast density analysis: results of formal operator training. Cancer Epidemiol Biomarkers Prev 11(11):1389–1393
Acknowledgements
We thank David MacMillan for his help with the collection of mammograms. We also gratefully thank the women who have participated in the study.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gao, J., Warren, R., Warren-Forward, H. et al. Reproducibility of visual assessment on mammographic density. Breast Cancer Res Treat 108, 121–127 (2008). https://doi.org/10.1007/s10549-007-9581-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10549-007-9581-0