Skip to main content

Making Sense of Cancer Risk Calculators on the Web

Journal of General Internal Medicine volume 23, pages 229–235 (2008)Cite this article

Objective

Cancer risk calculators on the internet have the potential to provide users with valuable information about their individual cancer risk. However, the lack of oversight of these sites raises concerns about low quality and inconsistent information. These concerns led us to evaluate internet cancer risk calculators.

Design

After a systematic search to find all cancer risk calculators on the internet, we reviewed the content of each site for information that users should seek to evaluate the quality of a website. We then examined the consistency of the breast cancer risk calculators by having 27 women complete 10 of the breast cancer risk calculators for themselves. We also completed the breast cancer risk calculators for a hypothetical high- and low-risk woman, and compared the output to Surveillance Epidemiology and End Results estimates for the average same-age and same-race woman.

Results

Nineteen sites were found, 13 of which calculate breast cancer risk. Most sites do not provide the information users need to evaluate the legitimacy of a website. The breast cancer calculator sites vary in the risk factors they assess to calculate breast cancer risk, how they operationalize each risk factor and in the risk estimate they provide for the same individual.

Conclusions

Internet cancer risk calculators have the potential to provide a public health benefit by educating individuals about their risks and potentially encouraging preventive health behaviors. However, our evaluation of internet calculators revealed several problems that call into question the accuracy of the information that they provide. This may lead the users of these sites to make inappropriate medical decisions on the basis of misinformation.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

43,34 €

Price includes VAT (Finland)
Tax calculation will be finalised during checkout.

References

  1. Viswanath K. Science and society: the communications revolution and cancer control. Nat Rev Cancer. 2005;5(10):828–35.

    PubMed  Article  CAS  Google Scholar 

  2. Armstrong K, Eisen A, Weber B. Assessing the risk of breast cancer. N Engl J Med. 2000;342(8):564–71.

    PubMed  Article  CAS  Google Scholar 

  3. Gail MH, Brinton LA, Byar DP, et al. Projecting individualized probabilities of developing breast cancer for white females who are being examined annually. J Natl Cancer Inst. 1989;81:1879–86.

    PubMed  Article  CAS  Google Scholar 

  4. Costantino JP, Gail MH, Pee D, et al. Validation studies for models projecting the risk of invasive and total breast cancer incidence. J Natl Cancer Inst. 1999;91(18):1541–8.

    PubMed  Article  CAS  Google Scholar 

  5. Bondy ML, Newman LA. Assessing breast cancer risk: evolution of the Gail Model. J Natl Cancer Inst. 2006;98(17):1172–3.

    PubMed  Google Scholar 

  6. Barlow WE, White E, Ballard-Barbash R, et al. Prospective breast cancer risk prediction model for women undergoing screening mammography. J Natl Cancer Inst. 2006;98(17):1204–14.

    PubMed  Google Scholar 

  7. Bach PB, Kattan MW, Thornquist MD, et al. Variations in lung cancer risk among smokers. J Natl Cancer Inst. 2003;95(6):470–8.

    PubMed  Google Scholar 

  8. Thompson IM, Ankerst DP, Chi C, et al. Assessing prostate cancer risk: results from the Prostate Cancer Prevention Trial. J Natl Cancer Inst. 2006;98(8):529–34.

    PubMed  Article  Google Scholar 

  9. Impicciatore P, Pandolfini C, Casella N, et al. Reliability of health information for the public on the World Wide Web: systematic survey of advice on managing fever in children at home. BMJ. 1997;314(7098):1875–9.

    PubMed  CAS  Google Scholar 

  10. Allen JW, Finch RJ, Coleman MG, et al. The poor quality of information about laparoscopy on the World Wide Web as indexed by popular search engines. Surg Endosc. 2002;16(1):170–2.

    PubMed  Article  CAS  Google Scholar 

  11. Eysenbach G, Powell J, Kuss O, et al. Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review. JAMA. 2002;287(20):2691–700.

    PubMed  Article  Google Scholar 

  12. McLeod S. The quality of medical information on the internet: a new public health concern. Arch Ophthalmol. 1998;116:1663–5.

    PubMed  CAS  Google Scholar 

  13. Benigeri M, Pluye P. Shortcomings of health information on the internet. Health Promot Int. 2003;18(4):381–6.

    PubMed  Article  Google Scholar 

  14. Theodosiou L, Green J. Emerging challenges in using health information from the internet. Adv Psychiatr Treat. 2003;9:387–96.

    Article  Google Scholar 

  15. Robinson T, Patrick K, Eng T, et al. An evidence-based approach to enteractive health communication. J Am Med Assoc. 1998;280(14):1264–9.

    Article  CAS  Google Scholar 

  16. Ademiluyi G, Rees CE, Sheard CE. Evaluating the reliability and validity of three tools to assess the quality of health information on the Internet. Patient Educ Couns. 2003;50(2):151–5.

    PubMed  Google Scholar 

  17. Ekman A, Hall P, Litton JE. Can we trust cancer information on the Internet?—a comparison of interactive cancer risk sites. Cancer Causes Control. 2005;16(6):765–72.

    PubMed  Article  Google Scholar 

  18. Freedman AN, Seminara D, Gail MH, et al. Cancer risk prediction models: a workshop on development, evaluation, and application. J Natl Cancer Inst. 2005;97(10):715–23.

    PubMed  Google Scholar 

  19. Berkey CS, Frazier AL, Gardner JD, et al. Adolescence and breast carcinoma risk. Cancer. 1999;85(11):2400–9.

    PubMed  Article  CAS  Google Scholar 

  20. Sweeney C, Blair CK, Anderson KE, et al. Risk factors for breast cancer in elderly women. Am J Epidemiol. 2004;160(9):868–75.

    PubMed  Article  Google Scholar 

  21. Lagiou A, Lagiou P, Vassilarou DS, et al. Comparison of age at first full-term pregnancy between women with breast cancer and women with benign breast diseases. Int J Cancer. 2003;107(5):817–21.

    PubMed  Article  CAS  Google Scholar 

  22. Helewa M, Levesque P, Provencher D, et al. Breast cancer, pregnancy, and breastfeeding. J Obstet Gynaecol Canada. 2002;24(2):164–80.

    Google Scholar 

  23. Newcomb PA, Egan KM, Titus-Ernstoff L, et al. Lactation in relation to postmenopausal breast cancer. Am J Epidemiol. 1999;150(2):174–82.

    PubMed  CAS  Google Scholar 

  24. Silvera SA, Miller AB, Rohan TE. Oral contraceptive use and risk of breast cancer among women with a family history of breast cancer: a prospective cohort study. Cancer Causes Control. 2005;16(9):1059–63.

    PubMed  Article  Google Scholar 

  25. Grabrick DM, Hartmann LC, Cerhan J, et al. Risk of breast cancer with oral contraceptive use in women with a family history of breast cancer. JAMA. 2000;284(14):1791–8.

    PubMed  Article  CAS  Google Scholar 

  26. Pesch B, Ko Y, Brauch H, et al. Factors modifying the association between hormone-replacement therapy and breast cancer risk. Eur J Epidemiol. 2005;20(8):699–711.

    PubMed  Article  Google Scholar 

  27. Hartmann LC, Sellers TA, Frost MH, et al. Benign breast disease and the risk of breast cancer. N Engl J Med. 2005;353(3):229–37.

    PubMed  Article  CAS  Google Scholar 

  28. Malin AS, Qi D, Shu XO, et al. Intake of fruits, vegetables and selected micronutrients in relation to the risk of breast cancer. Int J Cancer. 2003;105(3):413–8.

    PubMed  Article  CAS  Google Scholar 

  29. Gandini S, Merzenich H, Robertson C, et al. Meta-analysis of studies on breast cancer risk and diet: the role of fruit and vegetable consumption and the intake of associated micronutrients. Eur J Cancer. 2000;36(5):636–46.

    PubMed  Article  CAS  Google Scholar 

  30. Rubinstein WS. Hereditary breast cancer in Jews. Familial Cancer. 2004;3(3–4):249–57.

    PubMed  Article  CAS  Google Scholar 

  31. Terry KL, Willett WC, Rich-Edwards JW, et al. Menstrual cycle characteristics and incidence of premenopausal breast cancer. Cancer Epidemiol Biomark Prev. 2005;14(6):1509–13.

    Article  Google Scholar 

  32. Terry MB, Zhang FF, Kabat G, et al. Lifetime alcohol intake and breast cancer risk. Ann Epidemiol. 2006;16(3):230–40.

  33. National Cancer Institute. SEER cancer statistics review: 1973–1992. Maryland: National Cancer Institute; 1995.

    Google Scholar 

  34. American Cancer Society. Statistics for 2007. http://www.cancer.org/docroot/STT/stt_0.asp. Cited May 29, 2007.

  35. Calle EE, Rodriguez C, Walker-Thurmond K, et al. Overweight, obesity, and mortality from cancer in a prospectively studied cohort of U.S. adults. N Engl J Med. 2003;348(17):1625–38.

    PubMed  Article  Google Scholar 

  36. Ross JA, Parker E, Blair CK, et al. Body mass index and risk of leukemia in older women. Cancer Epidemiol Biomark Prev. 2004;13(11 Pt 1):1810–3.

    Google Scholar 

  37. Gillois P, Colombet I, Dreau H, et al. A critical appraisal of the use of Internet for calculating cardiovascular risk. Proc AMIA Symp. 1999;775–9.

  38. Chen X, Siu LL. Impact of the media and the internet on oncology: survey of cancer patients and oncologists in Canada. J Clin Oncol. 2001;19(23):4291–7.

    PubMed  CAS  Google Scholar 

  39. HarrisInteractive. 4-County survey finds most cyberchondriacs believe online health care information is trustworthy, easy to find and understand. http://www.harrisinteractive.com/news/allnewsbydate.asp? NewsID=464; 2002.

  40. Fox S, Rainie L. Vital decisions. How Internet users decide what information to trust when they or their loved ones are sick. Pew Internet and American Life Project; May 22, 2002.

  41. NCI. Breast cancer risk assessment tool. Bethesda, MD: National Cancer Institute Office of Communications; 1998.

    Google Scholar 

Download references

Acknowledgment

The authors are grateful to Sanghamitra Savadatti, Nicole Maddox, and the participants in the study.

Conflict of Interest

None disclosed.

Author information

Affiliations

  1. Center for Community-Based Research, Dana-Farber Cancer Institute, 44 Binney St, LW 618, Boston, MA, 02115, USA

    Andrea Gurmankin Levy PhD, MBe

  2. Department of Society, Human Development and Health, Harvard School of Public Health, Boston, MA, USA

    Andrea Gurmankin Levy PhD, MBe

  3. School of Medicine, University of Pennsylvania, Philadelphia, PA, USA

    Seema S. Sonnad PhD, Jibby E. Kurichi, Melani Sherman BA & Katrina Armstrong MD, MSCe

  4. Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, USA

    Seema S. Sonnad PhD & Katrina Armstrong MD, MSCe

  5. Abramson Cancer Center, University of Pennsylvania, School of Medicine, Philadelphia, PA, USA

    Katrina Armstrong MD, MSCe

Authors
  1. Andrea Gurmankin Levy PhD, MBe
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Seema S. Sonnad PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jibby E. Kurichi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Melani Sherman BA
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Katrina Armstrong MD, MSCe
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andrea Gurmankin Levy PhD, MBe.

Additional information

The manuscript and data have not been published previously and are not under consideration for publication elsewhere. This research did not have financial support from any source.

Electronic supplementary material

Below is the linked to the electronic supplementary material.

ESM 1 Comparison of breast cancer risk calculators’ output for all subjects (DOC 125 kb)

Appendices

Appendix 1: Risk factors of the hypothetical high and low breast cancer risk women

The high-risk patient is a 55-year-old, 5′2″, 150-lb Jewish woman who smokes. Her mother had breast and ovarian cancer, and two sisters had breast cancer, one of whom also had ovarian cancer. She has no personal history of cancer and no other family history of cancer. She has no significant medical history except for benign breast disease and two negative breast biopsies. She had no pregnancies, no live births, began menstruating at age 11, reached menopause at age 53, and did not have a hysterectomy. She took oral contraceptives for 10 years and stopped 10 years ago. She did not take hormone replacement therapy. She does not have annual mammograms or conduct regular self breast exams. She has poor nutrition and exercise habits (the worst option in response to questions assessing these two risk factors was entered on each site).

The low-risk patient is a 55-year-old, 5′5″, 115-lb African-American woman who does not smoke. She has no family history of any cancer and no personal history of cancer. She has had no biopsies and has not been diagnosed with benign breast disease and no other significant medical history. She has had 3 pregnancies, which all resulted in live births, breast fed for a total of 2 years, and had her first child at age 24. Menstruation began at age 14; she reached menopause at age 47 and has not had a hysterectomy. She never took oral contraceptives or hormone replacement therapy. She has annual mammograms and conducts regular self breast exams. She has good nutrition and exercise habits (the best option in response to questions assessing these two risk factors was entered on each site).

Other risk factor questions were either answered as “unknown/not sure” or were answered randomly and recorded.

Appendix 2: Risk factors for sample subjects presented in Table 4

Risk factor Subject 16 Subject 1 Subject 37 Subject 31
First period before age 12? No* No* Yes† No*
First child after age 30? No* No* No* No*
Childless? Yes* Yes* Yes* No†
Mother had/has breast cancer? No* Yes† No* No*
Sisters had/has breast cancer? No† No† No† No†
Daughters had/has breast cancer? No† No† No† No†
Ever had breast biopsy? No† No† No† Yes*
Doctor ever tell you biopsy showed premalignant or precancerous condition? No† No† No† No†
Doctor ever tell you that one of your biopsies showed early cancer that had not spread yet? No† No† No† No†
Have you ever used birth control pills? No* No* No* No*
Ashkenazi Jewish? No† No† No† No†
  1. *Status of this risk factor is risk increasing (e.g., is Ashkenazi Jewish).†Status of this risk factor is risk decreasing (e.g., is not Ashkenazi Jewish).

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Levy, A.G., Sonnad, S.S., Kurichi, J.E. et al. Making Sense of Cancer Risk Calculators on the Web. J GEN INTERN MED 23, 229–235 (2008). https://doi.org/10.1007/s11606-007-0484-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11606-007-0484-x

KEY WORDS

  • internet
  • web risk calculators
  • cancer risk
  • breast cancer