Skip to main content


Log in

Understandability of Patient Information Booklets for Patients with Cancer

  • Published:
Journal of Cancer Education Aims and scope Submit manuscript


The improvement of health literacy in general and the information of individual patient is a major concern of the German national cancer plan and similar initiatives in other western countries. The aim of our study was to assess the readability and understandability of information booklets for cancer patients available at German Web sites. A support vector machine (SVM) was used to discriminate between laymen- and expert-centric patient information booklets about nine most common tumor types. All booklets had to be available for free at the Internet. A total of 52 different patient booklets were downloaded and assessed. Overall, the assessment of all booklets showed that an understandability level L of 4.6 and therefore increased medical background knowledge is required to understand a random text selected from the sample. The assessed information booklets on cancer show very limited suitability for laymen. We were able to demonstrate that a medical background is necessary to understand the examined booklets. The current study highlights the need to create information material adjusted to the needs of laymen. Assessing understandability before publication, especially for laymen with low health literacy, could ensure the suitability and thus quality of the information material.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others


  1. Hoefert H-W (2011) Wandel der Patientenrolle: neue Interaktionsformen im Gesundheitswesen [change of the patient role: new forms of interaction in healthcare]. Hogrefe, Göttingen

    Google Scholar 

  2. Berkman ND, Sheridan SL, Donahue KE et al (2011) Low health literacy and health outcomes: an updated systematic review. Ann Intern Med 155:97–107. doi:10.7326/0003-4819-155-2-201107190-00005

    Article  PubMed  Google Scholar 

  3. Bundesministerium für Gesundheit (2012) Nationaler Krebsplan - Handlungsfelder, Ziele und Umsetzungsempfehlungen [National Cancer Plan - fields of action, objectives and implementation of recommendations]. Druckerei im Bundesministerium für Arbeit und Soziales, Berlin

    Google Scholar 

  4. Klemperer D, Lang B, Koch K et al (2010) Die ‚Gute praxis Gesundheitsinformation’ [the, good practice health information ’]. Z Für Evidenz Fortbild Qual Im Gesundheitswesen 104:66–68. doi:10.1016/j.zefq.2009.12.018

    Article  Google Scholar 

  5. Böcken J, Braun B, Landmann J (2010) Gesundheitsmonitor 2010 - Bürgerorientierung im Gesundheitswesen [health monitor 2010 - focus on citizens healthcare]. Bertelsmann Stiftung, Gütersloh

    Google Scholar 

  6. Garcia SF, Hahn EA, Jacobs EA (2010) Addressing low literacy and health literacy in clinical oncology practice. J Support Oncol 8:64–69

    PubMed  PubMed Central  Google Scholar 

  7. Kane HL, Halpern MT, Squiers LB et al (2014) Implementing and evaluating shared decision making in oncology practice. CA Cancer J Clin 64:377–388. doi:10.3322/caac.21245

    Article  PubMed  Google Scholar 

  8. Keinki C, Seilacher E, Ebel M et al (2015) Information needs of cancer patients and perception of impact of the disease, of self-efficacy, and locus of control. J Cancer Educ Off J Am Assoc Cancer Educ. doi:10.1007/s13187-015-0860-x

    Google Scholar 

  9. Huebner J, Micke O, Muecke R et al (2014) User rate of complementary and alternative medicine (CAM) of patients visiting a counseling facility for CAM of a German comprehensive cancer center. Anticancer Res 34:943–948

    PubMed  Google Scholar 

  10. Friedman DB, Hoffman-Goetz L (2006) A systematic review of readability and comprehension instruments used for print and web-based cancer information. Health Educ Behav Off Publ Soc Public Health Educ 33:352–373. doi:10.1177/1090198105277329

    Article  Google Scholar 

  11. Estey A, Musseau A, Keehn L (1991) Comprehension levels of patients reading health information. Patient Educ Couns 18:165–169. doi:10.1016/0738-3991(91)90008-S

    Article  Google Scholar 

  12. The Free Readability Test Tool - Readable. Accessed 7 May 2016

  13. Charnock D, Shepperd S, Needham G, Gann R (1999) DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health 53:105–111

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Yan X, Song D, Li X (2006) Concept-based Document Readability in Domain Specific Information Retrieval. In: Proc. 15th ACM Int. Conf. Inf. Knowl. Manag. ACM, New York, NY, USA, pp 540–549

  15. Ownby RL (2005) Influence of vocabulary and sentence complexity and passive voice on the readability of consumer-oriented mental health information on the Internet. AMIA Annu Symp Proc AMIA Symp AMIA Symp 585–589

  16. Leroy G, Miller T, Rosemblat G, Browne A (2008) A balanced approach to health information evaluation: a vocabulary-based naïve Bayes classifier and readability formulas. J Am Soc Inf Sci Technol 59:1409–1419. doi:10.1002/asi.20837

    Article  Google Scholar 

  17. Schmidt H, Alilovic I, Klärs G (2011) Evaluation schriftlicher Gesundheitsinformationen zu Brustkrebs [Evaluation of written health information about breast cancer]. Gesundheitsinformationen Dtschl. Eine Übers. Zu Anforderungen Angeboten Herausforderungen

  18. Robert Koch-Institut, die Gesellschaft der epidemiologischen Krebsregister in Deutschland e.V (2013) Krebs in Deutschland 2009/2010 [cancer in Germany 2009/2010]. Robert Koch-Institut, Berlin

    Google Scholar 

  19. Liebl P, Seilacher E, Koester M-J et al (2015) What cancer patients find in the internet: the visibility of evidence-based patient information - analysis of information on German websites. Oncol Res Treat 38:212–218. doi:10.1159/000381739

    Article  PubMed  Google Scholar 

  20. Deutsche Krebshilfe (2016) Stiftung Deutsche Krebshilfe [German Cancer Aid Foundation]. Accessed 7 May 2016

  21. GKV-Spitzenverband Krankenkassenliste - GKV-Spitzenverband [Health insurance list - GKV Head Association]. Accessed 7 May 2016

  22. Products VBC, AG DT Umsatz und Forschungsausgaben der Top 50 Pharmaunternehmen weltweit im Jahr 2013 | Statistik [Sales and research expenditures of the top 50 pharmaceutical companies worldwide in 2013 | statistics]. In: Statista. Accessed 7 May 2016

  23. Zowalla R, Wiesner M, Pfeifer D (2014) Automatically assessing the expert degree of online health content using SVMs. Stud Health Technol Inform 202:48–51

    PubMed  Google Scholar 

  24. Joachims T (1998) Text categorization with support vector machines: learning with many relevant features. In: Nédellec C, Rouveirol C (eds) Mach. Learn. ECML-98. Springer Berlin, Heidelberg, pp. 137–142

    Chapter  Google Scholar 

  25. Chang C-C, Lin C-J (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2:1–27. doi:10.1145/1961189.1961199

    Article  Google Scholar 

  26. Yang Y, Pedersen JO (1997) A comparative study on feature selection in text categorization. In: Proc. Fourteenth Int. Conf. Mach. Learn. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, pp 412–420

  27. Salton G, Buckley C (1988) Term-weighting approaches in automatic text retrieval. Inf Process Manag 24:513–523. doi:10.1016/0306-4573(88)90021-0

    Article  Google Scholar 

  28. Platt JC (1999) Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Adv Large Margin Classif 10:61–74

    Google Scholar 

  29. Weintraub D, Maliski SL, Fink A et al (2004) Suitability of prostate cancer education materials: applying a standardized assessment tool to currently available materials. Patient Educ Couns 55:275–280. doi:10.1016/j.pec.2003.10.003

    Article  PubMed  Google Scholar 

  30. Cox N, Bowmer C, Ring A (2011) Health literacy and the provision of information to women with breast cancer. Clin Oncol R Coll Radiol G B 23:223–227. doi:10.1016/j.clon.2010.11.010

    Article  CAS  Google Scholar 

  31. Singh J (2003) Reading grade level and readability of printed cancer education materials. Oncol Nurs Forum 30:867–870. doi:10.1188/03.ONF.867-870

    Article  PubMed  Google Scholar 

  32. van Weert JCM, van Noort G, Bol N et al (2011) Tailored information for cancer patients on the internet: effects of visual cues and language complexity on information recall and satisfaction. Patient Educ Couns 84:368–378. doi:10.1016/j.pec.2011.04.006

    Article  PubMed  Google Scholar 

  33. Knapp P, Gardner PH, Carrigan N et al (2009) Perceived risk of medicine side effects in users of a patient information website: a study of the use of verbal descriptors, percentages and natural frequencies. Br J Health Psychol 14:579–594. doi:10.1348/135910708X375344

    Article  CAS  PubMed  Google Scholar 

  34. Seidel DG, Münch I, Dreier M et al (2014) Sind Informationsmaterialien zur Darmkrebsfrüherkennung in Deutschland verständlich oder verfehlen sie ihre Wirkung? Bundesgesundheitsbl Gesundheitsforsch Gesundheitsschutz 57:366–379. doi:10.1007/s00103-013-1908-x

    Article  CAS  Google Scholar 

  35. Sheridan SL, Sutkowi-Hemstreet A, Barclay C et al (2016) A comparative effectiveness trial of alternate formats for presenting benefits and harms information for low-value screening services: a randomized clinical trial. JAMA Intern Med 176:31. doi:10.1001/jamainternmed.2015.7339

    Article  PubMed  Google Scholar 

  36. Garcia-Retamero R, Galesic M (2010) Who profits from visual aids: overcoming challenges in people’s understanding of risks [corrected]. Soc Sci Med 1982 70:1019–1025. doi:10.1016/j.socscimed.2009.11.031

    Google Scholar 

  37. Brotherstone H, Miles A, Robb KA et al (2006) The impact of illustrations on public understanding of the aim of cancer screening. Patient Educ Couns 63:328–335. doi:10.1016/j.pec.2006.03.016

    Article  PubMed  Google Scholar 

  38. Brundage M, Feldman-Stewart D, Leis A et al (2005) Communicating quality of life information to cancer patients: a study of six presentation formats. J Clin Oncol Off J Am Soc Clin Oncol 23:6949–6956. doi:10.1200/JCO.2005.12.514

    Article  CAS  Google Scholar 

  39. Lipkus IM, Hollands JG (1999) The visual communication of risk. J Natl Cancer Inst Monogr:149–163

  40. Edwards A, Elwyn G, Mulley A (2002) Explaining risks: turning numerical data into meaningful pictures. BMJ 324:827–830

    Article  PubMed  PubMed Central  Google Scholar 

  41. Galesic M, Garcia-Retamero R, Gigerenzer G (2009) Using icon arrays to communicate medical risks: overcoming low numeracy. Health Psychol Off J Div Health Psychol Am Psychol Assoc 28:210–216. doi:10.1037/a0014474

    Google Scholar 

  42. Gaissmaier W, Wegwarth O, Skopec D et al (2012) Numbers can be worth a thousand pictures: individual differences in understanding graphical and numerical representations of health-related information. Health Psychol Off J Div Health Psychol Am Psychol Assoc 31:286–296. doi:10.1037/a0024850

    Google Scholar 

  43. Schwartz LM, Woloshin S, Welch HG (2009) Using a drug facts box to communicate drug benefits and HarmsTwo randomized trials. Ann Intern Med 150:516–527. doi:10.7326/0003-4819-150-8-200904210-00106

    Article  PubMed  Google Scholar 

  44. Woloshin S, Schwartz LM (2011) Communicating data about the benefits and harms of treatment: a randomized trial. Ann Intern Med 155:87–96. doi:10.7326/0003-4819-155-2-201107190-00004

    Article  PubMed  Google Scholar 

  45. Stacey D, Légaré F, Col NF, et al (2014) Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev CD001431. doi:10.1002/14651858.CD001431.pub4

  46. Spiegle G, Al-Sukhni E, Schmocker S et al (2013) Patient decision aids for cancer treatment: are there any alternatives? Cancer 119:189–200. doi:10.1002/cncr.27641

    Article  PubMed  Google Scholar 

  47. Nannenga MR, Montori VM, Weymiller AJ et al (2009) A treatment decision aid may increase patient trust in the diabetes specialist. the Statin choice randomized trial. Health Expect Int J Public Particip Health Care Health Policy 12:38–44. doi:10.1111/j.1369-7625.2008.00521.x

    Google Scholar 

  48. Edwards A, Gray J, Clarke A et al (2008) Interventions to improve risk communication in clinical genetics: systematic review. Patient Educ Couns 71:4–25. doi:10.1016/j.pec.2007.11.026

    Article  CAS  PubMed  Google Scholar 

  49. Thorne SE, Bultz BD, Baile WF, SCRN Communication Team (2005) Is there a cost to poor communication in cancer care?: a critical review of the literature. Psychooncology 14:875–884. doi:10.1002/pon.947

    Article  PubMed  Google Scholar 

  50. Holmes-Rovner M, Stableford S, Fagerlin A et al (2005) Evidence-based patient choice: a prostate cancer decision aid in plain language. BMC Med Inform Decis Mak 5:16. doi:10.1186/1472-6947-5-16

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Author information

Authors and Affiliations


Corresponding author

Correspondence to Christian Keinki.

Ethics declarations

Conflict of Interest

The authors declare no conflict of interest.

Ethical Approval

This article does not contain any studies with human participants performed by any of the authors.


This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Keinki, C., Zowalla, R., Wiesner, M. et al. Understandability of Patient Information Booklets for Patients with Cancer. J Canc Educ 33, 517–527 (2018).

Download citation

  • Published:

  • Issue Date:

  • DOI: