The Netherlands and Belgium are among the top five worldwide of highest incidence in breast cancer, leading to an increase in post-mastectomy reconstruction interest. This study aims to analyze readability of Dutch-written online patient-directed information on breast reconstruction.
An online patient query for the term “borstreconstructie” was simulated using the largest search engine, Google. Content from the 10 most popular web sites from the Netherlands and Belgium was collected and formatted into plain text. Readability level assessment was performed using four available tools for the Dutch language: Accesibility.nl, Klinkende Taal, Texamen, and WizeNote, which measure readability according to the Common European Framework of Reference for Languages (CEFR).
Of the 20 websites (10 Dutch and Belgian), breast reconstruction content was mainly written in B2/C1 and exceeded the recommended B1 level. The readability tool “Klinkende Taal” was found to have the lowest average CEFR level at B2 (average 4.01, 2.40–5.00), WizeNote (average 4.57, 3.00–5.00), and Accesibility.nl (average 4.58, 3.40–5.50). Both had a CEFR level B2/C1, while Texamen scored the highest average at C1 (average 4.77, 3.60–5.25). Kiesbeter.nl, a Dutch government web site, was found to comply with the recommended B1 level on their breast reconstruction information.
Readability of online health information on breast reconstruction was generally found to be too advanced for the lay population. Therefore, it may hold benefit for patient-directed health information to be analyzed and revised in order to tailor the information to the targeted population.
Level of Evidence: Not ratable.
The Netherlands was the first European country after the USA to obtain internet access in November 1988 . Both the Netherlands and Belgium began offering commercial internet access in 1993 [1, 2]. Currently, the Internet is one of the primary sources of health information. It has been reported that online health information can help increase medical knowledge, engagement, and competence in health decision-making strategies . Moreover, patients are now capable of receiving healthcare information and support while staying in a trusted environment with the use of patient-centered web sites, blogs, and support communities . On the contrary, online health information can be commercially biased and patient information can be therefore misleading. Furthermore, literature has shown that patient’s frequency of searching the internet correlates with health anxiety and can trigger unnecessary health concerns [5, 6].
Quite importantly, information should be written at a suitable readability level that is comprehensible by the largest proportion of society. Readability tools can be very useful as they measure the complexity of written text. It can thus be utilized to estimate how difficult content is to comprehend. The Dutch government states on its website that level B1 on the Common European Framework of Reference for Languages (CEFR) is recognized as most appropriate for the general population . Other measures have been taken, such as the implementation of the Web Content Accessibility Guidelines (WCAG) in order to make the internet more accessible by improving natural information (text, images, and sounds) and code or markup that defines structure, presentation, etc. . As of late 2016, all government web sites of European Union member states are required to conform to the latest version.
The European statistical office, Eurostat, found that 73% of the Dutch population and 56% of the Belgian had queried the internet searching for health-related information with a minimum of once in the past year [9, 10]. The primary reason for patients to search the Internet is because it is believed to be the fastest way of obtaining information . The Internet could be considered an important factor in the periclinical phase, providing patients with information, support, autonomy, and anonymity. The medical influence of the Internet is likely to grow, not necessarily in combination with clinicians’ expertise.
The global incidence of breast cancer is rising, of which Belgium has the highest incidence followed by the Netherlands, ranking fourth . Previous literature has concluded incomprehensive patient-directed information after analyzing readability of English online healthcare information on a variety of surgical topics including the operative treatment of breast cancer , mastectomy, lumpectomy , lymphedema , and breast augmentation . Breast reconstruction is becoming an increasingly conventional factor for women undergoing mastectomy, a variety of reconstructive techniques exist utilizing patients’ own tissue or alloplastic material [17, 18]. Intelligible online health information is becoming more important due to the easier accessibility for patients querying the Internet for background information. Studies analyzing English online health information on breast reconstruction reported that the readability level was too high for the general population despite the argument by the American Medical Association (AMA) that patient information written above the recommended sixth-grade reading level would be too difficult [19,20,21,22,23]. A Dutch study on online health information found that 80% of their included texts from a wide variety of medical specialties was too advanced . However, Dutch online health information on breast reconstruction has not been analyzed yet.
Therefore, the aim of this study was to analyze the readability level of online health information on breast reconstruction in the Dutch Language.
A web search for “borstreconstructie” was performed using the largest Internet search engine, Google (Google Inc., Mountain View, California), on September 13, 2017 to simulate an online patient search for information on breast reconstruction. We disabled location information and excluded sponsored content to avoid inadvertent bias in our results. The 20 most popular web sites with Dutch written content were included: 10 top-ranking from Belgium and 10 from the Netherlands (Table 1). Relevant articles (defined as ≥ 100-word count and within one click away from the original link) were gathered and formatted into plain text in separate Microsoft Word 2017 documents (Microsoft Corp., Redmond, Washington). Saved articles were edited to exclude videos, images, advertisements and links, and organized by original web site.
The CEFR scale was introduced by the Council of Europe and used as measurement tool for learning, teaching, and assessing European languages. The scale includes six levels: A1 (Breakthrough), A2 (Waystage), B1 (Threshold), B2 (Vantage), C1 (Effective Operational Proficiency), and C2 (Mastery). Scale A (A1 and A2) are “basic users” of the language, B (B1 and B2) “independent users,” and C (C1 and C2) are “proficient users” . Maximum readability and the biggest comprehending group are achieved at level B1 for medium knowledge of the language . Examples can be observed in the attachment included with this article and were derived from those by the Council of Europe .
Readability was analyzed using four tools: Accessibility.nl (Accessibility Foundation, Utrecht), Klinkende Taal (Klinkende Taal B.V., Amsterdam), Texamen (BureauTaal, Beusichem), and WizeNote (WizeNoze B.V., Amsterdam) (Table 2). Accessibility.nl is available online for free, while the remaining are paid services. These were the only tools available and known to evaluate readability of Dutch written content. All four tools utilize the CEFR scale.
Articles were individually analyzed with all four readability tools. The six readability levels each were numerically coded (A1 = 1 to C2 = 6) according to the ordinal scale to calculate averages (Table 3) . Readability level per web site was calculated using the average across all articles.
The following examples were derived from the Council of Europe :
1. A1 (Breakthrough):
Can understand and use familiar everyday expressions and very basic phrases aimed at the satisfaction of needs of a concrete type. Can introduce him/herself and others and can ask and answer questions about personal details. Can interact in a simple way provided the other person talks slowly and clearly.
2. A2 (Waystage):
Can understand sentences and frequently used expressions related to areas of most immediate relevance. Can communicate in simple and routine tasks requiring a simple and direct exchange of information on familiar and routine matters. Can describe in simple terms aspects of his/her background, immediate environment and matters in areas of immediate need.
3. B1 (Threshold):
Can understand the main points of clear standard input on familiar matters regularly encountered in work, school, leisure, etc. Can deal with most situations likely to arise whilst travelling in an area where the language is spoken. Can produce simple connected text on topics, which are familiar, or of personal interest.
4. B2 (Vantage):
Can understand the main ideas of complex text on both concrete and abstract topics, including technical discussions in his/her field of specialization. Can interact with a degree of fluency and spontaneity that makes regular interaction with native speakers quite possible without strain for either party. Can produce clear, detailed text on a wide range of subjects and explain a viewpoint on a topical issue giving the advantages and disadvantages of various options.
5. C1 (Effective Operational Proficiency):
Can understand a wide range of demanding, lengthier texts, and recognize implicit meaning. Can express him/herself fluently and spontaneously without much obvious searching for expressions. Can use language flexibly and effectively for social, academic, and professional purposes. Can produce clear, well-structured, detailed text on complex subjects.
6. C2 (Mastery):
Can understand with ease virtually everything heard or read. Can summarize information from different spoken and written sources, reconstructing arguments and accounts in a coherent presentation. Can express him/herself spontaneously, very fluently, and precisely, differentiating finer shades of meaning even in more complex situations.
The level per article was calculated from the mean average of the four readability tools. Descriptive statistics were collected using Excel (Microsoft Corp., Redmond, Washington). Statistical analyses were performed using IBM SPSS software v24.0 (IBM Corp., Armonk, N.Y.). t test was used for group differences with continuous data. A value of p < 0.05 was defined as being significant.
The top 20 highest ranked websites were Borstkanker.nl, Kanker.nl, UZLeuven.be, NVPC.nl, BeautifulABC.com, Plastischchirurgen.com, Think-pink.be, ZOL.be, Isala.nl, Allesoverkanker.be, UMCUtrecht.nl, Chirurgenoperatie.nl, Natrelle.nl, ErasmusMC.nl, BorstcentrumGent.be, Kiesbeter.nl, DrColpaert.be, ZiekenhuisGeel.be, DeVoorzorg.be, and JessaZH.be (Table 1). In total, 84 articles were analyzed of which 47 articles were Dutch and 37 articles were Belgian (Table 1). Five percent were government web sites, 10% industry, 35% association, foundation, or NGO (non-governmental organization), and 50% were health care providers (Fig. 1 and Table 1). Dutch written health information on breast reconstruction was written in CEFR level B2/C1 (average 4.48) (Table 4).
When sub-analyzing by readability tool, Klinkende Taal was found to have the lowest average CEFR level at B2 (average 4.01), ranging from 2.40 (Kiesbeter.nl) to 5.00 (ZOL.be, BeautifulABC.com and Chirurgenoperatie.nl). WizeNote (average 4.57) and Accesibility.nl (average 4.58) both had CEFR level B2/C1 and respectively ranged from 3.00 (kiesbeter.nl) to 5.00 (UMCUtrecht.nl, Isala.nl, Plastischchirurgen.com, ZiekenhuisGeel.be, Think-pink.be, BorstcentrumGent.be, Allesoverkanker.be, ZOL.be, BeautifulABC.com, Chirurgenoperatie.nl) and from 3.40 (Kiesbeter.nl) to 5.50 (JessaZH.be and Chirurgenoperatie.nl). Texamen scored the highest average at C1 (average 4.77) with a range from 3.60 (Kiesbeter.nl) to 5.25 (BeautifulABC.com) (Table 4).
Average CEFR levels of both nations were estimated at B2/C1. No significant difference (p = 0.200) was noted in readability scores between the Netherlands (4.34 SD ± 0.57) and Belgium (4.63 SD ± 0.39). A web site from the Netherlands, Kiesbeter.nl, had the lowest overall average CEFR level at B1 (3.10), followed by Kanker.nl with B1/B2 (average 3.67). DeVoorzorg.be had a B2 CEFR level (average 3.80) which was the lowest for Belgium and third overall. The other 17 web sites were estimated at B2/C1 (50%) and C1 (35%) (Fig. 2).
In total, 27 (32.1%) individual web site articles were found to have a CEFR level B1 or lower, analyzed using at least one readability tool.
Health information is more easily accessible due to the increasing influence of the Internet and mobile devices . The extended availability of educative materials might have benefits; well-informed patients may become capable and willing of participating in treatment decision-making . In 2014, more than half of the population of the Netherlands and Belgium searched for online health information [9, 10]. However, negative influences on patients cannot be excluded due to the unverified accuracy of data, misleading information and choosing self-treatment instead of consulting a healthcare professional . The worldwide incidence of cancer is increasing of which breast cancer is the most frequent malignancy in women . Mastectomy remains an essential part of breast cancer treatment or prophylaxis . Literature shows that over two-thirds of breast cancer patients have queried the internet for information on breast reconstruction . It seems realistic to argue that the number of patients seeking health information online is likely to grow in the future. In this study, we analyzed the readability of Dutch patient-directed health information on breast reconstruction available on the Internet as it is essential for patients to have access to good quality information, and readability plays a key role in this. Our results show that online health information readability, or reading comprehension, level on breast reconstruction is often too high for the average population. Of the 20 included web sites, one was found to comply with the recommended CEFR level B1. Fifty percent of the web sites were estimated at level B2/C1. This study is the first readability assessment of online health information on breast reconstruction in the Dutch speaking population.
The Dutch government recommends the use of CEFR level B1, comprehendible for 95% of the population . Dutch immigration and integration laws state that one is required to understand, speak, and read on CEFR level A2 in order to become a Dutch citizen . The company behind “Texamen,” “BureauTaal,” reported that Level C1 on the CEFR scale is comparable to an academic grade language which implies that approximately 60% of the population of the Netherlands and Belgium will have difficulty comprehending information . The Netherlands and Belgium are frequently considered to be countries with excellent educational systems, both ranking in the highest quartile of the Human Development Index by the United Nations . Despite that standing, literacy difficulties affect nearly 12% of the population in the Netherlands and 15% in Belgium, and this topic should not be underestimated or disregarded . Due to the easy access and increasing availability of the internet, suitable online health information readability is crucial. Readability tools can help analyze and fine-tune web sites content. These tools have been introduced in other languages; results of previous literature on the readability of English written information on breast reconstruction were in line with ours [19,20,21,22].
In 2014, Vargas et al. studied the top 10 web sites and reported that English online health information on breast reconstruction exceeded the sixth-grade reading level advised by the AMA. The authors found an average overall reading grade level of 11.5 . After 1 year, the same authors reevaluated readability, alongside with complexity and suitability and determined that all three factor levels were still too advanced . On the contrary, a study from the UK by Light et al. included a simple readability analysis of patient-direction information on breast reconstruction and listed the majority as “easy to read” on a three level scale (easy, moderate, or difficult): Only 7.0% of all included web sites was categorized as “difficult to read” . However, the methods and the tools used for readability assessment were unclear. Recently, Lynch et al. analyzed readability, accessibility, and quality of the top 75 web sites on breast reconstruction; readability and quality were found to be below standard . Nonetheless, sufficient accessibility was met by 31 web sites (42.0%) based on the “Web Content Accessibility Guidelines (WCAG).” We did not include these measures due to the fact that there was nothing yet known on readability of patient-directed health information in Dutch. Deviating from the primary aim was therefore unsuitable.
We found readability levels of information on breast reconstruction from the Netherlands and Belgium to be nearly identical. This finding is consistent with previous Eurostat data showing minimal differences in their report; slightly more Belgians compared to Dutch (87 versus 82%, respectively) considered online health information easy to comprehend [9, 10]. However, in the group of dissatisfied internet users, a higher percentage of Belgians considered the health content to be too advanced or too unclear (48 versus 41%) [9, 10]. Of note, these data did not make a clear distinction between Dutch written or international content, although the latter was likely included. One of the reasons might be that health information was not available in the participants’ spoken language. This was the case in 5 % of the Dutch and 8% of the Belgian participants. We decided to include web sites from both the Netherlands and Belgium to broaden the patient search for breast reconstruction health information. Information used in the studies by Eurostat was not specifically about breast reconstruction which may have affected their findings differently than ours. Moreover, we performed an analysis on the readability of the text in order to try to predict and foresee complexities. This does not necessarily mean that patients will actually find it difficult.
Average web site readability levels were calculated, but no individual statistical analyses between numerical differences were performed. Nevertheless, it is interesting that only one (5%) web site, Kiesbeter.nl, was estimated at B1 level. It is a government web site run by the Dutch National Health Institute. Furthermore, this web site has been approved by Stichting Makkelijk Lezen (Easy Reading Foundation). The Dutch government has been actively trying to innovate their websites to an acceptable reading level . Investments were made in making websites more accessible and monitoring them due to quality improvement using readability tools such as Texamen . In 2006, the company behind Texamen, BureauTaal, concluded that the majority of communication, including government, was at level C1 . This finding is in line with our study results. In 2015, a study examined readability levels of Dutch municipality web sites with the Accessibility.nl tool and reported an average of B2 (62%) . However, 25% of these municipality websites were measured at B1. Progression has been made over 10 years when the average was measured at C1 . In 2016, 46% of all Dutch municipalities had an accessibility statement on their web site based on the Dutch web site guidelines .
We also calculated the average readability level per tool even though this was not the primary aim of this study. This was done in order to account for any possible differences in scoring between the tools and make the reader aware of this by describing our findings per tool. Limited recourses exist and only four readability tools for the Dutch language were known to us. Kraf et al. evaluated three of these tools (Accessibility.nl, Klinkende Taal and Texamen) and found a discrepancy in scoring . Our results are in line with the findings of Kraf et al. as Texamen also scored higher. Therefore, we did not want to limit this analysis to only one tool and incorporated all available four. Unfortunately, the algorithm of each tool is a trade secret of the company. This makes it hard for us to pinpoint why in some cases the same text scores differently. We are aware of most factors that are being taken into account by the tools as shown in Table 2. Yet, this is not enough to provide an accurate answer on the discrepancy in scores as we simply do not have sufficient information.
Finally, technology is becoming increasingly important. Changing technology may improve digital media information delivery and improve patient communication. Dutch research has insinuated that spoken animations could improve comprehension in case of low health literacy . Nonetheless, preoperative counseling is essential combined with receiving appropriate and understandable information. Surgeons should be capable of guiding patients and assessing their needs in order to tailor them with suitable information. Appropriate readability may be rewarding in improving satisfaction and health outcomes [40, 41]. However, critics fear that oversimplification of text may in turn lead to inaccurate information and miscommunication . European guidelines exist to improve readability and accessibility of medicinal product labels and leaflets that focus on text size, fonts, headings, and layout . As mentioned before, the WCAG guidelines were created in order to improve accessibility . The introduction and implementation of similar guidelines for (online) health information may help improve readability in particular, expanding the target group.
There are several limitations concerning this study. The readability software used for the study is the only available software for the Dutch language. Other individual readability formulas exist for the Dutch language; however, there are only few and do not use CEFR as a unit for calculating readability (e.g., Cloze score or Douma score, the Dutch version of the Flesch-Kincaid Grade Level). However, modern Dutch readability tools utilized in our study analyze and use similar formula specifics (e.g., word and sentence length) and additionally translate readability scores into a standardized European scale. Even though we used the four available CEFR readability software tools, we recognize that the limited number could be perceived as a limitation. Furthermore, limitations of Accessibility.nl, Klinkende Taal, and Texamen as identified by Kraf et al. and Jansen et al. are known. Kraf et al. analyzed Accessibility.nl, Klinkende Taal, and Texamen in 2011 and reported inconsistent readability scores which differ per tool . In 2013, Jansen et al. revaluated readability assessments of the three tools by calculating and comparing them to a different readability unit; Accessibility.nl and Klinkende Taal were found to correlate significantly but Texamen was not . Therefore, readability scores should be interpreted critically. More readability, availability, and accessibility tools reviewing the Dutch language should be developed for future improvement and standardization of online healthcare information. Furthermore, research should focus on identifying geographical differences between countries and analyzing to possibility of an online healthcare algorithm for global use.
Breast reconstruction is becoming an increasingly frequent procedure for women with breast cancer or those desiring prophylactic mastectomy. Our study showed that Dutch written online health information on breast reconstruction was too difficult to understand for the general population. Therefore, it may hold benefit for patient-directed (online) health information to be analyzed and revised in order to improve patient quality of care regarding breast reconstruction.
Posthumus N (2013) 25 jaar internet in Nederland - een kwestie van goed ‘netwerken’ [Internet]. nrc.nl. Available from: https://www.nrc.nl/nieuws/2013/11/17/25-jaar-internet-in-nederland-een-kwestie-van-goed-netwerken-a1429671. Accessed 20 Nov 2017
20 jaar internet in Nederland, België volgde pas later [Internet]. HLN.be. 2008 [cited 2017 Nov 20]. Available from: https://www.hln.be/wetenschap-planeet/20-jaar-internet-in-nederland-belgie-volgde-pas-later~af2a3f19/
Iverson SA, Howard KB, Penney BK (2008) Impact of internet use on health-related behaviors and the patient-physician relationship: a survey-based study and review. J Am Osteopath Assoc 108:699–711
van Uden-Kraan CF, Drossaert CHC, Taal E, Shaw BR, Seydel ER, van de Laar MAFJ (2008) Empowering processes and outcomes of participation in online support groups for patients with breast Cancer, arthritis, or fibromyalgia. Qual Health Res 18:405–417
Muse K, McManus F, Leung C, Meghreblian B, Williams JMG (2012) Cyberchondriasis: fact or fiction? A preliminary examination of the relationship between health anxiety and searching for health information on the Internet. J Anxiety Disord Elsevier Ltd 26:189–196
Kim J, Kim S (2009) Physicians’ perception of the effects of internet health information on the doctor–patient relationship. Inform Heal Soc Care 34:136–148
Dutch Government (2017) Rijkswebsites: Aanbevolen richtlijnen. Taalniveau B1. [Internet]. Available from: https://www.communicatierijk.nl/vakkennis/r/rijkswebsites-aanbevolen-richtlijnen/taalniveau-b1. Accessed 20 Nov 2017
World Wide Web Consortium (W3C) Web Accessibility Initiative (WAI). Web Content Accessibility Guidelines (WCAG) Overview [Internet]. Available from: https://www.w3.org/WAI/standards-guidelines/wcag/. Accessed 23 Nov 2017
European Commission (2014) Flash Eurobarometer, vol 404. European Citizens’ Digital Health Literacy, Brussels
European Commission. (2014) Flash Eurobarometer 404 European citizens’ digital health literacy, Brussels
Tan SS-L, Goonawardene N (2017) Internet health information seeking and the patient-physician relationship: a systematic review. J Med Internet Res 19:e9
Ferlay J, Soerjomataram I, Dikshit R, Eser S, Mathers C, Rebelo M, Parkin DM, Forman D, Bray F (2015) Cancer incidence and mortality worldwide: sources, methods and major patterns in GLOBOCAN 2012. Int J Cancer 136:E359–E386
Vargas CR, Chuang DJ, Ganor O, Lee BT (2014) Readability of online patient resources for the operative treatment of breast cancer. Surgery 156:311–318
Tran BNN, Singh M, Singhal D, Rudd R, Lee BT (2017) Readability, complexity, and suitability of online resources for mastectomy and lumpectomy. J Surg Res 212:214–221
Tran BNN, Singh M, Lee BT, Rudd R, Singhal D (2017) Readability, complexity, and suitability analysis of online lymphedema resources. J Surg Res Elsevier Inc 213:251–260
Ricci JA, Vargas CR, Chuang DJ, Lin SJ, Lee BT (2015) Readability assessment of online patient resources for breast augmentation surgery. Plast Reconstr Surg 135:1573–1579
Kamali P, Paul MA, Ibrahim AMS, Koolen PGL, Wu W, Schermerhorn ML, Lee BT, Lin SJ (2017) National and regional differences in 32,248 postmastectomy autologous breast reconstruction using the updated National Inpatient Survey. Ann Plast Surg 78:717–722
Albornoz CR, Bach PB, Mehrara BJ, Disa JJ, Pusic AL, McCarthy CM et al (2013) A paradigm shift in U.S. breast reconstruction: increasing implant rates. Plast Reconstr Surg 131:15–23
Vargas CR, Koolen PGL, Chuang DJ, Ganor O, Lee BT (2014) Online patient resources for breast reconstruction. Plast Reconstr Surg 134:406–413
Vargas CR, Kantak NA, Chuang DJ, Koolen PG, Lee BT (2015) Assessment of online patient materials for breast reconstruction. J Surg Res Elsevier Inc 199:280–286
Khan H (2016) Abstract: a comparative readability analysis of online patient information regarding breast reconstruction following mastectomy. Plast Reconstr Surg - Glob Open 4:186
Lynch NP, Lang B, Angelov S, McGarrigle SA, Boyle TJ, Al-Azawi D et al (2017) Breast reconstruction post mastectomy—let’s Google it. Accessibility, readability and quality of online information. Breast 32:126–129
Weiss B (2003) Health literacy: a manual for clinicians. American Medical Association, American Medical Foundation, Chicago, IL
Meppelink CS, van Weert JCM, Brosius A, Smit EG (2017) Dutch health websites and their ability to inform people with low health literacy. Patient Educ Couns Elsevier Ireland Ltd 100:2012–2019
Council of Europe. (2017) Common European Framework of Reference for Languages: Learning, teaching, assessment [Internet]. page 33. Available from: https://rm.coe.int/168045b15e. Accessed 21 Nov 2017
Kraf R, Lentz L, Pander Maat H (2011) Drie Nederlandse instrumenten voor het automatisch voorspellen van begrijpelijkheid. Een klein consumentenonderzoek. Tijdschr voor Taalbeheers 33:249–265
Myrick JG, Willoughby JF (2017) Educated but anxious: how emotional states and education levels combine to influence online health information seeking. Health Informatics J 146045821771956
Losken A, Burke R, Elliott LF, Carlson GW (2005) Infonomics and breast reconstruction: are patients using the internet? Ann Plast Surg 54:247–250
Matros E, Yueh JH, Bar-Meir ED, Slavin SA, Tobias AM, Lee BT (2010) Sociodemographics, referral patterns, and internet use for decision-making in microsurgical breast reconstruction. Plast Reconstr Surg:1
Dutch Government (2017) Immigration and Naturalization Services. Inburgering in Nederland [Internet]. Available from: https://ind.nl/Paginas/Inburgering-in-Nederland.aspx#Inburgeringsexamen_voor_naturalisatie. Accessed 20 Nov 2017
BureauTaal (2018) Eenvoudig Nederlands [Internet]. Available from: https://www.bureautaal.nl/eenvoudig-nederlands-26. Accessed 13 Nov 2017
Jahan S (2016) Human Development Report 2016. United Nations Dev. Program, New York
The European Literacy Policy Network (ELINET) (2015) Literacy in Europe: Facts and Figures
Light A, Munro C, Breakey W, Critchley A (2014) The Internet: what are our patients exposed to when considering breast reconstruction following mastectomy? The Breast Elsevier Ltd 23:799–806
Bureau Taal (2009) Over Texamen: Wie gebruikt Texamen? [Internet]. Available from: https://www.texamen.nl/over-texamen-4.html. Accessed 21 Nov 2017
Heij K (2006) Visser H. Schrijven in eenvoudig Nederlands, The Hague
Braat M (2015) Vitamine B1 maakt de overheid niet beter. Tekst[blad] 21:16–19
Dutch Government (2017) Public and Communication Services. Hoe ver zijn Nederlandse overheidsorganisaties met het toegankelijk maken van hun websites? [Internet]. Available from: https://www.digitoegankelijk.nl/monitor/. Accessed 21 Nov 2017
Meppelink CS, van Weert JC, Haven CJ, Smit EG (2015) The effectiveness of health animations in audiences with different health literacy levels: an experimental study. J Med Internet Res 17:e11
Hussey LC (1994) Minimizing effects of low literacy on medication knowledge and compliance among the elderly. Clin Nurs Res 3:132–145
Nielsen-Bohlman, L, Panzer AM, Goldfrank LR, Kindig DA (2004) Health literacy: a prescription to end confusion. Heal. Lit. A Prescr. To end confusion. Washington, DC: Institute of Medicine, National Academies Press
European Commission (2009) Guideline on the Readability of the Labelling and Package Leaflet of Medicinal Products for Human Use. 27
Jansen C, Boersma N (2013) Meten is weten? Over de waarde van de leesbaarheidsvoorspellingen van drie geautomatiseerde Nederlandse meetinstrumenten. Tijdschr voor Taalbeheers 35:47–62
The authors would like to sincerely thank the companies BureauTaal, Beusichem (Texamen), Klinkende Taal B.V., Amsterdam (Klindende Taal), and WizeNoze B.V., Amsterdam (WizeNote), for allowing the use of their readability software for this study, exempted of charges.
Conflict of interest
Patrick Panayotis Bletsis and Sabine Egeler declare that they have no conflict of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Bletsis, P.P., Egeler, S., van der Lei, B. et al. Readability of Dutch online patient-directed health information on breast reconstruction. Eur J Plast Surg 42, 343–350 (2019). https://doi.org/10.1007/s00238-019-1498-4
- Breast reconstruction
- Patient health information