Abstract
Phenylketonuria (PKU) is a condition that results in the build-up of phenylalanine in the blood. This can cause severe brain damage and neurological issues if left untreated. Management can be complex and many individuals may turn to the internet to access further information. It is important that resources are understood as misinterpretation could result in harm to health. The aim of this study was to assess the readability of online resources for PKU and to assess their visual appearance using a communication sciences assessment framework. We searched the top five websites through Google using the search term “phenylketonuria/PKU”. We then analysed the text content of the identified websites using five readability formulae to determine the USA and UK reading grade. The median readability level across the five websites was US grade/UK grade 10.6/11.6, with individual grades ranging from 10/11 to 13.3/14.3. We found wide differences in the focus, layout and general appearance of the websites. The readability of resources was much higher than the recommended US 6th grade level. Online resources for PKU need to be simplified to ensure they can be easily understood.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Phenylketonuria (PKU) is one of the most common inborn errors of metabolism (Macleod and Ney 2010; Winn et al. 2016), with a mean European prevalence of around 1 in 10,000 newborns, although rates vary across Europe (Blau et al. 2010; van Wegberg et al. 2017). It is caused by an autosomal recessive deficiency in the phenylalanine hydroxylase (PAH) enzyme that is responsible for converting phenylalanine into tyrosine (van Wegberg et al. 2017). Deficiency of PAH leads to a build-up of phenylalanine in the blood and brain which is toxic and can lead to neurotransmitter dysfunction and motor defects (Blau et al. 2010; van Wegberg et al. 2017).
Left untreated PKU is associated with progressive intellectual impairment along with a number of additional symptoms including eczematous rash, autism, seizures, motor deficits and microcephaly (Blau et al. 2010; van Wegberg et al. 2017). As the child grows further developmental problems, aberrant behaviour and psychiatric symptoms become more apparent (Blau et al. 2010). In adults, PKU can present itself with a short attention span and low mood, confusion and, in extreme cases, seizures (Brown and Lichter-Konecki 2016).
If blood phenylalanine levels are controlled, the associated central nervous system defects can be effectively managed, with most individuals showing normal development and expected educational achievement (Blau et al. 2010). The management of PKU is dependent on maintaining a diet low in phenylalanine (Macleod and Ney 2010).
Recent studies however have illustrated that large number of patients have higher than recommended phenylalanine levels, especially with increasing age (Jurecki et al. 2017). They also have difficulty adhering to a low phenylalanine diet (Brown and Lichter-Konecki 2016).
Over the past two decades, there have been huge technological advancements in computing which have been accompanied by a rapid growth in the number of individuals having access to or using computers. There has similarly been an increase in the number and diversity of websites, with health information websites forming a large part. The increasing utilization of the internet has provided a better opportunity for people to search for health information online, where previously the major source of health information would be medical staff (Chen et al. 2018). It is estimated that 37% of all internet traffic relates to health information (Maloney et al. 2005). Many patients with PKU feel that they receive limited support from health professionals (Ford et al. 2018). This may result in PKU patients seeking additional guidance and information through online resources.
People with low literacy skills may not be able to read a book or newspaper, understand road signs or price labels, make sense of a bus or train timetable, fill out a form, read instructions on medicines or use the internet (The National Literacy Trust 2019). A high proportion of the adult general population has been documented as having below average levels of general literacy. Table 1 illustrates readability ages and the equivalent UK and US education level. Figures from the UK range from 1 in 8 to 1 in 4 adults having general literacy levels below that expected of a 6th grade student (age 11) (The National Literacy Trust 2019). In the USA, 52% of the population are documented as having only basic (4th or 5th grade) or below levels of literacy (Wylie Communications 2019).
Health literacy has been defined as ‘The degree to which individuals have the capacity to obtain, process, and understand basic health information and services needed to make appropriate health decisions’ (Ratzan and Parker 2000). Given the increase in internet use, it is essential that the information presented to patients is accessible and understandable to them. Poor reading ability has a major effect on the level of health literacy. As PKU may present with developmental and neurological problems in patients it is important that they receive accurate and understandable online information. Even subtle abnormalities in phenylalanine levels have been shown to impair ‘executive function’ such as planning, problem solving and information processing, making difficult to read information unavailable to them and potentially worsening their health inequality (Blau et al. 2010; VanZutphen et al. 2007). For patients who are experiencing some of the PKU symptoms this may make understanding information from websites even more difficult. The level of knowledge and information possessed by patients has also been shown to have an impact on treatment compliance. Accessibility of information is therefore key if patients are to make informed decisions (Fowler et al. 2011; Martin et al. 2005). The aim of this research was therefore to assess the readability of the major online resources for PKU and to assess their visual appearance.
Methods
We undertook a scoping review of the literature prior to deciding which readability formulae to use. As we were assessing health related literature we aimed to determine the most appropriate formulae for this type of literature. In our selection of formulae we also considered the output and the ease of comparison of the readability assessment across different formulae. It has been demonstrated that for health-related literature where 100% comprehension is the goal, a combination of two or more formulae should be used, including the SMOG (Burke and Greenberg 2010; Wang et al. 2013). The five formulae chosen all display a calculated level of readability as a US grade level, enabling comparison across results. In addition, they could all be easily calculated using the freely available software, ‘readable’ (https://readable.com/). The readability formulae selected use a variety of techniques to calculate grades, some using whole text, while others use a sample of text (see Table 2).
We performed a search using the terms ‘Phenylkentonuria’ and ‘PKU’ through Google. We wanted to identify the top five non-sponsored websites that were identified on the first search page, as data indicates that less than 10% of users progress beyond the first page of an internet search (https://www.protofuse.com/blog/details/first-page-of-google-by-the-numbers/). We focused on sites that had the primary purpose of providing information for patients about the condition. We excluded Wikipedia due to concerns about information accuracy and credibility (Gorman 2007; Luyt and Tan 2010). Google was chosen as it was deemed to be the most popular search engine at over 90% of the UK market share (Statcounter GlobalStats 2014). We undertook the searches using incognito to avoid any browser history bias. The searches and data capture were all undertaken on 10 October 2018 using the same computer.
We tabulated the top five identified websites into Excel (Microsoft Excel for Windows, Microsoft Office ProPlus 365). We then accessed each website one by one and pasted the text from the first or main information page (where multiple pages were present) of each website into a Word document (Microsoft Word for Windows, Microsoft Office ProPlus 365). We also took a screenshot from each website which was saved for later visual assessment.
We assessed the readability of the text from each of the websites with the Flesh-Kincaid Grade Level, The Gunning-Fog Index, The Coleman-Liau Index, The SMOG Index and the Automated Readability Index using an online calculator (https://readable.io). Readability formulae take different elements into account when calculating a score, therefore the text were edited prior to pasting into the readability calculator to avoid bias between the different formulae. Headings, subheadings, bullet points and hyphenated words from all website text were removed. Any identified spelling errors were also corrected. Once edited, we pasted the text from each of the websites into the calculator and calculated the five readability grades for each of the five websites. The calculations were repeated three times by two members of the team (JMM and HAH) to ensure that the results obtained were consistent.
Data analysis
We analysed the readability data using SPSS (IBM SPSS Statistics for Windows, 2017. Version 25.0 licensed to Swansea University). The results are presented as individual readability grades for each of the five readability calculations for the five websites. We also present the pooled median readability grades with range for each of the websites identified for the purpose of comparison. The Kruskal-Wallis test was used to compare the median readability grades across each of the five top websites identified.
In addition to comparing the readability grades across websites, we also assessed the appearance of each of the websites using a framework based on guidance provided in the Centers for Medicare and Medicaid Services toolkit (https://www.cms.gov/Outreach-and-Education/Outreach/WrittenMaterialsToolkit/index) (Doak et al. 1996). Broadly, we assessed: overall design and page layout; fonts, size of print and contrast; headings, bulleted lists and blocks of text; use of colour; photographs and illustrations; and use of tables, charts and diagrams. We assigned a score of 1 where there was clear evidence of the criterion being met, − 1 where it was not met, and 0 where it was not applicable or unclear. We calculated an overall score for each website based on its visual appearance. We also documented the currency of the information and credibility by exploring website update information and whether source reference information were provided.
Results
The top 5 websites identified using the search term ‘Phenylketonuria’ using Google incognito were, in order of appearance: The National Health Service (NHS); Genetics Home Reference (GHR); The National Society for Phenylketonuria (NSPKU); Healthline; and Mayo Clinic. When we used the abbreviation PKU, the same five websites were identified in the same order.
Readability assessment
Table 3 illustrates the US and UK readability grades using five readability formulae for the top five sites identified. We found no difference in the results obtained when the process was repeated on three occasions and by different research team members. The median readability grade across the five websites using the five formulae was US 10.6 (UK 11.6). This was equivalent to a reading age of 15–16 years. The readability grade varied with different formulae, ranging between US 10 and 11.3 (UK 11 and 12.3).
In terms of the readability of each of the websites we identified that Healthline had the lowest readability grade, having a median readability grade of US 10 (UK 11) with a range between US 7.7 and 10.6 (UK 8.7 and 11.6). This was equivalent to a reading age of between 15 and 16 years. The most difficult website to read was GHR, with a median readability grade of US 13.3 (UK 14.4) and a range between US 12.1 and 13.9 (UK 13.1 and 14.9). This was equivalent to a University level reading age (18+).
Using the Kruskal-Wallis test, we identified that there was a statistically significant difference between the median readability grades across the five websites (p = 0.009). A post hoc analysis identified that the statistically significant difference in readability grades was between the GHR and Healthline websites (p = 0.006).
Visual assessment
Table 4 illustrates the visual scoring assessment of each website based on its visual appearance. Of the five websites identified, NHS and Healthline appeared to be the most focussed on improving the individual’s health. The GHR website appeared to have a more specific focus on those searching for genetic information. The Mayo Clinic seemed at first to be targeted to both researchers as well as the public; however, on closer examination it was clear from the website that the text was more directed towards patients themselves. The aim of the NSPKU website was the management of PKU by patients and included lots of self-help and support information. The first pages of the identified websites which were used for the analysis of readability all included a background to PKU, PKU symptoms and how to manage the condition. The NHS website was the highest scoring in terms of its overall layout, followed by GHR and then Mayo Clinic. Healthline and NSPKU were jointly scored last in terms of overall layout.
NHS (https://www.nhs.uk/conditions/phenylketonuria/)
The NHS website provided information on different diseases and conditions and how to manage them. In terms of the general layout of the websites, the NHS was the most appealing and straightforward to read and to look at. The contrast was good and used a white background with clear bold headings in a black colour scheme. The text was well spaced out and the font size used was larger than the other sites. The language was clear and unambiguous. No images or diagrams were used however, which could have improved the overall visual aesthetics of the website. The information was up to date and included a regular review date. The information was contained within one page, with links out to relevant other pages. No references were included. The NHS site scored the highest in terms of its overall layout.
Genetics Home Reference (GHR) (https://ghr.nlm.nih.gov/condition/phenylketonuria)
GHR provided a guide for different genetic conditions, what they are and how to manage them. GHR looked professional and well laid out, with clear dark headings on a white background. The text however was complex and technical and included a ‘chemical structure’ diagram of phenylalanine as well as the phenylalanine hydroxylase (PAH) gene and a depiction of autosomal inheritance with no explanation offered. The information was contained under a series of headings that had to be clicked to provide detail. The website provided the date it was last updated and a review date. Source references for the information provided were also included. GHR scored highly in terms of overall layout.
The National Society for Phenylketonuria (NSPKU) (http://www.nspku.org/information/whatispku)
NSPKU is a charity dedicated to PKU individuals. The website included what PKU is and how to manage it, recipes and helpful advice for new parents with children with PKU. The NSPKU website had a dark green colour scheme for headings on a white background. The main information page was clear and the language was straightforward with limited technical language. A large photograph was used which made the web page more accessible and appealing. The page included additional tabs linking to reference information, support and recipes for example. NSPKU was one of the poorest scoring websites in terms of its overall appearance.
Healthline (https://www.healthline.com/health/phenylketonuria#symptoms)
The Healthline website contained general information and wellbeing tips. Information was presented on a simple white background with key headings. There were images present; however, none were relevant to PKU. The site contained lots of advertisements throughout the page including a large advertisement at the top of the page, obscuring sight of some of the website’s content. Healthline scored poorly in terms of its overall layout.
Mayo Clinic (https://www.mayoclinic.org/diseasesconditions/phenylketonuria/symptoms-causes/syc-20376302)
Mayo Clinic website was clear and well spaced out with text appearing on a white background. It included an image of a simple autosomal inheritance diagram that was explained further in the text. It also included some Mayo Clinic–related adverts and an opportunity to book a clinic appointment. Mayo Clinic scored well in terms of its overall layout.
Discussion
Using the search terms ‘phenylketonuria/PKU’ through the Google incognito search engine, we identified that the top five websites for PKU were (in order): The National Health Service (NHS); Genetics Home Reference (GHR); The National Society for Phenylketonuria (NSPKU); Healthline; and Mayo Clinic. The median US readability grade across all five websites was 10.6, with individual grades ranging from 10 to 13.3. This was equivalent to a reading age of between 15 and 16 years. We identified a range of scores across sites with the Healthline website being identified as the simplest and GHR as the most complex. Visually, we deemed the NHS website to be the most appealing and simplest to read. This was based on a detailed visual assessment using an adapted framework that assessed various aspects of the written material including text size and colour, use of white space and inclusion of illustrations (US Department of Health and Human Services Centers for Medicare and Medicaid Services 2020). Based on these findings we would recommend that patients explore non-sponsored, governmental or charity websites as they had the best readability levels and visual assessments.
Our findings identified that the five websites all had readability grades above the recommended US 6th grade (age 11–12). Given the increasing extent that the internet is relied upon to further information and understanding of health conditions (Fox 2011), it is becoming increasingly important that such health resources are accessible to the general population. It is recommended that all patient information should be written at or below the US 6th grade level (US Department of Health and Human Services and Office of Disease Prevention and Promotion 2010). Given that between 1 in 4 and 1 in 6 adults in the UK have general health literacy levels below that expected of a 6th grade student (age 11) (The National Literacy Trust 2019), a substantial proportion of the UK population would struggle to read and understand the information contained in the identified websites for PKU.
Our findings concur with those from other studies that have demonstrated overly high reading levels of online resources for other health conditions, including skin cancer (Dobbs et al. 2017), breast cancer (Vargas et al. 2014a), breast reconstruction (Vargas et al. 2014c), abdominoplasty (Phillips et al. 2015), hernia repair (Vargas et al. 2014b), neurosurgery (Agarwal et al. 2013), stroke (Sharma et al. 2014), dementia (Weih et al. 2008), Parkinson’s disease (Fitzsimmons et al. 2010) and Polycystic Ovary Syndrome (Chiu et al. 2018). This highlights that high readability level is an issue across a range of health conditions.
Our findings are limited by a number of factors. We only used the search terms phenylketonuria or PKU. Including additional terms may have resulted in different results. We also only used five readability tools, using other tools may have resulted in different findings. We used the Google search engine and assessed the first or main page of each web site. Google is however the most frequently used in the UK (Statcounter GlobalStats 2014), and it is questionable whether other search engines would have changed the results. Including additional webpages may have changed the overall readability level, but we believe that most patients are unlikely to go on and look at further pages if they do not understand the first page. In addition, for many of the websites, the information was contained within one page.
Readability forms only one aspect of website assessment and is based primarily on information such as the sentence length, number of words per sentence and the complexity of some of the words. Other aspects of website also need to be considered such as the credibility or trustworthiness of the information as well as the quality of the information provided. We did not assess the quality, accuracy or relevance of the information published and this would need to be examined in a future study.
The readability formulae examine the readability of a piece of text. They do not include materials such as tables, diagrams, videos and audio-visual materials (Badarudeen and Sabharwal 2010), which may aid the understanding of the included text on websites. The readability grades found in our study therefore only give an insight into the overall website readability. We did however visually assess the overall appearance of each website which will also play a part in engaging with the patient.
Our findings for PKU websites, illustrate that there is a need to improve the readability of website information, particularly those that are regularly accessed by patients. There are a number of ways in which this can be achieved. The readability formulae are largely based on the number of words, sentence length and number of syllables per word. It may therefore be possible to reduce the readability grade by reducing these parameters (Dobbs et al. 2017). For example, by removing medical terminology (which is often complex and polysyllabic) from a piece of text the readability of it can be reduced (Sand-Jecklin 2007). For health information, however, this may not always be straightforward. It may not always be possible to remove medical terminology as an alternative may not exist, and not all medical terms are unfamiliar to patients. For example, a patient with PKU will understand the term.
Other ways of improving the visual appearance and accessibility of online materials are to consider the type and size of font (Doak et al. 1996; Eyles et al. 2003). The UK Government suggests that public resources should be written in Arial or Helvetica font (GOV.UK. Design System 2019). They also suggest using headings to break up text. Using bullet points and numbering, with large text and white space is also useful. Making new or complex words bold, along with a definition may also help readers (Danielson 1987).
Written text may also be improved by utilizing audio-visual materials. They can be an effective learning and teaching method and can convey and present information in a clear, organized way. In the health setting, several studies have shown benefits in using audio-visual materials alongside written materials (Carey et al. 2007).
When writing a piece of text, it is important to specify which aspects of it have a patient focus and which may encourage the patient to have further discussion with their clinician. Given the high proportion of individuals who are below normal levels of literacy, this should be aimed at 9–11-year-old reading capability.
Conclusion
We found that the readability of online health resources for PKU appeared much higher than the recommended US 6th grade level. This high reading level may affect the management of PKU by patients. Online resources for PKU need to be re-worded into simpler, lower grade levels to ensure patients, caregivers and families can easily understand and interpret the text. Future studies should analyse other elements of readability, such as the use of audio-visual materials. The credibility and quality of the web content also needs to be considered.
References
Agarwal N, Chaudhari A, Hansberry DR, Tomei KL, Prestigiacomo CJ (2013) A comparative analysis of neurosurgical online education materials to assess patient comprehension. J Clin Neurosci 20:1357–1361. https://doi.org/10.1016/j.jocn.2012.10.047
Badarudeen S, Sabharwal S (2010) Assessing readability of patient education materials: current role in orthopaedics. Clin Orthop Relat Res 468:2572–2580 doi:https://doi.org/10.1007/s11999-010-1380-y
Blau N, van Spronsen FJ, Levy HL (2010) Phenylketonuria. Lancet 376:1417–1427. https://doi.org/10.1016/S0140-6736(10)60961-0
Brown CS, Lichter-Konecki U (2016) Phenylketonuria (PKU): A problem solved? Mol Genet Metab Rep 6:8–12. https://doi.org/10.1016/j.ymgmr.2015.12.004
Burke V, Greenberg D (2010) Determining readability: how to select and apply easy-to-use readability formulas to assess the difficulty of adult literacy materials. Adult Basic Educ Lit 4:34–42
Carey M, Schofield P, Jefford M, Krishnasamy M, Aranda S (2007) The development of audio-visual materials to prepare patients for medical procedures: an oncology application. Eur J Cancer Care (Engl) 16:417–423. https://doi.org/10.1111/j.1365-2354.2006.00772.x
Chen YY, Li CM, Liang JC, Tsai CC (2018) Health information obtained from the Internet and changes in medical decision making: questionnaire development and cross-sectional survey. J Med Internet Res 20:e47. https://doi.org/10.2196/jmir.9370
Chiu WL, Kuczynska-Burggraf M, Gibson-Helm M, Teede HJ, Vincent A, Boyle JA (2018) What can you find about polycystic ovary syndrome (PCOS) online? Assessing Online Information on PCOS: Quality, Content, and User-Friendliness Semin Reprod Med 36:50–58 doi:https://doi.org/10.1055/s-0038-1667186
Coleman M, Liau TL (1975) A computer readability formula designed for machine scoring. J Appl Psychol 60:283–284
Danielson KE (1987) Readability fromulas: a necessary evil? Reading Horizons 27:178–188
Doak LG, Doak CC, Meade CD (1996) Strategies to improve cancer education materials. Oncol Nurs Forum 23:1305–1312
Dobbs T, Neal G, Hutchings HA, Whitaker IS, Milton J (2017) The readability of online patient resources for skin cancer treatment. Oncol Ther 5:149–160 doi:https://doi.org/10.1007/s40498-017-0051-5
Eyles P, Skelly J, Schmuck M (2003) Evaluating patient choice of typeface style and font size for written health information in an outpatient setting. Clin Eff Nurs 7:94–98
Fitzsimmons PR, Michael BD, Hulley JL, Scott GO (2010) A readability assessment of online Parkinson’s disease information. J R Coll Physicians Edinb 40:292–296. https://doi.org/10.4997/JRCPE.2010.401
Ford S, O'Driscoll M, MacDonald A (2018) Living with phenylketonuria: lessons from the PKU community. Mol Genet Metab Rep 17:57–63. https://doi.org/10.1016/j.ymgmr.2018.10.002
Fowler FJ Jr, Levin CA, Sepucha KR (2011) Informing and involving patients to improve the quality of medical decisions. Health Aff (Millwood) 30:699–706. https://doi.org/10.1377/hlthaff.2011.0003
Fox S (2011) The social life of health information, 2011. Available from: https://www.pewinternet.org/2011/05/12/the-social-life-of-health-information-2011/ (access date 16 august 2019)
Gorman GE (2007) A tale of information ethics abd encyclopaedias; or, is Wikipedia just another internet scam? Online Inf Rev 31:273–276
GOV.UK. Design System Typography. Available from: https://design-system.service.gov.uk/styles/typography/ (access date 16 August 2019)
Gunning R (1952) The technique of clear writing. McGraw-Hill
Jurecki ER et al (2017) Adherence to clinic recommendations among patients with phenylketonuria in the United States. Mol Genet Metab 120:190–197. https://doi.org/10.1016/j.ymgme.2017.01.001
Kincaid JP, Fishburne RP, Rogers RL, Chissom BS (1975) Derivation of new readability formulas (automated readability index, fog count, and flesch reading ease formula) for Navy enlisted personnel. Research Branch Report 8–75. Available from: https://apps.dtic.mil/dtic/tr/fulltext/u2/a006655.pdf (access date 22 January 2020). Naval Air Station Memphis
Luyt B, Tan D (2010) Improving Wikipedia’s credibility: references and citations in a sample of history articles. J Am Soc Inf Sci Technol 61:715–722
Macleod EL, Ney DM (2010) Nutritional management of phenylketonuria. Ann Nestle Eng 68:58–69. https://doi.org/10.1159/000312813
Maloney S, Ilic D, Green S (2005) Accessibility, nature and quality of health information on the internet: a survey on osteoarthritis. Rheumatology (Oxford) 44:382–385. https://doi.org/10.1093/rheumatology/keh498
Martin LR, Williams SL, Haskard KB, Dimatteo MR (2005) The challenge of patient adherence. Ther Clin Risk Manag 1:189–199
McLaughlin GH (1969) SMOG grading — a new readability formula. J Read 12:639–646
Phillips NA, Vargas CR, Chuang DJ, Lee BT (2015) Readability assessment of online patient abdominoplasty resources. Aesthet Plast Surg 39:147–153. https://doi.org/10.1007/s00266-014-0425-0
Ratzan SC, Parker RM (2000) Introduction. In: National Library of Medicine current bibliographies in medicine: health literacy vol NLM Pub. No. CBM 2000-1. National Institutes of Health, U.S. Department of Health and Human Services., Bethesda, MD
Sand-Jecklin K (2007) The impact of medical terminology on readability of patient education materials. J Community Health Nurs 24:119–129. https://doi.org/10.1080/07370010701316254
Sharma N, Tridimas A, Fitzsimmons PR (2014) A readability assessment of online stroke information. J Stroke Cerebrovasc Dis 23:1362–1367. https://doi.org/10.1016/j.jstrokecerebrovasdis.2013.11.017
Smith EA, Senter RJ (1967) Automated Readability Index. AMRI.-TR-66-220. Available from: https://apps.dtic.mil/dtic/tr/fulltext/u2/667273.pdf (access date 13 January 2020). Wright-Patterson Air Force Base, Ohio, Defense Documentation Center, Virginia
Statcounter GlobalStats Search Engine Market Share United Kingdom. Jan - Dec 2014. Available from: https://gs.statcounter.com/search-engine-market-share/all/united-kingdom/2014 (access date 15 August 2019)
The National Literacy Trust What is literacy? Available from: https://literacytrust.org.uk/information/what-is-literacy/ (access date 15 August 2019)
US Department of Health and Human Services, Office of Disease Prevention and Promotion (2010) National action plan to improve health literacy. Washington, DC
US Department of Health and Human Services Centers for Medicare and Medicaid Services (2020) Toolkit for making written material clear and effective. Section 2: Detailed guidelines for writing and design. Part 3: Summary list of the “Toolkit guidelines for writing and design”. Available from: https://www.cms.gov/Outreach-and-Education/Outreach/WrittenMaterialsToolkit/index (access date 21 January 2020)
van Wegberg AMJ, MacDonald A, Ahring K, Bélanger-Quintana A, Blau N, Bosch AM, Burlina A, Campistol J, Feillet F, Giżewska M, Huijbregts SC, Kearney S, Leuzzi V, Maillot F, Muntau AC, van Rijn M, Trefz F, Walter JH, van Spronsen F (2017) The complete European guidelines on phenylketonuria: diagnosis and treatment. Orphanet J Rare Dis 12:162. https://doi.org/10.1186/s13023-017-0685-2
VanZutphen K, Packman W, Sporri L, Needham M, Morgan C, Weisiger K, Packman S (2007) Executive functioning in children and adolescents with phenylketonuria. Clin Genet 72:13–18 doi:https://doi.org/10.1111/j.1399-0004.2007.00816.x
Vargas CR, Chuang DJ, Ganor O, Lee BT (2014a) Readability of online patient resources for the operative treatment of breast cancer. Surgery 156:311–318. https://doi.org/10.1016/j.surg.2014.03.004
Vargas CR, Chuang DJ, Lee BT (2014b) Online patient resources for hernia repair: analysis of readability. J Surg Res 190:144–150. https://doi.org/10.1016/j.jss.2014.03.045
Vargas CR, Koolen PG, Chuang DJ, Ganor O, Lee BT (2014c) Online patient resources for breast reconstruction: an analysis of readability. Plast Reconstr Surg 134:406–413. https://doi.org/10.1097/PRS.0000000000000472
Wang L-W, Miller MJ, Schmitt MR, Wen FK (2013) Assessing readability formula differences with written health information materials: application, results, and recommendations. Res Soc Adm Pharm 9:503–516
Weih M, Reinhold A, Richter-Schmidinger T, Sulimma AK, Klein H, Kornhuber J (2008) Unsuitable readability levels of patient information pertaining to dementia and related diseases: a comparative analysis. Int Psychogeriatr 20:1116–1123. https://doi.org/10.1017/S1041610208007576
Winn SR, Scherer T, Thony B, Harding CO (2016) High dose sapropterin dihydrochloride therapy improves monoamine neurotransmitter turnover in murine phenylketonuria (PKU). Mol Genet Metab 117:5–11. https://doi.org/10.1016/j.ymgme.2015.11.012
Wylie Communications U.S. literacy rate: Can you read me now?. Available from: https://www.wyliecomm.com/2019/03/us-literacy-rate/ (access date 15 August 2019)
Author information
Authors and Affiliations
Contributions
Hayley Hutchings, Jessie Marsh and Thomas Dobbs conceived the study. Jessie Marsh undertook the searches and analysed the data. Hayley Hutchings was responsible for drafting the initial article. All authors provided input to and reviewed all versions of the article. All authors have approved the final published version. All authors meet the International Committee of Medical Journal Editors (ICMJE) criteria for authorship and take responsibility for the integrity of the work undertaken and its presentation in this article.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethics statement
This article does not contain any new studies with human or animal subjects performed by any of the authors.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Marsh, J.M., Dobbs, T.D. & Hutchings, H.A. The readability of online health resources for phenylketonuria. J Community Genet 11, 451–459 (2020). https://doi.org/10.1007/s12687-020-00461-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12687-020-00461-9