Background

Diabetes mellitus is a metabolic disorder characterised by elevated blood glucose levels (hyperglycaemia) due to insulin deficiency or insulin resistance [1]. Diabetes is considered a significant global health issue [2, 3] and is referred to as the world’s largest non-communicable epidemic [4, 5]. The global prevalence of diabetes was 8.5% in 2014 [3], and it is predicted that approximately 700 million people will be living with diabetes by 2045 [6]. In Australia, around 1.2 million individuals are diagnosed with diabetes, with more than 10,000 new cases identified every year [7]. The economic burden of diabetes to the Australian economy is estimated to be over $6 billion annually [8].

Chronic and poorly managed diabetes affects an individual’s cardiovascular, renal, optical, neurological and oral health [9]. The relationship between diabetes and oral health is significant [10] with a bidirectional link between hyperglycaemia and periodontitis (advanced periodontal disease) [1]. Specifically, periodontitis can adversely affect diabetes management as periodontitis is linked to an increase in glycated haemoglobin (HbA1C) [11]. Individuals with poorly managed diabetes are up to three times more likely to develop periodontitis than individuals without diabetes [5] and are also at an increased risk of dry mouth, tooth decay, tooth loss, oral thrush and taste impairment [12]. Systematic reviews and meta-analyses suggest that a significant reduction in HbA1C ranging from 0.3–0.7% [13,14,15,16,17] is observed among individuals with diabetes who have received periodontal treatment.

Despite the literature providing evidence detailing the importance of oral health in diabetes management, studies suggest that there is a gap in oral health knowledge, attitudes and practices among people with diabetes. One systematic review found that individuals were generally not aware of the relationship between diabetes and oral health [18]. Furthermore, attitudes towards oral health, as well as compliance with the recommended oral hygiene practices and dental visits were poor [18]. A review of studies worldwide found that just over half of the people with diabetes had visited a dentist in the last 12 months with dental costs cited as the main underlying barrier to lower dental visits [18]. Impaired oral health is already known to affect quality of life [19]. Individuals with diabetes who also experience mouth pain, xerostomia, halitosis and periodontitis, report lower oral health-related quality of life (OHQoL) and overall health-related quality of life compared to people without diabetes [20]. Nevertheless, there is evidence to suggest that people with diabetes are receptive to advice about oral health from diabetes care providers such as diabetes educators and general practitioners (GPs) [18, 21]. Receiving such advice has been shown to significantly improve the oral health behaviours like brushing frequency and dental visits among patients with diabetes [22, 23].

The role of diabetes care providers, particularly diabetes educators, is to provide guidance and education on the management of diabetes [24]. Current clinical practice guidelines for the prevention and management of diabetes also recommend the integration of an oral health review and referral by diabetes care providers [25,26,27]. Diabetes care providers are therefore ideally placed to address the gaps in knowledge and behaviours with respect to oral health among clients. However, a review of current literature has shown very few Diabetes care providers discuss oral health and there are significant barriers for them to undertake this role which include lack of training in this area, time constraints, lack of appropriate oral health referral pathways as well as limited oral health promotional resources and screening tools [2, 24].

Over the years various strategies have been implemented in Australia to support diabetes care providers to promote oral health. These have included professional development oral health training programs, tailored evidenced based resources for people with diabetes and government schemes to improve access to oral health services [28,29,30]. To further assist diabetes care providers in screening and referring clients to oral healthcare professionals, recent needs assessment studies (involving diabetes educators and GPs) in Australia [2, 24] revealed the need for a short, non-invasive oral health screening tool. Diabetes care providers felt that including such a tool as part of their normal assessment protocol would provide a trigger for them to discuss oral health with their clients [24] and provide prompt screening and dental referrals. Shorter screening tools have been developed for non-dental professionals in other settings. A short two-item oral health screening tool was developed by George et al. [31] for midwives to screen and refer pregnant women to the dentist. This validated tool was found to have high sensitivity (up to 94%) [32], and was easily administered by midwives [31]. Nijland et al. [33] also developed an 8-item screening tool for medical professionals to screen for periodontitis, although it had a comparatively lower sensitivity (49%). Among people with diabetes, however, there are currently no short, screening tools available to screen for risk of poor oral health. Validated tools such as the 21-item Diabetes Oral Health Assessment Tool (DiOHAT) [34] and the 17-item modified DiOHAT [35] have been identified as difficult to incorporate into practice due to their length and time constraints. The aim of this study, therefore, was to develop and pilot a short oral health screening tool for diabetes care providers.

Methods

Development of the oral health screening tool

A comprehensive review of the literature was undertaken to identify potential items for inclusion in the screening tool. The review particularly focussed on existing oral health screening tools for diabetes as well as shorter tools used for other disorders. The results generated three potential items of which two were tested and validated in other population groups. These items were then reviewed by an expert panel consisting of academics and clinicians from relevant fields (dentistry, diabetes, general practice and public health) as well as among people with diabetes. The items were then revised to reflect the needs of people with diabetes and the Australian context (Fig. 1). The first item related to commonly reported oral health problems encountered with diabetes and those caused by related dental diseases, such as periodontitis. The second item focussed on the frequency of dental visits in the last 12 months. The last item related to smoking, and was included as it is a known risk factor for both Type 2 diabetes and periodontitis [36, 37]. The items were scored 0 and 1 and a total of score of ≥ 1 (having a dental problem or not seen a dentist in the last 12 months or currently smoking) indicated the person with diabetes was at risk of poor oral health and required a referral to an oral health professional (Fig. 1).

Fig. 1
figure 1

Oral health screening tool

Testing of the screening tool

The tool was tested as part of a cross-sectional survey that assessed the self-reported oral health status, knowledge and behaviours of people living with diabetes. Additional information about this survey has been published elsewhere by Poudel et al. [38]. The data pertaining to the oral health screening tool was used for the analysis in this study.

Sample and setting

Adults who have been diagnosed with diabetes (type 1 or type 2) and were accessing one of four public diabetes clinics in Sydney, Australia, were eligible to participate in the study. For participants who were not fluent in English, accredited interpreters were used where possible, or family members were asked to assist the participant to complete the questionnaire. People who were not comfortable communicating in English and did not have the assistance of an interpreter or family member were excluded from the study.

Participants were recruited from one hospital clinic in northern Sydney as well as three hospital clinics in South Western Sydney. These two regions were selected as they capture a diverse range of socioeconomic backgrounds. The local government area (LGA) covering South Western Sydney includes populations that are more disadvantaged, and reports one of the highest rates of diabetes across Sydney [39]. The LGA for northern Sydney, however, represents one of the most advantaged populations in Sydney [40].

Recruitment and procedure

Information about the study was advertised through flyers posted in waiting rooms of the diabetes clinics. An experienced investigator (PP) attended each diabetes clinic to provide potential participants with additional information about the study, including a summary of the study aims and protocol. The presence of the investigator on site provided an opportunity for potential participants to ask any questions before providing written consent to participate. Participants completed the self-administered questionnaire prior to their appointment while in the waiting room. Oral health promotion information and dental products (toothbrush and toothpaste) were provided to all invited participants, irrespective of whether they took part in the study.

Data collection

Data collection of the surveys occurred between March 2019 and January 2020. Each participant that completed the questionnaire also completed both the three-item diabetes and oral health screening tool and the Oral Health Impact Profile-14 (OHIP-14) [41]. Participants typically took about 10 to 15 min to complete the questionnaire. The OHIP-14 tool was developed in 1994 and is a valid and reliable instrument that provides a subjective measure of oral health and its impact on quality of life [41]. Numerous studies have demonstrated a significant association between the OHIP-14 tool and poor oral health [23, 42] in particular periodontal disease [43]. Further, measuring oral health quality of life using the tool can inform the dental care needs of patients and help health care providers in treatment planning [44, 45]. The OHIP-14 tool has been used in previous studies for preliminary validation of oral health screening tools for other populations like HIV patients and pregnant women [32, 46]. It has also been used in other studies to assess the oral health quality of life, including among people with diabetes [47, 48]. The OHIP-14 tool asks respondents 14 questions across 7 domains (functional limitation, physical pain, psychological discomfort, physical disability, psychological disability, social disability and handicap) that are measured using a Likert rating scale from 0 (“never”) to 4 (“very often”). The sum of all items were added for a score out of a total possible of 56, where higher scores reflected poorer self-reported oral health [41]. The responses for the oral health screening tool (Fig. 1) used three items with dichotomous variables (‘Yes’ and ‘No’) for responses, with responses corresponding with a score of either one or zero. The sum of each item was added, with scores ranging from zero to three. As indicated in the tool (Fig. 1), individuals who scored one or greater were indicated for a dental referral.

Demographic information about participants were also collected. These questions asked about the person’s gender, cultural and linguistic background, type of diabetes, lifestyle behaviours, presence of other chronic diseases, employment, education, marital status, annual household income, private health insurance and whether they had a government-issued concession card.

This study was approved by the South Western Sydney Local Health District Research and Ethics Committee (LNR/18/LPOOL/510), Northern Sydney Local Health District Research Office (RESP/19/017) and the Human Research Ethics Committee of Western Sydney University (RH13145). The study was also conducted in accordance with the Australian National Health & Medical Research Council’s national statement on ethical conduct in human research, which follows the principles outlined in the Declaration of Helsinki.

Data analysis

Data were manually entered and analysed using SPSS (Version 27) Demographic data were analysed for descriptive statistics. As both OHIP-14 and the Oral Health screening tool scores were not normally distributed, these scores were correlated using Spearman’s rank-order correlation coefficient (rho). Following this, both variables were dichotomised for further analysis. With no existing cut-offs developed for OHIP-14, this variable was dichotomised at the median according to the method outlined by Locker et al. [49]. The oral health screening tool was dichotomised as 0 = 0 (no risk), and any score greater than or equal to 1 = 1 (at risk). As the purpose of this screening tool was to identify individuals at risk of poor oral health, high sensitivity was crucial to ensure as many at-risk individuals as possible were identified. Thus, the at-risk score of 1 or greater was chosen to optimise sensitivity over specificity. Sensitivity analyses were conducted to evaluate the dichotomised oral health screening tool against the dichotomised OHIP-14 scores, whereby sensitivity, specificity, positive predictive value and negative predictive value were calculated. Additional sensitivity analysis was undertaken to test each individual oral health screening tool items against the OHIP-14. For all analyses, alpha was set at 0.05.

Results

A total of 260 patients completed the survey. The average age of participants was 61.7 ± 13.8 years, and over half (n = 139, 53.5%) of participants were male. More than two thirds (n = 177, 68.1%) of participants were born overseas, and 57.7% (n = 150) spoke English at home. Most participants (n = 224, 86.1%) reported educational attainment of at least secondary school. More than half of participants (n = 143, 55.0%) had a combined household income of less $40,000, and over two-thirds (n = 177, 68.1%) did not have private health insurance, with over half (n = 151, 58.0%) eligible for public dental services via health care card or being a defence force veteran. The majority of participants (n = 226, 86.9%) reported having type 2 diabetes, with the mean duration since their diagnoses being 15.3 (SD 11.66) years. Within the oral health screening tool, 53.1% (n = 138) of responses indicated having dental problems in Item 1, 37.3% (n = 97) of responses in Item 2 indicated they had not visited a dentist in the last 12 months, and 14.2% of responses (n = 37) indicated they were smokers in Item 3. A total of 190 participants (73.1%) scored one or higher on this tool, indicating that they would require a dental referral. According to the OHIP-14, 52.7% (n = 137) of participants scored 21 or higher, and thus were indicated for a dental visit.

Spearman’s rank-order correlations revealed a statistically significant correlation between the oral health screening tool and the OHIP-14 (rho = 0.453, p < 0.001), indicating validity of the oral health screening tool. Furthermore, the results of the sensitivity analyses indicated that the 3-item oral health screening tool had high sensitivity (90.5%, 95% CI 84.9%, 94.7%), with a specificity of 46.3% (95% CI 37.7%, 55.2%). The negative predictive value was 81.4% (95% CI 71.3, 89.3). For individual items, Item 1 had the highest sensitivity 79.6% (95% CI 72.3%, 85.7%) and Item 3 had the lowest (18.2%, (95% CI 12.4%, 25.3%), but Item 3 had the highest specificity at 90.2% (95% CI 84.2%, 94.7%) and Item 2 having the lowest (66.7%, 95%CI 58.1%, 74.6%). No single item performed as well regarding sensitivity and negative predictive value when compared to the three items collectively (Table 1).

Table 1 Comparison of sensitivity, specificity, positive predictive value and negative predictive value for the screening tool

Discussion

This study aimed to develop and pilot a short oral health screening tool for diabetes care providers to utilise in routine clinical practice. A key aspect of a screening tool is its validity. In this study the sensitivity of each item varied from 18.2% to 79.6%, but collectively the three items showed marked improvement in sensitivity (90.5%). The three items also had a significant correlation with the OHIP-14 indicating adequate validity. This is particularly important as poor oral health like periodontal disease has been found to be significant correlated with higher OHIP-14 scores [50]. These are very positive findings that could be attributed to the way the items were developed. The first item explored the most common dental problems linked with poor oral health, and more than half of the respondents reported (53%) these concerns (dry mouth, gaps between teeth, pain in teeth and/or gums and loose teeth) in the related study surveying people with diabetes in Australia [38]. The second item related to the frequency of dental visits in the last 12 months as the evidence shows that infrequent dental attendance is associated with poor oral health [51]. Smoking was included as the last item as it is a risk factor for both diabetes and periodontal disease [36, 37]. A recent systematic review and meta-analysis found that smoking increases the risk of periodontal disease by 80% [52]. The combination of the three items also improved the negative predictive value (NPV) (81.4%) suggesting the tool is reliable in excluding dental referrals for people with diabetes deemed not at risk of poor oral health. This is an important factor as a high NPV is desirable in conditions where early intervention is advisable and effective [53]. It is well established that people with uncontrolled diabetes are at greater risk of periodontitis, which can deteriorate very rapidly [5, 10]. Thus, early detection of periodontitis and subsequent dental treatment can improve periodontal health as well as glycaemic control. Studies show periodontal treatment can decrease HbA1c levels by 0.3–0.7% which is similar to adding a second oral anti-diabetic medication to metformin [25, 54]. Seeing a dentist earlier can also reduce the cost of associated treatment [55].

One issue that is evident in the findings is the lower specificity (46.3%) and positive predictive value (PPV) (65.3%) when combining the three items. This is not surprising as the sensitivity of any diagnostic tool is influenced by the prevalence of the disease [56]. A meta-analysis 23 studies of analysing diagnostic accuracy found that specificity significantly reduced with higher prevalence [56]. These findings are relevant to the current study as there is a high prevalence of dental problems among people with diabetes ranging from 53–86% depending on the demographic profile [38, 57, 58]. Low specificity and NPV is an issue for screening tools if there are cost implications or risk of harm and discomfort to the patient from treatment [53]. However, in the case of oral health screening for patients with diabetes this may not be an issue. The current consensus worldwide is that all people with diabetes should have regular dental check-ups as part of diabetes self-management [25, 27, 59]. Thus, people with diabetes, who may not have any oral disease, but are incorrectly referred to an oral health professional through this screening process will still have a thorough oral health examination to assess their oral health status. These benefits could justify a tool having moderate PPV [53] particularly if there is potential flow-on health benefits such as improved glycaemic control [54] and quality of life [60] through preventive and timely dental examinations. Having a “dental home” is an important element of health care for people with diabetes, as the oral health professional is able to make a more specific risk assessment from the dental examination to help tailor preventive care and inform the timing of review examinations for the patient [61].

Lastly, in addition to validity it is important to consider the acceptability of the screening tool for both the diabetes care providers and their patients. Previous research in Australia has shown that diabetes educators and GPs prefer short screening tools due to their time constraints [2, 24]. Further a recent doctoral study surveyed the views of 260 patients with diabetes in Sydney and found that more than 88% were receptive to diabetes care providers asking questions about their oral health and initiating dental referrals [62]. These initial studies suggest that the tool could be acceptable for all stakeholders, but more research is needed to confirm that it can be implemented into practice and is easy to use in diabetes care settings without evoking any discomfort from patients.

Limitations

This study is limited by the non-random sampling method which could have led to a biased selection of participants who were well motivated in oral health care. The sample only included people with type 1 and type 2 diabetes, not people with gestational diabetes. Further, the study was undertaken across metropolitan Sydney, Australia and thus the findings may differ in other populations of people with diabetes from regional/rural areas as well as other countries. However, all attempts were made to recruit diverse participants from across the socio-economic spectrum in Sydney including those from culturally and linguistically diverse backgrounds and the resulting sample was fairly representative of the population data from the Australian National Diabetes Audit [38]. Another limitation is that only one aspect of the psychometric assessment of the tool was assessed and other aspects like construct validity was not undertaken. Lastly, the OHIP-14 may not be the ideal standard to validate the tool and as this study did not utilise clinical examinations for validation, correlations with actual oral health status remain unknown. Despite this, the OHIP-14 is likely a sound standard due to its known correlation with poor oral health and dental care needs.

Conclusion

Diabetes care providers are recommended to undertake oral health risk assessments of their clients but currently there are no simple screening tools that can assist them in this role. This study has identified a simple 3-item screening tool with high sensitivity and NPV that can identify risks of poor oral health which requires dental referrals in patients with diabetes, without adding extra burden on the consultation time for the clinician. This tool has the potential to be easily incorporated into diabetes care practice but further validation is needed using against comprehensive dental assessments of screened clients as the gold standard.