FormalPara Key Summary Points

Successful generic inhaler substitution requires GPs to obtain consent from their patients to switch inhaler devices AND to demonstrate correct technique to their patients.

GPs have experienced limitations with demonstrating the correct inhaler technique in the past.

This study demonstrates that GPs are equally likely to be able to demonstrate correct inhaler technique with generic and standard inhaler devices.

Digital Features

This article is published with digital features to facilitate understanding of the article to view digital features for this article go to https://doi.org/10.6084/m9.figshare.12933002.

Introduction

Inhaled medicines are the mainstay of pharmacological treatment in asthma and COPD, with tailored treatment for individuals available for a wide selection of inhaler devices [1, 2]. With increased pressure on healthcare budgets and the concurrent expiration of the patent protection of established inhaled treatments, several generic substitutes delivered by devices different from those of the original branded options were developed but were not immediately available due to the difficulty of demonstrating bio-equivalence in practice [3]. Generic substitutes are products that contain the same active substance and quantity as the original branded medicines, and are able to demonstrate bio-equivalence [4, 5]. For inhaled medicines, demonstrating bio-equivalence is not straightforward as performance of the therapeutic substance is dependent on the formulation, delivery device, and correct use of the device, which is susceptible to the greatest variability [3, 6]. Therefore, regulatory bodies have come to accept demonstration of ‘therapeutic equivalence’ as a suitable alternative to bio-equivalence, meaning that the delivery of the same drug via the same route of administration and in the same dose as the original branded option must yield an equivalent dose [4]. The fundamental proviso of this determination is that the two inhaler devices used to deliver the therapeutic substance are being used correctly [7].

While the health economic benefits to individuals and societies associated with generic substitutes are widely accepted [8, 9], ongoing debate surrounds the impact on respiratory health outcomes. While some feel that generic substitution will cause reduced adherence due to patient confusion and dislike of physical attributes of a new inhaler device [3, 10, 11], patients who have switched appear to be equally non-adherent to their generic medicines as to their branded options [8]. It is widely agreed that if generic substitution is to occur, the best outcomes require the prescriber to obtain consent from the patient and demonstrate correct inhaler technique of the generic inhaler device [3, 8, 12, 13]. Although substitution can also occur within the pharmacy at the point of dispensing [14], the success of generic substitution of inhalers is dependent on the prescriber obtaining consent and their ability to be able to demonstrate its correct use [3, 13].

Poor inhaler technique (IT) has been a major problem in managing chronic respiratory conditions for decades [2, 15,16,17,18,19,20,21,22,23]. It compromises disease control [22, 24] and is associated with an increase in the economic burden of disease management [3]; yet incorrect inhaler use continues to remain an issue in clinical practice [25]. Global experts stress the importance of inhaler technique in the management of chronic respiratory disease [6] and the updated Australian Asthma Management Guidelines and the Global Initiative for Asthma (GINA) Strategy identify inhaler technique as one of the core targets for assessment and intervention for people with poorly controlled disease [7, 8, 26]. Given that approximately 50% of people with asthma in Australia do not have well-controlled disease [27] and up to 80% have poor inhaler technique [16], it highlights the importance/need for prescribers to be actively engaged in IT training, including those inhalers for which there are generic substitutions [27, 28]. Health care professional (HCP) delivery of IT education can take as little as 2 min [29], however, it is essential that patients’ IT is assessed and education repeated over time [30]. Most importantly, the HCPs need to have practical knowledge of how to use the inhalers in order to be able to be proficient in the delivery of IT themselves [30].

While there is much evidence that HCPs are key stakeholders in ensuring correct IT in their patients, their ability and willingness to train patients in the use of inhalers is not ideal [6, 9, 31, 32]. Research consistently shows HCPs seldom receive formal training in the use of inhalers [31] and lack the basic knowledge and technical skills to teach (different) inhaler techniques [33, 34]. It has been demonstrated that in some cases, only 15% of HCPs are able to demonstrate correct IT [33]. The paradigm ‘If you don’t know, you can’t teach’ rings true with IT, with patients rarely receiving training in the use of inhalers, despite the emphasis on IT education within the current management guidelines [35, 36].

While the literature has highlighted examples of HCPs not being able to master correct IT, it is important to remember that some inhalers are easier to use than others [1], skills can be transferrable between inhalers of a similar nature [37], and that some steps are more critical than others in optimizing disease control [16]. With these factors in consideration, we need to gain an insight and better understanding of prescribers’ skills with the use of newer inhaler devices that are available for generic substitution. Although there are a limited number of inhaler devices that can be substituted for asthma and COPD on the Australian market [38], to date, no prospective observational study has assessed the level of training required for general practitioners (GPs) to demonstrate correct inhaler technique using two devices delivering fixed-dose combination budesonide/formoterol therapy, i.e., the newer generic inhaler device Spiromax® and the established inhaler device Turbuhaler® in the general practice setting [39, 40]. The Turbuhaler® and Spiromax® both deliver equivalent doses of budesonide/formoterol in multidose, dry powder inhalers, with powder reservoirs from which unit doses are measured [37, 41, 42] and are registered on the Therapeutic Goods Administration register as being “Brand Equivalent”, meaning that these brands may be interchanged without differences in clinical effect [43]. The Turbuhaler® and Spiromax® generic substitution is arguably of significant importance at this point in time, not only because fixed-dose combination therapy is frequently prescribed as GINA step 3 and above [35, 44], but also when we consider the recent shift in asthma management guidelines, with the introduction of budesonide/formoterol as GINA step 1 therapy for patients with mild asthma [26]. Hence, the ability of GPs to use these devices will potentially have an impact on a large proportion of people with asthma in particular.

The aims of this study are: (1) to determine the level of training required for GPs to master and maintain correct IT when using two different dry powder inhalers that are able to be substituted in clinical practice and (2) to determine the number and types of errors made by GPs on each device and inhaler device preference at each training visit.

Methods

Study Design and Subjects

This study was a multicenter, randomized, un-blinded, cross-over study and registered as a clinical trial on the Australia and New Zealand Clinical Trials Registry (ACTRN12618001478202). This study was approved by the University of Sydney (2017/872) and Notre Dame University (018109S) Human Ethics Committees.

The sampling frame was GPs who are registered and currently practicing as general medical practitioners in NSW. Primary Health Networks (PHNs) within the Sydney metropolitan region were approached to facilitate with distribution of recruitment material. Flyers and advertisements were placed in newsletters and at GP educational events. Snowball recruiting was also encouraged. GPs who were interested in participating were asked to contact the research team via telephone, fax, or e-mail and a researcher then scheduled an appointment to screen for eligibility, complete enrolment, and conduct the study. Appointments took between 10 and 15 min.

GPs were eligible for inclusion into this study if they fulfilled the following criteria: They were a registered, practicing GP in the state of NSW, Australia; were willing and able to comply with the study protocol for the duration of the study and provided verbal informed consent. Potential participants were excluded if they had asthma or COPD or used an inhaler themselves. GPs who were not eligible to participate were provided with inhaler technique education on the Spiromax® and Turbuhaler ®.

Study Devices and Inhaler Technique

Participants were required to demonstrate use of a Spiromax® placebo device and a Turbuhaler® placebo device. Placebo devices were requested from the manufacturers of both Turbuhaler® and Spiromax® devices and were supplied as standard placebo inhalers, i.e., empty Turbuhaler® and drug-free lactose containing Spiromax ®. It was not possible to confirm from the manufacturer why one placebo device was supplied as empty and the other as drug-free lactose containing. It can only be noted that the use of these placebo devices delivers an experience that mimics that of a device containing an active ingredient used by patients in real life. That is, when a patient uses a Turbuhaler®, there is a lack of sensation of drug delivered and when Spiromax® is used, there is the sensation of lactose delivery in the mouth [45,46,47,48,49].

The ability of participants to demonstrate correct IT was assessed against IT checklists [39]. These checklists categorize errors into those associated with dose preparation, positioning, inhalation, or general knowledge of device use (Appendix A in ESM).

Study Procedures

A randomized, parallel-group cross-over study design (Fig. 1) was used to compare the IT of participants with a Spiromax® placebo device and a Turbuhaler ® placebo device. This study consisted of two visits with each participant over a period of 4 ± 1 weeks (visit 1 and visit 2). At the beginning of each visit, data regarding history of inhaler use were collected. At visit 1, participants were randomly assigned to demonstrate their ability to use either Spiromax® first followed by Turbuhaler® or Turbuhaler® first followed by Spiromax®. Device mastery was assessed by a trained researcher observing the way in which the participant used the devices, against the above-mentioned checklists [39]. Device mastery was defined as the ability to use the device without performing any errors as observed by the trained researcher assessor. Device maintenance was defined as the ability to use the device at visit 2 without performing any errors (level 1, Fig. 2), without the need to undergo any training during this visit.

Fig. 1
figure 1

Overall study design

Fig. 2
figure 2

Inhaler technique assessment and training process. Visit 2 was conducted 4 weeks (± 1 week) after visit 1, and identical procedures were repeated

At visit 1, participants were randomly assigned to either Spiromax®, training followed by Turbuhaler® training or Turbuhaler® training followed by Spiromax® training, in a cross-over stage design. Training consisted of five consecutive steps until device mastery was achieved. At visit 2, which commenced 4 ± 1 week after visit 1, participants undertook the same training procedure.

A total of six levels of assessment and five of training were implemented as required (Fig. 2) (Appendix B in ESM) [39]. Level 1, intuitive use (no training); level 2, following use of written instruction; level 3, following viewing of instructional video; level 4, expert tuition from the researcher; level 5/level 6, repeats of expert tuition from the researcher when required. Participants progressed through each level and stopped at the point at which they demonstrated device mastery. At each level, trained researchers assess the IT of participants. The number and type of individual handling errors observed were recorded in the Research Electronic Data Capture (REDCap) system, a secure web application for building and managing online surveys and databases.

After device mastery was achieved, participants were asked to report on the device they preferred based on the Patient Satisfaction and Preference Questionnaire (PASAPQ), Part II Q15 (Appendix C in ESM), which is a single question on device preference extracted from a multi-item validated questionnaire on device satisfaction and preference [50].

Sample Size and Data Analysis

Data were analyzed using IBM SPSS Version 26.0 (IBM Corporation, Armonk, N1Y). The primary outcome was device mastery at level 1, visit 1, i.e., intuitive use of the device. Secondary outcomes included the ability to maintain device use at visit 2; achievement of device mastery at level 1, and the number of steps required to achieve device mastery; number and types of errors made, and the inhaler preferred by participants at each visit.

In order to detect a minimum statistically significant difference (0.23) on the primary outcome variable (proportion of participants who achieved device mastery at visit 1 between the Spiromax® and Turbuhaler®, Power 0.9, with a McNemar’s test of equality of paired proportions with a 0.050 two-sided significance level at a minimum, a minimum sample size of 115 pairs was required [39].

The McNemar’s test was used to compare the proportion of subjects achieving mastery of IT between the two devices. The Chi-square test was used to compare the proportion of participants achieving device mastery stratified by the order of randomization and the mean/median number of levels required to achieve device mastery between the two devices, respectively. For all analyses where a p value is provided, statistical significance was set at 0.05. Summary statistics collected at each visit included: number of levels required to achieve device mastery, number and type of assessor-observed errors (total of errors made at all steps), and device preference. Continuous variables (including age and number of levels taken to achieve device mastery) were summarized by reporting their mean along with their standard deviations. Categorical variables were reported as frequencies and percentage proportions. In particular, device mastery (yes/no) was expressed as cumulative number and percentage of participants achieving device mastery by each training step, unless otherwise stated. Participant demographic and baseline characteristics were summarized using descriptive statistics.

Results

Participant Demographics and Device Use History

The study was conducted between August 2018 and May 2019. A total of 246 participants were recruited into this study; of these 228 (44% male, mean age 46 ± 13 years) met the eligibility criteria and were enrolled in the study (Table 1). Of these, 177 participants were available for follow-up at visit 2: and there was a dropout rate of 51/228 (22%).

Table 1 Demographic characteristics for participants at visit 1

A significantly higher proportion of GPs indicated having previously received training on the Turbuhaler® prior to visit 1 compared to those having previously received training on the Spiromax®(61.5 vs. 9.6%, respectively, n = 228, Chi-squared analysis, p < 0.05).

Primary Outcome: Device Mastery at Visit 1, Level 1

There was no statistically significant difference between the proportion of participants who demonstrated device mastery with the Turbuhaler® compared with the Spiromax® at level 1 (119/228 (52%) versus 131/228 (57%), respectively, n = 228, p = 0.323; McNemar’s test of paired data). All but two participants achieved device mastery by level 3 instruction on the Turbuhaler® and the Spiromax® (Table 2).

Table 2 Participants achieving device mastery at visit 1, irrespective of randomization order (n = 228)

There was a statistically significant higher proportion of participants who demonstrated device mastery with the Spiromax® at level 2 overall (irrespective of randomization order) (Table 2) and at level 2 when it was the randomized to be the second device used (Table 3) compared with the proportion of participants who demonstrated device mastery with the Turbuhaler®.

Table 3 Participants achieving device mastery at visit 1, relative to randomization order (n = 228)

Secondary Outcome: Maintaining Device Mastery at Visit 2, Level 1

There was a statistically significant difference between the proportion of participants who demonstrated maintenance of device mastery with the Turbuhaler® compared with the Spiromax® at visit 2, level 1 (127/177 (72%) versus 151/177 (85%) respectively, p = 0.003; McNemar’s test of paired data). All but two participants achieved device mastery by level 3, visit 2. (Table 4 and 5).

Table 4 Participants maintaining and achieving device mastery at visit 2, irrespective of randomization order (n = 177)
Table 5 Participants maintaining and achieving device mastery at visit 2, relative to randomization order (n = 177)

Figure 3 shows the proportion of participants demonstrating mastery over time at each visit and at each level of assessment.

Fig. 3
figure 3

Proportion of participants achieving and maintaining device mastery over the study period. The chart shows the cumulative proportion (%) of participants demonstrating correct inhaler technique with the two study devices at each step during the study visits. Total number of participants: visit 1, n = 228 and visit 2, n = 177

Secondary Outcome: Number and Types of Errors Made

The most common error made on the Turbuhaler® was a positioning error where the “Inhaler is not held upright when a dose is prepared”, performed incorrectly on 32% of occasions during visit 1. The most common errors on the Spiromax® were the “inhaler is not held up right when the dose is prepared” and “vigorous shaking before or after dose preparation” steps, both performed incorrectly on 20% of occasions during visit 1 (Table 6). Results for rates of errors at all steps are available in the Supplement Table 1.

Table 6 Most common device errors at each visit

Secondary Outcome: Participants’ Preferences for Inhaler

At visit 1, 223 participants completed question 15 of the PASAPQ PART II. Spiromax® was the preferred device by 41% of participants compared to 34% who stated that Turbuhaler® was their preferred device; 25% of participants reported no preference (Fig. 4).

Fig. 4
figure 4

Participants’ preferred device at the completion of visits 1 and 2

At visit 2, all participants (n = 177) completed question 15 of the PASAPQ PART II. Spiromax® was the preferred device by 50% of participants compared to 32% who stated that Turbuhaler® was their preferred device; 18% of participants reported no preference (Fig. 4).

Discussion

This multicenter, randomized, un-blinded, cross-over study, to our knowledge, is the first to compare the level of training required for GPs to master and maintain correct IT when using two dry powder inhaler devices that can be substituted in clinical practice—the Spiromax® and the Turbuhaler®. The study further determined the number and types of errors made by GPs on each inhaler device and inhaler device preference at each training visit. Our study revealed several key findings: (1) despite the fact that GPs were less likely to have previously received training on the newer generic Spiromax®, they were equally able to demonstrate device mastery with the Spiromax® and Turbuhaler®, on which a majority of GPs had received previous training; (2) maintaining device mastery by GPs was more likely with Spiromax® than Turbuhaler®; (3) GPs were more likely to make more errors with Turbuhaler® than Spiromax®; (4) the most common error made on the Turbuhaler® was not holding the inhaler upright during dose preparation and on the Spiromax® it was not holding the inhaler upright after dose preparation as well as vigorous shaking of the inhaler before or after dose preparation and (5) Spiromax® was the preferred inhaler device at each training visit.

This study demonstrated that there was no difference in the proportion of GPs who could demonstrate device mastery with Turbuhaler® compared with the Spiromax®. Considering that the majority of GPs had reported having previously received education/instruction on the use of the Turbuhaler® and a minority on the use of the Spiromax®, it suggests that device-naïve GPs are likely to be able to intuitively use the Spiromax® device at the point of prescribing and to demonstrate correct IT to their patients when generic substitution is required. This finding has significant implications for everyday practice in the general practice setting, especially given the overwhelming number of inhalers available on the market. GPs are the first HCP in the chain of asthma management; they initiate medication treatment, are in a position to change therapy (and devices), and are the HCP that most people with respiratory illness turn to [16, 17]. A history of poor IT among HCPs has cast doubt on the feasibility of generic substitution of inhaler devices, given that successful substitution requires GPs to obtain patient consent as well as demonstrate correct device technique [13]. However, this research goes some way to alleviating the potential risks of generic substitutions in the case of budesonide/formoterol, (i.e., of Turbuhaler® and Spiromax®). Given the paradigm shift in asthma management with budesonide/formoterol as needed therapy at GINA step 1 for mild asthma [26] and the potential for millions of people with asthma to be affected by this particular inhaler generic substitution, the reassurance of device equipoise between these two distinctly different devices in terms of IT in real-life general practice (despite differences in education received) is particularly reassuring.

Consistent with previous research among HCPs and patients, this study among practicing GPs confirmed that maintaining device mastery is problematic [7, 45,46,47,48]. It can be argued that 100% of prescribers should be maintaining correct IT after training, however despite this, we have found that maintaining correct IT was more likely with the Spiromax® than with the Turbuhaler®. These findings are in line with health care profession students who are naive to these dry powder inhaler devices® [39] with the implication that GPs may require less frequent “refreshment”/upskilling on the use of certain devices compared to others [51]. While frequent educational interventions do improve long-term maintenance of IT [51], the reality is that from the GPs perspective, there needs to be a prioritization of this aspect of asthma management. Research has clearly shown that IT is more than a physical skill and motivation plays an important role [17]. Whether GPs have the time and inclination to devote the time to IT and the complex counselling that is probably needed around IT, adherence, and the quality use of medicines [52, 53] is a question that continues to remain unanswered.

From a technical perspective, it was found that GPs were more likely to make a greater number of IT errors with the Turbuhaler® when compared to the Spiromax®. The errors identified with Turbuhaler® use were “critical errors” that have been shown to be linked to poor asthma control and increased exacerbation rate among asthma patients [16, 54, 55]. Although the Spiromax® had not been evaluated in the above studies as it was not available at the time, the types of errors performed incorrectly with its use are of a similar nature to those critical errors made with Turbuhaler® use, namely positioning, dose preparation, and inhalation maneuver. The consistency in the types of errors performed incorrectly between devices is understandable given that dry powder inhalers frequently have the same features [37]. However, it also raises the question about whether errors are individual user rather than device related. This similarity can mean that there is also a knowledge transfer between devices [37] and this partially played out in this study with GPs performing better with the Spiromax®, once they had been trained with the Turbuhaler®, but not visa a versa. Despite the fundamental mechanisms underpinning this finding, there is a clear message that comes out of it, i.e., considering the wide range of dry powder inhalers and the concern among HCPs with regards to switching between inhalers [56], focusing education on these commonly performed errors may help to improve mastery of IT across a range of inhalers.

It is also interesting to delve more deeply into the nature of the errors made. By exploring these errors, there is a suggestion that perhaps these GPs do not have a full understanding of the concept of dry powder inhalers (DPIs), which have a number of core characteristics. The most common error made on the Turbuhaler® was not holding the inhaler upright during dose preparation and on Spiromax® it was not holding the inhaler upright after dose preparation as well as shaking the inhaler vigorously. Both at visit 1 and visit 2, the proportion of participants who made a breathing maneuver error was similar, which is understandable because the breathing maneuver is the most similar step between these two devices. However, there was a difference in the proportion who made the other errors and this can be explained by the fact that these two devices look and operate very differently. Interestingly, the shaking of the Spiromax® once again shows that participants did not really have an understanding of what a DPI is and because it visually resembles a pressurized metered-dose inhaler (pMDI), in the absence of education, it was being treated like a pMDI. This result is different from a study where student HCPs who have no experience prescribing medicines were assessed in their ability to correctly use and maintain correct technique with Turbuhaler® and Spiromax® [39], where shaking of the Spiromax was not a common error observed. Considering that our study involved experienced prescribers and that DPIs are prescribed in equal frequency to pMDIs for the delivery of ICS [38], it is no surprise that this confusion arose and that perhaps training of IT should focus on steps that are technically specific to each device, once again, highlighting the knowledge transfer that happens form the use of one device to another, and that fact that this is sometimes not a positive transfer of knowledge.

In this study, Spiromax® was the preferred inhaler device at the conclusion of each training visit, with preference increasing during the second visit. One possible reason for this increased preference at the second visit was the increased likelihood of being able to demonstrate its correct use in the first instance (level 1). Dry powder inhalers, including Turbuhaler® and Spiromax®, are traditionally easier to use than pMDIs [1] and Spiromax has been identified as a preferred inhaler due to its ease of use in a study with patients comparing use of dry powder inhalers [57]. While the GPs in this study expressed a preference for Spiromax®, in practice, patient preference for a device, the device itself, the physician’s own experience with the device, and several other factors impact their choice of prescription [1, 11, 58]. Similarly, cost to the patient is in consideration when prescribing a device, hence the importance of ensuring a ‘generic’ device is able to be mastered by prescribers who bear significant responsibility in ensuring correct device technique during generic substitution [58, 59].

A limitation of this study was interrater variability as previously identified in similar IT assessment research [16]. To minimize interrater variability, assessors received standardized training, used the same resources, and assessed each other prior to fieldwork. They were also shown the same examples of incorrect device use and asked to provide their independent evaluations and further training was undertaken when there were discrepancies in the assessments among assessors, but this cannot completely eliminate possibility of inter-rater and intra-rater variability. Further, as with most research, there is participant bias in that only GPs who were interested in IT agreed to participate or alternatively, those who felt that they needed training participated. We are not able to determine the potential impact of this potential bias. Despite these biases, there were no significant outliers present in the results demonstrating consistency in the assessment process. However, several steps such as inhalation force cannot be measured objectively through observation and this study could be strengthen if objective measures could be conducted.

A potential bias in this study is associated with the fact that we were supplied with empty Turbuhaler® devices versus Spiromax® devices containing lactose. The presentation of these two devices was consistent with the way in which each of the two manufacturers supply their “placebo” inhalers. We believe that this does in fact mimic the sensations experienced by patients when using these medication-filled devices [45, 47,48,49], however do recognize that it may be a source of bias in this study. The presence of lactose in the Spiromax® does equate to a feedback mechanism associated with use of this device. Feedback mechanisms provide users with a sign that the device has been used, however not necessarily that the device has been used correctly. While the primary aim of this study was to evaluate intuitive IT, which is not necessarily impacted by feedback mechanisms, it is foreseeable that this feedback mechanism could influence participant preference. Research indicates that feedback mechanisms can impact user device preference in both a positive and negative way [3, 45, 60, 61]. “Taste” (such as that associated with the deposition of lactose in the mouth) is a polarizing feature that can sometimes be associated with a decreased preference for a device but can also be a feature associated with increased preference due to the feedback feature [47]. With the development of novel “smart” inhalers, digital feedback, such as audio and visual feedback, is becoming a key feature [62]. In light of this, the results relating to participant preference for a device should be interpreted with caution.

Future studies assessing feasibility of generic substitution of inhaler devices should go beyond assessing the GP’s ability to demonstrate correct IT. There are several other factors associated with generic substitution and IT that were not addressed within this study. Investigations into how GPs teach and assess patients’ IT, their ability to identify errors, and counsel on other issues associated with substitution such as feel/taste/delivery/confusion/packaging needs to be conducted. Further to this, it is essential to investigate the relationship between the GP’s ability to use inhalers and its effect on patient IT. Similarly, investigating the role of the pharmacist in obtaining consent for generic substation, identifying IT errors, and teaching correct IT would be valuable to distribute the responsibility between both HCPs involved in prescribing and dispensing. Further investigations also need to evaluate whether correcting IT may lead to greater adherence and evaluation of whether a dose adjustment may be required [63, 64].

Conclusions

GPs can equally demonstrate correct technique with both Turbuhaler® and Spiromax® devices although most were Spiromax®-naïve with only a minority reporting a history of receiving training on Spiromax® instruction in the past. Substitution of either device during prescribing can be supported with GPs demonstrating correct device use, once patient consent for substitution has occurred. However, the use of inhalers and knowledge around the difference between different inhalers remains an issue, regardless of the extent of training previously received.