Abstract
Background
During the COVID-19 pandemic, United Kingdom (UK) stop smoking services had to shift to remote delivery models due to social distancing regulations, later reintroducing face-to-face provision. The “Living Well Smokefree” service in North Yorkshire County Council adopted a hybrid model offering face-to-face, remote, or a mix of both. This evaluation aimed to assess the hybrid approach’s strengths and weaknesses and explore potential improvements.
Methods
Conducted from September 2022 to February 2023, the evaluation consisted of three components. First, qualitative interviews involved 11 staff and 16 service users, analysed thematically. Second, quantitative data from the QuitManager system that monitored the numbers and proportions of individuals selecting and successfully completing a 4-week quit via each service option. Third, face-to-face service expenses data was used to estimate the value for money of additional face-to-face provision. The qualitative findings were used to give context to the quantitative data via an “expansion” approach and complementary analysis.
Results
Overall, a hybrid model was seen to provide convenience and flexible options for support. In the evaluation, 733 individuals accessed the service, with 91.3% selecting remote support, 6.1% face-to-face, and 2.6% mixed provision. Remote support was valued by service users and staff for promoting openness, privacy, and reducing stigma, and was noted as removing access barriers and improving service availability. However, the absence of carbon monoxide monitoring in remote support raised accountability concerns. The trade-off in “quantity vs. quality” of quits was debated, as remote support reached more users but produced fewer carbon monoxide-validated quits. Primarily offering remote support could lead to substantial workloads, as staff often extend their roles to include social/mental health support, which was sometimes emotionally challenging. Offering service users a choice of support options was considered more important than the “cost-per-quit”. Improved dissemination of information to support service users in understanding their options for support was suggested.
Conclusions
The hybrid approach allows smoking cessation services to evaluate which groups benefit from remote, face-to-face, or mixed options and allocate resources accordingly. Providing choice, flexible provision, non-judgmental support, and clear information about available options could improve engagement and match support to individual needs, enhancing outcomes.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Introduction
Smoking rates in the United Kingdom (UK) have fallen rapidly since the publication of the Smoking Kills White Paper in 1998 [1], but smoking rates remain high in certain sectors of the population. The UK policy narratives on reducing smoking rates highlight the high smoking rates among people who work in routine and manual occupations and people who live in the 20% most deprived areas [2, 3]. Smoking rates are particularly high among people experiencing multiple disadvantage and social exclusion, e.g., people experiencing homelessness and people in minority communities [4]. The National Health Service (NHS) Core20Plus5 approach to reducing health inequalities [5] emphasises the need to focus on “priority population groups” such as, pregnant and new mothers, people with a long-term mental health condition (particularly people with anxiety, depression, and severe mental illness), people with drug and alcohol dependence, people with a learning disability, and people with long-term physical health conditions (particularly chronic respiratory disease, cancer, and cardiovascular diseases). Given the disproportionate rates of smoking for people experiencing multiple disadvantages [2,3,4] and given that smoking is a leading cause of preventable chronic illness [5], to reduce health inequalities, models for the provision of support to stop smoking [6] need to be better targeted to “priority population groups” [7, 8].
Community Stop Smoking Services (CSSS) are at the forefront of efforts to reduce smoking in the UK [9, 10]. They work by receiving referrals from primary and secondary care services, maternity services as well as self-referrals, and supporting service users to work towards stopping smoking. They provide regular support, including behavioural and pharmacological interventions, with the aim of supporting the service user to achieve a 4-week quit. It is well established that engagement with CSSS can lead to increased successful quit attempts [11,12,13]. However, the low uptake of and engagement with CSSS by priority population groups [14], suggests that CSSS could be made more accessible to meet the needs of such populations.
During the COVID-19 pandemic, restrictions on the provision of face-to-face support [15] resulted in CSSS moving to “remote” delivery models, i.e. online and phone-based provision [16,17,18]. There is evidence that remote approaches are an effective means of delivering stop smoking support [19,20,21,22]. Remote provision can increase the availability of stop smoking support, especially in rural communities [17]. It can also increase the accessibility of support by decreasing the time and costs required by service users to attend support sessions [16, 20, 23]. Some CSSS have reported that service users had positive perceptions of remote provision during the COVID-19 pandemic [9, 24]. However, concerns around remote-only provision in terms of its suitability to different population groups, if staff can provide support of the same efficacy over remote mediums, and if wide-scale remote provision is sufficiently resourced, have been noted [17].
This study reports on a Public Health Intervention Responsive Studies Team (PHIRST) formative evaluation (see Elwy et al. [25]) of the North Yorkshire Council Living Well Smokefree (LWSF) service. The LWSF service is commissioned by North Yorkshire County Council as part of their strategy to reduce smoking prevalence across the North Yorkshire region [26]. To continue operating during the COVID-19 pandemic, the LWSF service moved from face-to-face provision, which was the main method of engaging service users, to predominantly remote delivery, with support being typically delivered through voice calls (video calls were provided for those who requested this, but this had a much lower use) [18]. As COVID-19 restrictions eased, the LWSF service developed a “hybrid” approach that includes three service delivery modalities: (1) “Face-to-face”– support delivered in-person, (2) “Remote”– stop smoking support via voice or video calls; (3) “Mixed”– a flexible combination of both face-to-face and voice or video calls. The motivation for doing so was to retain the positive aspects of remote provision whilst ameliorating issues for service users who would have benefitted from face-to-face support. Further, a hybrid service was seen to offer an equitable option for the county’s population (which is relatively geographically dispersed), providing the potential to overcome differences in service users’ geographical proximity to clinics. North Yorkshire is one of the largest English councils by area, with a sizable rural population [27], and the LWSF service only has the equivalent of six and a half full-time staff members to provide support over this area. The local authority is among the least deprived in England, ranking 125th least deprived out of 152 upper-tier local authorities for the 2015 Index of Multiple Deprivation (IMD), although there are pockets of high levels of deprivation within the county [28].
Our study aimed to assess the benefits and challenges of reconfiguring the LWSF service to provide a hybrid mix of face-to-face, remote and mixed support options. We sought to explore the extent to which hybrid approaches are acceptable delivery models to service users and practitioners, are equitable and provide value for money. To do this we drew on elements from evaluation frameworks [29, 30] to help highlight key considerations from service users, service staff and service managers, and insights from service data. The evaluation design and primary questions that this project aimed to answer were co-developed with the LWSF service stakeholders as part of an initial Evaluability Assessment (see Additional file 1) [31]. The two evaluation questions were: (1) What are the strengths and weaknesses of the new hybrid approach to service delivery? (2) How could the hybrid service be adapted and improved?
Methods
Our evaluation employed a mixed methods approach. We used interviews and focus groups to collect primary qualitative data which explored service staff and service user’s perspectives and experiences of the hybrid LWSF service, and existing quantitative data to explore service monitoring and outcome measures.
Qualitative methods
Sample and recruitment
This research employed a purposive and convenience sample, which was designed to capture a range of perspectives, and which reflected the practical challenges of recruitment in real-world settings and in “live” health services [32, 33]. Eleven staff involved in the design and delivery of the LWSF service (including seven stop smoking advisors (SSAs), two specialist advisors, and two service managers) participated in four focus group interviews. Sixteen service users receiving support from the LWSF service were also interviewed. Our service user sample included 13 females and 3 males, and was predominantly white British (13 White British, 2 Mixed/Multiple ethnic groups, 1 Asian/Asian British). The majority of the participants received remote support (12 remote support, 2 mixed, 2 face-to-face). (See Addition file 2 for service user demographic/characteristic information). Recruitment and dissemination of study information was facilitated by the LWSF managers. Staff involved in the LWSF service were provided with information sheets and consent forms (see Additional file 2) and invited to participate. Service users were approached by their SSA and provided with a verbal description of the study, and a project information sheet if they expressed interest in participation. All participants were provided with time to read the information sheet and to ask questions about the study and their participation. All participants consented to their contact information being securely transferred to the research team. The research team contacted potential participants to further discuss the research and then followed up after a week to arrange interview times. All participants provided written informed consent for their involvement in the research which was electronically signed.
Data generation
All data collection took place via an online video call platform or through a telephone call. All focus groups and interviews were facilitated by NW. The focus groups ran between September 2022 and March 2023 and lasted between 60 and 70 min. The interviews were conducted between September 2022 and February 2023 and lasted between 25 and 35 min. We recruited fewer service user participants than originally intended due to recruitment challenges (n = 20). Similar perspectives around service experience were continually present in the participant’s accounts, but that is not to say a larger or more diverse sample would not have produced differing perspectives. Nevertheless, our sample appeared sufficient enough to provide valuable insights and data to answer our research questions and address our aims [34].
The focus groups and interviews followed semi-structured topic guides (Additional file 2) which explored perspectives and experiences around offering and receiving remote vs. face-to-face vs. mixed smoking support, facilitators and barriers of engagement through different provision modalities, and suggestions for future service provision and development. An effort was made to ensure all questions were asked. The topic guides, information and consent forms were reviewed for comprehension and additional avenues of exploration, and then revised through public involvement, engagement and participation work. This was supported by our LWSF service partners who recruited LWSF service users not involved as participants in the study to act as our public advisors.
Data management, confidentiality, right to withdraw and consent were verbally reaffirmed before data collection began. All focus groups/interviews were audio-recorded only, using an encrypted recorder, and transcribed verbatim by a university-approved transcriber. All transcripts were anonymised at the point of transcription, checked for accuracy by NW, and stored securely.
Data analysis
Qualitative data were analysed by NW and LK drawing on Braun and Clarke’s [35] thematic analysis approach. An initial coding frame was inductively developed based on initial readings of the transcripts; both NW and LK separately read a selection of transcripts, with initial thoughts and ideas being noted. Transcripts were re-read and coded using a line-by-line approach, where codes were generated inductively. The coding framework was revised following discussions between NW and LK, with the codes examined, merged, and grouped into potential themes and sub-themes. The revised framework (Additional file 2) was applied to the transcripts by NW, and LK separately coded a selection of transcripts to check for accuracy and consistency. NW and LK discussed the coding and reviewed and refined the themes following this. Through the analysis five key themes were generated: (1) Reach of the service to priority service user groups, (2) Perceived effectiveness of the stop smoking intervention, (3) Accommodation of service users’ needs, (4) Implementation of the hybrid service, and (5) Maintenance of the hybrid service. Transcripts were coded using the qualitative data management software system NVivo 12.
Quantitative methods
Service use and effectiveness
The LWSF service routinely monitors service usage and quitting outcomes in terms of 4-week quits [36]. Data is recorded on QuitManager (North 51, Nottingham, UK), an online database system for recording information on service users and intervention characteristics. The LWSF team regularly inspect these data by generating summary statistics of service use and outcomes, stratified by priority service user groups, geographic areas, and source of referral. With the introduction of the new hybrid service, this monitoring was extended to include variation by mode of contact with the service, i.e., differences in usage and outcomes depending on whether a service user initially chose the remote, face-to-face or mixed service pathways. For reasons of practicality, the recording of data on the pathway chosen by the service user was based on their preference expressed at first contact with the service. If a service user initially chose the remote or face-to-face options and then it was agreed that they would receive a mixture of contact modalities, their recorded pathway was changed to the mixed option. However, if a service user chose the face-to-face option and happened to need a remote session because they were unable to attend face-to-face, then they were still recorded under the face-to-face option. The service began to collect quantitative data in this structure to enable monitoring of differential use of the three pathways in September 2022. A summary of the 6 months of data provided by the service is available in Additional file 3.
Due to the early stage of hybrid service implementation and the limited data available, statistical analysis of the difference in quit rates was not possible due to the small sample sizes for the different modalities. Therefore, only descriptive statistics are presented (see Tables 1 and 2).
Value for money of face-to-face services
The evaluability assessment process identified a need to estimate how the new hybrid service affected the value for money of the LWSF service from the provider’s perspective. Value for money is normally assessed using a metric of the “cost per 4-week quit” generated by the service. The evaluation aimed to estimate the value of reintroducing face-to-face delivery by estimating the additional monthly cost to the service of providing face-to-face appointments (that could be used by service users in the face-to-face or mixed pathways) and dividing this cost by the number of 4-week quits achieved by service users in the face-to-face or mixed pathways. The definition of cost components was discussed with the service, resulting in the costs being based on the cost of venues in which to hold face-to-face clinics, and the cost of travel and parking for service staff. The costs of carbon monoxide (CO) monitoring were not included due to the low rate of CO monitoring at the time of the evaluation and the relatively modest cost of the consumables involved in CO monitoring. The cost data used in the evaluation is available in Additional file 3.
Mixed methods synthesis of findings
Drawing on an “expansion” approach [37] and complementary analysis [38], findings from the qualitative themes and quantitative elements were synthesised to give a five-part structured answer to the two evaluation questions. We present our findings using the 5 key themes generated from the qualitative analysis as headings: (1) Reach of the service to priority service user groups, (2) Perceived effectiveness of the stop smoking intervention, (3) Accommodation of service users’ needs, (4) Implementation of the hybrid service, and (5) Maintenance of the hybrid service. Where appropriate, we have used available quantitative data to complement the qualitative findings. Our synthesis integrated findings across the interviews with service users and service staff, the discussions with the service management team as part of the formative evaluation process, and the quantitative data provided by the service to inform the evaluation. The qualitative data provided context to the quantitative findings, which is important because the quantitative findings were a snapshot of the new hybrid service at an early stage in its implementation.
Research question 1 (What are the strengths and weaknesses of the new hybrid approach to service delivery?) is addressed across the first four themes. Research question 2 (How could the hybrid service be adapted and improved?) is predominantly addressed in theme five, but other findings are presented where relevant across the first four themes.
Ethics
Ethical approval for the study was granted by the Sheffield Centre for Health and Related Research (SCHARR) ethics committee at the University of Sheffield, application reference number: 049146.
Results
Overall, there was a general preference for remote over face-to-face provision by service users and staff, with over 90% of service users who accessed the service selecting remote support (Table 1). For those who set a quit date, phone support was found to have similar, but slightly higher, 4-week quit outcomes compared to face-to-face support– 76% (279 quits out of 367 quit dates set) vs. 73.9% (17 quits out of 23 quit dates set), but lower than mixed support– 87.5% (7 quits out of 8 quit dates set). However, the early stage of hybrid service implementation, and the small sample sizes on which these comparisons are based, mean that there is too much uncertainty to be able to draw conclusions about differences in quitting outcomes between the different modalities (Table 1).
Reach of the service to priority service user groups
Remote provision was described by service staff as enabling a much wider service offering and facilitating greater access and support for different populations, including for people who were often “geographically excluded” in rural areas far from available clinics, those who struggled to access face-to-face appointments due to mental or physical health issues, and those unable to attend due to time requirements and employment commitments:
“I’m speaking to people I never would have spoken or had a face-to-face with because it wouldn’t have been possible for me to go there. So it has made the service more accessible to those hard to reach rural groups and people who couldn’t attend because of their employment situation and so on.” (FG1– service staff).
There was a suggestion from service staff that more flexible ways were needed to engage with the current smoking population, and that a hybrid service can help to facilitate this:
“We’re at the harder to reach smokers, we’re at the stage of the difficult smokers now, so if anything we need to be even more accommodating to them, this [hybrid service] can solve that really.” (FG3– service staff).
The modality selection preferences for all service users who set a quit date was 92.2% phone support, 5.8% face-to-face support and 2.0% mixed support (see table 1). This overall pattern was reflected in the priority population groups: pregnant service users (98.2%, vs. 0% face-to-face and 1.8% mixed support), people with mental health conditions (93.4%, vs. 5.1% face-to-face and 1.5% mixed support) and people with long-term physical health conditions (91.2%, vs. 5% face-to-face and 3.8% mixed support) (Table 2).
“It has helped not actually having to have to visit somebody face-to-face…it’s a lot more beneficial to people who have anxiety and mental health issues like me.” (IN12– service user).
Perceived effectiveness of the stop smoking intervention
Privacy and openness
For many service users, phone support was spoken of as enabling more openness in discussions, typically through perceived partial anonymity and a greater level of privacy due to participation from known places of comfort. Further, the perceived protections that remote provision offers acted to reduce potential stigmas (e.g., around smoking during pregnancy) and anxieties (e.g., having to attend clinics in person for people with mental health issues) associated with attending face-to-face clinics, and was noted as important in facilitating engagement and openness during appointments:
“It [remote provision] means people don’t see you going in when you can do it over the phone, so it’s better when you’re pregnant so you know you won’t be judged by anyone.” (IN15– service user).
Carbon monoxide (CO) monitoring
A challenge of remote provision, that some SSA saw as linked to service user engagement and motivation, was the inability to conduct CO monitoring to validate quits. This was commented on as reducing service user accountability, and removing a tangible measure of success, as CO monitoring was seen as something that could motivate service users:
“It’s almost like when people go to slimming world or weight watchers, that scale gives them accountability. And they think that the CO reader is that accountability, it’s like ‘ooh let’s see what I can blow this week’. And it does help motivate people quite a lot” (FG1– service staff).
However, there were mixed perspectives from service users around the use of CO monitoring, with some unaware of it being offered, some using and seeing it as a motivating and engaging feature of support, whilst others were indifferent about its use.
Barriers and facilitators to rapport development
There were mixed views over the ability to develop rapport and therapeutic relationships via remote means. Some SSA and service users suggested it was easier and quicker to develop a rapport face-to-face, due to the interpersonal connection such sessions provided. Despite this, many participants noted they were able to develop effective relationships and engagement with service users/SSA through remote means only. A key benefit of mixed provision was the ability to have initial face-to-face contact with a SSA which was noted as facilitating the development of rapport for some:
“I liked it the way it happened with me, where I see them at the start, and then just phone after…then you already know who it is, so, and with phone calls then, it’s still quite personal, because it’s not just a voice, know what I mean.” (IN16– service user).
Interestingly, there was a suggestion from some SSA that, for some service users, remote provision can result in poor engagement with sessions, due to remote support not permitting focus and attention:
“The difficulty we’ve had with telephone support for a lot of the time was that you’d ring and they were like out doing their shopping. I mean in COVID it was different because a lot of people were stuck at home…but sometimes now, you aren’t getting their full attention…They’re not really like engaging with you.” (FG2– service staff).
Accommodation of service users’ needs
Having a hybrid approach was consistently noted as providing the flexibility and accommodation to meet the eclectic needs of service users, to enable support to fit into people’s personal and work lives, and to remove “barriers” around service engagement:
“It’s like, booking time off work for an appointment and stuff like that, whereas doing it remotely, I could just do it at work, just saying I’ll be back in five minutes I’ve got an appointment on the phone…It’s the time and having to go to appointments, know what I mean, it’s just easier on the phone.” (IN3– service user).
Whilst the majority of service users were selecting remote over face-to-face or mixed provision (Table 1), there was still a perceived need and want for face-to-face options from some service users. Further, offering mixed support (typically experienced as being able to move from face-to-face to phone support), was particularly valued at permitting the continuation of support in response to the complexities of everyday life:
“It’s the best of both worlds really, so it’s made it all more accessible for me…, because when I couldn’t make a meeting due to childcare issues, I could still get my support that week over the phone.” (IN4– service user).
Supportive and flexible approaches
It was consistently clear that each service user was different, and thus required support and approaches to meet individual needs and preferences. Having the ability to choose the type of provision received, and having flexibility in support, was valued as an important aspect of engagement which contributed to perceived service satisfaction:
“Having that flexibility in getting support means I can get that support when I need it, it’s like allowing me to make the most of my determination before it’s gone.” (IN6– service user).
The perception of non-judgmental supportive relationships from service staff was noted as crucial in engagement and rapport building for service users. It appeared that the skills of staff to develop relationships, and the levels of care, compassion, and personalised support they provided, helped engagement irrespective of the modality of support:
“I never felt judged, and that’s what I was scared of [being pregnant], but straight away even on the phone [name] made me feel at ease, just really friendly. That helped me open up, because we just got on”. (IN15– service user)
Implementation of the hybrid service
“Quantity vs. quality” of quits
Generally, the SSAs and service managers noted that remote provision was a much more “efficient” use of time, compared to purely face-to-face provision, in terms of increasing SSA caseload capacity and the number of service user contacts they could have. However, due to the nature of remote provision, quits were self-reported and not validated by CO monitoring. In light of the reported lack of national or local requirement for services to achieve CO validated quits, the LWSF service were prioritising offering service users’ choice and flexibility in the support they received. Any national or local change in requirements around achieving CO validated quits was noted as requiring a change in how the hybrid service would be delivered, and the proportion of remote and face-to-face provision offered:
“If you wanted to get to as close to 100% CO validation as possible, you’d need to put a lot of face-to-face clinics on, and then you’d need to not offer as much remote, and that would cut down on your numbers… it’s a difficult balance to strike between getting people in face-to-face, getting CO validation rates up, but seeing the amounts of people we need to, and having flexibility to see people.” (FG4– service managers).
Therefore, achieving CO validated (“quality”) quits was seen to be balanced against the number (“quantity”) of quits and service user engagement that could be achieved through remote provision.
Managing increased caseloads
Offering primarily remote provision was described by some SSA as resulting in, at times, considerable workloads and extremely large caseloads, specifically during “peak” periods. Further, many SSA felt their roles went beyond stop smoking support to various aspects of social and mental health support, which was described as “draining”:
“A lot of people talk about their problems during their phone calls, and actually, that can be very draining as well.” (FG2– service staff)
These issues were particularly pertinent during the COVID pandemic and were noted to have been exacerbated by the consecutive “back-to-back” nature of phone support sessions, and the lack of formal and informal team support accessible through complete working from home:
“[It’s] a little bit isolating. Because you’re working from home, you don’t have any colleagues that you see every day, you’re not having those corridor talks or those five minutes for a coffee in the canteen… being able to sit and have a chat with somebody, and a moment to sorta say ‘oh did you find that!’ and ‘oh I’ve been struggling with that!’. And a lot of that is missing.” (FG1– service staff)
Maintenance of the hybrid service
Data-led service delivery decisions
To inform future service adaptations to the needs of the local population, it was noted that data on the hybrid service was needed over a longer period of implementation. This would better determine the relative effectiveness of the remote, face-to-face and mixed pathways (in terms of the number of people setting and achieving 4-week quits) and how this varied by population demographics (e.g., ages, genders, ethnicities, geographies) and priority groups (e.g., maternity, mental health, substance misuse). See Table 2, and Additional file 3 for emerging data around variations in quit outcomes between the different pathways for different priority groups.
We estimated that the additional cost of providing a face-to-face option in the period September 2022 to February 2023 was £692 per month. In the average month from September 2022 to February 2023, 149 people were referred to the LWSF service. Using the percentages from Table 1, the service could expect 4 of these people to achieve a 4-week quit using either the face-to-face or mixed pathways. Dividing the total cost by the total quits gave a cost per 4-week quit from the additional face-to-face option of £175. (See Additional file 3 for further detail and breakdown around the calculation of return on investment for the face-to-face offering). Whilst information on the “cost-per-quit” for each of the three pathways was noted as important, offering service users a choice of pathways was perceived as crucial and potentially more important than any differences in the value for money among the pathways provided.
There were discussions around offering all service users a choice around pathway options and providing a more tailored and targeted approach for different populations and priority groups. This again was discussed in terms of a “quantity vs. quality” perspective, with a perceived need for targeted support for some smokers, but reflection that this could be a more time and resource-intensive approach. National and local priorities around guidance on what the LWSF service should be offering, as well as ongoing data collection, were suggested to be the key influences on the promotion and adaptation of support pathways going forward.
Improving awareness of the hybrid service
The most consistent suggestion for service improvement was for better service information and knowledge to be available, advertised and disseminated, specifically around the hybrid offering and the flexibility of provision:
“I think most people think that it is just like face-to-face appointments and if people are working they struggle to get to appointments or if they’ve got young kids. So, if it’s made clear that there are both face-to-face appointments and over the phone whichever works best for them, that could make a big difference.” (IN1– service user)
Several service users who were “referred in” from primary and secondary services noted receiving little information about the LWSF service, in terms of the modalities of support available, how support was provided and the flexibility of support. This information was noted as important in reducing anxieties and encouraging engagement.
Discussion
The LWSF service’s shift towards remote provision was seen to have enabled a greater level of service accessibility, removing barriers to support for those who were previously excluded, unable or struggling to attend and participate in face-to-face provision. The re-introduction of face-to-face provision, and offering of mixed support, to form a hybrid approach was seen to expand service user choice and access. For some staff, remote provision was noted to have produced increased efficiency in terms of the number of people receiving support, but also increased caseloads. There was a perceived trade-off between the “quantity vs. quality” of quits, where face-to-face contact was seen to produce a smaller number of “higher quality” CO validated quits vs. the greater quantity of quits that could be achieved through more “efficient” remote provision. Tailoring support pathways to specific populations was noted as potentially more resource-intensive than offering a flexible choice of support options to all, but it was also noted that this might be required in order for the service to effectively support these populations.
Personal contact, perceived connection and interpersonal relations between service users and providers have consistently been noted as important in engagement and treatment adherence [15, 16, 39] and in supporting, encouraging and motivating health-promoting behaviours [20, 40]. Remote provision was noted as beneficial in engaging priority groups by removing barriers around engagement, such as stigma, and fear of judgement [41], which can facilitate openness during sessions [42]. It was suggested in the accounts of the SSA that remote provision, especially now post-COVID lockdown policies, when people were not restricted to their homes, was resulting in lower levels of engagement for some service users. It has been noted in previous work that remote sessions are less engaging, and that service users spend more time participating in face-to-face provision than online/remote sessions [23]. Thus, remote sessions may have greater accessibility, but at the potential cost of less engagement for some. In our study, whilst there was a suggestion that developing effective relationships through remote provision could be more difficult [20, 43, 44], it was still achievable. Regardless of the modality of care, our service user participants discussed the importance of a supportive therapeutic relationship upon their engagement, with non-judgmental and personalised approaches from service staff facilitating rapport building.
There does not appear to be a single approach that will universally suit all service users, but a key theme evident in our study was how valued a flexible, patient-centred approach was. This echoes findings from the wider literature where there is a consistent recommendation of a patient-centred approach (for example, the recent calls for personalisation in health care [45]), and where the modality of care is designed, chosen and delivered in conjunction with service users [16, 44]. It is important to note that despite flexibility and choice being valued by service users, some populations may require more targeted or tailored ways of provision (e.g., [46, 47]). Such considerations around offering “flexible choice” or “targeted” provision are crucial for services in the establishment, adaptation and promotion of support. Our results suggest that whilst there were similar 4-week quit outcomes for priority groups (see Table 2), there were some variations in quit outcomes between the different pathways for different groups (e.g. a higher percentage of 4-week quits were achieved with face-to-face support (85.7%, n = 6) compared to phone support (72.4%, n = 92) for people with mental health conditions (see Table 2). However, the short time that the LWSF hybrid service had been in operation and the small sample sizes in some subgroups leads to high uncertainty in conclusions. Longer-term data around the outcomes of different pathways for different populations, will inform and guide services around designing, targeting and tailoring provision to best support and engage service user engagement and access.
Misconceptions of what smoking services offer, their proximity and how they can be accessed have been noted as barriers to engagement [48]. Such issues were commented on in our study, with service user participants highlighting a general lack of awareness around available service provision options before and during their referral. Therefore, ensuring that accurate knowledge of CSSS and their offer is received by potential service users is important, and may facilitate initial engagement.
Similarly, despite mixed awareness and perceptions from service users of CO testing, promoting this may be beneficial in engagement and encouraging uptake of face-to-face appointments by providing an additional motivation via a tangible marker of success [49]. Additionally, there is the ability for CSSS to employ remote CO monitoring (e.g., via the home delivery of devices and undertaking self-reported or video-monitored checks, undertaking home visits to complete tests, or organising verification at local clinics/chemists [50,51,52,53]. However, conducting remote CO verification of smoking has associated challenges, including issues around digital inequalities for service users, the accuracy of devices and recording [50], and crucially the costs of remote CO devices for CSSS [54]. Nevertheless, if remote support is to continue to be offered by CSSS and primarily selected by service users, it may be important for CSSS to consider strategies around delivering remote CO monitoring.
Strengths and limitations
The main strength of our study is the formative evaluation approach that was designed to identify potential and actual influences on the progress and effectiveness of implementation efforts from the point of view of informing future service adaptations and responses [55]. Our formative evaluation was preceded by an Evaluability Assessment process in which the aims, objectives, and design of the subsequent evaluation were co-developed through a participatory process with service stakeholders (see Additional file 1) [56]. Evaluability Assessment is a rapid, systematic, and collaborative way of deciding how a programme or policy can be evaluated [31]. Our formative evaluation approach enabled us to deliver emerging findings back to the LWSF team, allowing data to help inform, improve and adapt the service during the evaluation process [57]– for example, around the value of more clearly presenting the hybrid offering and flexible options for potential service users.
The main limitation is that our study was based on only one stop smoking service in England, which was at an early stage of implementing its new hybrid service offering. The evaluation occurred under “real life” conditions, and thus there was no randomisation of service users to groups of remote, face-to-face or mixed provision, with service users selecting which provision mode they preferred at the start of their treatment. We worked with our LWSF project partners to try and represent the heterogeneity of participants the service engages with, but due to the nature and challenges of our recruitment methods, we were only able to sample service users opportunistically. Thus, our findings reflect the perspectives and experiences of the service users who had engaged and nearly completed their treatment. Future work could explore the experiences and perspectives of those who disengaged from support, or employ a targeted outreach approach to explore the experiences of marginalised populations often excluded from CSSS (e.g. the most disadvantaged groups [58, 59], such as homeless populations [60]).
Conclusion
The findings of our study add to the evidence showing high levels of acceptability around remote [15, 61, 62] and flexible mixed provision [23], and shows the potential of hybrid treatment options for people trying to stop smoking [16, 23]. Our study illustrates how the establishment of hybrid support can provide an opportunity for services to assess which types of users in their local populations might benefit from remote, face-to-face or mixed options, as well as to direct their approaches and resources accordingly. Ensuring that CSSS provide choice around their support, flexible delivery of provision, non-judgmental support, and that there is clear understanding around what provision they provide, may contribute to engagement and successful outcomes through enabling preferred and beneficial support when needed.
Data availability
The qualitative datasets generated and/or analysed during this study are available from the corresponding author on reasonable request, and subject to approval from the Sheffield Centre for Health and Related Research (SCHARR) ethics committee at The University of Sheffield. The quantitative data provided by the LWSF service to inform the evaluation is summarised in the results section and in the supplementary material– Additional file 3. The data on which these summaries are based is not possible to make available due to the risk of disclosing individual service user identities. For the purpose of open access, the author has applied a Creative Commons Attribution (CC BY) licence to any Author Accepted Manuscript version arising.
Abbreviations
- CO:
-
Carbon monoxide
- CSSS:
-
Community Stop Smoking Services
- FG:
-
Focus group
- IN:
-
Interview
- LWSF:
-
Living Well Smokefree
- NHS:
-
National Health Service
- PHIRST:
-
Public Health Intervention Responsive Studies Teams
- SSA:
-
Stop smoking advisor
- UK:
-
United Kingdom
References
Department of Health. Smoking kills: a White Paper on Tobacco. London: Stationary Office; 1998.
Department of Health. Towards a Smokefree Generation: a Tobacco Control Plan for England. London: Department of Health; 2017.
Kahn J. The Khan review: making smoking obsolete. London: Office for Health Improvement and Disparities; 2022.
Office for National Statistics. Deprivation and the impact on smoking prevalence, England and Wales: 2017 to 2021. 2023.
NHS England. Core20PLUS5 (adults)– an approach to reducing healthcare inequalities. 2023.
Public Health England. Models of delivery for stop smoking services: options and evidence. London: Public Health England; 2017.
Bryant J, Bonevski B, Paul C, et al. A systematic review and meta-analysis of the effectiveness of behavioural smoking cessation interventions in selected disadvantaged groups. Addiction. 2011;106(9):1568–85.
Hill S, Amos A, Clifford D, et al. Impact of tobacco control interventions on socioeconomic inequalities in smoking: review of the evidence. Tob Control. 2014;23(e2):e89–e97.
Action on Smoking and Health. Reaching Out: Tobacco control and stop smoking services in local authorities in England. 2021.
Smith CE, Hill SE, Amos A. Impact of specialist and primary care stop smoking support on socio-economic inequalities in cessation in the United Kingdom: a systematic review and national equity analysis. Addiction. 2020;115(1):34–46.
Bauld L, Bell K, McCullough L, et al. The effectiveness of NHS smoking cessation services: a systematic review. J Public Health. 2010;32(1):71–82.
Chamberlain C, O’Mara-Eves A, Porter J et al. Psychosocial interventions for supporting women to stop smoking in pregnancy. Cochrane Database Syst Reviews 2017(2).
West R, May S, West M et al. Performance of English stop smoking services in first 10 years: analysis of service monitoring data. BMJ 2013;347.
Latif A, Mandane B, Qureshi S. Commentary on the new English smoking cessation Advanced service: a sustainable gateway to care or will it disappear in a puff of smoke? Int J Pharm Pract. 2022;30(4):391–3.
Davies NP, Callister ME, Copeland H, et al. Opportunistic non-governmental Organisation Delivery of a Virtual Stop Smoking Service in England during the COVID-19 Lockdown. Int J Environ Res Public Health. 2022;19(13):7722.
Mahoney MC, Park E, Schlienz NJ, et al. Transitioning to remote clinic visits in a smoking cessation trial during the COVID-19 pandemic: mixed methods evaluation. JMIR Formative Res. 2021;5(4):e25541.
Vinci C, Hemenway M, Baban SS, et al. Transition to telehealth: challenges and benefits of conducting group-based smoking and alcohol treatment virtually. Contemp Clin Trials. 2022;114:106689.
Action on Smoking and Health. Stepping up: The response of stop smoking services in England to the COVID-19 pandemic. 2021.
Bennett L, Jones A, Paranjothy S. Models for Access to maternal smoking Cessation Support: a quasi-experiment to increase the engagement of pregnant women who smoke in National Health Service stop smoking services. Lancet. 2016;388:23.
Byaruhanga J, Paul CL, Wiggers J, et al. The short-term effectiveness of real-time video counselling on smoking cessation among residents in rural and remote areas: an interim analysis of a randomised trial. J Subst Abuse Treat. 2021;131:108448.
Danielsson A-K, Eriksson A-K, Allebeck P. Technology-based support via telephone or web: a systematic review of the effects on smoking, alcohol use and gambling. Addict Behav. 2014;39(12):1846–68.
Matkin W, Ordóñez-Mena JM, Hartmann‐Boyce J. Telephone counselling for smoking cessation. Cochrane Database Syst Reviews 2019(5).
Siemer L, Ben Allouch S, Pieterse ME, et al. Patients’ user experience of a blended face-to-face and web-based smoking cessation treatment: qualitative study. JMIR Formative Res. 2020;4(6):e14550.
Cox S, Ward E, Ross L, et al. How a sample of English stop smoking services and vape shops adapted during the early COVID-19 pandemic: a mixed-methods cross-sectional survey. Harm Reduct J. 2021;18(1):95.
Elwy AR, Wasan AD, Gillman AG, et al. Using formative evaluation methods to improve clinical implementation efforts: description and an example. Psychiatry Res. 2020;283:112532.
Health and Wellbeing Board North Yorkshire. North Yorkshire tobacco control strategy 2015-25. 2015.
Local Government Association. Responding to cost of living challenges: North Yorkshire. 2023.
Data North. Yorkshire. 2015.
Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.
Michie S, Atkins L, West R. The behaviour change wheel. A guide to designing interventions 1. Great Britain: Silverback Publishing. 2014;1003:1010.
Leviton LC, Khan LK, Rog D, et al. Evaluability assessment to improve public health policies, programs, and practices. Annu Rev Public Health. 2010;31:213–33.
Campbell S, Greenwood M, Prior S, et al. Purposive sampling: complex or simple? Research case examples. J Res Nurs. 2020;25(8):652–61.
Etikan I, Musa SA, Alkassim RS. Comparison of convenience sampling and purposive sampling. Am J Theoretical Appl Stat. 2016;5(1):1–4.
Malterud K, Siersma VD, Guassora AD. Sample size in qualitative interview studies: guided by information power. Qual Health Res. 2016;26(13):1753–60.
Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Res Psychol. 2006;3(2):77–101.
NHS Digital. Statistics on NHS Stop Smoking Services in England April 2019 to March 2020. 2020.
Bryman A. Integrating quantitative and qualitative research: how is it done? Qualitative Res. 2006;6(1):97–113.
Bazeley P. Complementary analysis of varied data sources. Integrating analyses in mixed methods research. Thousand Oaks, FL, USA: SAGE Publications Ltd; 2018. pp. 91–125.
Fredman Stein K, Sawyer K, Daryan S, et al. Service-user experiences of an integrated psychological intervention for depression or anxiety and tobacco smoking in improving access to psychological therapies services: a qualitative investigation into mechanisms of change in quitting smoking. Health Expect. 2023;26(1):498–509.
Wilhelmsen M, Lillevoll K, Risør MB, et al. Motivation to persist with internet-based cognitive behavioural treatment using blended care: a qualitative study. BMC Psychiatry. 2013;13:1–9.
Grant A, Morgan M, Gallagher D, et al. Smoking during pregnancy, stigma and secrets: visual methods exploration in the UK. Women Birth. 2020;33(1):70–6.
Hammett P, Fu SS, Nelson D, et al. A proactive smoking cessation intervention for socioeconomically disadvantaged smokers: the role of smoking-related stigma. Nicotine Tob Res. 2018;20(3):286–94.
Norwood C, Moghaddam NG, Malins S, et al. Working alliance and outcome effectiveness in videoconferencing psychotherapy: a systematic review and noninferiority meta-analysis. Clin Psychol Psychother. 2018;25(6):797–808.
Vera San Juan N, Shah P, Schlief M, et al. Service user experiences and views regarding telemental health during the COVID-19 pandemic: a co-produced framework analysis. PLoS ONE. 2021;16(9):e0257270.
Paddison C. Digital and remote primary care: the inverse care law with a 21st century twist. The Nuffield Trust; 2022.
Ho LLK, Li WHC, Cheung AT, et al. Effectiveness of smoking cessation interventions for smokers with chronic diseases: a systematic review. J Adv Nurs. 2021;77(8):3331–42.
van Wijk EC, Landais LL, Harting J. Understanding the multitude of barriers that prevent smokers in lower socioeconomic groups from accessing smoking cessation support: a literature review. Prev Med. 2019;123:143–51.
Hartwell G, Egan M, Petticrew M. Understanding decisions to use e-cigarettes or behavioural support to quit tobacco: a qualitative study of current and ex‐smokers and stop smoking service staff. Addiction. 2020;115(3):518–26.
Ormston R, van der Pol M, Ludbrook A, et al. quit4u: the effectiveness of combining behavioural support, pharmacotherapy and financial incentives to support smoking cessation. Health Educ Res. 2014;30(1):121–33.
Dahne J, Wahlquist AE, McClure EA et al. Remote Carbon Monoxide capture via REDCap: evaluation of an Integrated Mobile Application. Nicotine Tob Res 2023:ntad230.
Karelitz JL, Michael VC, Boldry M, et al. Validating use of internet-submitted carbon monoxide values by video to determine quit status. Nicotine Tob Res. 2017;19(8):990–3.
Kim J-R, Lee M-S, Hwang J-Y, et al. Efficacy of a smoking cessation intervention using the AHCPR guideline tailored for koreans: a randomized controlled trial. Health Promot Int. 2005;20(1):51–9.
Thrul J, Howe CL, Devkota J, et al. A scoping review and meta-analysis of the use of remote biochemical verification methods of smoking status in tobacco research. Nicotine Tob Res. 2023;25(8):1413–23.
Herbec A, Brown J, Shahab L, et al. Lessons learned from unsuccessful use of personal carbon monoxide monitors to remotely assess abstinence in a pragmatic trial of a smartphone stop smoking app–a secondary analysis. Addict Behav Rep. 2019;9:100122.
Stetler CB, Legro MW, Wallace CM, et al. The role of formative evaluation in implementation research and the QUERI experience. J Gen Intern Med. 2006;21:1–S8.
PHIRST Fusion. North Yorkshire County Council ‘Living Well Smokefree’: Evaluability Assessment Report. 2022.
Bauer MS, Damschroder L, Hagedorn H, et al. An introduction to implementation science for the non-specialist. BMC Psychol. 2015;3(1):1–12.
Hiscock R, Bauld L. Stop Smoking Services and Health Inequalities. National Centre for Smoking Cessation and Training (NCSCT); 2013.
Murray RL, Bauld L, Hackshaw LE, et al. Improving access to smoking cessation services for disadvantaged groups: a systematic review. J Public Health. 2009;31(2):258–77.
Laura T, Billie B, Christine P, et al. Perceived barriers to smoking cessation in selected vulnerable groups: a systematic review of the qualitative and quantitative literature. BMJ Open. 2014;4(12):e006414.
Johnston E, Bains M, Hunter A, et al. The impact of the COVID-19 pandemic on Smoking, Vaping, and Smoking Cessation Services in the United Kingdom: a qualitative study. Nicotine Tob Res. 2022;25(2):339–44.
Kim SS, Darwish S, Lee SA et al. A randomized controlled pilot trial of a smoking cessation intervention for US women living with HIV: telephone-based video call vs voice call. Int J women’s health 2018:545–55.
Acknowledgements
We are extremely grateful to the staff and service user participants who took part in interviews and focus groups for this study, and those who provided help in recruiting them. We would also like to thank those involved in our public involvement, engagement and participation work for their commenting on our study documents.
Funding
This project is funded by the National Institute of Health and Care Research (NIHR) [Public Health Research Programme (NIHR133202/PHIRST)]. The views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care.
Author information
Authors and Affiliations
Contributions
Conceptualization: NW, DG, EG, NC AP, RA, SC, Mo’BEvaluability Assessment: NC, APMethodology: NW, DGFormal analysis: NW, DG, LKInvestigation: NW, DGResources: SC, Mo’BWriting - Original Draft: NW, DGWriting - Review & Editing: NW, DG, EG, AP, NC, RA, Mo’B, SC, ZC, LKSupervision: EGProject administration: NW, DGFunding acquisition: EG.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Ethical approval for the study was granted by the Sheffield Centre for Health and Related Research (SCHARR) ethics committee at the University of Sheffield, application reference number: 049146. Informed consent to participate in the study was obtained from all participants. All participants provided written informed consent for their involvement in the study which was electronically signed.
Consent for publication
Written informed consent included consent for publication of the findings and the use of anonymised quotations in publications.
Competing interests
NW, DG, EG, LK, NC, AP, MA, ZC, do not have any conflicts of interest.SC and Mo’B are employed at the North Yorkshire Council LWSF service.This study has been co-produced with the North Yorkshire council LWSF service. All involved are committed to helping to facilitate a robust evaluation of the LWSF service in order to inform potential changes and adaptations. There has been no pressure or influence to modify, restate, weaken, omit or frame findings, conclusions and recommendations from any team member. SC and Mo’B are employed at the North Yorkshire Council LWSF service. This study has been co-produced with the North Yorkshire council LWSF service. All involved are committed to helping to facilitate a robust evaluation of the LWSF service in order to inform potential changes and adaptations. There has been no pressure or influence to modify, restate, weaken, omit or frame findings, conclusions and recommendations from any team member.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Woodrow, N., Gillespie, D., Kitchin, L. et al. Reintroducing face-to-face support alongside remote support to form a hybrid stop smoking service in England: a formative mixed methods evaluation. BMC Public Health 24, 718 (2024). https://doi.org/10.1186/s12889-024-18235-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12889-024-18235-0