Background

Obesity is the single biggest global issue affecting health in developed countries and a key challenge in meeting the United Nations sustainable development goal of achieving good health and well-being [1]. It is increasingly recognised that a multi-faceted systems approach is needed to address complex persistent “wicked” public health problems like obesity [2]. One aspect of this systems approach is to employ population wide policies and interventions to address obesity prevention in the various ‘settings’. The school provides a unique captive setting for implementation and scale up of population based approaches to prevention of childhood overweight and obesity. Childhood obesity is a significant precursor of adult obesity [3,4,5,6,7]. However, positive health behaviours if embedded in childhood are more likely to persist into adulthood. Within the school setting single or multi-component interventions that address dietary intake, and/or physical activity or sedentary behavior have shown limited effectiveness in reducing sedentary behavior and BMI [8,9,10].

There is empirical evidence to suggest that successful outcomes of public health interventions depend not only on the existence of the specific intervention components needed to achieve behaviour change [11] but also on the extent to which they are implemented in the real world setting [12]. A greater understanding of context and how and to what extent interventions are implemented to ensure system-wide sustainability is required. An overarching synthesis of the empirical evidence [13] identified 83 conditions to be important for successful implementation of interventions and policies promoting a healthy diet, physical activity (PA), and a reduction in sedentary behaviour using the five domains of the Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) evaluation framework [14, 15].

Within the school setting a meta-synthesis of 18 qualitative studies, which explored the views of parents, school staff and students on the overall role of the primary school in preventing childhood obesity, concurred that the school is an important setting for obesity prevention, in promoting and providing opportunities for healthy eating and physical activity and the need for schools to work with parents [14].

Implementation strategies are defined as “methods or techniques used to enhance the adoption, implementation, and sustainability of a clinical program or practice” [15]. There is limited in-depth research to date on the implementation strategies necessary for successful adoption, implementation and sustainment for scale-up of public health interventions addressing diet and or physical activity particularly within the primary school setting. Some school-based research carried out in older children has identified general themes e.g. commitment and leadership within schools as enabling strategies and a lack of time and external resources as barriers [16,17,18,19],

The focus of the current study was, therefore, to qualitatively explore the implementation of school-based interventions targeting childhood obesity. The study was part of a larger series of European case studies conducted by the Determinants of Diet and Physical Activity Knowledge Hub, DEDIPAC-KH, the first research project of the European Union’s (EU) Joint Programming Initiative - Healthy Diet for a Healthy Life (JPI-HDHL), which aimed to provide better insight into the determinants of diet, physical activity and sedentary behaviour across the life course [20].

Methods

The overall aim of this study was to explore and categorise factors likely to result in successful implementation and transferability of multi-component dietary, physical activity or sedentary behaviour interventions in Irish schools and those factors that hinder successful implementation. It sought to provide insight from the stakeholders’ viewpoint into the supportive actions required for successful implementation and how barriers to implementation might be overcome. The Adoption, Implementation and Maintenance elements of the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) implementation framework, used extensively for evaluating implementation of public health interventions [21] was used to categorise the findings.

Study design and case selection

A case study is an empirical method aimed at investigating contemporary phenomena in their context and in particular where the boundary between the phenomenon and its context may be unclear [22]. Hence a multiple case study design was deemed most appropriate for this study.

Intervention selection

Informal meetings with Irish collaborators and a brief scoping review of the available literature led to case selection. Two school-based multi-component interventions were chosen - The Food Dudes (FD) Healthy Eating Programme and the Travel Theme of the Green Schools Environmental Programme, which is known internationally as Eco-Schools. Both of these programmes are purposive interventions aimed at influencing positive changes in one or more factors affecting behaviour. Both programmes have been rolled out nationally in the Republic of Ireland and are subject to evaluation and/or ongoing audit [23,24,25,26,27,28].

Intervention description

Food Dudes healthy eating programme

FD is a peer modelling and rewards-based intervention to increase fruit and vegetable consumption in primary school children [25, 29]. It was developed by researchers in Bangor University Wales based on the theory that provision and repeated tasting of fruit and vegetables over a period will result in a sustainable increase in fruit and vegetable consumption. Phase 1 involves provision and repeated tasting of fruit and vegetables over a 16-day intervention period with the support of cartoon role models (Food Dudes Heroes) and small rewards, followed by a home phase where fruit and vegetables are supplied from home (Phase 2). It was first rolled out in Ireland in 2005 [28]. It is jointly funded by the Irish Government and the European Union through the School Fruit Scheme. The programme is managed nationally by the Irish Food Board (An Bord Bia) and delivered by a private project management company (PMC). The PMC is responsible for training FD coordinators (one or two teachers within each school) and the organisation of fruit and vegetable suppliers. The FD coordinators are responsible for cascading the information to other teachers and organising deliveries within the school during the intervention phase. Schools are invited to take part in the FD programme on a regional / district basis. The original Food Dudes Programme was completed in 2014 having reached 95% of all 3300 primary schools in Ireland [30]. Participation in the FD programme is voluntary. A Food Dudes ‘Boost’ programme was introduced in 2015. A flow diagram of FD is shown (Fig. 1a).

Fig. 1
figure 1

(a) Organisational structure Food Dudes, (b) Organisational structure GTS (Primary Schools)

Green Schools Travel

Green Schools Travel (GST) is the fourth of seven themes of the Green-Schools Programme (GSP). GST aims to promote the use of sustainable modes of transport to school e.g. walking, cycling and public transport use. Following a two-year pilot in the Greater Dublin Area GST has been rolled out nationally since 2008 in schools that have completed the first three themes of the GSP (Litter and Waste, Energy and Water). GST is funded by national government via the National Transport Authority to a non-governmental organisation (NGO) who operate the programme. Between 2006 and 2011, 539/3030 primary schools (17%) and 55/700 (8%) secondary schools took part in GST [23]. Schools take two years to complete GST [23]. Schools set their own travel targets. Participation in GST is voluntary and schools self-select to participate in the programme.

A network of Green School Travel Officers (GSTOs), employed by the NGO, assists schools throughout the process. The programme is organised within the school by a designated teacher who volunteers for the role as GST coordinator and a pupil-led GST committee. The GST coordinator and committee cascade the programme to all classes within the school. A flow diagram of GST in primary schools is shown (Fig. 1b).

Case study sites and sampling

Permission to use the selected programmes as cases was obtained from government departments and intermediaries involved in the management and/or funding of the programmes. Introductory meetings were held with agencies responsible for their organisation and management. These meetings provided background information and assisted in the purposeful identification of potential interviewees involved in implementation of the interventions. All key stakeholders were invited to participate: senior personnel from government departments, intermediary agencies (NGO and PMC) and educationalists.

Inclusion criteria for eligible schools were: school location; Greater Dublin Area (counties Dublin, Wicklow, Kildare; total population 1,709,864), [31] urban rural mix, school type; primary or secondary (GST only) and status of the intervention recently completed or completed within a given timeframe. There were 552 eligible FD and 364 GST schools. From discussion with the above stakeholders and guided by the literature [32] an initial sample of eight schools, four from each programme was deemed sufficient to provide adequate sample size to achieve data saturation, and to be feasible within the timelines and resources for the study.

The FD management company, at their request selected and contacted four schools meeting these criteria. From a list of potential GST schools provided by the NGO, four schools were randomly selected using a random numbers table. Potential participants from all stakeholder groups were sent an introductory letter, explanatory leaflet and consent form and invited to participate in face-to-face interviews. Follow up was conducted by telephone if no response was obtained within two weeks of initial contact.

Data collection

Fifteen semi-structured in-depth interviews were conducted (Table 1). An interview topic guide developed by the European DEDIPAC research team guided the direction of interview questions. This was informed by an umbrella review of conditions identified as being associated with successful implementation of diet and/or physical activity interventions/policies [33]. The topic guide was adapted to suit the role/knowledge of the interviewee, which allowed for deductive and inductive themes to emerge. The list of questions covered in the topic guide was the same for both programmes and are included as a supplementary file (Additional file 1).

Table 1 Description of participants

Fourteen interviews were conducted face-to-face and one by telephone by a post-doctoral researcher with previous experience in conducting qualitative research (MO’S), who was recruited specifically for the project and was not known to the stakeholders. One interview was observed directly by the prinicpal researcher (CH) to ensure fidelity to the topic guide. The mean interview duration was 55 min (28–69 min). All face-to-face interviews were conducted in a private office at the participant’s work place. Two initial interviews were not recorded; however, extensive notes were made following each interview. Thirteen interviews were digitally audio recorded and transcribed verbatim by an external stenographer. Participant names were removed prior to transcription. The transcripts were verified by reading a selection while listening to the audio recordings(MO’S). Any discrepancies between the transcripts and audio recordings were rectified before coding.

Data analysis

The interviews were coded in NVivo Version 10.2 (QSR 2014), using a common categorization matrix developed by the European DEDIPAC research team [34]. The matrix was informed by the review of conditions identified as being associated with successful implementation of interventions aimed at improving diet and/or levels of physical activity [33]. Initial coding was conducted by MOS and verified by CH and discrepancies were amended following discussion to clarify coding and emergent themes. Coded data were subsequently exported into Microsoft Excel version 16.6.5 (2018 Southampton), and collated into themes (MOS). A thematic analysis of data was carried out using a hybrid inductive-deductive approach to identify patterns in the data.

Themes were then classified (CH and MOS) according to Adoption, Implementation and Maintenance (Sustainment) of the interventions as follows:

  • Factors facilitating adoption, implementation and maintenance

  • Factors hindering adoption, implementation and maintenance

  • Supportive actions for adoption, implementation and maintenance

  • Recommendations to overcome barriers to adoption, implementation and maintenance

The Consolidated criteria for reporting Qualitative Studies (COREQ-32 item checklist) were consulted in reporting the study findings [35].

Results

Description of interview participants

A breakdown of participants is shown in Table 1. Seven schools agreed to participate. All participants contacted in those schools agreed to be interviewed. Three interviews had two participants. There were no notable differences between male and female respondents. Data saturation was reached following completion of interviews within the initial sample of six primary schools with no new themes emerging [32]. As findings particular to secondary schools were less robust and timing and resources did not permit further sampling, these findings were excluded from this paper.

Factors facilitating adoption, implementation and maintenance (Table 2)

Adoption

Good communication, collaboration and support from various government departments (e.g. Department of Transport, Department of Agriculture and Department of Education) were seen as key to developing a strategy for encouraging schools to adopt either programme. Engagement of all school partners (parents, teachers, principal and students) was found to be a critical success factor in the adoption and implementation of both programmes. The ability of the FD coordinator to provide leadership and effectively organise and delegate responsibility for the delivery of the fruit and vegetables was also important (cited*3).

Table 2 Quotations illustrating factors facilitating adoption, implementation and maintenance

Implementation

Fidelity to the core components of FD was assessed by project managers employed by the PMC to check the implementation of the programme and was identified as an important factor influencing the success of the programme. Incentives (e.g. stickers, certificates of achievement), which encouraged children to taste and then eat fruit or vegetables were a core component of the FD delivery mechanism.

Adaptations to FD were seen as enabling factors in ensuring successful implementation e.g. adaptations to programme delivery were made for children with special needs and/or serious aversions to specific fruit or vegetables and the timing of the intervention was customised to suit the school timetable.

The school leads delivery of the GST programme. The only core components are the conduct of surveys and walkability audits. Flexibility around implementation is a key feature of the programme. Examples of adaptation include the GS committee composition and conduct and adapting Walking on Wednesdays (WOW) to another day of the week or mode of transport Cycle on Wednesdays, (COW). The programme was deemed to be most successful when children were centrally involved in the different initiatives and competitions across the school. Inter-class competitions e.g. the Golden Boot award and materials e.g. stickers provided by the intermediary, act as incentives for students to participate in the programme.

Maintenance/transferability

Dissemination of information through school websites, newsletters, posters, social media, assembly meetings, events and action days and an inter-school symposium to disseminate peer learning were considered important factors aiding success of the GST programme.

Whether continued funding was secured was a key factor in ensuring sustainability of either programme. Another significant factor effecting sustainability was whether or not the programme was embedded in an organisational structure which offered support to the programme e.g. pre-existing healthy eating policies, which reflected the ethos and commitment of the school.

Factors hindering successful adoption, implementation and maintenance (Table 3)

Insufficient communication between stakeholders at all levels was a perceived barrier e.g. between parents and the schools, within the schools, and between the schools and the programme organisers and funders.

Table 3 Quotations illustrating factors hindering adoption, implementation and maintenance of the interventions

Individual/family level barriers

At individual/family level changing familial norms and eating habits of children were perceived as particularly difficult in the FD programme. In GST parental attitude and busy work schedules were seen as important determinants in the means of transport children use to get to school. The perceived lack of priority around active transport by parents and their reluctance to become involved in other school activities e.g. a cycle training initiative for parents, made implementation of GST challenging. In addition, culturally there was a prolific perception that cycling to school is unsafe and a stereotypical image that cycling, as a means of transport, is unsuitable for girls. Negative peer pressure regarding cycling helmets was also an important barrier.

Barriers within the school setting

The time required to implement and record uptake of the programmes was cited as a recurrent challenge. FD was noted to be time consuming to implement in the classroom (cited *10). The time taken to sort out the fruit and vegetables for the FD programme without the aid of additional staff and /or involvement of parents was particularly challenging. The short school day particularly in the infant classes made the delivery of the FD programme difficult in addition to the prescribed curriculum. Timetable and curricular commitments also made implementation of the GST challenging. Different calendars (EU funding year, academic year, calendar year) were challenging from a budgetary and organisational perspective.

The time taken to record activities and monitoring programme implementation was noted to be time consuming and administration dependent. Recording on a wall chart of the portions of fruit and vegetables brought from home was cited as particularly time consuming. The translation of a research based intervention into a national programme with fidelity presented a considerable challenge. In addition, FD coordinators reported it difficult to evaluate the implementation of the FD programme in the classroom. Time spent securing funding was an ongoing barrier for the GST programme.

Accuracy in assessing the impact of the GST programme was a common concern. The absence of a set protocol for GST delivery, differences in the methodological approaches used to set targets and the method used to assess the programme, may have contributed to discrepancies in results. Lack of clear data on effectiveness inhibited dissemination of the programme impact. Moreover, evidence of what worked on the ground was not captured in hardcopy which further inhibited dissemination.

Structural and external barriers

The lack of canteens in Irish primary schools presented logistical challenges in terms of organising delivery, packaging and storage of fresh produce in the FD programme. External factors influenced implementation of the GST, in particular poor road and transport infrastructure, concerns around road safety, bicycle safety, security and insurance. The lack of infrastructure near rural schools, though not confined to them, was recognised as a major challenge in terms of promoting active and / sustainable travel.

Absence of a travel plan for the GST, with defined measures, as a requirement to receive government funding, unlike UK and other countries, was cited as significant barrier to long term development and sustainment of GST in Ireland, and made it difficult to compare implementation across countries. Limited funding and/or uncertainty around funding was noted to have a negative impact on programme staff, planning and resource acquisition needed for implementation.

Supportive actions around adoption, implementation and maintenance (Table 4)

Adoption

The provision of support from a variety of internal and external sources was critical to the successful adoption and subsequent implementation of both programmes. In the FD programme, coordinators (teachers) in participating schools were supported by a designated FD Manager, employed by the PMC, who was contactable if any problem arose (cited*2 (Fig. 1a).

Table 4 Quotations illustrating supportive actions around adoption, implementation and maintenance of the interventions

The support offered by the GSTO to the school, and by local enterprise including involvement of the police in traffic workshops in the school, were viewed as supportive. In addition, the expertise of the GSTO in facilitating and supporting schools’ actions plans was important. Provision of cycle training for parents in particular was found to encourage a better parental attitude towards cycling with their children.

Implementation

The delivery of the FD programme in participating schools was aided by the presence of supportive teaching staff willing to engage in the programme and presence of non-teaching staff willing to assist with its delivery. Constructive feedback had led to better packaging of fruit and vegetables. In addition, allowing teachers' discretion to adapt the programme to suit individual children was perceived as strongly supportive (cited*3). Factors in the external environment e.g. timely delivery of fruit and vegetables by suppliers, was also regarded as a supportive measure.

In the GST Programme, the presence of teachers who acted as clear role models e.g. by cycling to school, was a strong supportive factor.

Transfer-dissemination

Development of an internal database of particular queries in the GST programme facilitated peer learning and sharing of ideas between GSTOs.

Recommendations from stakeholders to overcome barriers (Table 5)

Adoption

Personal interest, leadership, commitment, experience of the teacher and principal, and openness to innovation were key factors in overcoming barriers for both programmes. In the case of GST, better communication and collaboration between the NGO and the local authorities was recommended.

Table 5 Quotations illustrating recommendations to overcome barriers

Implementation

Because implementation of GST depended on the practical infrastructure and location of the school, effective traffic management infrastructure at the school gate and provision of cycle lanes were cited as priority areas which needed to be addressed.

Students were disappointed that the green flags awarded for each theme of the Green School Programme were identical. A different emblem for each theme was recommended by stakeholders. Maintaining interest from pupils was an ongoing issue and introduction of short-term projects was suggested as a way to sustain student interest. The organisation of bike maintenance workshops with experts sourced from the local community had resulted in an increase in the number of boys cycling to school and continuation of this activity was recommended.

A recommendation was made to conduct the “Hands Up” surveys on non-event days to enhance the validity of evaluation component of the GST programme. In addition, stakeholders recommended that evaluation be conducted by an independent observer on a periodic basis.

Sustainability

A number of measures were recommended by stakeholders to inform future development of the programmes. The presence of pre-existing whole school policies were a key factor influencing the sustainability of both programmes. A whole school approach, pre-existing environmental and school safety policies, the long-term continuation of initiatives (e.g. a walking bus) and incentives (e.g. the ‘Golden Boot’ class awards) following the award of the Green Flag were recognized as promoting sustainability of GST. Parental involvement was perceived as key for long-term success of the walking buses. Long term sustainability of FD was aided by a variety of pre-existing healthy eating measures (cited*2) and parental support.

Continued funding was seen as core for sustainability of both programmes. In spite of the recent economic recession funding for FD and GST has continued. A budgetary reduction for the FD, was noted to increase the likelihood of sustainment in the long-term. Ongoing political support was recognised as important for the continuation of the GST despite doubts regarding its overall impact.

Discussion

This study qualitatively examined the implementation of two school-based obesity prevention interventions. The interventions have been rolled out in other countries, are theory-based and have been previously evaluated. FD is based on well-funded external research evidence; it has clearly defined core components, covers primary schools only and has an uptake of 95% nationally. In contrast GST’s core components are broad rather than specific, implementation is flexible, targets are unclear and it is open to both primary and secondary schools with a lower national coverage. Both programmes are coordinated by external parties, who provide training and technical support, but are delivered by class teachers. Evaluation of FD is precise (e.g. consumption takes place in the classroom) whereas GST has less clear targets and uses a hands-up honesty approach. Key success factors and enablers were identified for both programmes.

Previous research in this area is limited to a recent cross-sectional study of primary schools in Malaysia [19] and to studies conducted with staff in schools with different target age groups, 9–13 year-olds (middle schools) in the US [16, 17] and to teenagers in the Netherlands [18].

Some general themes emerged from our research, which were consistent with these studies. Sufficient communication and collaboration between teachers has been noted previously as being a faciliatory factor [18]. However previous qualitative research has sought only the opinions of school personnel [16,17,18]. In our study good working relationships and adequate communication at national and local levels, e.g. political backing with associated national and local funding, were identified as key strategies for successful implementation of both programmes.

Involvement of all the partners in the school was critical, from leadership by principals, enthusiastic participation of teachers who led by example ‘champions’, through to student and parent engagement. This commitment by the schools, and buy in from staff members and students has also been noted previously as a key facilitator [16,17,18,19]. Presence of an in-school ‘champion’ was one of the strongest reported facilitators to organisational readiness to adopt and sustain the intervention in the Massachusetts Childhood Obesity Demonstration Project in two low income districts, which appeared to offset implementation barriers [16]. Similar to our study the organisational ability of coordinators in making the programmes feasible was also seen as an important factor for implementation success [18].

The programmes chosen for our study had established partnerships with external organisations who provided training, on going support and resources for the schools. This facilitating factor has been noted in a previous study [18] and suggested to be important for on-going sustainability [17].

Within the school the use of incentives to encourage children such as stickers in FD and the awarding of a school flag in GST were enablers. The use of incentives directed at children rather than at teachers has not been reported. Freedom to adapt the interventions to context e.g. for special needs children while maintaining the core components, was viewed as an important enabling strategy. Flexibility in terms of programme delivery was also noted as an enabler in the Dutch study [18]. On-going adaptation of interventions with a primary focus on fit between the intervention and multi-level contexts lead to expectation of on-going improvement of interventions rather than their diminution over time [36]. However, while aspects of the flexibility of the GST programme were welcomed it also created difficulties for some of the participants. Defining success in the GST programme was particularly problematic and difficulties focused on poor communication around clear targets and subjective evaluation (hands-up) methods.

Barriers associated with budgetary limitations [17] and time constraints [17, 19] have previously been noted. Lack of time to implement and record obesity prevention interventions during the daytime curriculum, particularly in infant classes, was a particular issue for our study. Funding insecurity, particularly for GST, led to a feeling of uncertainty although this was a challenge to long-term sustainability of both programmes. Other barriers identified in these studies; high staff turnover [16, 18], lack of equipment [19] and insufficient or lack of access to training [19, 37] were not applicable to our setting.

Existing attitudes and perceptions of the target action acted as a considerable barrier to greater levels of engagement. These were associated with safety and social pressure i.e. perception of cycling as being inappropriate for girls. Some of these beliefs may be well founded particularly in implementing an intervention where the broader infrastructure was insufficient. Engaging pupils and especially parents of disadvantaged pupils was particularly problematic and required a deep understanding by teachers of the context of the children’s home lives where fundamental issues such as school attendance rather than anti-obesity interventions were the top priority.

A strength of our study is that we interviewed stakeholders involved in the funding and organisation of the programmes in addition to school staff, thus bringing a wider perspective to the factors involved in implementation of school-based obesity prevention programmes. Engaging participation of key stakeholders was essential and all stakeholders invited to participate agreed to be interviewed. As the researcher who conducted the interviews was not known to the stakeholders, this minimised the liklihood of socially desirable responses.

However the pragmatic nature of this study means that it has some limitations. Non-randomisation of FD schools creates the possibility of bias towards the selection of schools where the programme was more successfully implemented. However, issues of concern around implementation were identified for both programmes.

A whole school approach involving pupils, teachers and parents is deemed necessary for sustained impact of lifestyle interventions in schools [38]. However, only the opinions of teachers were sought in this study, reducing the comprehensiveness of the findings.

Research on the “health promoting schools” initiative has recommended that process evaluation must move beyond simple measures of acceptability and fidelity to include detailed contextual information [39]. Good contextual fit occurs when implementers, recipients, and other stakeholders (e.g. parents, teachers), identify an intervention as acceptable, doable, effective, and sustainable in their local setting.

Our findings provide insight into the facilitators and barriers that must be addressed to successfully implement health behaviour change interventions in the school setting and provide guidance in setting out parameters for evaluation to include fidelity and adaptation. This pragmatic approach also provides recommendations on how identified barriers may be overcome/reduced. Although some recommendations are particular to the school setting and relate to shaping the future of these programmes, many are generalisable across different contexts. The findings are highly relevant to those involved in the organisation and execution of national public health interventions; policy makers, guidelines developers, those involved in the local organisation of the interventions and frontline staff involved in their delivery.

Implementation of complex public health interventions requires leadership and commitment at and across all levels. Stronger alliances between health and education professionals and the impact of future interventions must address health and educational outcomes to improve scalability [39]. The absorptive capacity of teaching staff to engage with and deliver behavioural interventions is a constant challenge in an overcrowded curriculum. An unanswered question for future research is the concept of reaching a “tipping point” when attitudes of staff harmonise to support a particular intervention/policy.

Conclusion

Successful implementation and scale up of public health anti-obesity interventions in schools is dependent on having a good contextual fit between the intervention and setting, engagement and leadership at multiple levels, and secure funding. Pre-existing healthy lifestyle policies within a school were a strong supportive factor. At individual level, tailoring the intervention and use of incentives were important enablers. Recommendations to overcome barriers include: capacity to deliver within an already overcrowded curriculum, supports needed to do so, and clear specification of intervention components within a conceptual framework to facilitate evaluation. The importance of adaptation without compromising core components in enhancing intervention sustainability also emerged. Our findings are generalisable across different contexts and are highly relevant to those involved in the development or adaptation, organisation or execution of national public health interventions in the schools setting; policy makers, guidelines developers, and staff involved in local organisation and delivery of such interventions.