Whole systems approaches to obesity and other complex public health challenges: a systematic review
Increasing awareness of the complexity of public health problems, including obesity, has led to growing interest in whole systems approaches (WSAs), defined as those that consider the multifactorial drivers of overweight and obesity, involve transformative co-ordinated action across a broad range of disciplines and stakeholders, operate across all levels of governance and throughout the life course. This paper reports a systematic review of WSAs targeting obesity and other complex public health and societal issues, such as healthy lifestyles for prevention of non-communicable disease.
Seven electronic databases were searched from 1995 to 2018. Studies were included if there had been an effort to implement a WSA. Study selection was conducted by one reviewer with a random 20% double checked. Data extraction and validity assessment were undertaken by one reviewer and checked by a second reviewer. Narrative synthesis was undertaken.
Sixty-five articles were included; 33 about obesity. Most examined multicomponent community approaches, and there was substantial clinical and methodological heterogeneity. Nevertheless, a range of positive health outcomes were reported, with some evidence of whole systems thinking. Positive effects were seen on health behaviours, body mass index (BMI), parental and community awareness, community capacity building, nutrition and physical activity environments, underage drinking behaviour and health, safety and wellbeing of community members, self-efficacy, smoking and tobacco-related disease outcomes.
Features of successful approaches reported in process evaluations included: full engagement of relevant partners and community; time to build relationships, trust and capacity; good governance; embedding within a broader policy context; local evaluation; finance.
Systems approaches to tackle obesity can have some benefit, but evidence of how to operationalise a WSA to address public health problems is still in its infancy. Future research should: (a) develop an agreed definition of a WSA in relation to obesity, (b) look across multiple sectors to ensure consistency of language and definition, (c) include detailed descriptions of the approaches, and (d) include process and economic evaluations.
KeywordsWhole systems approaches Obesity Systematic review Public health Complexity Systems science
Association for the Study of Obesity
Be Active Eat Well
Body Mass Index
Coordinated Approach To Child Health
Central California Regional Obesity Prevention Program
Cumulative Index to Nursing and Allied Health Literature
Communities Mobilising for Change on Alcohol
California Tobacco Control Program
Database of Abstracts of Reviews of Effects
Database of Promoting Health Effectiveness Reviews
Ensemble Prévenons l’Obésité Des Enfants’ (Together Let’s Prevent Childhood Obesity)
Health Technology Assessment
International Network of Agencies for Health Technology Assessment
Local Government Association
Minnesota Heart Health Programme
National Health Service Economic Evaluation Database
National Institute of Health & Care Excellence
Public Health England
Put it Out Rockland
Randomised controlled trial
Racial and Ethnic Approaches to Community Health
Trials Register of Promoting Health Interventions
World Health Organisation
Whole systems approach
In recent years, in response to the increasing awareness of the complexity of many public health problems, there has been growing interest in the role of systems-based approaches in public health. In 2007, the UK Foresight map  presented a pioneering portrayal of the complex web of obesity causation. In the same year the American Journal of Community Psychology devoted an edition to systems-thinking. In 2008 Mabry et al.  outlined the strategic vision of the Office of Behavioural and Social Sciences Research at the National Institutes of Health, listing systems science as one of four key programmatic directions, and the importance of systems thinking was also noted in the 2011 and 2015 Lancet Series on Obesity [3, 4].
In 2010 a number of evidence reviews were undertaken for the National Institute for Health and Care Excellence (NICE) [5, 6, 7], intended to inform the development of NICE guidelines on the prevention of obesity using a whole system approach (WSA) (note that the scope of the work was changed and instead resulted in the development of NICE guidelines on whole of community approaches) [5, 8].
Identifying a system.
Explicit recognition of the public health system with the interacting, self-regulating and evolving elements of a complex adaptive system. Recognition given that a wide range of bodies with no overt interest or objectives referring to public health may have a role in the system and therefore that the boundaries of the system may be broad.
An explicit goal to support communities and organisations within the system.
Creativity and innovation
Mechanisms to support and encourage local creativity and/ or innovation to address public health and social problems.
Methods of working and specific activities to develop and maintain effective relationships within and between organisations.
Clear methods to enhance the ability of people, organisations and sectors to engage community members in programme development and delivery.
Mechanisms to support communication between actors and organisations within the system.
Embedded action and policies
Practices explicitly set out for public health and social improvement within organisations within the system.
Robust and sustainable
Clear strategies to resource existing and new projects and staff.
Strong strategic support and appropriate resourcing developed at all levels.
Monitoring and evaluation
Well-articulated methods to provide ongoing feedback into the system, to drive change to enhance effectiveness and acceptability.
Aims & objectives
The aim was to undertake a systematic review of national and international published evidence on WSAs targeting obesity, other public health areas and areas outside public health (such as social care, crime and justice), to understand what is known about WSAs and how they can be implemented in practice.
What has been done in terms of a WSA to obesity, and other complex public health problems, and how effective have these been?
What elements of a WSA are effective or not effective in (a) obesity (b) other areas of public health (c) areas other than public health?
What are the barriers and facilitators to implementing a WSA in (a) obesity (b) other areas of public health (c) areas other than public health?
What is the evidence on cost-effectiveness of WSAs in (a) obesity (b) other areas of public health (c) areas other than public health?
A broad, sensitive search strategy was designed. The following databases were searched from January 1995 to September 2015 using a combination of text and Medical Subject Headings (MeSH terms): MEDLINE, CINAHL, Social Science Citation Index, The Cochrane Library (includes CENTRAL, DARE, NHSEED, HTA and INAHTA databases), PsycLIT/ PsycINFO, DoPHER, TRoPHI and IDOX.
In February 2017 an additional update search was run in MEDLINE, using the same search strategy applied from January 2015 to February 2018.
“whole systems approach” and related terms such as holistic; cross-sector; systems-based approach; multi-strategy approaches etc.
Terms related to relevant initiatives such as: Healthy Cities; Healthy Towns; Together Let’s Prevent Childhood Obesity (EPODE); Change4Life etc.
We also manually searched the websites of relevant organisations such as: Department of Health; Public Health England (PHE); Local Government Association (LGA); World Health Organisation (WHO); National Institute for Health and Care Excellence (NICE); Association for the Study of Obesity (ASO); National Obesity Forum etc.
The full search strategy is available as Additional file 1.
Any population where a WSA has been used, at local, regional, national and international level
WSAs, defined as those that:
• Involve transformative co-ordinated action (including policies, strategies, practices) across a broad range of disciplines and stakeholders, including partners outside traditional health sectors;
• Operate across all levels of governance, including the local level so that such approaches are reinforced and sustained, and
• Identify and target opportunities throughout the life course (from infancy to old age)
• Multiagency partnership working across sectors e.g. health & social care, but not at more than one level; case management initiatives focused on individuals or individual families;
• Studies which looked at only one part of a WSA (i.e. one specific intervention delivered as part of a wider approach).
Any or none
Review questions 1 and 2:
• Health outcomes, e.g. weight, Body Mass Index (BMI), type 2 diabetes, diet and nutrition, physical activity, psychological well-being & quality of life; co-morbidities related to obesity, reductions in health inequalities, reductions in premature morbidity and mortality, cardiovascular disease and obesity-related cancers.
• Organisational outcomes e.g. cross-sector collaboration; new partnerships; environmental changes; resource allocation; leadership etc.
• Process outcomes, e.g. what each project aimed to achieve and barriers and facilitating factors associated with achieving or not achieving those aims.
Outcomes may be at individual, local, regional or national/ federal/ principality level.
Review question 3
Process and implementation outcomes e.g. training, recruitment, sustainability, people’s views on barriers and facilitators to implementation of WSAs.
Review question 4:
Cost, cost-effectiveness, cost-benefit or cost-utility.
Review questions 1 and 2: primary research or evaluation studies. These may be randomised controlled trials (RCTs) or non-RCTs, natural experiments, before and after studies, or mixed methods evaluations (including case study approaches).
Review question 3: process evaluations (qualitative or mixed method studies).
Review question 4: cost-effectiveness, cost-benefit or cost-utility studies.
Data were extracted from included articles by one reviewer into a piloted electronic form, and checked by the lead reviewer. Queries were resolved as above. We extracted data into the following fields: study details; study design; setting; population (including PROGRESS-Plus indicators ); public health or other issue; intervention; comparator (if appropriate); outcomes; findings; reviewer comments.
We also assessed all included studies against the ten features for WSAs for obesity, in the working definition prepared by Garside et al. for the NICE guidance .
Two reviewers carried out validity assessment of included articles using checklists developed for quantitative and qualitative study designs of public health interventions . These were adapted from the National Institute for Health and Care Excellence Public Health methods guidance, and the Critical Skills Appraisal Programme [16, 17]. Studies were given a quality rating based on how many criteria they met on the appropriate checklist.
Due to the substantial clinical and methodological heterogeneity of included studies, a narrative approach to synthesis was chosen . Evidence on health and non-health outcomes is presented as a descriptive thematic summary, grouped within each review question according to whether it relates to obesity, other public health or non-health issues, with the most methodologically robust evidence presented first.
We also looked at whether there was any association or pattern between the direction of reported health effects and the number of WSA features  that a study met, using the cross-tabulation function in EPPI-reviewer and carrying out a Fisher’s exact test in IBM SPSS 24 statistical software.
Qualitative evidence on barriers and facilitators to implementation and delivery of WSAs was summarised using a framework synthesis approach, allowing themes to emerge inductively from the included studies, within the framework of ‘barriers’ and ‘facilitators’. The framework was agreed within the review team, and data were aggregated according to the major themes.
Study selection process
Description of included studies
Public health issue addressed in studies, by country
Healthy weight gain in pregnancy
Chronic disease management
Other (domestic or alcohol related violence or disorder)
USA & Canada
TOTAL = 12
1 survey 
1 nRCT 
1 Qual 
1 CS 
1 NAS 
TOTAL = 8
1 P cohort 
1 B&A 
TOTAL = 7
1 RCT 
1 nRCT 
1 B&A 
TOTAL = 2
1 MME 
1 Qual 
TOTAL = 2
1 MME & Qual 
1 Qual 
1 nRCT 
1 MME 
1 MME 
TOTAL = 7
1 MME 
1 survey 
1 B&A 
TOTAL = 3
1 MME 
1 MME/ B&A 
1 nRCT 
1 Qual 
1 MME/ B&A 
TOTAL = 5
1 MME 
1 P cohort 
1 P cohort 
1 Qual 
1 Qual 
WHO Healthy Cities (Global)
TOTAL = 9
1 Qual 
WHO Healthy Cities (Spain)
WHO Healthy Cities (Germany)
1 MME 
WHO Healthy Cities (Israel)
1 Survey 
Who Healthy Cities (Bangladesh)
1 Qual 
Forty-three studies included adults [19, 20, 21, 22, 26, 32, 33, 34, 35, 36, 38, 39, 43, 44, 45, 46, 47, 48, 49, 50, 52, 54, 55, 56, 58, 59, 60, 61, 62, 63, 64, 65, 66, 69, 70, 71, 72, 73, 74, 78, 80, 81, 83] and 51 included children [19, 20, 21, 22, 23, 25, 26, 27, 30, 31, 32, 34, 35, 36, 38, 39, 40, 42, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 55, 56, 58, 59, 60, 61, 62, 63, 64, 65, 68, 69, 70, 71, 72, 73, 76, 78, 79, 80, 81, 82, 83]. Fourteen focused on areas of socioeconomic deprivation [23, 44, 48, 50, 58, 61, 66, 68, 69, 73, 74, 75, 76, 83] and ten on people in black or minority ethnic groups [23, 40, 49, 50, 56, 57, 66, 74, 76, 83]. Nine studies specified that they included older people [20, 22, 24, 34, 40, 45, 61, 66, 71]. Four studies targeted socially excluded groups [24, 66, 74, 75], two looked at women only [37, 74], two targeted people with disabilities [24, 74] and one targeted a specific religious or cultural group .
Results of validity assessment
Methodological details were on the whole poorly reported. Twenty of the 44 quantitative studies did not have a comparator group. The comparator group was judged to be appropriate in 14 of the remaining 24 studies, and in 10 studies there was judged to be baseline equivalence between the groups. Eleven studies reported randomised assignment of participants to groups. Fourteen studies allocated interventions at the right level (e.g. cluster randomisation for school-level interventions); ten studies did not report sufficient information to judge allocation. Intention to treat analysis was reported in two of the three RCTs. The intervention was considered to have been described adequately in almost all the studies (n = 39). Unbiased intervention delivery (i.e. intervention and comparator groups treated the same, apart from the intervention) was reported in 20 of the 44 studies. The sample was judged to be representative of the population in 17 of the included studies, while in 28 studies the sample size was judged to be large enough. Potential confounding factors were adjusted for in 11 studies. Due to the nature of the interventions, blinded assignment to groups did not occur in any of the included studies, nor was blinded outcome assessment reported. Nine studies reported on attrition rates. In 29 studies, the analysis methods were judged to be appropriate, and a further 14 studies did not provide enough detail about the methods of analysis for the review team to assess whether they were appropriate.
Of the 30 studies with a qualitative design, the design was judged to be appropriate in 28 studies, with the remaining two providing insufficient detail. Seventeen studies provided a clear statement of findings, six provided insufficient detail, and the remaining seven did not provide a clear statement of findings. Fifteen studies used appropriate strategies for data collection (and 13 did not provide enough information), and 13 recruited participants appropriately (with 16 not providing enough information). Seven studies undertook rigorous data analysis, with three failing on this criterion and the remaining 20 providing insufficient information. Only three studies showed evidence of reflexivity regarding the relationship of the researcher to the participants, 18 failed on this criterion and the remaining 9 did not provide enough information. Nine studies provided enough information to satisfy the review team that ethical issues had been considered, while 21 did not provide enough information.
Review question 1: What has been done in terms of a WSA to obesity, and other complex public health problems, and how effective have these been?
Studies meeting all ten guidance features for WSA
Thirteen included studies met all ten of the Garside et al.  features for a WSA [25, 29, 39, 46, 47, 53, 64, 65, 67, 75, 76, 77, 80]. Five of these 13 studies reported health or wellbeing outcomes [25, 29, 53, 75, 80], two reported outcomes associated with the social determinants of health [29, 80], and eleven reported process outcomes [25, 29, 39, 46, 47, 64, 65, 75, 76, 77, 80]. Three of these were UK initiatives, which all aimed to address obesity and healthy lifestyle promotion: a poor to moderate mixed methods evaluation of Change 4 Life , which reported positive outcomes for social determinants of health and mixed outcomes for health and wellbeing; a poor quality before and after study of Health Heroes , which reported positive health and wellbeing outcomes, and a poor quality case study of Public Health England’s paths to public health and wellbeing , which reported on process outcomes. Of the remaining 10 articles, seven were about the WHO Healthy Cities initiative [29, 39, 46, 47, 64, 67, 77] and all reported on process outcomes only. One of these was of poor to moderate quality , one was of moderate to good quality , one was good quality ,and the remaining four were poor quality [29, 64, 67, 77]. The remaining three articles were: a poor quality mixed methods evaluation of the Central California Regional Obesity Prevention Program , which reported positive health outcomes; a poor quality case study of the San Diego Healthy Weight Collaborative , which reported process outcomes only, and a moderate to good quality randomised controlled trial of “Communities mobilizing for change on alcohol” , which also reported positive health outcomes.
All included studies
Positive effects on BMI and health behaviour were reported in two good quality non-RCTs of Be Active Eat Well (BAEW) in Australia, which met 7 out of the 10 WSA features [44, 69]; on BMI in a moderate to good quality non-RCT of “Shape up Somerville” in the USA , which met 8 out of the 10 NICE guidance features; on parental health behaviour & awareness in a mixed methods evaluation of moderate quality of the first year of the UK social marketing initiative Change 4 Life (C4L) , which met 8 out of the 10 WSA guidance features; on fitness and obesity in a moderate quality prospective cohort study of Healthy Living Cambridge Kids  in the USA, which met 4 of the 10 WSA guidance features; on BMI, parental awareness and community capacity building in two moderate to poor quality mixed methods evaluations of Romp and Chomp in Australia, which met 9 out of the 10 WSA guidance features [27, 31]; and on nutrition and physical activity environments in an evaluation (of unclear design or quality) of the Central California Regional Obesity Prevention Program (CCROPP) , which met all 10 WSA guidance features.
Mixed effects on health and wellbeing outcomes, with no reduction in obesity prevalence, were seen in a moderate to poor quality nested case control study of “Healthy Towns” in the UK , which met all 10 of the WSA guidance features; and mixed effects were reported for obesity prevalence in a moderate quality non-randomised trial of Travis County CATCH in the USA , which met none of the 10 WSA guidance features.
Other public health issues
Positive effects on underage drinking behaviour and health, safety and wellbeing of community members were reported in a moderate to good quality RCT of the USA initiative Communities Mobilising for Change on Alcohol (CMCA), which met all 10 WSA guidance features ; on self-efficacy and intentions in a moderate quality non-RCT of a community-based intervention in Indigenous populations in the Canadian Arctic , which met 9 out of the 10 WSA guidance features; in smoking and tobacco-related disease outcomes in a cross-sectional survey of moderate quality, and a before and after study of poor quality, of the California Tobacco Control Program (CTCP) [56, 63], which met 2 out of the 10 WSA guidance features; on smoking prevalence in a prospective cohort study of moderate to poor quality  of the Racial and Ethnic Approaches to Community Health (REACH) project, in the USA, which met 8 out of the 10 NICE guidance features; in healthy eating behaviour in a non-RCT of moderate to poor quality of The Isfahan Healthy Heart programme evaluation in Iran , that met 6 out of 10 WSA guidance features; on smoking rates, home smoking bans and support for smoke-free policies in a repeated cross-sectional survey of poor quality of Put it Out Rockland (PIOR) in the USA , which met 3 out of the 10 WSA guidance features; and on access to health and medical services for managing diabetes, and access to fresh food in a poor quality case study on community-based participatory diabetes prevention , which met only one of the 10 WSA guidance features.
Mixed health effects were reported on risk factors for cardiovascular disease in a moderate quality prospective cohort study of a community intervention in the Netherlands , which met 7 of the 10 WSA guidance features; and on BMI in a moderate to poor quality non-RCT  of the Minnesota Heart Health Programme (MHHP), which met 4 of the 10 WSA guidance features.
Review question 2: What elements of a WSA are effective or not effective in (a) obesity (b) other areas of public health (c) areas other than public health?
Number of WSA criteria met versus direction of health effects
Number of Criteria Met
8–10 (Systems embedded)
4–7 (Systems moderately embedded)
0–3 (Systems not embedded)
Review question 3: What are the barriers and facilitators to implementing a WSA in (a) obesity (b) other areas of public health (c) areas other than public health?
Strong leadership and full engagement of all partners is key for success: Senior leadership buy-in was important to the effective development and delivery of a number of initiatives [65, 77]. Evaluations of the Healthy Cities initiative [39, 22] reported that effective organisational change required core principles to be integrated into an organisation’s mainstream activity, and recognised the need to have a genuine consortium of partners who were actively engaged rather than a single main driving force.
Engaging the local community is an important component of a successful approach: Several evaluations showed that projects were successful because of effective community involvement in identifying their needs and actively participating in local solutions [47, 49, 50, 51, 57, 74, 75, 77, 80, 82]. Capacity building through coalitions, targeted actions and community and system change were also identified as important [49, 50].
Creating successful outcomes requires time to build relationships, trust and community capacity: Local authority action built up good working relationships based on mutual trust, shared vision, aims and values, which were of central importance to developing and delivering effective work. A Public Health England report  suggested that where such partnerships were not already in place, it was worth investing time and effort to develop them.
Good governance and shared values: Distinguishing features of the WHO European Healthy Cities Network are shared vision and values and an explicit commitment to good governance by local councils and their executive arms [29, 39]. The evaluations showed that the emphasis on good governance resulted in better participation, policy-making and intersectoral action. This happened across the designated cities and was not limited to a certain class (in terms of population or geographical location) .
Appropriate partnerships are important to create sustainable multilevel environmental change: Building an effective and sustainable collaborative team was found to be key [46, 65, 76, 83]. Identifying key stakeholders and securing their early participation was considered important, as was building an appropriate network of collaborators [22, 27, 32, 65, 82]. Strong relationships between stakeholders was identified as one of the factors influencing effectiveness , whilst engaging non-traditional partners can expand reach .
Consistency in language used across organisations: The creation and use of a common language can overcome the fact that most organisations have their own beliefs and structures, for example by using consistent and authorised messages and materials, based on insights gained through prior research in the target community .
Embedding initiatives within a broader policy context: It is important to ensure agendas focus on the principles of what the organisations wish to achieve, and to integrate or align initiatives so they are not seen as additional to mainstream activity [39, 51].
Sufficient financial support and resources: Access to relevant resources, including funding, was identified as important in several process evaluations, and lack of resource was identified as a barrier to successful implementation of WSAs [27, 39, 46, 51, 62, 64, 65, 82, 83].
Review question 4: What is the evidence on cost-effectiveness of WSAs in (a) obesity (b) other areas of public health (c) areas other than public health?
We found very little evidence relating to cost effectiveness of a WSA. Only one study, a cross-sectional survey of moderate to poor quality of Put it Out Rockland , reported an apparent cost-benefit comparison, although the methods used were not clear: with an estimated return of $4 to $5 for every dollar spent on tobacco control, Rockland’s total $6 million investment between 2000 and 2010, added to the state’s investment, translated to a potential $24 million to $30 million savings in tobacco- related costs for Rockland County. However the cross-sectional study design means that conclusions about impact cannot be drawn.
Although 65 studies met the broad inclusion criteria, the heterogeneity of studies in terms of different outcomes, research designs, populations and interventions, prevented the data from being analysed statistically. It is also worth noting that most of the included studies did not set out to implement or evaluate a WSA. Furthermore, reporting of intervention and approaches in published articles was usually brief and lacked detail. This underlines the lack of robust evidence in this area and the need for further research to expand and support the suggested associations, in order to increase our understanding of how WSAs can be implemented. Nevertheless, it does seem reasonable that programmes in a community setting that adopt the principles of the ten features identified by Garside et al.  such as developing relationships and engaging stakeholders, ensuring the approach is robust and sustainable and having supportive leadership, are more likely to be successful than programmes that do not adopt these principles. Similarly, it is also feasible that all ten of the features  are associated with positive health effects, however in relation to current thinking around systems approaches, these ten features do not comprehensively describe a WSA.
The review also found consistent evidence from process evaluations that ownership and commitment, strong relationships between stakeholders, and allowing sufficient time to build relationships, trust and community capacity are all key to building a successful WSA.
There is recognition in the literature that several public health problems, including obesity, are complex issues requiring system-based approaches [84, 85]. However, although the concepts and terminology have existed for some decades the degree to which the field has progressed is debatable, partly due to the multitude of ways in which the language surrounding systems approaches is used.
Systems science “refers to a range of methods, composed largely of mathematical or computational modelling and simulation, that enable the user to explore complex problems by addressing both interactions between components of a system and the behaviour of the system over time” . On the one hand, there have been significant advances in the application of a range of systems science approaches to a variety of obesity-related public health issues using techniques such as micro-simulation, social network analysis, agent-based modelling and system dynamics modelling. On the other hand, Garside et al. (2010) reported that the term “whole system approach” was found to represent approaches informed by theory about complex systems which propose new ways of organising, managing and evaluating activities, and also as terminology within a long list of approaches which referred to cross-disciplinary, multi-agency, multi-level community activities aimed at addressing health concerns affected by complex socio-economic conditions  and which rarely, if ever, encompass the use of the system science methods as described above.
Similarly to Garside et al. , this review found little evidence of systems science or systems thinking in included studies. Few programmes had been explicitly designed and delivered with an a priori recognition of the public health issue as a system and thus rarely approached implementation from a perspective encapsulating a systems approach – the implications of which are significant for the reporting and evaluation of interventions. Furthermore, because interventions to date have not been undertaken with a systems-thinking lens or set out to take a WSA at the outset, there has been little recognition of properties inherent in a complex system (e.g. nonlinear relationships, feedback loops, dynamic interacting elements) and little attention afforded to the reporting of the central underlying operational mechanisms (e.g. improving networks, developing a common agenda, developing relationships), as suggested by Allender et al. . Hawe et al.  noted that although the majority of health promotion programmes claim to take an ecological approach, in reality this is realised as multiple interventions at multiple levels with “little theory put forward about how these levels impact the unfolding of the intervention or how they affect intervention outcomes”. Moreover, several authors have noted that implementation of a suite of activities across multiple-settings or multiple-levels is not necessarily the same as taking a “systems approach” [5, 85, 87]. Systems approaches focus on the context into which the intervention is introduced  and relate to intervening directly on the feedbacks, structures and goals of a system . Considered in this light the evidence highlights the limited progress that has been made in the practical implementation and evaluation of WSAs to public health issues to date. What is needed a framework to incorporate the complexity of systems approaches into public health research, policy and practice .
Garside and colleagues in 2010 also looked for examples of a whole system in action, finding only eight articles on the effectiveness of community wide programmes displaying features of a WSA to prevent obesity, none of which were undertaken in the UK and all of which targeted children below 14 years of age . Most findings favoured the interventions but improvements were found to be small and not always statistically significant. The inconclusive evidence relating to the 10 NICE guidance features in the present review may be because these emerged from a systematic review with the aim of providing a working definition of a WSA to obesity prevention, which did not find any “authentic” WSAs, and the definition was therefore widened to include those programmes that were designed to work at multiple levels among multiple agencies in a locality . So, meeting all ten of these criteria still does not indicate an “authentic” WSA. In addition, although studies may have met many or all of the 10 NICE guidance features in their description of their proposed intervention, in studies which presented effectiveness outcomes there was little evidence of whether these interventions had been implemented with fidelity to the WSA framework.
Our search strategy was designed to look as widely as possible to minimise the risks of missing valuable material. Although 20% of titles and abstracts were double screened, screening of the remaining 80% was limited to a single reviewer, an “acceleration strategy” recommended for rapid reviews . While this was a pragmatic necessity, it does potentially introduce bias and human error, which may have resulted in some relevant studies being missed.
Methodological details of included studies were, on the whole, poorly reported, which limits our confidence that the findings are not at significant risk of bias.
Only 11 of the included studies were UK-based, however their findings might be expected to be generalisable to the UK context and three of these [32, 53, 65] met all ten of the NICE criteria for a WSA.
Few studies targeted population groups known to be at higher risk of obesity and other public health issues, such as black and minority ethnic groups and people with low levels of education or low socioeconomic status. This limits the usefulness of the findings.
Thirteen of the 65 included studies were judged to meet all ten of the criteria for a WSA proposed by Garside et al.  in an earlier review. However, the heterogeneity of studies in terms of interventions, outcomes, research designs, and populations prevented the data from being analysed statistically.
Using a broad lens, this systematic review aimed to obtain a greater insight on the effectiveness of WSAs and how they can be implemented in practice. Evidence exists to demonstrate promise with interventions working towards systems approaches. This was most clearly demonstrated through a suite of WHO Healthy Cities process evaluations and evidence from whole of community approaches. A range of positive health outcomes were reported, but there was little evidence of an association between specific WSA features and health impacts. Evidence of systems science and systems thinking was less clear, even in the most “joined up” approaches, similar to the findings of the series of reviews carried out for NICE in 2010.
It is important to note that most of the included studies did not report that they set out to implement or evaluate a WSA, and reporting of interventions and approaches in published articles was usually brief and lacked detail. This underlines the lack of evidence in this area and the need for further research. Whilst several learnings on multi-level, community wide interventions have been obtained which are likely to be relevant to the implementation of a true WSA (e.g. evidence about barriers and facilitators to implementing such approaches), it is also evident that evidence of how to operationalise a whole systems approach to address public health problems is still in its infancy. We recommend that future researchers and policy makers develop consistency in language and an agreed definition of what a WSA should be in relation to obesity. Future research studies into the effectiveness of WSAs should look across sectors and should include detailed descriptions of interventions including approaches, and embedded process and economic evaluations, as recommended by existing guidance on developing and evaluating complex interventions [90, 91].
This report was commissioned from Leeds Beckett University by Public Health England as part of a larger project looking at Whole System Approaches to Obesity. We would like to thank Ben Mitchell for designing the search strategy and carrying out the electronic database searches, and Leonie O’Dwyer and Robin Kaye for their help with data extraction and validity assessment of included studies. We would also like to thank the Interlibrary loans team (Susan Ellis and Karl Derbyshire) in the Sheila Silver Library at Leeds Beckett University, for their excellent help in locating articles. We would also like to acknowledge the support given by the PHE Whole Systems Advisory Group, chaired by Jim McManus, and thank the following individuals for their helpful input: Adrienne Cullum, Diet, Obesity and Physical Activity Health Improvement Directorate PHE; Jim McManus, Director of Public Health, Hertfordshire County Council and Chair, PHE Whole Systems Advisory Group; Verity Hawkes, Higher Nutrition Scientific Officer, Diet & Obesity, Public Health England.
The review was funded, as part of a larger project, by Public Health England. The funding body was not involved in the design of the study or in collection or analysis of the data. Some members of the funding body (listed as authors) were involved in discussions around interpretation of some of the data and in writing the manuscript. Some of James Nobles' time was supported by the National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care West (CLAHRC West) at University Hospitals Bristol NHS Foundation Trust.
Availability of data and materials
The data extracted and used during this study are included in this published article and its supplementary information files. A full report is available from the authors on request.
AMB designed and was principal investigator for the review, wrote the protocol, contributed to the search strategy, study selection, data extraction, validity assessment and synthesis, and led the writing of the manuscript. DR contributed to the design of the review, writing the protocol, study selection, data extraction, validity assessment, and commented on and revised drafts of the full report and manuscript. RJ contributed to study selection, data extraction, validity assessment, and commented on and revised drafts of the full report and manuscript. PG was principal investigator for the larger study, commented on the design of the review and on drafts of the manuscript. JN contributed to study selection, data extraction, validity assessment, and commented on drafts of the manuscript. MVD commented on the synthesis, drafts of the full report and the manuscript. JB commented on the synthesis, drafts of the full report and the manuscript. SM commented on the synthesis, drafts of the full report and the manuscript. PS contributed to the design of the review, writing the protocol, and commented on drafts of the full report and manuscript. All authors have read and approved the manuscript.
Ethics approval and consent to participate
Consent for publication
MVD, JB and SM are part of the Public Health England team responsible for the Whole Systems Obesity programme.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
- 1.Butland B, Jebb S, Kopelman P, McPherson K, Thomas S, Mardell J, Parry V. Foresight: tackling obesities: future choices - project report. London: Department of Innovation, Universities and Skills; 2007.Google Scholar
- 5.Garside R, Pearson M, Hunt H, Moxham T, Anderson R. Identifying the key elements and interactions of a whole system approach to obesity prevention. Exeter: Peninsula Technology Assessment Group (PenTAG); 2010.Google Scholar
- 6.Hunt H, Anderson R, Coelho H, Garside R, Bayliss S, Fry-Smith A. The effectiveness of Whole System Approaches to prevent obesity. Exeter: Peninsula Technology Assessment Group (PenTAG); 2011.Google Scholar
- 7.Pearson M, Garside R, Fry-Smith A, Bayliss S. Preventing obesity using a “whole system” approach at local and community level. Barriers and facilitators to effective whole system approaches. Exeter: Peninsula Technology Assessment Group (PenTAG); 2011.Google Scholar
- 8.National Institute of Health and Care Excellence. Identifying the key elements and interactions of a whole system approach to obesity prevention. Edited by National Institute for Health and Care Excellence. London: Peninsula Technology Assessment Group (PenTAG); 2010.Google Scholar
- 10.Centre for Reviews and Dissemination. Systematic Reviews: CRD’s guidance for undertaking reviews in health care. York: University of York; 2009.Google Scholar
- 11.Higgins J, Green S. Cochrane handbook for systematic review of interventions version 5.0.1. In: The Cochrane Collaboration; 2008.Google Scholar
- 12.Thomas J, Brunton J, Graziosi S. EPPI-Reviewer 4.0: software for research synthesis. In: EPPI-Centre Software. London: Social Science Research Unit, Institute of Education, University of London; 2010.Google Scholar
- 13.Dahlgren G, Whitehead M. Policies and strategies to promote social equity in health. Stockholm: Institute for Futures Studies; 1991.Google Scholar
- 14.Kavanagh J, Oliver S, Lorenc T. Reflections on developing and using PROGRESS-plus. Equity Update. 2008;10:1–3.Google Scholar
- 15.Snape D, Meads C, Bagnall A, Tregaskis O, Mansfield L. What Works Centre for Wellbeing: a guide to our evidence review methods. London: What Works Centre for Wellbeing; 2017.Google Scholar
- 16.Critical Appraisal Skills Programme. CASP qualitative Checklist. 2018. [online] Available at: https://casp-uk.net/wp-content/uploads/2018/03/CASP-Qualitative-Checklist-2018_fillable_form.pdf. Accessed 6 Dec 2018.
- 17.National Institute for Health and Care Excellence (NICE). Methods for the development of NICE public health guidance. 3rd ed. London: NICE; 2012.Google Scholar
- 18.Thomas J, Harden A, Newman M. Synthesis: combining results systematically and appropriately. In: Gough D, Oliver S, Thomas J, editors. An introduction to systematic rveiews. London: Sage; 2012. p. 179–226.Google Scholar
- 19.Active Living by Design. Growing a movement: healthy kids, healthy communities. Final report. Chapel Hill: Active Living by Design; 2014.Google Scholar
- 24.Cook G, Dawson P, Elliot D. Case study 1: explicating the role of partnerships in Northumberland FISHNETS. In: Holland K, Warne AR, Howath ML, editors. Explicating the role of partnerships in changing the health and well-being of local communities in urban regeneration areas: an evaluation of the Warnwarth Conceptual framework: a case study approach, vol. 3; 2009. p. 14–34.Google Scholar
- 25.Copeland R, Moullin M, Reece L, Gibson D, Barrett D. Sheffield’s Let's Change4Life: a whole systems approach to tackling overweight and obesity in children, young people and families. A local evaluation report. Sheffield: Sheffield Hallam University; 2011.Google Scholar
- 29.de Leeuw E, Tsouros AD, Dyakova M, Green G, editors. Healthy cities: promoting health and equity: evidence for local policy and practice. Copenhagen: WHO Regional Office for Europe; 2014.Google Scholar
- 30.de Silva-Sanigorski A, Elea D, Bell C, Kremer P, Carpenter L, Nichols M, Smith M, Sharp S, Boak R, Swinburn B. Obesity prevention in the family day care setting: impact of the Romp & Chomp intervention on opportunities for children's physical activity and healthy eating. Child Care Health Dev. 2011;37:385–93.CrossRefGoogle Scholar
- 32.Department Of Health: Change4life: one year on; 2010.Google Scholar
- 33.Donchin M, Shemesh AA, Horowitz P, Daoud N. Implementation of the Healthy Cities’ principles and strategies: an evaluation of the Israel Healthy Cities Network. Health Promot Int. 2006;21:266–73.Google Scholar
- 34.Eat Smart Move More North Carolina Leadership Team. Eat smart, move more: North Carolina’s plan to prevent overweight, obesity and related chronic diseases, 2007–2012: final report. Raleigh: Eat Smart Move More; 2013.Google Scholar
- 41.Green G, Price C, Lipp A, Priestley R. Partnership structures in the WHO European Healthy Cities project. Health Promot Int. 2009;24:37–44.Google Scholar
- 43.Jeffery RW, Gray CW, French SA, Hellerstedt WL, Murray D, Luepker RV, Blackburn H. Evaluation of weight reduction in a community intervention for cardiovascular-disease risk - changes in body-mass-index in the Minnesota heart health program. Int J Obes. 1995;19:30–9.Google Scholar
- 48.Komro KA, Perry CL, Veblen-Mortenson S, Farbakhsh K, Toomey TL, Stigler MH, Jones-Webb R, Kugler KC, Pasch KE, Williams CL. Outcomes from a randomized controlled trial of a multi-component alcohol use preventive intervention for urban youth: Project Northland Chicago. Addiction. 2008;103:606–18.Google Scholar
- 51.Lieberman L, Diffley U, King S, Chanler S, Ferrara M, Alleyne O, Facelle J. Local tobacco control: application of the essential public health services model in a County Health Department's efforts to Put It Out Rockland. Am J Public Health. 2013;103:1942–8.Google Scholar
- 52.Lipp A, Winters T, Leeuw E. Evaluation of partnership working in cities in phase IV of the WHO Healthy Cities Network. J Urban Health. 2013;90:S37–51.Google Scholar
- 53.London Borough of Hackney: Health heroes. A whole school approach to healthy weight. 2014.Google Scholar
- 54.Lynn WR, Freedman LS, Green SB, Corle DK, Gail M, Glasgow RE, Hartwell TD, Cummings KM, Ockene JK, Giffen CA. Community intervention trial for smoking cessation (COMMIT) .1. Cohort results from a 4-year community intervention. Am J Public Health. 1995;85:183–92.Google Scholar
- 55.Maguire M, Nettleton H, Rix A, Raybould S. Reducing alcohol-related violence and disorder: an evaluation of the ‘TASC’ project (Home Office research study 265). London: Home Office; 2003.Google Scholar
- 58.Middleton G, Henderson H, Evans D. Implementing a community-based obesity prevention programme: experiences of stakeholders in the North East of England. Health Promot Int. 2014;29:201–11.Google Scholar
- 59.Mohammadifard N, Kelishadi R, Safavi M, Sarrafzadegan N, Sajadi F, Sadri GH, Maghroon M, Alikhasi H, Heydari S, Sarmadi F. Effect of a community-based intervention on nutritional behaviour in a developing country setting: the Isfahan Healthy Heart Programme. Public Health Nutr. 2009;12:1422–30.Google Scholar
- 61.Peters J, Ellis E, Goyder G, Blank L. Healthy eating initiatives: case studies (New Deal for Communities National Evaluation Research Report 56). Sheffield: Sheffield Hallam University; 2005.Google Scholar
- 64.Plumer KD, Kennedy L, Trojan A. Evaluating the implementation of the WHO Healthy Cities Programme across Germany (1999-2002). Health Promot Int. 2010;25:342–54.Google Scholar
- 65.Public Health England. Paths to public health and wellbeing: examples of local authority action in the South-West. London: Public Health England; 2014.Google Scholar
- 67.Ritsatakis A, Ostergren PO, Webster P. Tackling the social determinants of inequalities in health during phase V of the Healthy Cities project in Europe. Health Promot Int. 2015;30:i45–53.Google Scholar
- 69.Sanigorski AM, Bell AC, Kremer PJ, Cuttler R, Swinburn BA. Reducing unhealthy weight gain in children through community capacity-building: results of a quasi-experimental intervention program, Be Active Eat Well. Int J Obes. 2008;32:1060–7.Google Scholar
- 70.Sarrafzadegan N, Kelishadi R, Esmaillzadeh A, Mohammadifard N, Rabiei K, Roohafza H, Azadbakht L, Bahonar A, Sadri G, Amani A, et al. Do lifestyle interventions work in developing countries? Findings from the Isfahan healthy heart program in the Islamic Republic of Iran. Bull World Health Organ. 2009;87:39–50.CrossRefGoogle Scholar
- 71.Sautkina E, Goodwin D, Jones A, Ogilvie D, Petticrew M, White M, Cummins S. Lost in translation? Theory, policy and practice in systems-based environmental approaches to obesity prevention in the Healthy Towns programme in England. Health Place. 2014;29:60–6.Google Scholar
- 74.Schulz AJ, Zenk S, Odoms-Young A, Hollis-Neely T, Nwankwo R, Lockett M, Ridella W, Kannan S. Healthy eating and exercising to reduce diabetes: exploring the potential of social determinants of health frameworks within the context of community-based participatory diabetes prevention. Am J Public Health. 2005;95:645–51.CrossRefGoogle Scholar
- 80.Wagenaar AC, Gehan JP, Jones-Webb R, Toomey TL, Forster JL, Wolfson M, Murray DM. Communities Mobilizing for Change on Alcohol: lessons and results from a 15-community randomized trial. J Community Psychol. 1999;27:315–26.Google Scholar
- 81.Werna E, Harpham T. The implementation of the Healthy Cities project in developing countries: lessons from Chittagong. Habitat Int. 1996;20:221–8.Google Scholar
- 82.Amed S, Shea S, Pinkney S, Wharf Higgins J, Naylor P-J. Wayfinding the Live 5-2-1-0 initiative-at the intersection between systems thinking and community-based childhood obesity prevention. Int J Environ Res Public Health. 2016;13(6). https://doi.org/10.3390/ijerph13060614.
- 83.Mikkelsen BE, Novotny R, Gittelsohn J. Multi-level, multi-component approaches to community based interventions for healthy living-a three case comparison. Int J Environ Res Public Health. 2016;13(10):1023–40.Google Scholar
- 84.Carey G, Malbon E, Carey N, Joyce A, Crammond B, Carey A. Systems science and systems thinking for public health: a systematic review of the field. BMJ Open. 2015;5:e009002.Google Scholar
- 87.Huang T, Ferris E. Connecting the dots: translating systems thinking into innovative solutions for childhood obesity. In: Goran MI, editor. Childhood obesity causes, consequences, and intervention approaches. Boca Raton: CRC Press Taylor & Francis Group; 2016. p. 465–77.Google Scholar
- 88.Rutter H, Savona N, Glonti K, Bibby J, Cummins S, Finegood D, Greaves F, Harper L, Hawe P, Moore L, et al. The need for a complex systems model of evidence for public health. Lancet. 2017;390(10112):2602–4.Google Scholar
- 90.Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: new guidance. London: Medical Research Council; 2006.Google Scholar
- 91.Coly A, Parry G. Evaluating complex health interventions: a guide to rigorous research designs. In: AcademyHealth; 2017.Google Scholar
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.