Abstract
Background
The Exemplars in Under-5 Mortality (U5M) was a multiple cases study of how six low- and middle-income countries (LMICs), Bangladesh, Ethiopia, Nepal, Peru, Rwanda, and Senegal, implemented health system-delivered evidence-based interventions (EBIs) to reduce U5M between 2000 and 2015 more effectively than others in their regions or with similar economic growth. Using implementation research, we conducted a cross-country analysis to compare decision-making pathways for how these countries chose, implemented, and adapted strategies for health system-delivered EBIs that mitigated or leveraged contextual factors to improve implementation outcomes in reducing amenable U5M.
Methods
The cross-country analysis was based on the hybrid mixed methods implementation research framework used to inform the country case studies. The framework included a common pathway of Exploration, Preparation, Implementation, Adaptation, and Sustainment (EPIAS). From the existing case studies, we extracted contextual factors which were barriers, facilitators, or determinants of strategic decisions; strategies to implement EBIs; and implementation outcomes including acceptability and coverage. We identified common factors and strategies shared by countries, and individual approaches used by countries reflecting differences in contextual factors and goals.
Results
We found the six countries implemented many of the same EBIs, often using similar strategies with adaptations to local context and disease burden. Common implementation strategies included use of data by decision-makers to identify problems and prioritize EBIs, determine implementation strategies and their adaptation, and measure outcomes; leveraging existing primary healthcare systems; and community and stakeholder engagement. We also found common facilitators included culture of donor and partner coordination and culture and capacity of data use, while common barriers included geography and culture and beliefs. We found evidence for achieving implementation outcomes in many countries and EBIs including acceptability, coverage, equity, and sustainability.
Discussion
We found all six countries used a common pathway to implementation with a number of strategies common across EBIs and countries which contributed to progress, either despite contextual barriers or by leveraging facilitators. The transferable knowledge from this cross-country study can be used by other countries to more effectively implement EBIs known to reduce amenable U5M and contribute to strengthening health system delivery now and in the future.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Main messages
-
These six countries which dropped under-5 mortality faster than their peers between 2000 and 2015 used a number of common implementation strategies to implement evidence-based interventions known to reduce amenable under-5 mortality in low- and middle-income countries.
-
These countries used a common pathway to implementation from Exploration to Preparation, Implementation, Adaptation, and Sustainment, with variability reflecting national and subnational contexts and learning during implementation.
-
Use of data and stakeholder input to understand and act on contextual factors which can hinder or facilitate implementation, and to choose and adapt implementation strategies to reflect mechanisms of action, can help improve implementation outcomes of these evidence-based interventions.
-
Using implementation research to understand how and why countries successfully implement evidence-based interventions is valuable to extract transferable lessons which can inform work to accelerate progress in further reducing under-5 mortality in other countries.
Introduction
Between 2000 and 2015 and supported by the efforts of the Millennium Development Goals (MDGs), there was an increase in focus and funding towards maternal and child health. This effort contributed to progress in low- and middle-income countries in reducing under-5 mortality (U5M) by 43% globally [1,2,3,4,5]. The commitment to achieving the MDGs spurred countries to introduce and strengthen implementation of evidence-based interventions (EBIs) known to reduce U5M directly through prevention or treatment of leading causes of death, through health interventions which reduced U5M risk, and through broader public health system strengthening that supported this work to reduce U5M [6]. Despite these well-known health system-delivered EBIs being used to reduce U5M, success in implementing these interventions was not uniform [7]. Much of the published work to understand these efforts has focused on overall coverage and effectiveness, and less on how and why countries succeeded in the implementation strategies used and contextual factors which helped or hindered this work [8, 9].
Implementation research is “the scientific study of the use of strategies to adopt and integrate evidence-based health interventions into clinical and community settings to improve individual outcomes and benefit population health” [10]. This method of study offers tools that can help understand and create the transferable knowledge needed to support learning between countries which have been more and less successful in EBI implementation [8, 11, 12]. The Exemplars in U5M project used implementation research methods to conduct mixed methods case studies to understand how and why six countries, Rwanda, Nepal, Senegal, Bangladesh, Ethiopia, and Peru, were able to lower U5M more than other countries from similar regions and with comparable economic growth [13, 14]. From 2000 to 2015, these countries dropped U5M by more than 50%, and all but Senegal achieved MDG4, defined as more than two-thirds decline in U5M during that period [5]. The case studies focused on the implementation of the health system-delivered EBIs known to reduce amenable U5M, defined as deaths preventable through quality in healthcare delivery [15]. In every country we studied, work in other sectors – including female empowerment and education, economic growth, and water, sanitation, and hygiene – also served as facilitators or barriers to the implementation strategies or their adaptation, in and beyond the health system, and the overall impact of the EBIs in reducing U5M. While we recognize their importance, understanding the exact contribution was not part of our study. Further, while we also explored other interventions outside the health system EBIs known to reduce the risk of major causes of U5M as well as improve survival, in-depth analysis of how these were implemented was beyond the scope of this project.
For this paper, we conducted a cross-country analysis from the country case studies to understand similarities and differences across the six countries. Using the lens of a framework for implementation we adapted to in order to look at the decision pathways from exploration to preparation, implementation, adaptation, and sustainment (EPIAS), we strove to understand how the countries mitigated barrier or leveraged facilitating contextual factors through the choice, implementation, and adaptation of implementation strategies, as well as the implementation outcomes of the work to implement health system-delivered EBIs to reduce amenable U5M. As we reach the midpoint of the Sustainable Development Goals period, many countries are continuing to work to achieve gains in reducing under-5 and neonatal mortality. We hope the results of this study will be of value to implementers and policymakers looking to accelerate work to strengthen implementation of existing EBIs for future interventions to reduce amenable child mortality in different contexts and to contribute to strengthening public health system delivery now and in the future.
Methods
Case study design
The details of the Exemplars in U5M project are described on the Exemplars website (https://www.exemplars.health/topics/under-five-mortality), with methodological details of the country case studies published elsewhere [15]. Briefly, six low- and middle-income countries – selected to represent a range of locations and population sizes – were identified as having experienced greater U5M drops between 2000 and 2015 in relation to the gross domestic product per capita than countries in their regions with similar socioeconomic development. The mixed methods case studies were informed by a hybrid implementation research framework designed for the Exemplar study [15]. This framework built on existing implementation research frameworks and EPIAS (Exploration, Preparation, Implementation, Adaptation, and Sustainment) steps to understand the implementation pathways, contextual factors at the global, national, health system, and community level, and implementation outcomes including appropriateness, feasibility, acceptability, fidelity, effectiveness, equity, and sustainability (Fig. 1) [15].
Evidence-based interventions
We reviewed existing literature and guidelines to identify EBIs known to reduce the most common causes of amenable mortality among neonates and children under 5 in low- and middle-income countries during the study period [16, 17] (Additional file 1).
Data collection
Between 2017 and 2020 we analyzed publicly available quantitative data on mortality, causes of death, and EBI coverage over the study period. We also conducted desk reviews of reports, policy documents, and published articles and other gray literature describing strategies, contextual factors, implementation outcomes, and policies related to these health system-delivered EBIs. Finally, we conducted 104 key informant interviews across the six countries (range 11 in Ethiopia to 23 in Senegal) with current and former ministry of health officials, implementers, donors, and other global, national, or subnational actors using a semi-structured interview guide based on the implementation research framework. The guides were adapted to each country and designed to understand the EBI implementation process, from exploration and preparation, through implementation, adaptation, and sustainment (EPIAS) (see Additional file 2 for a key informant interview guide). The key informants (KIs) were chosen purposively to represent a variety of viewpoints and experiences during the study period of 2000–2015. The selection of KIs was not intended for saturation but to cover a range of EBIs and was limited by time and resources. Resource limitations precluded inclusion of community and frontline providers, although a number of key informants served as a provider of these EBIs prior to their current position. The interviews were conducted by phone or face-to-face by the U5M project principal investigators (AB and LRH), lead country partners (PJG, FAH, MM, MS, FS, RKS, AMT), and project staff (KU). Each interview’s duration was approximately 1 h. The country cases were designed and conducted using the same methodology and core tools for data collection and analysis to facilitate a cross-case analysis.
To understand the success or challenges of the EBI implementation, we focused on implementation outcomes including acceptability, appropriateness, effectiveness, feasibility, fidelity, coverage (reach), sustainability, and equity where available (Table 1) [18]. While not typically an implementation outcome, we included coverage as it is critical to achieving drops in U5M. In feedback sessions we had for each country as part of the case study development process, we sought input from country partners and health system stakeholders for consensus on the identification of outcomes. There were challenges with data gaps and limitations for implementation outcomes both through primary and secondary sources. To support the qualitative acceptability data, we also used coverage and reach data. We recognize however that other factors impact acceptability, for example, including access such as through geography.
Quantitative analysis
We used equity plots produced by the International Center for Equity in Health and data on equity gaps collected and analyzed from Demographic and Health Survey data for each country, for coverage of selected EBIs including vaccinations and facility-based delivery (FBD), and to explore changes in countries’ equity gaps over time across region, wealth quintile, and sex.
Qualitative analysis
For the country-specific analysis, we used a sequential explanatory mixed methods approach; we used coverage data to inform qualitative questions [21], and used directed content analysis of the KI interviews based on the hybrid framework [22, 23]. Following the close of the interview, notes were combined and audio recordings (if permitted) were used to clarify areas as needed. We analyzed the key informant interviews to expand on the literature review, identifying the contextual factors and implementation strategies to understand how and why countries reached their quantitative results. Using the framework, we created an initial set of codes for EBIs, contextual factors, and implementation outcomes. We coded manually and added new codes as we identified new concepts, contextual factors, or implementation strategies. We used inductive and deductive approaches for thematic coding of interviews; this was reviewed by one of the principal investigators for accuracy, with discussion for differences. Guided by the framework we also extracted evidence from the quantitative and qualitative data sources to explore other implementation outcomes such as acceptability, adoption, and equity. We analyzed and synthesized the findings and presented them for review during a convening of in-country stakeholders for feedback and validation.
Cross-case analysis and synthesis
We performed the cross-case analysis using multiple case studies methodology, in which common research questions unite the cases, facilitating a greater understanding of the set of cases from both commonality and uniqueness [24,25,26]. We reviewed each case study and extracted the contextual factors, implementation strategies, and implementation outcomes by EBI for each country into an excel database, creating matrices to identify those which were more or less common. We used the case studies to identify cross-cutting contextual factors that were facilitators or barriers, as well as those that could be either a barrier or facilitator depending on local context, or those not identified, as contextual factors to EBI implementation. We developed a matrix of all implementation strategies identified across the countries and EBIs and used it to assess whether selected strategies were implemented successfully, implemented with some success, or not implemented at all. We defined “cross-cutting” implementation strategies as those implemented in at least three of the six countries. We reviewed implementation outcomes identified in the case studies to explore where EBI implementation was more, or less, successful across the six countries.
Ethical considerations
The study was determined to be non-human subjects research by the Rwandan National Ethics Committee and Northwestern University reflecting the scope and focus, and each of the country case studies were reviewed and approved by in-country Ethics Review Committees (Bangladesh, PR-18074; Ethiopia, PM23/281; Nepal, 165–2018; Peru, 104,276; Rwanda, 132/RNEC/2017; Senegal, SEN18/33). Interviewees were informed about the goals and structure of the project, and verbal informed consent for participation was obtained from all interview participants.
Results
Common pathway for implementation of interventions
We found that the six countries implemented many of the same EBIs, often using similar strategies with adaptations to local context and disease burden and a common pathway of EPIAS stages. They often went through similar decision-making processes, identifying and leveraging facilitating contextual factors or mitigating identified barriers. While the process used many of the same strategies across EBIs and countries, the decision-making and contextual differences also contributed to adaptation of how these were implemented, as well as some strategies which were more specific to national or subnational contexts. For instance, difficult geographic access was a challenge for EBI implementation including delivery in healthcare facilities for women who lived in mountainous areas in countries such as Nepal and Bangladesh. Both countries responded to this barrier by integrating a cadre of skilled births attendants into the existing community health worker (CHW) system who could reach provide delivery services to the women, and Nepal added another strategy of cash transfers for transport for pregnant women who delivered in health facilities. In Ethiopia, the community-based delivery of EBIs was also implemented, with use of health extension workers who reached and built trust with underserved pastoralist communities with limited access to healthcare.
During the Exploration phase, all countries used data to understand the burden of disease, determine if the EBI was appropriate for implementation at that time, and to establish whether EBI adaptation was needed. The type of data used (such as previous analysis from the country or global evidence, newly analyzed from existing routine data, or newly collected data) differed by EBI and by country. For example, in Bangladesh, icddr,b, an academic research institution, supported the government with pilot testing and data collection. This existing research capacity allowed for ongoing data analysis to inform the needs of interventions and their adaptation. It also encouraged policymakers to rely on national data collection and analyses. Further, this allowed Bangladesh to innovate based on in-depth understanding of relevant topics and local context. In Nepal, the Ministry of Health (MOH), in close collaboration with implementing partners, adopted EBIs after conducting small-scale testing to confirm appropriateness and acceptability. The Nepal Health Research Council assessed quality of the findings from research conducted in a small geographic area and, if found a good fit, recommended the integration of tested interventions into national policy and planning. Rwanda, on the other hand, more often leveraged existing data, routinely collected from patients in healthcare facilities. According to one key informant, Rwanda’s investment in information technology and systems, improving data availability at the local level, meant that “All the data went through that platform, and each level can see that data and can analyze themselves (over time). This platform can help them to see how (things are working).”
During the Preparation stage, countries employed a number of common strategies. These strategies were used to inform understanding and to choose implementation strategies when possible to directly address contextual barriers or leverage facilitating factors to effectively implement the chosen EBIs. Common strategies included use of data, partnering with donors and collaborators (both within the health sector and across ministries and implementing partners), and engaging with stakeholders from national to community levels. For instance, Rwanda employed a public/nongovernmental organization/faith-based organization partnership strategy, signing formal agreements to provide the same package of health services and reports as the one provided by the public sector. In return, these health facilities received the same supervision and government support for salaries, equipment, and infrastructure as the public health facilities. This collaboration increased the number of district hospitals and health centers available to the population. All the countries also effectively used data to understand disease burden to prioritize work and resources.
Common strategies used by countries during the Implementation stage included engagement and education of community; integration of EBI policies and protocols into standards of care; activation of monitoring and evaluation systems; and training of personnel and stakeholders. In Peru, for example, the MOH developed and implemented a national sexual and reproductive health strategy beginning in 2004, promoting FBD as one of the country’s main strategies to reduce maternal mortality. Training and other human resources strengthening activities such as supportive supervision facilitated implementation of new EBIs or expansion of coverage for existing ones. In the case of FBD, this included national-level training for providers. In Senegal, community engagement and use of data systems were important in implementing strategies to reduce malaria. According to KIs, a significant strategy associated with success in Senegal’s malaria program was community engagement through awareness-raising campaigns that involved a variety of door-to-door and community-wide outreach activities. Routine data collection and surveys, including the Demographic and Health Survey and the Malaria Indicator Survey, were used to monitor important indicators such as care-seeking rates and preferences for available malaria treatment options. All countries used the existing community health system to implement EBIs, although the emphasis ranged between countries with the highest in Rwanda, Nepal, Ethiopia, and Bangladesh.
Countries continued to use data to direct work on implementation outcomes including reach and fidelity and ongoing stakeholder engagement to identify where Adaptations in existing strategies or where new strategies were needed at a national or subnational level. For example, in Ethiopia, coverage data helped in recognizing gaps in newborn care. Ethiopia used this information to adapt the services provided by its health extension workers, putting a priority on neonatal mortality by adding in community-based newborn care to the curriculum.
Less uniform between countries and across EBIs was use of strategies in laying the groundwork to ensure Sustainment – that effective implementation strategies and EBI delivery would be maintained. In addition, KIs reported that donor funding was a potential threat to the sustainment of U5M initiatives, due to countries being overly dependent on donor funding. For example, Senegal chose strategies including leveraging donor support and increasing government funding to try to influence sustainment, with total health expenditure per capita increased from $22 in 2000 to $36 in 2015. In Nepal, there was an ongoing reliance on donor funding despite efforts to increase government financing and leverage donor support. This made sustainment a challenge as Nepal’s economic status increased and donor funding priorities reoriented to other countries.
Contextual factors
Facilitating factors for EBI implementation found across many or all of the countries included culture of data use, stakeholder engagement, an existing CHW structure, national priority for health and primary care, leadership and governance and a culture of accountability, donor funding availability and aligned priorities with national agenda, and economic development (Table 2). Contextual factors that were barriers (or could be, depending on local context) included geography, health system structure and strength, and culture and beliefs around EBIs. Countries often chose or adapted strategies to leverage facilitators or directly or indirectly address barriers. Below we discuss differences in examples of important contextual factors, both facilitators and barriers. More examples are in Additional file 3 as well as the full case studies available at https://www.exemplars.health/topics/under-five-mortality [27,28,29,30,31].
Preexisting culture and capacity of data use
We found the pre-existing culture and capacity of data use for evidenced-based decisions was a facilitator in all countries. In Senegal, this contextual factor was important for making data use an effective strategy and facilitating the design, planning, and piloting of EBIs tailored to the local context before they were scaled up. According to one KI, the pre-existing culture of data use enabled decision-makers to use pilot data to “see the costs of implementation; see where to scale-up; evaluate all the needs that must be available first, quantify everything; [and] know which particular actors must be trained and supervised.” Bangladesh leveraged its culture and capacity of in-country data generation and data use for understanding gaps, implementing, and adapting strategies. This was facilitated through researchers from in-country research institutions such as icddr,b and others participating in regular meetings with decision-makers.
Strong preexisting community health system and structure including CHWs
A strong community health system and structure including CHWs was an important facilitator across many of the countries. For example, Ethiopia’s comprehensive community health system, the Health Extension Program, was identified by several KIs as a key facilitator in the country’s efforts to implement EBIs to reduce U5M. An Ethiopian KI explained that “it is difficult to say there is one and only one initiative but the major umbrella I would say could be the Health Extension Program into which [was] imbedded management of childhood illness, and the newborn community-based initiatives along with integration of child immunization program into the [Health Extension Program] and this … encompasses both rural and urban communities. That is one area that has contributed much of the reduction to under-5 mortality.” The Health Extension Program increased access to health education and promotion, prevention, and delivery services, particularly in rural areas – and became a platform to introduce new services such as integrated community case management. Similar findings included the leveraging of the CHWs in Rwanda through the Binome program and in Nepal through the Lady Health Workers or female community health volunteers. A KI in Nepal said that the female community health volunteers were important in contributing to major achievements in the health sector, stating that they “were behind every major changes and achievements in the health sector and I consider them to be one of the main reasons behind the U5 mortality drop.”
Leadership and governance and a culture of accountability and, closely related, national priority for health and primary care
We found leadership and governance and national priority for health including a focus on primary care and linking to accountability to be facilitators in each of the six countries. For example, in Rwanda and Nepal, the commitment of leadership to access to healthcare as a human right of the people is enshrined in the constitution. A high national priority of “reaching the unreached” was a core theme repeated by several KIs. In Nepal this commitment to healthcare allowed the work to reduce U5M to continue during the country’s civil war because all sides protected the health sector programs. In Peru, the Roundtable for the Fight Against Poverty, a multisectoral initiative that set a national anti-poverty agenda, facilitated national leadership and prioritization and increased the culture of accountability for implementation of EBIs. One KI explained, “the Roundtable is reviewing budget and implementation issues and looking at the problems that are in regions, and I think it also helps the same actors who execute to be able to feel observed and seen, and not just do what they want without accountability and transparency.”
Factors could be either a barrier or facilitator, depending on the country. A factor could be strong and leveraged in one place while weak and need to be addressed in another, while not really affecting implementation elsewhere. We identified a number of contextual factors shared across many of the countries which were barriers, and which countries worked to directly address or accommodate through adaptation of strategies. For example, we found culture and beliefs around healthcare was a barrier factor that needed to be overcome in some places (Table 2). In Peru, cultural practices in many areas meant that pregnant women who lived in rural Andean regions preferred to deliver in vertical position. To increase FBD, cultural sensitivity to this practice was integrated into the delivery protocols (strategy: adaptation during implementation). In Ethiopia, the pastoralist communities believed that delivery was a normal process which did not necessarily require delivery in health facilities. In addition, it was not culturally acceptable for postpartum women to leave homes within hours after delivery, creating a barrier to accessing postnatal care in health facilities. To reduce the risk of life-threatening complications during perinatal period, health extension workers were trained to provide postnatal care at home (strategy: building on CHW program and community-based care delivery). In Senegal, some pregnant women still relied on traditional norms, such as hiding early pregnancies, delaying uptake of healthcare services including antenatal care visits. In response, the country leveraged its preexisting community health system and structure including CHWs, introducing a new cadre of CHWs (strategy: building on CHW program and community-based care delivery), locally known as bajenou gokh, who were culturally respected older women. The bajenou gokh saw to health promotion including early detection of pregnancy and encouragement of care-seeking behavior, such as antenatal care visits and FBD.
Geography
In many countries, geographic barriers were addressed through strategies to facilitate access to healthcare services for people living in hard-to-reach areas. For instance, in Senegal, a cadre of home-based care providers, known as dispensateurs de santé à domicile, was introduced to provide basic healthcare services such as testing and treatment of malaria for underserved people living in hard-to-reach areas. In Ethiopia, although there was scale up of the health extension program to deliver EBIs to underserved people across the country, coverage was still low in some regions particularly where most pastoralist communities lived. In Nepal, people who lived in hard-to-reach areas had limited access to health services. The country prioritized conducting small-scale testing of EBIs such as measles vaccination and malaria interventions primarily in these areas and, after having effective findings from the testing, the interventions were scaled up to other regions.
Many implementation strategies were mapped to specific contextual factors across different EBIs. For example, the strategies chosen to focus on equity reflected contextual factors underlying inequity such as existing gaps in economic development (poorer versus wealthier populations) and geography (including both urban/rural and hard-to-reach areas). The specific strategies which were then applied differed between countries and included subsidizing or providing free care, beginning implementation in poorer areas, or targeting focused interventions in hard-to-reach areas, depending on the contextual factors associated with existing inequity.
Common implementation strategies
The six countries often chose or adapted implementation strategies to address or leverage identified contextual factors before or during implementation. Important strategies implemented across all or most of these countries included data use for decision-making, multisectoral collaboration, building and leveraging existing primary healthcare systems to integrate new EBI delivery into existing systems including CHWs, national leadership and accountability for EBI implementation, integrating the EBI into national protocols and policies, and community engagement and education (Table 3). Countries also selected strategies to address some contextual factors which were barriers, directly through the health sector or by leveraging national level work led by the ministry of health and other sectors such as infrastructure development, female empowerment, nutritional interventions to reduce stunting, water, sanitation, and hygiene, and broader work in strengthening human resources for health. This approach was important in adapting strategies addressing barriers, for example through access-focused strategies to address cultural barriers and improve acceptability. Below we discuss examples of key cross-cutting implementation strategies as well as some that were implemented with more variable success. More examples are in the full case studies available at https://www.exemplars.health/topics/under-five-mortality [27,28,29,30,31].
Countries leveraged implementation strategies such as building and strengthening existing primary healthcare based on the contextual factor of strong preexisting community health system and structure including CHWs. The strategies of rapid versus phased scale-up reflected factors including donor funding priorities and availability, national priority for health and primary care, and geography. Finally, countries leveraged partner support (for example for evidence generation, cold and supply chain strengthening, and implementation), reflecting gaps in health systems structure and strength, culture and beliefs, and preexisting culture and capacity of data use.
Multisectoral collaboration
Multisectoral collaboration, including across ministries and particularly for interventions to address barriers, was consistently important for implementation success. This strategy was also combined in some of the countries with strong coordination of donors who often funded much of the initial EBI implementation to implement following national priorities and guidelines. In Senegal, partners across sectors and ministries collaborated to set the policy agenda and priorities for national maternal and child health programming, with the Ministry of Economy, Finance, and Planning a key partner to avoid duplicating efforts and increase efficiency in planning for implementation. A KI explained that collaborative planning was essential, “because there are many stakeholders, we need to pool resources according to needs and priorities. If two stakeholders are in the same area, we are better pooling them instead of coming in the same area do the same work without knowing each other’s programs.” Rwanda used multisectoral collaboration as an implementation strategy through the Social Cluster (made up of Ministries of Health, Education, Local Government, Agriculture, and Gender), which worked to address overlapping issues, such as malnutrition, teenage pregnancy, and gender-based violence. Peru used multisectoral collaboration for sustained efforts, such as the Roundtable for the Fight Against Poverty, which specifically targeted maternal and child health indicators and remained active throughout government transitions, with collaboration between civil society, the public sector, and nongovernmental organizations.
Building on CHW program and community-based care delivery
The adaptation or expansion of the existing community-based care delivery systems (a facilitating factor) and building on CHW programs was an important strategy in five countries, though less so in Peru. Community health workers have been utilized in Peru for decades but tended to have little training, working as volunteer health promoters, and were used with variable effectiveness for a few EBIs. Ethiopia leveraged its Health Extension Program, establishing health extension workers to implement multiple key community-level EBIs through demand generation (via community engagement and education) as well as care delivery (including vaccines, antenatal care, and FBD). Senegal leveraged its strong community-based care delivery system with multiple cadres of CHWs to engage and educate communities and provide direct care delivery. This strategy helped to increase acceptability as well as facilitate broader scale-up of interventions.
Focus on equity
Prioritization of equity was an important strategy across countries, but took different forms. In Bangladesh, this strategy was used in integrated management of childhood illness, with areas with higher U5M targeted at the start of the phased roll-out. In Peru, a focus on equity meant the country prioritized introducing new vaccines, including rotavirus and pneumococcal, into the poorest areas first before national rollout. However, even where countries experienced overall reductions in U5M, there was variability subnationally in every country, with some areas or groups lagging behind in the reduction in U5M and in coverage of some EBIs [32]. Subnational variability in amenable U5M reductions was observed for disease incidence, EBI reach – often related to contextual factors such as culture, geography (by region and urban/rural) – and socioeconomic status. Across the six countries, U5M and neonatal mortality were higher in rural areas and among the poorest [33,34,35,36,37,38,39,40,41,42,43,44].
Even when the EBI implementation strategies were carefully planned, they were not always effective. We found that countries had successes when they recognized and diagnosed the challenges and addressed them through strategy adapted to context (for example, Peru’s modification of maternal waiting homes, discussed further below) or directly addressing the barrier (such as home-based care delivery when geography limited access). Implementation strategies chosen by countries to address quality – such as supportive supervision – were implemented with more variable success. Supportive supervision was not always done routinely (Senegal), or sufficiently (Rwanda and Ethiopia), or with high quality (Nepal). In Senegal, it was noted that supervision was variable due to its reliance on donor resources. In Rwanda, lack of supervision within the CHW program was one of the reasons attributed to challenges to identifying cases of malnutrition in the community using existing CHW systems. In Ethiopia, health extension workers received quarterly supportive supervision visits. However, KIs identified ensuring continued supportive supervision for specific interventions such as integrated community case management through integration into the routine supervision as a challenge to this strategy’s effective implementation.
Evidence-based intervention type and implementation strategy
The use of a given implementation strategy reflected the nature or complexity of systems and skills needed to deliver the EBI. For example, some implementation strategies supported EBIs delivered at facilities (e.g. facility staff training in management and monitoring and evaluation), while other strategies could be implemented for community-delivered EBIs (e.g. the strategy of community-based care delivery); still other strategies were agnostic of intervention delivery (e.g. multisectoral collaboration and focus on equity). Preventative health system EBIs such as vitamin A supplementation, insecticide-treated bed net distribution, and intermittent preventive therapy for groups at high risk for malaria exposure could be delivered both in the community and in facilities. For these types of EBIs, dual strategies were often chosen to take advantage. These differentiations can be understood by different types of EBIs, in the following categories: vaccination, preventative (neonatal or children under 5 broadly), and curative (again, neonatal or children under 5 broadly) (Table 4).
Implementation outcomes
We were able to find some qualitative and less often quantitative evidence for some implementation outcomes including acceptability, appropriateness, coverage (reach), feasibility, and equity for some of the EBIs and countries. We identified fewer results for other outcomes including cost, fidelity (including quality), and sustainability. Below we discuss findings for outcomes of acceptability, coverage (reach), equity, and sustainability. See Table 5 for more detail on additional outcomes.
Countries’ choice of some implementation strategies varied depending on what outcomes they prioritized, as well as the existing contextual factors that needed to be overcome or could be leveraged. For example, geography, cultural barriers to acceptability, and human resource capacity were identified barriers to implementation in many of the countries. Countries often used the strategy of community-based delivery through CHWs or campaigns when populations were more dispersed geographically to achieve reach. Additionally, to achieve effectiveness, this work needed to be accompanied by strategies to strengthen quality through supportive supervision and focus on equity, and interventions to address weak health systems. The strategy of leveraging CHWs as trusted agents to communities was also important for overcoming the barrier of culture and beliefs and achieving the outcome of increased acceptability in countries including Senegal, Ethiopia, and Bangladesh.
Acceptability
Acceptability was generally measured by uptake, with variability depending on the EBI and subnational context. Strong community and stakeholder engagement was often associated with higher reports of acceptability. For example, in Nepal, behavior change communications, school-based outreach, and celebrity engagement were all strategies used to increase acceptability of insecticide-treated bed nets. Countries also leveraged acceptability of similar EBIs such as with the rotavirus vaccine in Senegal. According to a KI, “The advantage is that people have confidence in immunization programs and even when there is a new introduction...they accept to take it.” Adaptation of strategies was also done to increase acceptability. In Nepal, acceptability of and demand for FBD increased when pregnant women were given conditional cash transfers and transportation vouchers to travel to health facilities. Peru reviewed data on FBD coverage and recognized the need to adapt how FBD and maternal waiting homes were implemented to increase acceptability. They changed facility infrastructure, allowed family members and traditional healers to accompany women, and allowed traditional birthing techniques such as vertical delivery as well as existing techniques.
Coverage (reach)
We found these outcomes were high overall for most vaccination EBIs. There was high reach across most countries for measles vaccination (86% in Bangladesh in 2014, 90% in Nepal in 2016, 92% in Peru in 2015, 95% in Rwanda in 2015, and 88% in Senegal in 2016). With a priority on reach and coverage, Rwanda leveraged rapid scale-up, aiming for full coverage, and prioritizing the use of global versus local data for decision-making as implementation strategies, with coverage reaching 97% 1 year after introduction. There was subnational variability in some countries based on geography and income (see Fig. 2a). A variety of strategies, and particularly community-based delivery, contributed to the successful implementation overall. Challenges for reach included culture, geography, and national prioritization.
Examples of A Vaccination coverage and equity and B Facility-based (institutional) delivery by wealth quintile. Source: Victora et al, [45]
Equity
We found substantial progress towards increased equity in all six countries, with equity gaps for many EBIs diminishing nationally. Nevertheless, for some EBIs including four or more visits for antenatal care, vaccinations, FBD, and oral rehydration therapy, there was substantial variation subnationally (see Fig. 2a and b) [32]. Several countries had challenges with geographic inequity for antenatal care, delivery by a skilled provider, and FBD, including Bangladesh, Ethiopia, Nepal, Peru, and Senegal. In Ethiopia and Bangladesh, disparities in outcomes by wealth or geography persisted across EBIs. Challenges to implement included geographic access, culture and beliefs (acceptability), and civil unrest. Strategies to increase equity included data use for prioritization, rapid scale up, building on CHW programs and community-based care delivery, engagement and education of community, and multisectoral collaboration.
To reduce U5M due to malaria, Bangladesh targeted equity and reach as outcomes, using strategies such as rapid scale up, when focusing on 13 malaria-endemic districts in the northeast and southeast (rather than the entire country) for its insecticide-treated nets program. This implementation resulted in achieving high reach, with 92% of U5 children sleeping under an insecticide-treated net in the southeast and 87% in the northeast between 2008 and 2011. Similarly, for prioritization for indoor residual spraying for malaria prevention implementation, Senegal employed strategies including focus on equity and data use in prioritizing areas with the highest need versus full coverage, leading to limited but targeted coverage from 3% in 2007 to 12% in 2016.
Sustainability
We found sustainability was high when countries focused early on integrating EBIs into primary care systems – such as integrating vaccination EBIs into routine immunization schedules. Additional strategies, including integration of EBIs into national budgets or work to build community trust in the health system and commitment from national leadership through financial investment, contributed to the outcome of sustainability. Community trust and commitment from national leadership were important in achieving sustainability in Rwanda which integrated the monitoring of coverage and the maintenance of the national supply chain. In doing so, Rwanda secured the counterpart funding in the annual national budget for all vaccines for U5. In contrast, the lack of long-term government financing threatened sustainability. For example, in Peru’s decentralized vaccination program, regions were responsible for the costs of distributing the rotavirus vaccine, but some did not receive the necessary funding allocations to do so.
Discussion
Our cross-country analysis using existing case studies compared how Nepal, Rwanda, Bangladesh, Senegal, Peru, and Ethiopia chose, implemented, and adapted strategies to mitigate barrier or leverage facilitator contextual factors, and improve implementation outcomes, in order to implement health system-delivered EBIs to reduce amenable U5M. We found that these six countries were often strategic in how they chose and implemented EBIs known to reduce amenable U5M. They often used a common pathway of Exploration, Preparation, Implementation, Adaptation, and Sustainment. They typically made use of locally or globally generated data to identify the needs, select the EBIs, choose implementation strategies, adapt those strategies to their local context, and sustain implementation of the EBIs and adapted strategies.
Contextual factors had a substantial impact in the implementation of EBIs to reduce amenable U5M, and in broader reduction of U5M. Across all six countries, national priority for health (including for U5M), leadership and governance, and a culture of accountability were critical factors which either preexisted or were developed during the study period to establish a local context in which implementation of EBIs could be successful. The role of national priority for health as an important potential facilitator supports Moucheraud et al. who found political commitment and strong leadership aided progress towards MDG 4 – and that conversely a lack of political commitment was a key factor to lack of attention for neonatal health during the same period [7]. Similarly, Hailemariam et al. found national leadership and accountability can also increase likelihood of sustainment [46], while a lack of accountability for results could be a barrier to accessing and utilizing learning from others [47].
Our findings support and expand on previous studies that have found community health systems and structure, and in particular existence and use of CHW programs and focus on primary care, to be a critical facilitating contextual factor for the reduction of amenable U5M [48,49,50]. Increasingly, CHWs are found to play a critical role in supporting community health systems and structure – and yet their less formal position within the health sector and the quality of service they provide are commonly cited as a challenge to their success [48, 51, 52]. Further challenges include the potential for overburdening CHWs by continuously adding to their work as health programs increase, inadequate training, and high turnover [49, 51]. In a recent article on coverage equity by delivery channel, community-based delivery of interventions, largely delivered by CHWs – including education and promotion of vaccination and case management for common diseases – were found to be among the most equitable mode of delivery [50]. Use of CHWs is associated with significant increases in access to care especially in rural areas [51]. Community health systems which used CHWs and garnered community trust have contributed to strengthening interventions to reduce U5M, integrating interventions, and increasing community engagement [49].
The contributions of non-health system and cross-system factors including female empowerment, national infrastructure and systems strengthening, and economic growth were important in all of the six countries studied. These findings are consistent with other studies which have found significant contributions from non-health system interventions including female empowerment and stunting reduction [2, 4] and, critically during the MDG period, economic growth [7]. Similarly, a project for electrification of health centers in Ghana and Uganda was linked to improved service availability and use – as well as supporting EBIs including through appropriate storage of vaccines [53].
We found that major change can be brought where there are major barriers, when countries choose and implement strategies which either address these directly or provide opportunities for circumventing them. For example, Nepal made significant advances in implementing EBIs despite ongoing conflict, and a challenging mountainous geography that limited access to healthcare for rural and remote populations. Rwanda, despite having a gross domestic product of just $219 per capita in 2000 [54], was able to leverage donor funding to successfully implement EBIs. Ethiopia overcame challenges due to a large population size by rolling out a large-scale community Health Extension Program to increase coverage. Other cross-country studies have similarly noted that reforms have often been catalyzed by conflict, crisis, or new global opportunities (such as GAVI) – which can provide both the need and motivation to enact change, as well as the opportunity to challenge the existing context [47]. The six countries were often able to overcome major obstacles to implement large-scale transformation, a reminder to all of what can be achieved in contexts with substantial challenging contextual factors.
We found a number of implementation strategies which were common across countries and most EBIs. Knowing when to utilize and when to adapt strategies can be as important as the actual choice of strategy [19], and further, adaptation can also increase likelihood of sustainment [46]. Community-based care in these six countries was often delivered by CHWs at no cost to families, meaning that this was also often a strategy that could increase equity [50]. Engagement of community, and long-term partnerships, are important to the adaptation, implementation, and sustainability of EBIs [55]. Multisectoral collaboration and stakeholder and donor engagement and coordination were critical across countries and phases of EPIAS, and closely tied to other strategies including use of data. Developing stakeholder interrelationships was similarly identified in a study of key strategies and outcomes for newborn care EBIs [56]. Our findings support literature that shows strategies that actively engage stakeholders may be more effective than more passive strategies such as adoption of global guidelines [55, 57, 58].
Adaptation of strategies can be an essential way to increase implementation outcomes including acceptability, feasibility, equity, and sustainability. According to Lewis and colleagues, determinants – or contextual factors – can help with understanding why a strategy did or did not have its intended outcome. Beyond that though, it is understanding the mechanism which will help explain how a strategy had an effect, or not [59]. For example, acceptability of an EBI such as FBD may be very low in culturally sensitive environments across different countries [60]. A country’s strategy of adaptation to allow traditional birthing positions likely operated through the mechanism of compromise or accommodation to increase the willingness of pregnant women to deliver in facilities, ultimately leading to the outcome of increased acceptability. As reflected in Peru’s case of cultural adaptation of FBD [61], the design and implementation of the interventions may need to be adapted to local cultural practices and beliefs to ensure community acceptability, uptake, and increase in coverage of the services [60].
Implementation research studies more typically focus on outcomes including adoption, fidelity, sustainability, and cost [55], but depending on the setting data for some of these measures can be challenging to come by. We found that feasibility of EBIs, for example, was influenced by a number of factors including the nature of the intervention, community acceptability, and leadership involvement. Community IMCI, where CHWs treat common childhood illness at community level, is one such example. As found in other studies, CHWs tend to be accepted by their neighbors as they are commonly selected by communities they live among [49, 62], which further increases the likelihood of outcomes including acceptability, feasibility, and equity. Implementation of this program mainly requires leadership follow-up and use of small budget, which helps with feasibility of its rollout [63, 64]. In addition, sustainability of EBIs such as pneumococcal conjugate vaccine and rotavirus vaccination was mainly dependent on funding availability from both partners and governments. In case partners either reduced or stopped their funding, governments had to integrate the vaccine delivery into the existing systems and national budget, possibly due to GAVI and WHO requirements that countries receiving support for their immunization programs have financial sustainability plans for immunization services [65, 66].
In each of these countries, remaining challenges include expanding and sustaining coverage in areas where the EBIs were still not fully and effectively implemented, and challenges in quality of care, both experiential and technical. The six countries focused more on access and coverage and collection of data than on effective coverage and ensuring and sustaining performance of an EBI’s implementation to reduce the causes of death for U5M. More recent UN data show that all six countries have continued to decrease U5M, and between 2015 and 2020 have done so with a greater percentage change than global averages [67, 68]. While these trends suggest ongoing progress, research focusing on country progress towards achieving Sustainable Development Goal U5M targets has reflected on the unequal progress on U5M subnationally in countries, suggesting that more work will be necessary to maintain this progress for all populations [69,70,71,72].
Countries confront ongoing challenges in planning, monitoring, and evaluation of EBIs. The future sustainability of implementing EBIs to reduce U5M faces health sector threats such as the COVID-19 pandemic or potential decreases in the availability of funds and global support. However, learnings from implementation strategies adopted for U5M EBIs, and increased understanding of critical contextual factors, have the potential to help increase resilience in the face of these threats moving forward. This work will benefit from future research to better understand whether and how countries have maintained their successful approaches during the COVID-19 pandemic.
The identification of common implementation strategies and contextual factors that can facilitate or impede the strategies use for an EBI’s successful implementation; the exploration of a common pathway to implementation; and the overall implementation research tools to understand the “how” and the “why” behind countries’ success, continue to be extremely relevant as we arrive at the midpoint of the Sustainable Development Goals. Many countries are continuing to work to achieve gains in reducing under-5 and neonatal mortality, and there is value to decision-makers in countries trying to replicate the successes and efforts in other countries in having access to transferable lessons learned, information of common implementation strategies, and other resources developed by countries that have experienced success.
Our study had a number of limitations. The most significant limitation was related to the scope of funded work to only look at successful countries, without the important comparison of factors in countries that did not achieve these major reductions in U5M. While the cross-case analysis methodology strengthens the evidence for the successful strategies identified, without the comparison to strategies and factors in countries with less success in reducing U5M, these conclusions need to be interpreted with caution, and work to replicate these case study methods in these other countries with more limited reductions in U5M is needed. Other limitations included limited availability of data or other information from multiple sources on outcomes, context, and strategies. There were limitations in the numbers and range of our key informant interviews, which were retrospective. This meant we could not do contribution analysis or claim attribution or causality, which would have also required more extensive quantitative data. We were limited in our ability to conduct research into some factors associated with U5M such as malnutrition, and the scope of our work was limited to amenable U5M and health system-delivered EBIs – which meant that the not-insubstantial contribution of non-health-sector interventions was beyond the scope of this study.
Conclusion
The six countries included in this analysis achieved significant reductions in amenable U5M. They used similar approaches to implementation of health system EBIs. They made national and local adaptations while going through similar journeys in selecting appropriate EBIs, identifying and leveraging or addressing contextual factors, and adopting and adapting implementation strategies. Cross-cutting strategies implemented across all or most of these countries included data use for decision-making, multisectoral collaboration, and building and leveraging existing primary healthcare systems to integrate new EBI delivery into existing systems including CHWs. These strategies are all adoptable by other countries and contexts and can be adapted to address or leverage identified contextual factors before or during implementation. Countries can use this work to identify, analyze, and build on their contextual factors in recognition of where adaptations are needed to increase effective coverage and ensure a more resilient response in continuing to reduce amenable U5M and contribute to strengthening public health system delivery now and in the future.
Availability of data and materials
The case studies analyzed for this cross-country analysis are available from https://www.exemplars.health/topics/under-five-mortality.
All quantitative data were from publicly available sources.
Qualitative data access is restricted to users with appropriate ethics approval from the committees listed in the Ethical Considerations section. A reader or reviewer may apply to the authors for access by providing a written description of background, reasons, and intended use. If the methodology does not violate the condition of informed consent under which the interview was conducted, and the proposal approved by UGHE and other relevant ethics boards, the user can obtain the data from the corresponding author, and include one of the authors in the project and analysis.
Abbreviations
- CHW:
-
Community health worker
- EBI:
-
Evidence-based intervention
- EPIAS:
-
Exploration, Preparation, Implementation, Adaptation, Sustainment
- FBD:
-
Facility-based delivery
- IMCI:
-
Integrated management of childhood illness
- KI:
-
Key informant
- MDG:
-
Millennium Development Goal
- MOH:
-
Ministry of Health
- PMTCT:
-
Prevention of mother-to-child transmission of HIV
- U5M:
-
Under-5 mortality
References
Ruhago GM, Ngalesoni FN, Norheim OF. Addressing inequity to achieve the maternal and child health millennium development goals: looking beyond averages. BMC Public Health. 2012;12(1) Available from: https://pubmed.ncbi.nlm.nih.gov/23270489/. Cited 2021 Mar 14.
Kuruvilla S, Schweitzer J, Bishai D, Chowdhury S, Caramani D, Frost L, et al. Success factors for reducing maternal and child mortality. Bull World Health Organ. 2014;92(7):533–44 Available from: https://pubmed.ncbi.nlm.nih.gov/25110379/. Cited 2021 Mar 14.
Lozano R, Wang H, Foreman KJ, Rajaratnam JK, Naghavi M, Marcus JR, et al. Progress towards millennium development goals 4 and 5 on maternal and child mortality: an updated systematic analysis. Lancet. 2011;378(9797):1139–65 Available from: https://pubmed.ncbi.nlm.nih.gov/21937100/. Cited 2021 Mar 14.
Gakidou E, Oza S, Fuertes CV, Li AY, Lee DK, Sousa A, et al. Improving child survival through environmental and nutritional interventions: the importance of targeting interventions toward the poor. J Am Med Assoc. 2007;298(16):1876–87 Available from: https://pubmed.ncbi.nlm.nih.gov/17954539/. Cited 2021 Mar 14.
UNICEF DATA. Under-five Mortality. unicef. 2020. Available from: https://data.unicef.org/topic/child-survival/under-five-mortality/. Cited 2021 Feb 25.
MDG 4: Reduce child mortality. MDG Monitor: tracking the millennium development goals. 2016. Available from: https://www.mdgmonitor.org/mdg-4-reduce-child-mortality/. Cited 2021 Feb 25.
Moucheraud C, Owen H, Singh NS, Ng CK, Requejo J, Lawn JE, et al. Countdown to 2015 country case studies: what have we learned about processes and progress towards MDGs 4 and 5? BMC Public Health. 2016;16(S2):794.
Binagwaho A, Frisch MF, Udoh K, Drown L, Ntawukuriryayo JT, Nkurunziza D, et al. Implementation research: an efficient and effective tool to accelerate universal health coverage. Int J Health Policy Manag. 2020;9(5):182–4.
Ghaffar A, Swaminathan S, Sheikh K, Al-Mandhari A, Jhalani M, Sambo B, et al. Implementation research is crucial to countries’ efforts to strengthen learning health systems. Available from: https://www.who.int/alliance-hpsr/partners/en/.
United States Department of Health and Human Services. Dissemination and Implementation Research in Health (R03). Available from: https://grants.nih.gov/grants/guide/pa-files/par-13-056.html.
Lobb R, Colditz GA. Implementation science and its application to population health. Annu Rev Public Health. 2013;34:235–51 Available from: https://www.annualreviews.org/doi/10.1146/annurev-publhealth-031912-114444. Cited 2021 May 28.
Rapport F, Clay-Williams R, Churruca K, Shih P, Hogden A, Braithwaite J. The struggle of translating science into action: foundational concepts of implementation science. J Eval Clin Pract. 2018;24(1):117–26 Available from: https://onlinelibrary.wiley.com/doi/epdf/10.1111/jep.12741. Cited 2021 May 28.
Carter A, Akseer N, Ho K, Rothschild O, Bose N, Binagwaho A, et al. A framework for identifying and learning from countries that demonstrated exemplary performance in improving health outcomes and systems. BMJ Glob Health. 2020;5(12):e002938.
Gates Ventures. Under five mortality. Exemplars in Global Health 2020. Available from: https://www.exemplars.health/topics/under-five-mortality.
Hirschhorn LR, Frisch M, Ntawukuriryayo JT, VanderZanden A, Donahoe K, Mathewos K, et al. Development and application of a hybrid implementation research framework to understand success in reducing under-5 mortality in Rwanda. Gates Open Res. 2021;5:72 Available from: https://gatesopenresearch.org/articles/5-72/v1. Cited 2021 Apr 1.
Requejo J, Victora C, Bryce J. A Decade of Tracking Progress for Maternal, Newborn and Child Survival: The 2015 Report. Geneva: UNICEF and World Health Organization; 2015. http://countdown2030.org/documents/2015Report/CDReport_2015_ex-profiles_final.pdf.
UNICEF, WHO. A decade of tracking progress for maternal, newborn, and child survival: 2015 report. Vol. 6736, countdown to 2015; 2015. p. 1–220.
Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health Ment Health Serv Res. 2011;38(2):65–76 Available from: /pmc/articles/PMC3068522/. Cited 2021 Mar 24.
Proctor EK, Powell BJ, Mcmillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8:139 Available from: http://www.implementationscience.com/content/8/1/139.
Ogrinc G, Davies L, Goodman D, Batalden P, Davidoff F, Stevens D. SQUIRE 2.0 (standards for quality improvement reporting excellence): revised publication guidelines from a detailed consensus process. BMJ Qual Saf. 2016;25(12):986–92.
Pluye P, Nha HQ. Combining the power of stories and the power of numbers: mixed methods research and mixed studies reviews. Annu Rev Public Health. 2014;35:29–45 Available from: www.annualreviews.org.
Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88 Available from: https://journals.sagepub.com/doi/10.1177/1049732305276687. Cited 2021 Aug 26.
Assarroudi A, Heshmati Nabavi F, Reza Armat M, Ebadi A, Vaismoradi M. Directed qualitative content analysis: the description and elaboration of its underpinning methods and data analysis process. J Res Nurs. 2018;23(1):42–55 Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7932246/pdf/10.1177_1744987117741667.pdf. Cited 2021 Aug 26.
Stake R. Multiple case study analysis. New York: Guilford Press; 2005. p. 342.
Bartlett L, Vavrus F. Rethinking case study research: a comparative approach. New York: Routledge; 2017. p. 140. Available from: https://www.routledge.com/Rethinking-Case-Study-Research-A-Comparative-Approach/Bartlett-Vavrus/p/book/9781138939523
Khan S, VanWynsberghe R. Cultivating the under-mined: cross-case analysis as knowledge mobilization. Forum Qual Sozialforsch. 2008;9(1):34.
Subedi RK, VanderZanden A, Adhikari K, Bastola S, Hirschhorn LR, Binagwaho A, Maskey M. Integrated Management of Childhood Illness implementation in Nepal: understanding strategies, context, and outcomes. BMC Pediatr. 2024;23(Suppl 1). https://doi.org/10.1186/s12887-023-03889-3.
Sayinzoga F, Hirschhorn LR, Ntawukuriryayo JT, Beyer C, Donahoe K, Binagwaho A. Integrated Understanding rapid implementation from discovery to scale: Rwanda’s implementation of rotavirus vaccines and PMTCT in the quest to reduce under-5 mortality. BMC Pediatr. 2024;23(Suppl 1). https://doi.org/10.1186/s12887-023-03888-4.
García PJ, Williams AL, Carcamo MH, VanderZanden A, Binagwaho A. Lessons from Peru to reduce under-5 mortality: understanding program implementation and context. BMC Pediatr. 2024;23(Suppl 1). https://doi.org/10.1186/s12887-023-03890-w.
Drown L, Amberbir A, Teklu AM, Zelalem M, Tariku A, Tadesse Y, Gebeyehu S, Semu Y, Ntawukuriryayo JT, VanderZanden A, Binagwaho A, Hirschhorn LR. Reducing the equity gap in under-5 mortality through an innovative community health program in Ethiopia: An implementation research study. BMC Pediatr. 2024;23(Suppl 1). https://doi.org/10.1186/s12887-023-04388-1.
Huda FA, Mathewos K, Mahmood HR, Faruk O, Hirschhorn LR, Binagwaho A. Examining the implementation of facility-based integrated management of childhood illness and insecticide treated nets in Bangladesh: lessons learned through implementation research. BMC Pediatr. 2024;23(Suppl 1). https://doi.org/10.1186/s12887-023-04389-0.
Ntawukuriryayo JT, VanderZanden A, Amberbir A, Teklu A, Huda FA, Maskey M, et al. Inequity in the face of success: Understanding geographic and wealth-based equity in success of facility-based delivery for under-5 mortality reduction in six countries. BMC Pediatr. 2024;23(Suppl 1). https://doi.org/10.1186/s12887-023-04387-2.
National Institute of Population Research and Training, Mitra and Associates, The DHS Program. Bangladesh demographic and health survey 2014. Dhaka; 2016. Available from: https://dhsprogram.com/pubs/pdf/FR311/FR311.pdf
Mitra S, Al-Sabir A, Saha T, Kumar S. Bangladesh demographic and health survey 1999–2000. Dhaka; 2001. Available from: https://dhsprogram.com/pubs/pdf/FR119/FR119.pdf
USAID, CSA, EPHI. Ethiopia demographic and health survey 2016. Addis Ababa; 2017. Available from: https://dhsprogram.com/pubs/pdf/FR328/FR328.pdf
CSA, ORC Macro. Ethiopia 2000 demographic and health survey. Addis Ababa; 2001. Available from: https://dhsprogram.com/pubs/pdf/FR118/FR118.pdf
ONP, Macro O. Enquête Démographique et de Santé (DHS), Rwanda 2000. Kigali; 2001. Available from: https://dhsprogram.com/publications/publication-fr125-dhs-final-reports.cfm
National Institute of statistics. Rwanda Demographic and Health Survey. Maryland: Ministry of Health Kigali, Rwanda and The DHS Program ICF International Rockville; 2015. https://dhsprogram.com/pubs/pdf/FR316/FR316.pdf.
Family Health Division of the Department of Health Services of the Ministry of Health/Nepal, New ERA/Nepal, ORC Macro. Nepal demographic and health survey 2001. Kathmandu; 2002. Available from: https://dhsprogram.com/publications/publication-FR132-DHS-Final-Reports.cfm
Ministry of Health Nepal, New Era/Nepal, ICF. Nepal demographic and health survey 2016. In: Demographic and health surveys. Kathmandu; 2017. Available from: https://dhsprogram.com/publications/publication-fr336-dhs-final-reports.cfm.
Ndiaye S, Ayad M. Enquête Démographique et de Santé Sénégal 2005. Dakar; 2006. Available from: https://dhsprogram.com/pubs/pdf/FR177/FR177.pdf. Cited 2021 Apr 14
NEI. Lima: Peru Encuesta Demográfica y de Salud Familiar (ENDES) 2014. INEI/Perú; 2015. https://www.inei.gob.pe/media/MenuRecursivo/publicaciones_digitales/Est/Lib1211/index.html.
INEI, USAID, UNICEF. Peru Encuesta Demográfica y de Salud Familiar 2000. Lima; 2001. Available from: https://dhsprogram.com/pubs/pdf/FR120/FR120.pdf.
Agence National de la Statistique et de la Démographie. Sénégal Enquête Démographique et de Santé Continue (EDS-Continue). Dakar; 2017. Available from: https://dhsprogram.com/pubs/pdf/FR331/FR331.pdf. Cited 2021 Apr 14.
Victora C, Boerma T, Requejo J, et al. Analyses of inequalities in RMNCH: rising to the challenge of the SDGs. BMJ Glob Health. 2019;4:e001295. https://doi.org/10.1136/bmjgh-2018-001295.
Hailemariam M, Bustos T, Montgomery B, Barajas R, Evans LB, Drahota A. Evidence-based intervention sustainability strategies: a systematic review. Implement Sci. 2019;14(1):1–12.
Witter S, Anderson I, Annear P, Awosusi A, Bhandari NN, Brikci N, et al. What, why and how do health systems learn from one another? Insights from eight low- and middle-income country case studies. Heal Res Policy Syst. 2019;17(1):1–13.
Samuels F, Amaya AB, Balabanova D. Drivers of health system strengthening: learning from implementation of maternal and child health programmes in Mozambique, Nepal and Rwanda. Health Policy Plan. 2017;32(7):1015–31.
Perry HB, Zulliger R, Rogers MM. Community health Workers in low-, middle-, and high-income countries: an overview of their history, recent evolution, and current effectiveness. Annu Rev Public Health. 2014;35(1):399–421 Available from: http://www.annualreviews.org/doi/10.1146/annurev-publhealth-032013-182354. Cited 2021 Apr 16.
Leventhal DGP, Crochemore-Silva I, Vidaletti LP, Armenta-Paulino N, Barros AJD, Victora CG. Delivery channels and socioeconomic inequalities in coverage of reproductive, maternal, newborn, and child health interventions: analysis of 36 cross-sectional surveys in low-income and middle-income countries. Lancet Glob Health. 2021;21:1–9.
Labonté R, Sanders D, Packer C, Schaay N. Is the Alma Ata vision of comprehensive primary health care viable? Findings from an international project. Glob Health Action. 2014;7(1):24997. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4141965/pdf/GHA-7-24997.pdf.
WHO guideline on health policy and system support to optimize community health worker programmes. Geneva; 2018. Available from: https://www.who.int/publications/i/item/9789241550369.
Javadi D, Ssempebwa J, Bosco Isunju J, Yevoo L, Amu A, Nabiwemba E, et al. Implementation research on sustainable electrification of rural primary care facilities in Ghana and Uganda. Health Policy Plan. 2020;35:124–36.
World Bank Data. GDP per capita (current US$) - Rwanda. World Bank. Available from: https://data.worldbank.org/indicator/NY.GDP.PCAP.CD?locations=RW. Cited 2021 Feb 25.
Shelton RC, Lee M, Brotzman LE, Wolfenden L, Nathan N, Wainberg ML. What is dissemination and implementation science?: an introduction and opportunities to advance behavioral medicine and public health globally. Int J Behav Med. 2020;27(1):3–20.
Peven K, Bick D, Purssell E, Rotevatn TA, Nielsen JH, Taylor C. Evaluating implementation strategies for essential newborn care interventions in low-and low middle-income countries: a systematic review. Health Policy Plan. 2020;35:47–65.
Keown K, Van Eerd D, Irvin E. Stakeholder engagement opportunities in systematic reviews: knowledge transfer for policy and practice. J Contin Educ Heal Prof. 2008;28(2):67–72.
Jacobs JA, Dodson EA, Baker EA, Deshpande AD, Brownson RC, Louis IS, et al. Barriers to evidence-based decision making in public health: a National Survey of chronic disease practitioners. Public Health Rep. 2010;125(5):736–42 Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2925010/pdf/phr125000736.pdf. Cited 2021 Jul 24.
Lewis CC, Klasnja P, Powell BJ, Lyon AR, Tuzzio L, Jones S, et al. From classification to causality: advancing understanding of mechanisms of change in implementation science. Front Public Health. 2018;6:136.
Jones E, Lattof SR, Coast E. Interventions to provide culturally-appropriate maternity care services: factors affecting implementation. BMC Pregnancy Childbirth. 2017;17(1):267 Available from: https://bmcpregnancychildbirth.biomedcentral.com/track/pdf/10.1186/s12884-017-1449-7.pdf. Cited 2021 Oct 6.
Fraser B. Peru makes progress on maternal health. Lancet. 2008;371(9620):1233–4.
Khatri RB, Mishra SR, Khanal V. Female community health volunteers in community-based health programs of Nepal: future perspective. Front Public Health. 2017;5:1–4. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5519587/pdf/fpubh-05-00181.pdf.
Chang W, Oo M, Rojas A, Damian AJ. Patients’ perspectives on the feasibility, acceptability, and impact of a community health worker program: a qualitative study. Heal Equity. 2021;5(1):160 Available from: https://doi.org/10.1089/heq.2020.0159. Cited 2021 Oct 6.
Onwujekwe O, Uzochukwu B, Ojukwu J, Dike N, Shu E. Feasibility of a community health worker strategy for providing near and appropriate treatment of malaria in Southeast Nigeria: an analysis of activities, costs and outcomes. Acta Trop. 2007;101(2):95–105.
The Financing Task Force of the Global Alliance for Vaccines and Immunization. Guidelines for preparing a national immunization program financial sustainability plan. Geneva: The Global Alliance for Vaccines and Immunization; 2004. https://www.vaccinealliance.org/financing/sustain.html.
Báscolo E, Cid C, Pagano JP, Urrutia MS, del Riego A. The challenge of sustainability of expanded programs on immunization. Pan Am J Public Health. 2017;41:e160. https://doi.org/10.26633/RPSP.2017.160.
Child and Infant Mortality. Our World in Data. 2022. Available from: https://ourworldindata.org/child-mortality. Cited 2022 May 12.
Mortality rate, under-5 (per 1,000 live births) - Peru, World, Ethiopia, Rwanda, Low & middle income, Bangladesh, Senegal, Nepal | Data. World Bank Data. 2022. Available from: https://data.worldbank.org/indicator/SH.DYN.MORT?locations=PE-1W-ET-RW-XO-BD-SN-NP. Cited 2022 May 12.
Mejía-Guevara II, Zuo W, Bendavid EI, Li N, Tuljapurkar S. Age distribution, trends, and forecasts of under-5 mortality in 31 sub-Saharan African countries: a modeling study. PLoS Med. 2019;16(3). https://doi.org/10.1371/journal.pmed.1002757 Cited 2022 May 12.
Nishimwe C, Mchunu GG. Stakeholders perceptions regarding implementing maternal and newborn health care programs in Rwanda. BMC Health Serv Res. 2021;21. https://doi.org/10.1186/s12913-021-06824-3 Cited 2022 May 12.
Kc A, Bhandari A. Lessons from the field: progress towards the sustainable development goals in Nepal in federal transition of the state. Arch Dis Child. 2020;105(9):817–8 Available from: https://adc.bmj.com/content/105/9/817. Cited 2022 May 12.
Tefera YG, Ayele AA. Newborns and Under-5 mortality in Ethiopia: the necessity to revitalize Partnership in Post-COVID-19 era to meet the SDG targets. J Prim Care Community Health. 2021;12:1–5 Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7917850/pdf/10.1177_2150132721996889.pdf. Cited 2022 May 12.
Acknowledgements
The authors would like to thank Laura Drown for her work on the study. We would like to thank the Exemplars team at Gates Ventures. We also want to acknowledge and thank the key informants and other stakeholders who provided essential information, historical perspectives and narratives, and feedback on our findings, ensuring we captured the most accurate reflection possible on these countries’ journeys to reducing under-5 mortality.
About this supplement
This article has been published as part of BMC Pediatrics Volume 23 Supplement 1, 2023: Understanding Success: Multi-country implementation research in U5M reduction. The full contents of the supplement are available online at https://bmcpediatr.biomedcentral.com/articles/supplements/volume-23-supplement-1.
Funding
This work was supported by The Bill & Melinda Gates Foundation grant [OPP1191491]. Funding was provided by Gates Ventures. These funding bodies were not directly involved in the development of this manuscript.
Author information
Authors and Affiliations
Contributions
AB and LRH developed the concept; AB, LRH, PG, FAH, MM, MS, FS, RKS, and AMT designed and conducted the country case studies; AB, LRH, MF, KD, KU, JT, AV contributed to the cross-country analysis work; AB, AV, LRH, MF, JT contributed to the original draft preparation; All authors participated to writing and revision of the manuscript and have approved the final version.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This overall project was reviewed by the Rwanda National Ethics Committee and Northwestern University and determined to be non-human-subjects research. Each of the country case studies were reviewed and approved by in-country Ethics Review Committees (Bangladesh, PR-18074; Ethiopia, PM23/281; Nepal, 165–2018; Peru, 104276; Rwanda, 132/RNEC/2017; Senegal, SEN18/33). Interviewees were informed about the goals and structure of the project, and verbal informed consent for participation was obtained from all interview participants.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1.
a. List of infant and child evidence-based interventions, and b. List of neonatal evidence-based interventions.
Additional file 2.
Example Exemplars in Under 5 Mortality key informant interview guide.
Additional file 3.
Interaction of selected contextual factors, implementation strategies, and targeted outcomes, and associated Exploration, Preparation, Implementation, Adaptation, and Sustainment (EPIAS) stage.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Binagwaho, A., VanderZanden, A., Garcia, P.J. et al. Cross-country analysis of contextual factors and implementation strategies in under-5 mortality reduction in six low- and middle-income countries 2000–2015. BMC Pediatr 23 (Suppl 1), 652 (2024). https://doi.org/10.1186/s12887-023-03906-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12887-023-03906-5