Abstract
Background
Public–private partnerships (PPP) are often how health improvement programs are implemented in low-and-middle-income countries (LMICs). We therefore aimed to systematically review the literature about the aim and impacts of quality improvement (QI) approaches in PPP in LMICs.
Methods
We searched SCOPUS and grey literature for studies published before March 2022. One reviewer screened abstracts and full-text studies for inclusion. The study characteristics, setting, design, outcomes, and lessons learned were abstracted using a standard tool and reviewed in detail by a second author.
Results
We identified 9,457 citations, of which 144 met the inclusion criteria and underwent full-text abstraction. We identified five key themes for successful QI projects in LMICs: 1) leadership support and alignment with overarching priorities, 2) local ownership and engagement of frontline teams, 3) shared authentic learning across teams, 4) resilience in managing external challenges, and 5) robust data and data visualization to track progress. We found great heterogeneity in QI tools, study designs, participants, and outcome measures. Most studies had diffuse aims and poor descriptions of the intervention components and their follow-up. Few papers formally reported on actual deployment of private-sector capital, and either provided insufficient information or did not follow the formal PPP model, which involves capital investment for a explicit return on investment. Few studies discussed the response to their findings and the organizational willingness to change.
Conclusions
Many of the same factors that impact the success of QI in healthcare in high-income countries are relevant for PPP in LMICs. Vague descriptions of the structure and financial arrangements of the PPPs, and the roles of public and private entities made it difficult to draw meaningful conclusions about the impacts of the organizational governance on the outcomes of QI programs in LMICs. While we found many articles in the published literature on PPP-funded QI partnerships in LMICs, there is a dire need for research that more clearly describes the intervention details, implementation challenges, contextual factors, leadership and organizational structures. These details are needed to better align incentives to support the kinds of collaboration needed for guiding accountability in advancing global health. More ownership and power needs to be shifted to local leaders and researchers to improve research equity and sustainability.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Background
Large implementation gaps in improving global health and nutrition remain despite abundant funding and research addressing health disparities [1,2,3]. A recent review found challenges with programming and mixed outcomes for nutritional interventions for children in low- and middle-income countries (LMICs) [4]. Quality improvement (QI), defined as a collaborative effort to improve outcomes, system performance, and professional development [5], is a well-documented approach for improving outcomes worldwide including in LMICs [6]. QI methods can be applied to improve the quality of whole health systems. Recent literature reviews have found that QI can lead to improved outcomes in LMICs including those focused on trauma care [6], surgical infections [7], and antiretroviral treatment [8], although there remains wide variation in individual and system outcomes. We could not find reviews that broadly examined the use of QI aimed at improving health and nutrition in LMICs.
There is a growing interest in understanding how QI can be leveraged in partnerships of international and local non-governmental organizations (NGOs) as well as community groups that function outside of the clinical arena. QI has been successfully applied to community settings to improve population health and primary care, but reviews of literature have been limited to high-income countries [9]. Public–private partnerships (PPP) have become increasingly important to fund and improve health in LMICs and to address the shortcomings of other strategies to improve global health. PPPs in LMICs focus on a variety of topics, including improving population health outcomes. This is because the private sector plays a key part in the delivery of healthcare and public health through procurement of equipment, medicines, ambulances, and technical assistance. However, these are mostly passive. We were interested in the extent to which PPPs are also actively focused on meaningful systems' change and what the literature reveals about how PPPs leverage QI methodologies to achieve their goals. The PPP business model leverages private-sector expertise to improve clinical performance in hospitals and other health facilities and is a useful arena for testing QI impacts [10]. The general perception about PPP is a private sector, for-profit company investing in the government to achieve a particular goal. The prevailing belief is that since the private sector is more efficient and outcome driven, a PPP will be more results-oriented and will hold governments more accountable for meaningful improvements. However, in the LMIC health environments, these kinds of partnerships are relatively few, and most private sector partners are NGOs who are driven by different incentives. In order to begin to understand the use of QI in PPP, we chose a broad definition of PPP to include as many types of PPPs as possible. QI tools and frameworks have been used to improve outcomes for PPP for health and nutrition in LMICs, but little is known about the extent to which these private sector funded approaches are effectively deployed and what are the key factors that contribute to their lasting success [11]. We did not find a systematic overview of this literature [12,13,14,15,16] and found limitations in reviewing the extent and impacts of PPP in middle income countries as well [17].
The objective of this study was to access and richly describe the landscape of QI interventions by PPP in LMICs in non-clinical settings and disciplines (e.g., public health) that influence population health and nutrition. We conducted a systematic literature review assessing the benefits and challenges of PPP-supported QI approaches in LMICs using the PRISMA guidelines. The motivation for the study emerged from a real-world request from an international funder seeking to understand how to best leverage QI methodologies to improve health and nutrition in the contexts of PPPs in LMICs.
Methods
Data sources
We searched for English-language studies published before March 2022 using the full text database SCOPUS and grey literature. The search included terms for community and organizations (e.g. community, coalition, population, partner), QI (e.g. quality improvement, continuous improvement, improvement science, plan-do-study-act), health and wellbeing (e.g. health, wellbeing, prevent*), and LMIC (i.e. low- and middle-income countries). The full search strings are available in Appendix A. We used a snowballing literature search technique to manually check the reference lists for additional studies missed in the original database search. Relevant systematic and scoping reviews were reviewed to identify additional relevant articles.
Study selection
Public–private sector partnerships were defined as programs with a combined deployment of private sector capital and, sometimes, public sector capital to improve public services [18]. Our search examined studies focused on using QI for public health in partnerships aimed at improving population-level public health conditions for social and physical conditions for health and nutrition. Studies exploring the use of QI in hospitals without partnership of public or community groups were deliberately excluded. We chose a broad definition of PPP to capture and assess the various models that are currently described in the literature. One reviewer (CBI) reviewed titles and abstracts to determine if studies retrieved from the search met the inclusion criteria. When the title and abstract did not provide enough information to assess study eligibility, a full-text copy of the study was retrieved and reviewed for inclusion. A detailed discussion with a second reviewer (PB) about the search findings and inclusion study criteria was done with full agreement achieved before proceeding. We did not exclude articles based on study methodology and reviewed all articles including randomized controlled trials, project reports, qualitative interview studies, and editorials. Each study had to meet the following criteria to be included in this review: 1) discuss improvement in one or more LMIC, 2) use a QI approach or methodology, and 3) be conducted within a public–private or community partnership.
Quality assessment of methods
The methodologic quality of the full-text studies was assessed by one reviewer (CBI) using the Mays and Pope (2000) framework for assessing quality and discussed in great detail with a second reviewer (PB). The methodological quality was assessed based on clarity of the research question, appropriateness of design question, adequate description of the context, robust sampling, systematic data collection and analysis, and reflexivity of the QI account.
Data extraction
Each article that met the inclusion criteria was abstracted by one reviewer (CBI) using a standardized form, which included key data assessed, study characteristics, setting, design, outcomes, and lessons learned. A second reviewer (PB) reviewed the abstracted data and assessed the overall quality of the data extraction for each selected paper.
Data synthesis and analysis
We organized the study outcomes in a tabular form including type of PPP, intervention characteristics, outcomes, and direction of effects observed. The interventions were classified based on the components of the intervention that aimed to improve the quality of services. Qualitative data from the selected papers on the study interventions, key roles, discussions, conclusions, and lessons learned were extracted from each article in detail to help guide decisions on real-world observational evidence. We then conducted a thematic analysis, with a phenomenological approach, by first reviewing all the data in detail, then creating initial themes, and finally describing the themes to derive their meaning [19]. Refinement of themes was done through discussion between two reviewers (CBI & PB). The lessons learned were presented in broad themes and widely discussed to better identify the factors for successful PPP interventions, and highlighting the barriers that undermined the effectiveness and/or sustainability of QI programs. This critical appraisal was done to assist decision makers in the identification of high-quality systematic reviews.
Results
Search results
Our initial search identified 9,457 citations citation (Fig. 1). The title and abstract scan resulted in 273 articles that appeared to meet the inclusion criteria. An additional 60 articles were identified through systematic reviews and references in the included articles. Of these, 20 articles were included in the final analysis. After the full text review, 144 papers met the inclusion criteria and underwent full-text abstraction.
Characteristics of included studies
Characteristics of the included studies are summarized in Table 1. The studies emanated from projects in 41 countries in Africa, Asia, Latin America, and the Middle East (Fig. 2) with 97 reports from single-country projects, 29 reports from multi-country projects, and 18 reports discussing efforts in LMICs. The main study populations consisted of community health workers, healthcare facilities, healthcare workers, and patients.
Number of included articles from LMICs across the world. Articles emanated from the following countries: Africa: Burundi (n = 1), Côte d'Ivoire (n = 1), Democratic Republic of Congo (n = 3), Ethiopia (n = 16), Ghana (n = 17), Kenya (n = 17), Lesotho (n = 3), Malawi (n = 6), Mozambique (n = 12), Namibia (n = 1), Niger (n = 1), Nigeria (n = 9), Rwanda (n = 15), Senegal (n = 1), Sierra Leone (n = 1), South Africa (n = 12), Tanzania (n = 25), Uganda (n = 16), Zambia (n = 13), Zimbabwe (n = 1). Asia: Afghanistan (n = 1), Bangladesh (n = 6), Cambodia (n = 2), India (n = 8), Indonesia (n = 1), Laos (n = 1), Malaysia (n = 1), Myanmar (n = 2), Nepal (n = 3), Pakistan (n = 2), Taiwan (n = 1), Thailand (n = 1), Vietnam (n = 2). Latin America: Bolivia (n = 1), Brazil (n = 1), Dominican Republic (n = 1), Ecuador (n = 1), Guatemala (n = 3), Haiti (n = 1), Nicaragua (n = 1). Middle East: Jordan (n = 1), Lebanon (n = 1). The size of the circle corresponds with the number of articles emanating from the given country
Figure 2 was created for the study. The “Blank Map of the World with Borders” from https://worldmapblank.com/blank-map-of-world/ was used as the background image with the circles representing the number of articles overlayed on top of the map.
The improvement work focused on a variety of health and public health areas. The most common were maternal and child health (n = 63), general healthcare and primary care (n = 41), human immunodeficiency virus (HIV)/acquired immunodeficiency syndrome (AIDS) (n = 25), other infectious diseases (n = 7), and nutrition (n = 4). Another 11 studies did not fit into one of these categories and included a variety of acute (e.g., burn services) and chronic (e.g., chronic obstructive pulmonary disease) conditions. Some studies were included in multiple categories (e.g., antenatal HIV, childhood nutrition).
The studies were primarily partnerships between funding organizations, government, and private or public healthcare facilities with substantially varying contractual, governance, incentive, and operational structures. The public–private partnerships described intended to influence population health outcomes extending far beyond healthcare settings and represented diverse forms. These PPPs were vaguely described and include private healthcare facilities, healthcare providers, funding (including insurers), and other mentions of “private partnerships” without elaboration. The population level community or public members varied greatly and included international governmental and non-governmental organizations (NGOs) (n = 104), local NGOs (n = 47), local and national governments and ministries of health (n = 80), and community partnerships (n = 43). Examples of international partners include Partners in Health, President’s Emergency Plan for AIDS Relief (PEPFAR), The Bill and Melinda Gates Foundation, U.S. Agency for International Development (USAID), Doris Duke Charitable Foundation (DDCF), and UNICEF. The World Health Organization (WHO) was involved in 10 studies and the Institute for Healthcare Improvement (IHI), an international leader in healthcare QI, was involved in 10 studies. We also acknowledge that other types of PPPs may be beyond the scope of this study.
The studies reported on various outcomes including clinical outcomes, processes of care, patient experience, processes of QI, and overall costs (Table 2). Outcomes included patient-, clinic-, and population-levels. We found great heterogeneity in the QI tools, study designs, participants, and outcome measures used. A variety of QI frameworks and tools were used including QI collaboratives (including collaboratives built on the IHI Breakthrough Series Collaborative Model) [20], and the Model for Improvement. Some studies did not reference a clear framework or technique but did refer to QI teams, meetings, and strategies as their intervention. Many studies (n = 29) included a QI coach as part of their approach. We included studies that used plan-do-study-act (PDSA) cycles, whether or not they reported using the Model for Improvement.
Methodological quality
We found wide heterogeneity in the reported methods of the included studies. The most common study methodologies were uncontrolled observational studies or descriptive project summaries (n = 90), reviews or editorials (n = 26), qualitative interview or focus group studies (n = 11), randomized controlled trials (RCTs) (n = 11), and cost-effectiveness or cost analysis studies (n = 6).
Effectiveness of QI interventions in PPP demonstrated by RCTs
Of the 11 RCT reports, only 7 provided data comparing the intervention and control groups. Two reports provided descriptions of the RCT without outcome data [21, 22], one was an interview study of RCT participants [23], and one study provided outcomes only from the intervention group [24]. Four studies provided odds ratios on a total of 14 primary outcomes (Fig. 3). The improvement effect size varied between interventions and between studies. Alhassan et al., found an increase in patient safety efforts in the intervention compared to control facilities [25]. Walker et al., showed a decrease in fresh stillbirth and neonatal mortality for intervention versus control facilities [26]. Horwood et al., showed an increased odds of mothers receiving various types of support from community health workers (CHW) in the intervention arm [27].
The other RCTs showed mixed effectiveness. Colbourn et al., found a statistically significant decrease in neonatal morality and perinatal mortality but no difference in maternal mortality [28]. Osibo et al., found that the time spent accessing services during clinic visits decreased in the intervention arm but found no significant difference in client satisfaction [29]. Oyeledun et al., showed increased rates of early infant HIV testing but no significant difference in retention at 6 months or in initiation of antiretroviral prophylaxis [30]. Finally, Manisha Yapa et al., found that QI significantly increased viral load monitoring but did not improve repeat HIV testing [31].
Lessons learned from included studies
We identified five overarching themes of key factors leading to effective QI in LMIC partnerships: I) leadership support and alignment with overarching priorities, II) local ownership and engagement of frontline teams, III) shared learning of lessons across teams, IV) resilience in managing external challenges, and V) robust data and data visualization to track progress.
Theme I: Leadership support and alignment with overarching priorities
The included studies repeatedly underscored the need for leadership support and alignment with overarching national or organizational priorities to have the resources available for improvement. Many authors discussed how partnerships between government, academia, and communities brought more support and rigor to the studies while maintaining a focus on the needs of the community [13, 32,33,34,35,36,37,38,39,40,41,42]. Having the necessary resources, training, and appropriate knowledge available for QI was discussed as an important aspect of the teams’ willingness to change [29, 43, 44]. Working with governments and Ministries of Health and leveraging existing infrastructure was specifically discussed as essential for leadership engagement and sustainment of improvement efforts [44,45,46,47,48,49,50,51,52,53,54,55]. Other studies described challenges when they lacked the appropriate support or policy to sustain their improvement efforts [56,57,58,59,60,61]. Government-run health systems are common in LMICs, requiring more governmental support for effective use of QI across the system [62]. An additional benefit of aligning QI with ongoing strategic priorities was that it reduced the additional workload on frontline staff [43, 63,64,65,66,67]. While unchecked and unaccountable power by executives without oversight can be problematic, studies in our search showed that projects had more resources when they had explicit leadership support that was unambiguous. Projects struggled to achieve their goals when the support was lukewarm, inconsistent, and misaligned to the vision of executive leadership.
While alignment with priorities was a strength, it was also identified as a challenge in assessing the true impacts of the QI approach. For example, one study discussed how it was difficult to determine if improvement was due to their work, or from other contemporaneous maternal, newborn, and child health program interventions in the region [68]. Another study discussed how other HIV/AIDS interventions might have improved care in the control group, blunting the ability to infer change by the QI intervention group [30].
Theme II: Local ownership and engagement of frontline teams
One of the primary benefits of using QI approaches was the focus on empowering the frontline teams to champion the improvement efforts. Authors of the included studies described the importance of engaging frontline staff, who understand the context and culture of the community, as well as the unique contextual problems and solutions that were likely to be acceptable and sustainable [26, 34, 45, 58, 69,70,71,72,73,74,75,76,77,78,79,80,81]. Many authors described a need for culturally specific interventions in LMIC settings [82,83,84,85]. Local ownership and interventions that were tailored to the local culture were important for individuals’ willingness to change [86]. Others expressed that QI methods allowed frontline teams to adapt interventions to their local contexts [13, 15, 49, 74, 87,88,89,90,91,92,93,94,95].
Strong community engagement was discussed as a core component of many of the projects [35, 54, 77, 85, 91, 96,97,98,99,100,101], including the development of partnerships with local organizations, not just international funders [102]. Teams were able through local engagement to leverage existing local resources, which aided in conducting and sustaining projects in resource-constrained settings [24,25,26, 31, 48, 59, 61, 89, 103, 104]. A common theme across QI projects was the community and frontline staff ownership of the system improvements [23, 36, 44, 49, 74, 86, 105,106,107,108,109,110,111], which often led to a high uptake of interventions [29, 112, 113], and sustainable changes [75, 114, 115]. For example, in one program in Zimbabwe aimed at eradicating malaria, the program focused specifically on empowering frontline workers to take ownership, solve problems, and act on decisions, and deliberately worked to increase ownership and accountability by conducting team building, awarding best performing districts, and providing peer support visits [34]. In contrast, another program in Ethiopia discussed how the QI teams were poorly integrated within the urban health extension program, leading to a lack of ownership of the QI initiative and a perception that the community-based intervention was an additional burden imposed on the system by the health center staff [61]. Others discussed how QI improvements led by the community and frontline staff were more effective in contrast to external audits which were viewed as punitive [55]. Teams were able to build trusting relationships [52, 56, 111, 116] by working closely with communities to implement QI efforts and focusing on problem-solving rather than fault-finding [12, 117,118,119].
Theme III: Shared learning of lessons across teams
The ongoing sharing of meaningful data and authentic lessons learned were described as common benefits of collaborative QI programs. Several of the included studies used a QI collaborative framework, such as the IHI Breakthrough Series model, which allowed for teams to talk with other teams working on QI projects. Team members valued the opportunities for peer-to-peer learning and the ability to learn directly from others working on similar projects in different settings [34, 36, 44, 54, 76, 82, 89, 95, 108, 111, 119,120,121,122]. QI tools could be applied to a wide variety of disciplines, and the teams benefitted from building QI capacity and learning techniques rather than focusing solely on one improvement project [36, 47, 69, 77, 94, 99, 122,123,124]. Many authors described the benefits of having coaches or external experts to teach QI methods, provide mentoring support, and motivate perseverance in the face of obstacles [51, 58, 63, 92, 93, 124].
Many authors discussed how QI work is often not published, which limits the ability to accurately assess their impact and share learnings across programs and geographic regions [13, 15]. The authors emphasized the importance of sharing across sectors and regions as community partners working in LMICs could benefit from shared learnings including on what intervenions have worked and what have failed.
Theme IV: Resilience in managing external challenges
Many of the authors discussed the challenges they faced and the resilience that was needed to overcome organizational, cultural, and resource constraints. Barriers to effective QI programs are common in virtually all settings, but especially in LMICs [28] given limited resources [12, 13, 40, 45, 56, 58, 66, 77, 84, 95, 96, 122], competing priorities [51, 94], natural disasters [91], ambiguous governance [12, 13], and political and social strife [29, 30, 44, 46, 75, 77, 105]. A common challenge noted in the included studies was high turnover of nurses, healthcare staff, and QI team members, which made ongoing leadership directions and sustained changes difficult [31, 37, 45, 47, 51, 53, 55, 81, 94, 122, 125] and led to loss of organizational memory and trust [15]. Others noted that QI efforts might take more time in a community setting than in higher-resource healthcare settings, which should be considered when funding and planning for LMIC QI interventions [126].
While resources were limited, QI could also be cost-effective. All six studies evaluating the costs of QI programs in partnerships in LMICs found the QI approach to be cost-effective [24, 56, 123, 127,128,129,130,131]. One author noted how local NGOs can compete for funding and resources but collaborative QI had the opportunity to bring them together to meaningfully collaborate and learn from each other and save resources [38]. Additionally, funders have an opportunity to incentivize and reward QI lessons [132]. Despite the cost-effective nature of these strategies, there is still a pervasive financial commitment needed from external donors to address the pervasive sustainability challenges [39, 46, 59, 75, 80, 83, 100, 104, 133,134,135]. Startup activities are especially resource intensive [69], but QI-based approaches appear to be cost-effective in the long run.
Theme V: Robust data and data visualization
The use of continuous, reliable, transparent data, and tools for data visualization emerged as a key theme for successful improvement efforts in LMIC settings. Many authors discussed the need for data to continuously measure progress of improvement efforts [26, 52, 55, 81, 82, 100, 101, 111, 119, 132]. Real-time monitoring of data and feedback allowed for continuous and rapid improvements [45, 64, 72, 73, 85, 90, 95, 96, 113, 122, 136]. Run charts were one common tool used for data visualization, and teams felt motivated by seeing their improvements displayed using a run chart [49, 63, 92]. Data dashboards also helped identify bottlenecks, set priorities, and focus QI leadership attention when a change was needed [12, 36, 87, 93, 120]. Collecting and analyzing data was also described as important for studying a pilot version of an improvement project before scaling up [33, 68, 137].
Some authors discussed the benefits of national data monitoring systems to systematically collect data and allow for meaningful comparisons across differing contexts [36, 138], and to increase the uptake of results [35, 49, 55, 64]. Many authors noted that data must be relevant to the local context as QI indicators in LMICs can often differ from those in high-income settings [13]. Some authors discussed the need to develop better quality indicators [34], or look beyond traditional metrics to identify data that are important and make sense in the local context (sense-making) [73, 139, 140].
There were additional challenges regarding data interpretation and effective data visualization. Many programs were challenged with capacity and resources to collect and analyze data [13, 35, 93, 126, 141]. There were concerns about the reliability of data and a need to create better data collection systems [15, 37, 44, 55, 77, 81, 88, 94]. Some authors discussed the urgent need for better measurement and data analyses that required minimal technical support and leveraged existing resources [24, 25, 59, 66, 67, 108, 119, 132, 133, 137]. Others reported that it was beneficial to integrate the QI data collection into existing workflows rather than creating additional tasks for already overworked teams [64, 65, 67]. Building upon existing data systems was essential for building sustainable capacity [26]. Another challenge with data analysis was information sharing, due to various governance constraints related to data privacy, data sharing limits, and regulatory roadblocks [42, 121, 142]. We noted yet another challenge in which project sites used different methodologies for collecting data, making cross-comparisons and meaningful and reliable learning difficult [108, 121].
Discussion
Our systematic literature review found that most QI interventions in LMICs were multi-component and most studies faced many of the same challenges that QI projects must address in high-income countries. This is the first study to examine the current literature on the use of QI in public–private and community partnerships in LMICs.
The articles included in our review reported the need for robust leadership, frontline engagement, ongoing learning, efficient resource management, and systems for data collection. Leadership support is needed to build infrastructure to facilitate QI, and for alignment with governments and Ministries of Health, especially important in low-resource settings. Engagement of frontline workers, community members, and local NGOs creates interventions that are tailored to the unique needs of the community, increasing acceptability and sustainability. Sharing across sites is valued and can be facilitated by international organizations. Resource limitation is a common challenge for LMICs, and partnerships with external organizations can provide resources, funding, and QI expertise to support local teams. Tools to visually manage data are essential to motivate systemic change so that data collection and application to QI efforts becomes the normal default. We note that several studies included in our review discussed national monitoring systems as important facilitators to drive QI efforts. However, while access to data is necessary, it is insufficient to motivate sustainable changes without systemic support.
The themes we drew from the included articles are similar to the themes that have been demonstrated in other, non-PPP settings. A review of a national program in the United States described the interactive elements critical to successful transformation: impetus to transform, leadership commitment to quality, improvement initiatives that actively engage staff in meaningful problem solving, alignment to achieve consistency of organization goals with resource allocation, and integration to bridge traditional intra-organizational boundaries [143]. Previous literature reviews have found that leadership, organizational culture, data infrastructure, microsystem motivation to change, and abundant resources are important for QI success [144]. Additionally, it is already widely accepted that factors in the organization and external environment in healthcare can have a large impact on the ability of QI teams to accomplish their goals [145]. The themes that emerged from the studies included in this review are therefore not surprising.
While we identified many themes on lessons learned, the articles included in our review rarely provided enough strategic and tactical data to understand how these concepts were operationalized and the organizational and resource constraints. This limited our ability to provide concrete examples of best practices for QI in public–private partnerships in LMICs. The lack of robust descriptions of the QI initiatives, poor methodologic quality, and a limited use of implementation frameworks make it difficult to understand the contextual factors that guide lasting success. For example, while ownership and engagement of frontline team members in the QI work was described as essential for QI success, the descriptions of how frontline staff were engaged in leading efforts were rarely provided. Additionally, while the teams valued the ability to share and learn from one another in QI collaboratives, the details of how learning lessons happened under real-world conditions and how those lessons were shared were rarely reported. The studies mostly lacked discussion of the participants’ competencies and the programs' willingness and culture to change.
We aimed to understand how QI has been applied in LMIC settings, however, we were limited by the poor descriptions of the QI programs and implementation details. There was very little substantive content on approaches to build systems of quality measurement, and motivate workers to routinize sharing these measures, appealing to intrinsic and extrinsic motivation for change. Although many of the included articles use well-known and highly studied approaches, many either did not use a formal QI framework from the literature or did not reference it in their published articles. There was no strong evidence that a single intervention was associated with positive effects on a specific outcome measure. Most multicomponent QI interventions were vaguely reported, making it difficult to determine the fidelity with which they were applied. In the few RCTs that we identified, the results were largely positive (Fig. 3). However, there was a lack of high-quality RCTs and publication bias might lead to negative results not being shared [146].
We also aimed to understand the role of public–private and community partnerships in LMICs and their impacts on population health. However, we were limited by the vague definitions and descriptions of the PPPs, with few papers formally screening for actual deployment of private-sector capital. The authors typically reported that the project was a partnership between public, private, and community organizations, listing the names of the organizations, but not providing information on how the partnership was governed, how the capital was used, and its impact on the project’s effectiveness. We also found limited discussion on the role of private-sector partners. These partnerships do not follow the traditional PPP model, which is a formal partnership with capital investment for a return on investment. The definition of PPPs appears to be misused in the literature and the descriptions of private sector, for-profit company investing in the government to achieve a particular goal are extremely limited. Instead, we found that almost all the reported results were partnerships between governments and private sector NGOs, who are driven by different incentives. Because of this we were unable to study other types of partnerships. We chose to define PPPs broadly to be able to assess the differences between types of PPPs, but due to the partnerships described in the literature we were ultimately unable to do so, and instead we reported the results as an aggregate. While rare, there were some descriptions of true PPPs, such as the one between the government of Lesotho and a private consortium of hospital services [10]. In this example, the important drivers of success included better defined policies and procedures, empowerment and training of managers and staff, and increased accountability, as supported by changes in infrastructure, communication, human resource management, and organizational culture [147].
In addition to the issue that the PPPs described in the literature do not meet the formal definition of for-profit companies investing in the government efforts, the details on the structure of the partnerships included was unavailable. Discussion of roles, responsibilities, shared vision, common goals, trust, and respect are needed to understand these relationships and their potential impacts on implementation success. This lack of detail makes it difficult to understand the governance and leadership structures overseeing the QI programs and what type of governance structures are most effective. We did not find evidence that any one governance structure better supports effective QI projects in LMICs.
The QI lessons learned emerged primarily from the discussion and conclusion sections of the reviewed articles. While these reflections by the authors added valuable insights into their perspectives on what led to success, the barriers impeding improvement, and lessons learned for future initiatives, they are limited in their inferential ability to offer a full and robust understanding of the key factors causally contributing to the reported outcomes. The vague descriptions of leadership, culture, and roles greatly undermined our ability to learn from these studies. We, and others, recognize the opportunity to systematically use implementation science to better appreciate the organizational and cultural contextual factors and determinants of success in QI initiatives in these challenging settings [16, 73, 113, 148]. Further empirical research using qualitative and quantitative approaches would be helpful to determine the full extent of the implementation challenges including the context, organizational culture, and user involvement.
The literature reviewed demonstrates that many QI programs have been able to improve health outcomes in LMICs through the use of QI frameworks. The randomized trials, while limited, demonstrated positive or mixed effectiveness. Promising interventions for improving PPP QI efforts in LMICs exist but require further investigation. These projects and their evaluations support our convictions on the need to prioritize authentic co-design of QI efforts, led by local stakeholders through coaching, to drive effective PPP-funded QI implementation efforts. Local leaders have a greater understanding of the local barriers blocking QI uptake and the enabling factors for sustainable success. Additionally, more studies on cost-effectiveness of PPPbased QI efforts are needed as resource limitations are a huge and ongoing issue for LMIC partnerships and their lasting impacts.
Research equity
In discussing partnerships between international organizations and LMICs, it is essential to consider the issues of equity, vision, and goals and how these factors can influence how a partnership is planned, implemented, and reported. There has been a recent movement in partnerships with LMICs to shift the agency, leadership, power, and ownership to local researchers and community leaders [149]. Researchers in LMICs have described the challenges they face that are often not understood by high-income country funders and researchers, and have called for a more active and meaningful role in decision-making, research planning, and study implementation [150]. These power imbalances are increasingly seen as a major factor in the underperformance of PPP-directed QI projects in LMICs and have been thrust to the forefront during the COVID-19 pandemic [151]. Some articles in our review discussed a need to focus on equity in QI planning, staff engagement and sustainable work [73]. One study by Muller et al. specifically noted how the “quality movement was driven by the United States” [152] as opposed to the need for locally derived solutions that are sensitive to local contexts and are meaningful to local stakeholders.
Limitations
Our study has several limitations. First, due to the broad range of methodologies, we were not able to report on each of the approaches in depth. Second, many of the studies had diffuse aims and lacked sufficient data and clear descriptions of the programs, limiting the ability to meaningfully assess what interventions led to the reported outcomes. Third, the populations varied greatly, limiting the ability to effectively compare interventions across studies. Fourth, our review deals with complex interventions, including a number of interactions between components, variability of outcomes, and the permitted degree of flexibility or tailoring of the interventions [153]. These aspects can hinder an appropriate and direct evaluation of the interventions. Fifth, our study was limited to English-language studies, potentially overlooking reports written in other languages. Sixth, while we aimed to review the literature on population level public health conditions by using search terms for health, wellbeing, and nutrition, public health is a broad field that creates the social and physical conditions in which people can be healthy [154]. Our review does not encompass all of the structural factors of public health (such as education, sanitation, housing). Additional work examining the use of QI for all aspects of physical and organizational infrastructure and capacity building in communities would be interesting and beyond the scope of this already expansive review. Seventh, many of the included studies either did not provide enough information to understand if or how private-sector capital is deployed or did not follow the formal PPP model, which is a formal partnership with capital investment for a return on investment. Eighth, PPPs exist outside of population health and we did not examine the financial structure of PPPs that leverage QI in other sectors, beyond the scope of this study, that might have valuable, transferrable lessons learned. Ninth, screening for eligibility and data extraction were performed by a single reviewer although all study findings were carefully reviewed, and all conclusions agreed to by the second reviewer. Finally, our review may be influenced by publication bias [146]; while we made an effort to search grey literature to gain a thorough breadth of QI work in LMICs, there is likely much more work that has not been published in peer-reviewed literature or available in the sources we explored, or due to unpublished negative results.
Conclusions
Many interventions aimed at improving QI in LMICs have made marginal impacts on global health through PPPs. The factors that emerged as important (including a clear vision, robust leadership support, frontline engagement, ongoing learning, and managing resources efficiently) were not surprising as these are well studied in other settings. Our study indicated that despite the promise of PPPs, we are currently unable to fully assess whether PPPs are in any way different or better from other funding organizations in LMIC improvement efforts. The descriptions of the interventions' aims and components, heterogeneity of the interventions and study characteristics, and validity of the outcome measurements, hinder the demonstration of robust evidence in supporting the effectiveness of the interventions. The papers we found in our exhaustive literature search say too little about how QI is actually implemented in PPPs, which makes it difficult to understand how to improve private sector funded QI implementation in LMICs. Most of the PPPs we studied were partnerships between NGOs and governmental entities where there is little incentive for accountability. Additionally, most of the programs were focused on project processes rather than outcomes. Third, we found that implementation of QI is unsystematic and poorly documented.
There is an ongoing need to understand how PPPs could potentially improve QI outcomes, how NGO/governmental partnerships support or impede this, and the implications for future research. Future research should develop a clearer description of the PPP funding and incentives structures, QI interventions, use uniform and valid outcome measures, appropriate study designs for assessing the impact and implementation, and attend to the local LMIC stakeholders' needs in developing effective QI interventions. A focus on implementation science is needed to better understand the organizational and cultural contextual factors that lead to successful improvement, and to inform alignment of the kinds of collaboration needed for achieving global health outcomes.
Availability of data and materials
All data are from currently published studies cited in the paper. Data summarized used for during the current study are available from the corresponding author on reasonable request.
Abbreviations
- QI:
-
Quality improvement
- PPP:
-
Public-private partnership
- LMIC:
-
Low-and-middle income countries
- NGO:
-
Non-governmental organization
- HIV:
-
Human immunodeficiency virus
- AIDS:
-
Acquired immunodeficiency syndrome
- IHI:
-
Institute for Healthcare Improvement
- PDSA:
-
Plan-do-study-act
- RCT:
-
Randomized controlled trial
- CQI:
-
Continuous quality improvement
- CHW:
-
Community health workers
References
Villalobos Dintrans P, Bossert TJ, Sherry J, Kruk ME. A synthesis of implementation science frameworks and application to global health gaps. Glob Health Res Policy. 2019;4(1):1–11.
Alonge O, Rodriguez DC, Brandes N, Geng E, Reveiz L, Peters DH. How is implementation research applied to advance health in low-income and middle-income countries? BMJ Glob Health. 2019;4(2):e001257.
Organization WH. Global progress report on HIV, viral hepatitis and sexually transmitted infections, 2021: accountability for the global health sector strategies 2016–2021: actions for impact. 2021.
Goudet SM, Bogin BA, Madise NJ, Griffiths PL. Nutritional interventions for preventing stunting in children (birth to 59 months) living in urban slums in low‐and middle‐income countries (LMIC). Cochr Database Syst Rev. 2019(6).
Batalden PB, Davidoff F. What is “quality improvement” and how can it transform healthcare? : BMJ Publishing Group Ltd; 2007. p. 2–3.
Jin J, Akau’ola S, Yip C-H, Nthumba P, Ameh EA, de Jonge S, et al. Effectiveness of quality improvement processes, interventions, and structure in trauma systems in low-and middle-income countries: a systematic review and meta-analysis. World J Surg. 2021;45(7):1982–98.
Jin J, Yip C-H, Nthumba P, Ameh EA, de Jonge S, Mehes M, et al. The impact of quality improvement interventions in improving surgical infections and mortality in low and middle-income countries: a systematic review and meta-analysis. World J Surg. 2021;45(10):2993–3006.
Hargreaves S, Rustage K, Nellums LB, Bardfield JE, Agins B, Barker P, et al. Do quality improvement initiatives improve outcomes for patients in antiretroviral programs in low-and middle-income countries? A systematic review. J Acquired Immune Deficiency Syndr (1999). 2019;81(5):487.
Turner M, Carr T, John R, Ramaswamy R. A scoping review of the use of quality improvement methods by community organizations in the United States, Australia, New Zealand, and Canada to improve health and well-being in community settings. IJQHC Communications. 2022;2(1):lyab019.
McIntosh N, Grabowski A, Jack B, Nkabane-Nkholongo EL, Vian T. A public-private partnership improves clinical performance in a hospital network in Lesotho. Health Aff. 2015;34(6):954–62.
Garcia-Elorrio E, Rowe SY, Teijeiro ME, Ciapponi A, Rowe AK. The effectiveness of the quality improvement collaborative strategy in low-and middle-income countries: a systematic review and meta-analysis. PLoS ONE. 2019;14(10):e0221919.
Nambiar B, Hargreaves DS, Morroni C, Heys M, Crowe S, Pagel C, et al. Improving health-care quality in resource-poor settings. Bull World Health Organ. 2017;95(1):76.
Bhat L, McCammon C. The importance of quality assurance and quality improvement in low-and middle-income settings. Curr Blad Dysfunct Rep. 2021;16(1):1–5.
Maru DS-R, Andrews J, Schwarz D, Schwarz R, Acharya B, Ramaiya A, et al. Crossing the quality chasm in resource-limited settings. Glob Health. 2012;8(1):1–5.
Garcia-Elorrio E, Schneider EC. Research on health-care quality improvement in low-and middle-income countries: is it a worthy investment? : Oxford University Press; 2012. p. 550–2.
Hirschhorn LR, Ramaswamy R, Devnani M, Wandersman A, Simpson LA, Garcia-Elorrio E. Research versus practice in quality improvement? Understanding how we can bridge the gap. Int J Qual Health Care. 2018;30(suppl_1):24–8.
Somani NA, Marshall K, Durrani H, Tang K, Mogilevskii R, Bhutta Z. Evaluation of frameworks demonstrating the role of private sector in non-communicable disease management and control: a systematic review and thematic synthesis. BMJ Open. 2023;13(3):e061370.
Gerrard M. Public-private partnerships. Finance and development. 2001;38(3):48–51.
Sundler AJ, Lindberg E, Nilsson C, Palmér L. Qualitative thematic analysis based on descriptive phenomenology. Nurs Open. 2019;6(3):733–9.
Kilo CM. A framework for collaborative improvement: lessons from the Institute for healthcare improvement’s breakthrough series. Qual Manage Healthcare. 1998;6(4):1–14.
Oyeledun B, Oronsaye F, Oyelade T, Becquet R, Odoh D, Anyaike C, et al. Increasing retention in care of HIV-positive women in PMTCT services through continuous quality improvement–breakthrough (CQI-BTS) series in primary and secondary health care facilities in Nigeria: a cluster randomized controlled trial. The Lafiyan Jikin Mata study. JAIDS J Acquired Immune Def Synd. 2014;67:S125–31.
Stringer JS, Chisembele-Taylor A, Chibwesha CJ, Chi HF, Ayles H, Manda H, et al. Protocol-driven primary care and community linkages to improve population health in rural Zambia: the Better Health Outcomes through Mentoring and Assessment (BHOMA) project. BMC Health Serv Res. 2013;13(2):1–10.
Mutale W, Ayles H, Bond V, Chintu N, Chilengi R, Mwanamwenge MT, et al. Application of systems thinking: 12-month postintervention evaluation of a complex health system intervention in Zambia: the case of the BHOMA. J Eval Clin Pract. 2017;23(2):439–52.
Alhassan RK, Nketiah-Amponsah E, Arhinful DK. Design and implementation of community engagement interventions towards healthcare quality improvement in Ghana: a methodological approach. Heal Econ Rev. 2016;6(1):1–13.
Alhassan RK, Nketiah-Amponsah E, Spieker N, Arhinful DK, Ogink A, van Ostenberg P, et al. Effect of community engagement interventions on patient safety and risk reduction efforts in primary health facilities: evidence from Ghana. PLoS ONE. 2015;10(11):e0142389.
Walker D, Otieno P, Butrick E, Namazzi G, Achola K, Merai R, et al. Effect of a quality improvement package for intrapartum and immediate newborn care on fresh stillbirth and neonatal mortality among preterm and low-birthweight babies in Kenya and Uganda: a cluster-randomised facility-based trial. Lancet Glob Health. 2020;8(8):e1061–70.
Horwood C, Butler L, Barker P, Phakathi S, Haskins L, Grant M, et al. A continuous quality improvement intervention to improve the effectiveness of community health workers providing care to mothers and children: a cluster randomised controlled trial in South Africa. Hum Resour Health. 2017;15(1):1–11.
Colbourn T, Nambiar B, Bondo A, Makwenda C, Tsetekani E, Makonda-Ridley A, et al. Effects of quality improvement in health facilities and community mobilization through women’s groups on maternal, neonatal and perinatal mortality in three districts of Malawi: MaiKhanda, a cluster randomized controlled effectiveness trial. Int Health. 2013;5(3):180–95.
Osibo B, Oronsaye F, Alo OD, Phillips A, Becquet R, Shaffer N, et al. Using small tests of change to improve PMTCT services in northern Nigeria: experiences from implementation of a continuous quality improvement and breakthrough series program. JAIDS J Acquired Immune Def Syndr. 2017;75:S165–72.
Oyeledun B, Phillips A, Oronsaye F, Alo OD, Shaffer N, Osibo B, et al. The effect of a continuous quality improvement intervention on retention-in-care at 6 months postpartum in a PMTCT program in northern Nigeria: results of a cluster randomized controlled study. JAIDS J Acquired Immune Def Syndr. 2017;75:S156–64.
Yapa HM, De Neve J-W, Chetty T, Herbst C, Post FA, Jiamsakul A, et al. The impact of continuous quality improvement on coverage of antenatal HIV care tests in rural South Africa: Results of a stepped-wedge cluster-randomised controlled implementation trial. PLoS Med. 2020;17(10):e1003150.
Jayanna K, Rao S, Kar A, Gowda PD, Thomas T, Swaroop N, et al. Accelerated scale‐up of Kangaroo mother care: evidence and experience from an implementation‐research initiative in south India. Acta Paediatr. 2022;112:15–26.
Barker PM, Reid A, Schall MW. A framework for scaling up health interventions: lessons from large-scale improvement initiatives in Africa. Implement Sci. 2015;11(1):1–11.
Chung AM, Case P, Gosling J, Gosling R, Madinga M, Chikodzore R, et al. Scaling up malaria elimination management and leadership: a pilot in three provinces in Zimbabwe, 2016–2018. Malar J. 2020;19(1):1–14.
Jesus TS, Hoenig H. Crossing the global quality chasm in health care: where does rehabilitation stand? Arch Phys Med Rehabil. 2019;100(11):2215–7.
Joseph JP, Jerome G, Lambert W, Almazor P, Cupidon CE, Hirschhorn LR. Going beyond the vertical: leveraging a national HIV quality improvement programme to address other health priorities in Haiti. AIDS. 2015;29:S165–73.
Leader A, Cadet C, Lazala D, Roa W, Arroyo O, Jensen L. Collaborative implementation strategy for newborn resuscitation and essential care training in the Dominican Republic. Front Public Health. 2017;5:61.
Mate KS, Ngubane G, Barker PM. A quality improvement model for the rapid scale-up of a program to prevent mother-to-child HIV transmission in South Africa. Int J Qual Health Care. 2013;25:373–80.
Mwidunda PE, Eliakimu E. Creating a national culture of quality: the Tanzania experience. AIDS. 2015;29:S175–7.
Mwita SK, Ngonyani MM, Mvungi J, de Ven RAMv, Masenge TJ, Rumisha D, et al. Engagement of national stakeholders and communities on health-care quality improvement: experience from the implementation of the partnership for HIV-free survival in Tanzania. J Int Assoc Providers AIDS Care (JIAPAC). 2019;18:2325958219847454.
Ugo O, Ezinne E-A, Modupe O, Nicole S, Winifred E, Kelechi O. Improving quality of care in primary health-care facilities in rural Nigeria: successes and challenges. Health Serv Res Managerial Epidemiol. 2016;3:2333392816662581.
Wu CY, Huang C-W, Yang H-C, Li Y-C. Opportunities and challenges in Taiwan for implementing the learning health system. Int J Qual Health Care. 2019;31(9):721–4.
Goyet S, Broch-Alvarez V, Becker C. Quality improvement in maternal and newborn healthcare: lessons from programmes supported by the German development organisation in Africa and Asia. BMJ Glob Health. 2019;4(5):e001562.
Magge H, Kiflie A, Nimako K, Brooks K, Sodzi-Tettey S, Mobisson-Etuk N, et al. The Ethiopia healthcare quality initiative: design and initial lessons learned. Int J Qual Health Care. 2019;31(10):G180–6.
Anatole M, Magge H, Redditt V, Karamaga A, Niyonzima S, Drobac P, et al. Nurse mentorship to improve the quality of health care delivery in rural Rwanda. Nurs Outlook. 2013;61(3):137–44.
Braithwaite J, Ludlow K, Churruca K, James W, Herkes J, McPherson E, et al. Systems transformation: learning from change in 60 countries. J Health Org Manag. 2019;34(3):237–53.
Gueye B, Wesson J, Koumtingue D, Stratton S, Viadro C, Talla H, et al. Mentoring, task sharing, and community outreach through the TutoratPlus approach: increasing use of long-acting reversible contraceptives in Senegal. Global Health: Sci Pract. 2016;4(Supplement 2):S33–43.
Leatherman S, Ferris TG, Berwick D, Omaswa F, Crisp N. The role of quality improvement in strengthening health systems in developing countries. Int J Qual Health Care. 2010;22(4):237–43.
Manyazewal T, Mekonnen A, Demelew T, Mengestu S, Abdu Y, Mammo D, et al. Improving immunization capacity in Ethiopia through continuous quality improvement interventions: a prospective quasi-experimental study. Infect Dis Poverty. 2018;7(06):35–48.
McNatt Z, Linnander E, Endeshaw A, Tatek D, Conteh D, Bradley EH. A national system for monitoring the performance of hospitals in Ethiopia. Bull World Health Organ. 2015;93:719–26.
Nyagawa FP. Strengthening services for most vulnerable children through quality improvement approaches in a community setting: the case of Bagamoyo District, Tanzania. Improving health care in low-and middle-income countries. 2020:151–75. https://library.oapen.org/bitstream/handle/20.500.12657/39566/2020_Book_ImprovingHealthCareInLow-AndMi.pdf#page=163.
Sequeira D’Mello B, Bwile P, Carmone AE, Kalaris K, Magembe G, Masweko M, et al. Averting maternal death and disability in an urban network of care in Dar ES Salaam, Tanzania: a descriptive case study. Health Syst Reform. 2020;6(2):e1834303.
Sherr K, Requejo JH, Basinga P. Implementation research to catalyze advances in health systems strengthening in sub-Saharan Africa: the African Health Initiative. BMC Health Serv Res. 2013;13(2):1–3.
Sibley LM, Tesfaye S, Fekadu Desta B, Hailemichael Frew A, Kebede A, Mohammed H, et al. Improving maternal and newborn health care delivery in rural amhara and oromiya regions of ethiopia through the maternal and newborn health in ethiopia partnership. J Midwifery Womens Health. 2014;59(s1):S6–20.
Wagenaar BH, Hirschhorn LR, Henley C, Gremu A, Sindano N, Chilengi R. Data-driven quality improvement in low-and middle-income country health systems: lessons from seven years of implementation experience across Mozambique, Rwanda, and Zambia. BMC Health Serv Res. 2017;17(3):65–75.
Chandani Y, Duffy M, Lamphere B, Noel M, Heaton A, Andersson S. Quality improvement practices to institutionalize supply chain best practices for iCCM: Evidence from Rwanda and Malawi. Res Social Adm Pharm. 2017;13(6):1095–109.
El-Jardali F, Fadlallah R. A review of national policies and strategies to improve quality of health care and patient safety: a case study from Lebanon and Jordan. BMC Health Serv Res. 2017;17(1):1–13.
Giannitrapani KF, Satija A, Ganesh A, Gamboa R, Fereydooni S, Hennings T, et al. Barriers and facilitators of using quality improvement to foster locally initiated innovation in palliative care services in India. J Gen Intern Med. 2021;36(2):366–73.
Ikeda DJ, Basenero A, Murungu J, Jasmin M, Inimah M, Agins BD. Implementing quality improvement in tuberculosis programming: Lessons learned from the global HIV response. Elsevier; 2019. p. 100116.
Waiswa P, Manzi F, Mbaruku G, Rowe A, Marx M, Tomson G, et al. Effects of the EQUIP quasi-experimental study testing a collaborative quality improvement approach for maternal and newborn health care in Tanzania and Uganda. Implement Sci. 2017;12(1):1–18.
Yilma Y, Bejiga M, Ayele T, Getachew D, Ishak N, Denbi T, et al. Implementation of quality improvement for community-based health services: what worked, what didn’t, and why? A case study in Ethiopia. Ethiopian J Health Dev. 2020;34(2):54–61.
Franco LM, Marquez L. Effectiveness of collaborative improvement: evidence from 27 applications in 12 less-developed and middle-income countries. BMJ Qual Saf. 2011;20(8):658–65.
Baker U, Petro A, Marchant T, Peterson S, Manzi F, Bergström A, et al. Health workers’ experiences of collaborative quality improvement for maternal and newborn care in rural Tanzanian health facilities: A process evaluation using the integrated’Promoting Action on Research Implementation in Health Services’ framework. PLoS ONE. 2018;13(12):e0209092.
Barker P, Barron P, Bhardwaj S, Pillay Y. The role of quality improvement in achieving effective large-scale prevention of mother-to-child transmission of HIV in South Africa. AIDS. 2015;29:S137–43.
Hirschhorn LR, Baynes C, Sherr K, Chintu N, Awoonor-Williams JK, Finnegan K, et al. Approaches to ensuring and improving quality in the context of health system strengthening: a cross-site analysis of the five African Health Initiative Partnership programs. BMC Health Serv Res. 2013;13(2):1–11.
Kinyua K, Muange P, Makenzi B, Kimani C, Amoah AO. Applying quality improvement strategies to health services for HIV-affected mother-baby pairs in rural Kenya. J Int Assoc Providers AIDS Care (JIAPAC). 2019;18:2325958219857977.
Mutale W, Chintu N, Amoroso C, Awoonor-Williams K, Phillips J, Baynes C, et al. Improving health information systems for decision making across five sub-Saharan African countries: Implementation strategies from the African Health Initiative. BMC Health Serv Res. 2013;13(2):1–12.
Ahmed S, Applegate JA, Mitra DK, Callaghan-Koru JA, Mousumi M, Khan AM, et al. Implementation research to support Bangladesh Ministry of Health and Family Welfare to implement its national guidelines for management of infections in young infants in two rural districts. J Health Popul Nutr. 2019;38(1):1–13.
Bazos DA, LaFave LRA, Suresh G, Shannon KC, Nuwaha F, Splaine ME. The gas cylinder, the motorcycle and the village health team member: a proof-of-concept study for the use of the microsystems quality improvement approach to strengthen the routine immunization system in Uganda. Implement Sci. 2015;10(1):1–18.
Brima N, Sevdalis N, Daoh K, Deen B, Kamara T, Wurie H, et al. Improving nursing documentation for surgical patients in a referral hospital in Freetown, Sierra Leone: protocol for assessing feasibility of a pilot multifaceted quality improvement hybrid type project. Pilot Feasib Stud. 2021;7(1):1–13.
Eboreime EA, Idika O, Omitiran K, Eboreime O, Ibisomi L. Primary healthcare planning, bottleneck analysis and performance improvement: An evaluation of processes and outcomes in a Nigerian context. Eval Program Plann. 2019;77:101712.
Habonimana D, Nimako G, Ncayiyana J, Ndayisaba G, Ramaswamy R. Improving long-lasting insecticidal nets use in Kayange community of north-western Burundi: a pilot study exploring the use of quality improvement methodologies in low-resource community settings. BMJ Open Qual. 2019;8(3):e000540.
Hirschhorn LR, Magge H, Kiflie A. Aiming beyond equality to reach equity: the promise and challenge of quality improvement. BMJ. 2021;374:n939.
Manyeh AK, Ibisomi L, Baiden F, Chirwa T, Ramaswamy R. Using intervention mapping to design and implement quality improvement strategies towards elimination of lymphatic filariasis in Northern Ghana. PLoS Negl Trop Dis. 2019;13(3):e0007267.
Ndaba T, Taylor M, Mabaso M. Establishing a community advisory group (CAG) for partnership defined quality (PDQ) towards improving primary health care in a peri-urban setting in KwaZulu-Natal, South Africa. BMC Health Serv Res. 2020;20(1):1–7.
Odaga J, Henriksson DK, Nkolo C, Tibeihaho H, Musabe R, Katusiime M, et al. Empowering districts to target priorities for improving child health service in Uganda using change management and rapid assessment methods. Glob Health Action. 2016;9(1):30983.
Potokar T, Bendell R, Phuyal K, Dhital A, Karim E, Falder S, et al. The development of the Delivery Assessment Tool (DAT) to facilitate quality improvement in burns services in low-middle income countries. Burns. 2022;48(6):1488–96.
Singh K, Speizer I, Handa S, Boadu RO, Atinbire S, Barker PM, et al. Impact evaluation of a quality improvement intervention on maternal and child health outcomes in Northern Ghana: early assessment of a national scale-up project. Int J Qual Health Care. 2013;25(5):477–87.
Streeton A-M, Kitsell F, Gambles N, McCarthy R. A qualitative analysis of vertical leadership development amongst NHS health-care workers in low to middle income country settings. Leader Health Serv. 2021;34(3):296–312.
Rombo CO, Oduor M, Mwamba PM, Tilock K, Kambale SM, Makokha E, et al. Implementing SLMTA in the Kenya national blood transfusion service: lessons learned. African J Lab Med. 2017;6(1):1–7.
Webster PD, Sibanyoni M, Malekutu D, Mate KS, Venter WF, Barker PM, et al. Using quality improvement to accelerate highly active antiretroviral treatment coverage in South Africa. BMJ Qual Saf. 2012;21(4):315–24.
Adeniran A, Likaka A, Knutsson A, Costello A, Daelmans B, Maliqi B, et al. Leadership, action, learning and accountability to deliver quality care for women, newborns and children. Bull World Health Organ. 2018;96(3):222.
Cofie LE, Barrington C, Akaligaung A, Reid A, Fried B, Singh K, et al. Integrating community outreach into a quality improvement project to promote maternal and child health in Ghana. Glob Public Health. 2014;9(10):1184–97.
Ferrelli R, Serrano CR, Balladelli PP, Cortinois A, Quinteros J. Strengthening local health care management in Bolivian districts through participatory operational research. Int J Health Plann Manage. 1997;12(1):29–50.
Tancred T, Mandu R, Hanson C, Okuga M, Manzi F, Peterson S, et al. How people-centred health systems can reach the grassroots: experiences implementing community-level quality improvement in rural Tanzania and Uganda. Health Policy Plan. 2018;33(1):e1–13.
Wereta T, Betemariam W, Karim AM, Fesseha Zemichael N, Dagnew S, Wanboru A, et al. Effects of a participatory community quality improvement strategy on improving household and provider health care behaviors and practices: a propensity score analysis. BMC Pregnancy Childbirth. 2018;18(1):31–42.
Bhardwaj S, Barron P, Pillay Y, Treger-Slavin L, Robinson P, Goga A, et al. Elimination of mother-to-child transmission of HIV in South Africa: rapid scale-up using quality improvement. S Afr Med J. 2014;104(3):239–43.
Karamagi E, Sensalire S, Muhire M, Kisamba H, Byabagambi J, Rahimzai M, et al. Improving TB case notification in northern Uganda: evidence of a quality improvement-guided active case finding intervention. BMC Health Serv Res. 2018;18(1):1–12.
Kim C, Kirunda R, Mubiru F, Rakhmanova N, Wynne L. A process evaluation of the quality improvement collaborative for a community-based family planning learning site in Uganda. Gates Open Res. 2019;3:1481.
Manzi A, Hirschhorn LR, Sherr K, Chirwa C, Baynes C, Awoonor-Williams JK. Mentorship and coaching to support strengthening healthcare systems: lessons learned across the five population health implementation and training partnership projects in sub-Saharan Africa. BMC Health Serv Res. 2017;17(3):5–16.
Nahimana E, Magge H, Bizimana F, Nyishime M, Lively CT, Gilbert H, et al. Sustainability Assessment of a District-Wide Quality Improvement on Newborn Care Program in Rural Rwanda: A Mixed-Method Study. Ann Glob Health. 2021;87(1):40.
Obssa A, Hailemichael A, Belayihun B, Teshome L, Mvuezolo JJN, Molla Y, et al. Point of care quality improvement approach increases immediate postpartum family planning uptake: A field report from Sululta district, Oromia, Ethiopia. Ethiopian J Health Dev. 2021;35(5):27–36.
Patterson J, Worku B, Jones D, Clary A, Ramaswamy R, Bose C. Ethiopian Pediatric Society Quality Improvement Initiative: a pragmatic approach to facility-based quality improvement in low-resource settings. BMJ Open Qual. 2021;10(1):e000927.
Twum-Danso NA, Akanlu GB, Osafo E, Sodzi-Tettey S, Boadu RO, Atinbire S, et al. A nationwide quality improvement project to accelerate Ghana’s progress toward millennium development goal four: design and implementation progress. Int J Qual Health Care. 2012;24(6):601–11.
Twum-Danso NA, Dasoberi IN, Amenga-Etego IA, Adondiwo A, Kanyoke E, Boadu RO, et al. Using quality improvement methods to test and scale up a new national policy on early post-natal care in Ghana. Health Policy Plan. 2014;29(5):622–32.
Mogasale V, Wi TC, Das A, Kane S, Singh AK, George B, et al. Quality assurance and quality improvement using supportive supervision in a large-scale STI intervention with sex workers, men who have sex with men/transgenders and injecting-drug users in India. Sexually Transmitted Infect. 2010;86(Suppl 1):i83–8.
Sacks E, Swanson RC, Schensul JJ, Gleave A, Shelley KD, Were MK, et al. Community involvement in health systems strengthening to improve global health outcomes: a review of guidelines and potential roles. Int Q Commun Health Educ. 2017;37(3–4):139–49.
Saleh SS, Alameddine MS, Natafgi NM. Beyond accreditation: a multi-track quality-enhancing strategy for primary health care in low-and middle-income countries. Int J Health Serv. 2014;44(2):355–72.
Sensalire S, Isabirye P, Karamagi E, Byabagambi J, Rahimzai M, Calnan J. Saving mothers, giving life approach for strengthening health systems to reduce maternal and newborn deaths in 7 scale-up districts in northern Uganda. Glob Health: Sci Pract. 2019;7(Supplement 1):S168–87.
Smith H, Ameh C, Godia P, Maua J, Bartilol K, Amoth P, et al. Implementing maternal death surveillance and response in Kenya: incremental progress and lessons learned. Glob Health: Sci Pract. 2017;5(3):345–54.
Tancred T, Manzi F, Schellenberg J, Marchant T. Facilitators and barriers of community-level quality improvement for maternal and newborn health in Tanzania. Qual Health Res. 2017;27(5):738–49.
Streeton A-M, Kitsell F, Kung M, Oo M, Rowse V, Wadd V, et al. The Improving Global Health Programme-leadership development in the NHS through overseas placement. BMJ Glob Health. 2021;6(Suppl 6):e004533.
Cosimi LA, Dam HV, Nguyen TQ, Ho HT, Do PT, Duc DN, et al. Integrated clinical and quality improvement coaching in Son La Province, Vietnam: a model of building public sector capacity for sustainable HIV care delivery. BMC Health Serv Res. 2015;15(1):1–9.
Kumar MB, Madan JJ, Achieng MM, Limato R, Ndima S, Kea AZ, et al. Is quality affordable for community health systems? Costs of integrating quality improvement into close-to-community health programmes in five low-income and middle-income countries. BMJ Glob Health. 2019;4(4):e001390.
Du Mortier SP, Arpagaus M. Quality improvement programme on the frontline: an International Committee of the Red Cross experience in the Democratic Republic of Congo. Int J Qual Health Care. 2005;17(4):293–300.
Hynes M, Meehan K, Meyers J, Mashukano Maneno L, Hulland E. Using a quality improvement approach to improve maternal and neonatal care in North Kivu, Democratic Republic of Congo. Reprod Health Matters. 2017;25(51):140–50.
Lazzerini M, Chhaganlal K, Macome AC, Putoto G. Nutritional services for children in Beira, Mozambique: a study reporting on participatory use of data to generate quality improvement recommendations. BMJ Open Qual. 2019;8(4):e000758.
Livesley N, Coly A, Karamagi E, Nsubuga-Nyombi T, Mwita SK, Ngonyani MM, et al. Reducing mother-to-child transmission of HIV using quality improvement approaches. J Int Assoc Providers AIDS Care (JIAPAC). 2019;18:2325958219855631.
Rahman AE, Iqbal A, Hoque DE, Moinuddin M, Zaman SB, Rahman QS-u, et al. Managing neonatal and early childhood syndromic sepsis in sub-district hospitals in resource poor settings: improvement in quality of care through introduction of a package of interventions in rural Bangladesh. PloS one. 2017;12(1):e0170267.
Tesfaye S, Barry D, Gobezayehu AG, Frew AH, Stover KE, Tessema H, et al. Improving coverage of postnatal care in rural Ethiopia using a community-based, collaborative quality improvement approach. J Midwifery Womens Health. 2014;59(s1):S55–64.
Webster PD, Deka S, Ismail A, Stern AF, Barker PM. Using a multicountry learning network to harvest and rapidly spread implementation knowledge across programs aimed to reduce mother-to-child transmission of HIV and improve nutrition: perspectives and lessons learned for similar large-scale initiatives. J Int Assoc Providers AIDS Care (JIAPAC). 2019;18:2325958219847452.
Jaribu J, Penfold S, Green C, Manzi F, Schellenberg J. Improving Tanzanian childbirth service quality. Int J Health Care Qual Assur. 2018;31(3):190–202.
Necochea E, Tripathi V, Kim YM, Akram N, Hyjazi Y, da Luz VM, et al. Implementation of the Standards-Based Management and Recognition approach to quality improvement in maternal, newborn, and child health programs in low-resource countries. Int J Gynecol Obstet. 2015;130:S17–24.
Akulima M, Ikamati R, Mungai M, Samuel M, Ndirangu M, Muga R. Food banking for improved nutrition of HIV infected orphans and vulnerable children; emerging evidence from quality improvement teams in high food insecure regions of Kiambu, Kenya. Pan African Med J. 2016;25(Suppl 2):4.
Broughton E, Hermida J, Hill K, Sloan N, Chavez M, Gonzalez D, et al. Evaluation of an intervention to improve essential obstetric and newborn care access and quality in Cotopaxi, Ecuador. Front Public Health. 2016;4:247.
Gilson L. Implementing health system change: What are the lessons from the African Health Initiative? BMC Health Serv Res. 2013;13(2):1–3.
Datta V, Srivastava S, Singh M. Formation of quality of care network in India: challenges and way forward. Indian Pediatr. 2018;55(9):824–7.
Juarez M, Dionicio C, Sacuj N, Lopez W, Miller AC, Rohloff P. Community-based interventions to reduce child stunting in rural guatemala: a quality improvement model. Int J Environ Res Public Health. 2021;18(2):773.
Youngleson MS, Nkurunziza P, Jennings K, Arendse J, Mate KS, Barker P. Improving a mother to child HIV transmission programme through health system redesign: quality improvement, protocol adjustment and resource addition. PLoS ONE. 2010;5(11): e13891.
Boyd AT, Ogbanufe O, Onyenuobi C, Mgbakor I, Bachanas P, Olupitan O, et al. Scale-up of antiretroviral treatment access among people living with HIV in Rivers State, Nigeria, 2019–2020. AIDS. 2021;35(7):1127–34.
Bryce J, Requejo JH, Moulton LH, Ram M, Black RE. A common evaluation framework for the African Health Initiative. BMC Health Serv Res. 2013;13(2):1–9.
Manzi A, Magge H, Hedt-Gauthier BL, Michaelis AP, Cyamatare FR, Nyirazinyoye L, et al. Clinical mentorship to improve pediatric quality of care at the health centers in rural Rwanda: a qualitative study of perceptions and acceptability of health care workers. BMC Health Serv Res. 2014;14(1):1–9.
Kumar MB, Madan JJ, Auguste P, Taegtmeyer M, Otiso L, Ochieng CB, et al. Cost-effectiveness of community health systems strengthening: quality improvement interventions at community level to realise maternal and child health gains in Kenya. BMJ Glob Health. 2021;6(3):e002452.
Manzi A, Nyirazinyoye L, Ntaganira J, Magge H, Bigirimana E, Mukanzabikeshimana L, et al. Beyond coverage: improving the quality of antenatal care delivery through integrated mentorship and quality improvement at health centers in rural Rwanda. BMC Health Serv Res. 2018;18(1):1–8.
Magge H, Anatole M, Cyamatare FR, Mezzacappa C, Nkikabahizi F, Niyonzima S, et al. Mentoring and quality improvement strengthen integrated management of childhood illness implementation in rural Rwanda. Arch Dis Child. 2015;100(6):565–70.
Hurtado E, Ramírez L, Moreira P. Addressing Behavior Change in Maternal, Neonatal, and Child Health with Quality Improvement and Collaborative Learning Methods in Guatemala. Improving Health Care Low- Middle-Income Countries. 2020:27–42.
Broughton E, Saley Z, Boucar M, Alagane D, Hill K, Marafa A, et al. Cost‐effectiveness of a quality improvement collaborative for obstetric and newborn care in Niger. Int J Health Care Qual Assur. 2013;26(3):250–61.
Broughton EI, Gomez I, Nuñez O, Wong Y. Cost-effectiveness of improving pediatric hospital care in Nicaragua. Rev Panam Salud Publica. 2011;30:453–60.
Colbourn T, Pulkki-Brännström A-M, Nambiar B, Kim S, Bondo A, Banda L, et al. Cost-effectiveness and affordability of community mobilisation through women’s groups and quality improvement in health facilities (MaiKhanda trial) in Malawi. Cost Effectiveness Res Allocation. 2015;13(1):1–15.
Hagaman AK, Singh K, Abate M, Alemu H, Kefale AB, Bitewulign B, et al. The impacts of quality improvement on maternal and newborn health: preliminary findings from a health system integrated intervention in four Ethiopian regions. BMC Health Serv Res. 2020;20(1):1–12.
Manzi A, Mugunga JC, Iyer HS, Magge H, Nkikabahizi F, Hirschhorn LR. Economic evaluation of a mentorship and enhanced supervision program to improve quality of integrated management of childhood illness care in rural Rwanda. PLoS ONE. 2018;13(3):e0194187.
Scott KW, Jha AK. Putting quality on the global health agenda. N Engl J Med. 2014;371(1):3–5.
Atherton F, Mbekem G, Nyalusi I. Project report. Improving service quality: experience from the Tanzania family health project. Int J Qual Health Care. 1999;11(4):353–6.
Johnson MC, Schellekens O, Stewart J, van Ostenberg P, de Wit TR, Spieker N. SafeCare: an innovative approach for improving quality through standards, benchmarking, and improvement in low-and middle-income countries. Joint Commission J Qual Patient Safety. 2016;42(8):350–AP11.
Ruelas E, Gómez-Dantés O, Leatherman S, Fortune T, Gay-Molina JG. Strengthening the quality agenda in health care in low-and middle-income countries: questions to consider. Int J Qual Health Care. 2012;24(6):553–7.
Ngongo Bahati P, Kidega W, Ogutu H, Odada J, Bender B, Fast P, et al. Ensuring quality of services in HIV prevention research settings: findings from a multi-center quality improvement pilot in East Africa. AIDS Care. 2010;22(1):119–25.
Singh K, Brodish P, Speizer I, Barker P, Amenga-Etego I, Dasoberi I, et al. Can a quality improvement project impact maternal and child health outcomes at scale in northern Ghana? Health Res Policy Syst. 2016;14(1):1–13.
Bardfield J, Palumbo M, Geis M, Jasmin M, Agins BD. A National Organizational Assessment (NOA) to build sustainable quality management programs in low-and middle-income countries. Jt Comm J Qual Patient Saf. 2016;42(7):325–30.
Barach P, Phelps G. Clinical sensemaking: a systematic approach to reduce the impact of normalised deviance in the medical profession. J R Soc Med. 2013;106(10):387–90.
Weick KE. Sensemaking in organizations: Sage; 1995.
Swanson JO, Plotner D, Franklin HL, Swanson DL, Bolamba VL, Lokangaka A, et al. Web-based quality assurance process drives improvements in obstetric ultrasound in 5 low-and middle-income countries. Glob Health: Sci Pract. 2016;4(4):675–83.
Establishing a critical care network in Asia to improve care for critically ill patients in low-and middle-income countries. Springer; 2020. p. 608.
Lukas CV, Holmes SK, Cohen AB, Restuccia J, Cramer IE, Shwartz M, et al. Transformational change in health care systems: An organizational model. Health Care Manage Rev. 2007;32(4):309–20.
Kaplan HC, Brady PW, Dritz MC, Hooper DK, Linam WM, Froehle CM, et al. The influence of context on quality improvement success in health care: a systematic review of the literature. Milbank Q. 2010;88(4):500–59.
Kaplan HC, Provost LP, Froehle CM, Margolis PA. The Model for Understanding Success in Quality (MUSIQ): building a theory of context in healthcare quality improvement. BMJ Qual Saf. 2012;21(1):13–20.
Dickersin K, Chan S, Chalmersx T, Sacks H, Smith H Jr. Publication bias and clinical trials. Control Clin Trials. 1987;8(4):343–53.
Vian T, McIntosh N, Grabowski A, Nkabane-Nkholongo EL, Jack BW. Hospital public–private partnerships in low resource settings: Perceptions of how the Lesotho PPP transformed management systems and performance. Health Systems & Reform. 2015;1(2):155–66.
Ramaswamy R, Shidhaye R, Nanda S. Making complex interventions work in low resource settings: developing and applying a design focused implementation approach to deliver mental health through primary care in India. Int J Ment Heal Syst. 2018;12(1):1–12.
Hamid M, Rasheed MA. A new path to mentorship for emerging global health leaders in low-income and middle-income countries. Lancet Glob Health. 2022;10(7):e946–8.
Jambo K. I have funds to buy reagents, but not remedies. Nature. 2022;606(7915):625.
Abimbola S, Asthana S, Montenegro C, Guinto RR, Jumbam DT, Louskieter L, et al. Addressing power asymmetries in global health: imperatives in the wake of the COVID-19 pandemic. PLoS Med. 2021;18(4):e1003604.
Muller ME. Quality improvement in health care–A fundamental analysis and South African perspective. Curationis. 1996;19(4):67–74.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. Bmj. 2008;337:a1655.
Health IoMCftSotFoP. The future of public health: National Academy Press; 1988.
Acknowledgements
We sincerely thank the three anonymous reviewers whose expertise and perspectives strengthen our manuscript through the review process.
Funding
Funding for this study was provided by Global Alliance for Improved Nutrition (GAIN).
Author information
Authors and Affiliations
Contributions
C.I., P.B., and R.R. designed the study. C.I. and P.B. collected and analyzed data and wrote the main manuscript text. R.R. and Z.B. reviewed the manuscript and provided critical feedback
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable- review of existing literature.
Consent for publication
Not applicable- review of existing literature.
Competing interests
The authors declare no competing interests
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Iroz, C.B., Ramaswamy, R., Bhutta, Z.A. et al. Quality improvement in public–private partnerships in low- and middle-income countries: a systematic review. BMC Health Serv Res 24, 332 (2024). https://doi.org/10.1186/s12913-024-10802-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12913-024-10802-w