1 Introduction

Since the 1990s, donor governments have acknowledged the ways in which flawed judicial systems can be obstacles to good governance, democratic accountability, human rights, and transparency (Elster & Slagstad, 1993; Linz & Stepan, 1996; Maravall & Przeworski, 2003; Baylies & Szeftel, 1997; O’Donnell, 1998). However, the role of foreign aid in developing the judiciary has thus far received limited attention, as democracy promotion efforts historically emphasized elections.Footnote 1 As the limits of elections for democratization have become clear in the past decade, donors have turned their attention to efforts to democratize justice systems through targeted judicial reforms. These reforms are have taken many forms, including efforts to “open” judicial selection processes by expanding the number of actors participating in the process of appointing judges to courts, with the goal of altering incentives in such a way as to make future attacks on the democratic process more difficult (Driscoll & Nelson, 2012, 2015). Underscoring the importance of the rule of law for democratic stability and consolidation, Carothers (1998: 4) thus advocates a shift in attention and resources towards judicial reform.

In addition to its importance for democratization and human rights, the judiciary also matters for economic development. A large literature shows that judicial autonomy, once enforced, is strongly associated with sustained growth because independent courts improve property rights protection and lower transaction costs associated with capital investment (Williamson, 1985; Henisz, 2000; Feld & Voigt, 2003; Haggard & Tiede, 2011).Footnote 2 By increasing judicial autonomy, governments increase their credibility vis-`a-vis investors, which in turn facilitates investment and economic development (Williamson, 1985; North, 1990; Acemoglu et al., 2001; La Porta et al., 2004). Further, judicial autonomy can promote long-term economic growth by providing institutional checks on erratic government policies (Henisz, 2000); by curbing corruption to secure equal treatment and procedural fairness in interactions between public and private actors (Haber et al. 2003); and by expanding the state’s institutional capacity (Haggard & Tiede, 2011).

Although donor governments increasingly hail judicial autonomy as a key element of democratic stability and economic development in aid-recipient countries, to date there is little systematic evidence that evaluates the efficacy of outside efforts to reform judicial systems and, ultimately, promote judicial independence abroad. Our study examines how external democracy promotion efforts influence judicial independence in developing countries. Donor governments across the OECD often treat judicial reform as a guarantor of judicial autonomy, which is seen as important for improving the investment climate. However, incumbent governments have competing incentives when it comes to the pursuit of judicial reforms – while reforms encouraging judicial autonomy can potentially help the incumbent improve development and economic growth (Tate, 1993; Whittington, 2003; Ginsburg, 2003; Hirschl, 2004; Wright, 2009; VonDoepp, 2009; Yadav & Mukherjee, 2014), reforms can also require leaders to submit to some limits on their behavior. Incumbents may have strategic reasons for pursuing reforms domestically, perhaps so as to better control the specific ways in which their power is circumscribed. Alternatively, they can choose to rely on donors to assist them in this process. Under what conditions does foreign aid help to improve judicial autonomy?

We argue that donor efforts to promote judicial independence are most likely to shape the judiciary in places where relinquishing control over the judiciary is particularly pressing for leaders. We argue that this is likely the case in recipient countries with weak state institutions, limited domestic revenue capabilities, and high dependency on foreign aid. In these environments, recipient governments often lack the capacity to design and implement credible domestic reforms that improve judicial autonomy, but they are under pressure to respond to expectations surrounding judicial autonomy so as to attract external revenue sources and support their budgetary needs. We argue that this susceptibility provides a fertile ground for the successful implementation of democracy and governance initiatives that seek to strengthen the independence of the judicial sector. Our empirical results are consistent with our theory: donor efforts to promote judicial reform are more likely to succeed in low-capacity states than in high capacity states.

This study contributes to our understanding of democracy promotion in two ways. First, it advances an argument linking foreign aid to judicial independence through the mechanisms of donor investment in democracy promotion and judicial reforms in particular.Footnote 3 Second, our argument contextualizes the effect of democracy promotion by accounting for important variation in state capacity across aid-receiving countries. Our empirical findings thus contribute to the burgeoning research in foreign aid that examines the conditions under which donors may promote democracy and development abroad.

2 Democracy aid, state capacity, and the judiciary

By the mid-1990s, it had become clear that problems in the judiciary were obstacles to improving governance and accountability in many democratizing countries. As donors became aware that the existing focus on free and fair elections was insufficient for democratic consolidation, they turned to the judicial sector for targeted investment. As Lord Paddy Ashdown noted in 2002 shortly after taking up the post of U.N. High Representative for Bosnia and Hercegovina: “[i]n Bosnia, we thought that democracy was the highest priority and we measured it by the number of elections we could organize. In hindsight, we should have put the establishment of rule of law first, for everything else depends on it: a functioning economy, a free and fair political system, the development of civil society, and public confidence in police and courts. We should do well to reflect on this as we formulate our plans for Afghanistan, and, perhaps, Iraq.”Footnote 4

Today, the rule of law as a concept is universally accepted in the donor community as a critical stepping stone for promoting democratic consolidation and development. The judiciary is a key component of the rule of law, ensuring the application of the law in an independent, fair, and efficient manner, and requiring independence from government intervention. Important guarantees of judicial autonomy include autonomy from the government in matters of judicial review, the appointment of judges, and terms of tenure, as well as sufficient resources to ensure the proper operation of the justice system, including the training of judges and access to justice programs (Hanssen, 1999; Domingo, 2000; Russell, 2001; Ginsburg, 2003; Hammergreen, 2007). To strengthen these and other guarantees, donors have spearheaded judicial reform efforts across the world by financing institutional reforms in law, court, and judicial administration, and by investing in the expanding and deepening the legal community in the context of broader democracy and governance programs. Such reforms help to strengthen both de jure and de facto elements of judicial independence.

Though judicial reform is a complex area of intervention—involving a variety of actors in courts, administration, and the legal society—the donor community’s modality for promoting institutional reform is very similar across projects. Donors typically provide technical expertise to aid-recipient governments, assist in the implementation of judicial projects, and actively monitor whether institutional change has taken place. For example, Canada’s $17 million investment in Mali’s justice development system in 2010 was implemented by the Malian Ministry of Justice (AidData   2016). However, the implementation relied on technical expertise and guidance from international experts who were hosted by the aid-recipient ministry. These experts not only shaped the program design and assisted in the implementation process, they also assumed monitoring and oversight functions on behalf of the donor government to ensure that the project was effectively implemented. While not all reform is an unequivocal boon to judicial autonomy, the common structure shared by many internationally-funded projects and its emphasis on technical capacity-building helps to create a class of professionalized bureaucrats. This cadre has the ability to develop their own professional norms and expertise, and provides qualified professionals with the structure to begin building autonomy. In essence, building technical capacity also creates the possibility for agents to engage in moral hazard, making it more difficult for political leaders to control agents of the judicial apparatus.

While the promotion of judicial autonomy is important for donors, incumbents also have their own incentives to embark on judicial reforms. As a large body of literature has suggested, judicial reform and autonomy are directly linked to economic growth and development via investment: by increasing judicial autonomy, governments increase their credibility vis-`a-vis investors, which in turn facilitates investment and economic development (Williamson, 1985; North, 1990; Acemoglu et al., 2001; La Porta et al., 2004). In addition, judicial autonomy can promote long-term economic growth by providing institutional checks on erratic government policies (Henisz, 2000); by curbing corruption to secure equal treatment and procedural fairness in interactions between public and private actors (Haber et al. 2003); and by expanding the state’s institutional capacity (Haggard & Tiede, 2011). Incumbents may also find strengthening of the judiciary advantageous when public support for particular rights is strong, as allowing limited autonomy to the judiciary may be less costly than widespread repression. Judicial reforms are not without risks for the incumbent, however, as it may be difficult to subsequently reverse reforms that can constrain the incumbent.Footnote 5 Incumbents can strategically elect to embark on prescribed reforms in order to limit potential threats to their rule in the future, by arguing that some issues are not legal matters or creating courts with specific jurisdictions to handle politically sensitive cases (Balasubramaniam, 2009; Cheesman, 2011) or even by strategically employing international arbitration in some domains on a case by case basis (Massoud, 2014).

Consistent with Klug (2000) and Landes and Posner (1975), we argue that incumbents in developing countries have incentives to deliver credible policies to investors and donors. To achieve this goal, incumbent governments can either design and implement credible indigenous reform proposals or rely on external assistance. In those instances where the incumbent has the willingness and resources to credibly implement reforms, we expect that they choose whether to do so and act accordingly. Because they have the capacity to engage in credible reforms, the decision to seek external assistance is one of reinforcement, rather than initiative – these regimes have already decided on their desired course of action and a decision to seek external buy-in is secondary. However, in instances where the incumbent lacks resources and credibility to implement reforms, we expect that they will seek external assistance. Whether incumbent governments resort to external assistance in this context, of course, has direct implications for the efficacy of aid in promoting judicial autonomy abroad: we would only expect aid to influence judicial autonomy in environments where indigenous reforms efforts are either not taking place or fall short of achieving credibility. We turn to state capacity as an important prerequisite for the implementation of credible judicial reform: while some aid recipients have the resources and governance systems in place to allow for the design and implementation of reforms, others lack the capacity to do so.Footnote 6 As a concept, state capacity has multiple dimensions that are analytically distinct, yet interrelated and mutually supporting: such dimensions include extractive, coercive, and administrative capacities (Hendrix, 2010; Hanson & Sigman, Forthcoming).Footnote 7 As our argument centers on the state’s ability to design and implement credible judicial reform proposals, we conceptualize state capacity in terms of administrative capacity. Borrowing from Weber (1978), Hanson and Sigman (Forthcoming: p.5) define a capable administration as requiring “technical competence, trusted and professional state agents, monitoring and coordination mechanisms, and effective reach across the state’s territory and social groupings.” While state capacity does not allow us to distinguish fine-grained variation in a state’s commitment to empowering the judiciary, we believe it helps to address a more general sense of the state’s ability to allocate resources to its many institutions.

If a state’s administrative capacity is relatively strong, incumbent governments can push through judicial reforms to increase judicial autonomy when they desire to do so. If the administrative capacity is low or even absent, judicial reforms, as other types of institutional reforms, are difficult to pursue even when there is a political willingness. We claim that it is in the latter environment where donors can play an important role in promoting judicial autonomy. Through targeted investments in the judiciary branch, donors can strengthen administrative capacities. Specifically, donor-sponsored expert advice assists the government in designing policy and managing its implementation. External monitoring mechanisms are often built into donor-sponsored projects, as is typically the case for investments in democracy and governance promotion. These mechanisms can help recipient administrations reduce corruption and inefficiencies around the implementation of projects (Gibson et al., 2015; Slough & Fariss, 2021). Finally, incumbent governments in low capacity environments are under particular pressure to respond to demands for judicial autonomy in order to attract external revenue to finance their budgetary needs. This susceptibility provides a fertile ground for the successful implementation of donor investments in judicial reform.

One example of a case where foreign aid has helped to promote judicial autonomy in a relatively low-capacity state is Kenya. For many decades after Kenya’s independence, the judiciary functioned as an arm of the executive, used primarily to facilitate and rationalize executive control. Though Kenya’s 1964 Independence Constitution included minimal safeguards for the judicial sector, it did not provide an effective framework for the balance of power between the different arms of government. As such, the provisions were inadequate to enable Kenyan courts autonomy from government influence. Kenya’s judicial system was thus incapable of effectively checking the excesses of the executive, with anti-establishment court cases routinely ruled in favor of the executive (Murungi, 2005). The legitimacy of courts suffered accordingly. For example, in the aftermath of the 2007 elections, which exhibited strong evidence of electoral fraud by the incumbent, the opposition leaders refused to submit to the jurisdiction of the courts to resolve the election dispute, calling for mass action and rejecting the judiciary’s legitimacy as an impartial and independent arbiter.Footnote 8 The lack of trust in judicial institutions contributed to protests and election violence that caused considerable suffering for thousands of people (Abuya, 2009).

Though donors supported and systematically funded projects that were designed to strengthen the rule of law prior to the 2007 Kenyan elections, such activities increased post-2007. Donors have worked with the Ministry of Justice, as well as judicial commissions, to help prepare and implement reform policies that allow for more balanced power among the branches of government, and specifically, a more autonomous judiciary. In 2010 Kenya adopted a new constitution, repealing the 1964 Independence Constitution. This new constitution strengthens the autonomy of the judiciary sector by weakening executive control over the appointment of lower and higher court judges; this is accomplished by assigning shared appointment powers to the legislature. The new constitution also subjects the executive to more stringent accountability procedures in its relations with the judiciary sector (Kramon & Posner, 2011).

Donor efforts have continued unabated. One such example includes the work by the multi-donor funded International Development Law Organization (IDLO), an intergovernmental organization devoted to strengthening the Kenyan judiciary with particular focus on court independence in electoral disputes. IDLO’s work is funded by many OECD donors, and includes the training of judicial officers and court staff on the new constitution and electoral laws, the promotion of ownership, leadership, and coordination of the electoral dispute resolution mechanism by the judiciary, the delivery of comprehensive, skill-building programs for judges and their support staff, as well as engaging and building the capacity of non-legal partners in the electoral process.Footnote 9

When Kenya’s Supreme Court declared the 2017 presidential election as legally void, it dealt a legal blow to incumbent President Kenyatta, who had been initially been declared the victor of the August poll. According to the IDLO, this declaration demonstrates that external support of independence of the judiciary and investing in judicial capacity helps to reinforce democracy. Emphasizing their intention to continue working to strengthen the Kenyan judiciary, IDLO added that “the Kenyan judiciary can effectively and efficiently handle electoral disputes in line with the Constitution.”Footnote 10 The Kenyan case provides an example of the role that donors’ capacity-building efforts play in environments where the Ministry of Justice and other relevant agencies had only limited administrative capacity to design and promote reforms.

When recipient countries have sufficient administrative capacity to design and implement reforms, however, we expect foreign aid to be less central to the success of reform initiatives. The evolution of the judiciary in Jordan illustrates the ways in which higher capacity states can engage in reform, with foreign aid playing a less relevant role in the process. Until the late 1990s, Jordan’s judiciary was not guaranteed autonomy by the Constitution.Footnote 11 Under King Abdullah II, Jordan’s commitment to promote legal reforms has increased, tied explicitly to economic development (Burgis, 2007), and with the suggestion that judicial reforms would “help translate the country’s reform plans into facts on the ground, including economic reform and efforts to increase the country’s economic competitiveness.”Footnote 12 Specific areas for reform activities included the strengthening of the efficiency of the judicial inspection methodology and developing the institutional capacity of the courts.Footnote 13 Though resistance to reforms by traditional, conservative elites has often stalled the reform agenda, reformers have progressively gained more support for their efforts.Footnote 14

Reforms to Jordan’s judicial system have taken place incrementally over the past two decades, and most were domestic initiatives. In 2005, the King directed the government and a national committee to propose laws that would guarantee judicial autonomy and competence, and in 2012 the first Constitutional Court was sworn in. These actions were followed by a 2013 amendment to judicial law that allows the judiciary to operate without political interference.Footnote 15 In 2016, King Abdullah II established the Royal Committee for Developing the Judiciary and Enhancing the Rule of Law, which produced over 40 specific recommendations to further improve the judiciary system with a view towards strengthening judicial autonomy.Footnote 16 According to the King,“ the economic and investment environment cannot be improved without an effective and independent judiciary.”Footnote 17

Donors have also contributed to these domestic reform initiatives, supporting the government’s actions. For example, the European Union sponsored “Technical Assistance for Institutional Strengthening of the Ministry of Justice,” a 1.1 million euro initiative that trained judges, clerks and legal professionals to build modern legal case management systems (AidData   2016). The World Bank has contributed by conducting training programs to upgrade Jordanian judges’ capabilities, as well as the skills of prosecutors in Amman. The “Jordan Legal and Judicial Reform Learning Program” focused on analyzing and discussing strategies to secure private property and oversee administrative agencies.Footnote 18 In both cases, donors funded the project after the Jordanian government had already prioritized efforts to reform the judiciary and had demonstrated sufficient administrative capacity to implement the projects effectively. In this environment, the role of donors is more complementary, supporting domestic processes that are already underway, and is thus unlikely to have an independent effect on judicial autonomy. This discussion suggests that a recipient’s administrative capacity is an important factor that conditions the efficacy of externally funded judicial reform efforts. Our argument generates testable empirical propositions:

  • Hypothesis 1a: Donor efforts to promote judicial reform are most likely to have a positive effect on judicial autonomy in countries where state capacity is low (and need for external assistance to design and implement reform is high).

  • Hypothesis 1b: Donor efforts to promote judicial reform are least likely to have a positive effect on judicial autonomy in countries where state capacity is high (and need for external assistance to design and implement reform is low).

2.1 Data

The sample period (1992–2015) corresponds to the first two and a half decades after the end of the Cold War. During this time, donors became more likely to attach political conditions to aid projects and became more selective in distributing aid resources – both among different countries as well as among different types of recipients within countries (Crawford, 1997, 2001; Dietrich, 2016, 2021; Molenaers et al., 2015). Further, donors continually increased democracy and governance aid during this period, in contrast to the Cold War when donors rarely provided direct democracy assistance. The sample includes all aid eligible countries with democratic or autocratic regimes and populations over 1 million (in 2009).Footnote 19 The main analysis employs eight three-year panels: 1992–1994; 1995–1997; 1998–2000; 2001–2003; 2004–2006; 2007–2009; 2010–2012; and 2013–2015.

Data on judicial independence

Our argument generates predictions about the types of states where foreign aid is likely to influence judicial independence. We employ data on de facto judicial independence from Linzer and Staton (2015). This measure focuses on de facto judicial independence as contingent on both autonomous judging as well as judges’ ability to make decisions that constrain other actors (Linzer & Staton, 2015: 225). This measure aggregates information from twelve direct and indirect indicators using a latent variable model.Footnote 20 We also check the robustness of the main results using data from the Varieties of Democracies project.Footnote 21 Using data on de facto judicial independence helps us to better capture positive and negative changes that occur in judicial practice, even when they are not necessarily reflected in changes directly to the de jure rules and institutions.

Aid data

We use democracy aid commitment data from AidData   3.1.Footnote 22 We aggregate aid commitments at the recipient-country-year level.Footnote 23 Our measure of democracy aid subsumes the aid spending that is earmarked for the “Government and Civil Society”, per the AidData coding manual. It comprises projects that fall into one or more of the following areas including economic and development policy/making, public sector financial management, legal and judicial development, government administration, strengthening civil society, conflict prevention and resolution, security assistance (including civilian peace-building, reintegration of former combatants into the economy, assistance to control the proliferation of small arms and light weapons. Democracy aid also incorporates distinct delivery modalities. Project examples for democracy and governance aid include those that directly target policy planning in areas such as fiscal and monetary policy, institutional capacity building, and structural reform. DGA also finances tax assessment procedures, legal and judicial development, and constitutional development. Donors use DGA to support government administration by helping finance civil service reform and government infrastructure. In addition to financing governance-related activities, DGA also flows to non-state development actors including civil society groups and political parties to support community participation and strengthen political accountability. However, as Dietrich and Wright (2015) show, the bulk of DGA flows to incumbent governments and only a small fraction directly funds non-state actors.

Donors also earmark specific programs to invest in judicial reform in recipient countries. These programs include projects focused on legal training and education, institutional strengthening of legal and judicial systems, as well as constitutional development.Footnote 24 Traditionally, aid in this sector is subsumed under the broader category of democracy aid. For the purposes of modeling exogenous aid flows using an instrumental variables approach (see below), we continue to group judicial aid within the category of democracy aid. We do this because the excluded variable we use in our two- stage analyses does not predict small categories of assistance very well, as is the case for judicial aid programs. Importantly, however, we also employ judicial aid as the explanatory variable, with very similar results to tests that employ democracy and governance assistance.Footnote 25

We leverage disaggregated project-level information to construct measures of aid flows in different sectors. We measure aid as the logged value of the lagged three-year (i.e. panel) average of constant dollar aid per capita.Footnote 26 The time series for smaller categories of aid, such as democracy assistance, show large variation from year to year, so the three-year panel set-up using averages smooths these trends to better capture inflows over the prior period.Footnote 27

The left panel of Fig. 1 plots the global time trend in aid commitments and judicial independence, showing average of per capita aid commitments (log, constant dollar) and the level of de facto judicial independence (scaled). Both data series trend upwards over time, but democracy aid is increasing rapidly over this period whereas judicial independence is rising at a much slower rate. Given the increasing time trends, we model a common time trend with year-effects. The right panel shows democracy aid commitments as well as the share of funds in this sector that are specifically allocated to judicial reform. While democracy aid is increasing over time, judicial aid remains a small fraction of total democracy assistance throughout the post-1990 period.

Fig. 1
figure 1

Foreign aid and judicial independence, 1990–2015

State capacity data

To measure state capacity, we rely on new data from Hanson and Sigman (Forthcoming). They use a measurement model to estimate latent state capacity across the world for over five decades. This approach aggregates information from 21 manifest indicators (i.e. extant data sources) that measure three related subcomponents of state capacity: administrative, coercive, and extractive. Administrative capacity encompasses concepts such as budgetary management, bureaucratic quality, civil service confidence, and the efficient implementation of government decisions, while extractive capacity entails effectiveness of revenue mobilization, taxes as a share of various types of revenue, and statistical capacity (e.g. frequency of census). Finally, coercive capacity captures features of the security (e.g. government monopoly on the use of force, military spending and personnel) and geographic environments (e.g. fractal borders and mountainous terrain). In the analysis below, we use the lagged two-year moving average of state capacity and standardize this variable.

Covariates

In the main models reported below, we condition on potential confounders.Footnote 28 Four covariates capture domestic political conditions that correlate with foreign aid and likely influence judicial politics: democracy from Coppedge et al. (2020); an indicator of whether there has been a successful coup in the observation year or the prior year, from Powell (2012); an indicator of an election period from Hyde and Marinov (2012); and regime duration as a measure of how long the current political regime has been in power, from Geddes et al. (2014). More economically developed countries are less likely to receive aid but more likely to have well- developed socio-political institutions, including judicial independence. Thus, we might condition on measures such as GDP per capita and economic growth. However, we omit these from our base line specification because GDP per capita and state capacity are highly collinear, and economic growth is plausibly a post-treatment outcome.Footnote 29 We view this set of covariates as potential confounders and therefore include them in the reported empirical models. To ensure that the model specification with respect to covariate selection is not driving our reported results, we test specifications without control variables as well as specifications with additional time-varying control variables such as GDP per capita, economic growth, population size, media freedom, and constitutional duration.Footnote 30

2.2 Estimation

Donors may make aid commitments based on a number of unobservable factors that vary by recipient country. For example, donors who want to foster economic growth may select recipient countries where the institutional environment for promoting investment is strongest; or strategic donors may send more aid to geo-politically important countries. Even if donors, perhaps for ideological reasons, are committed to sending aid to a recipient country with a poor investment climate—allocating more aid to former colonies, for example—donors may still bypass the government in the recipient country and instead fund non-state actors (Dietrich, 2013, 2021).

Further, Western donors have substantially increased democracy aid over the past two decades, leading to a strong time trend in the aid data. To model judicial autonomy, we therefore begin with a linear model and include country and year effects as well as, in some specifications, covariate adjustment:

$$ {JI}_{i,t}={\propto}_0+{\beta}_1{Aid}_{i,t-1}+{\beta}_2{X}_{i,t-1}+{\eta}_t+{\zeta}_i+{\varepsilon}_{i,t} $$
(1)

where JIi,t is judicial independence, Aidi,t   −   1 is the lagged (one-period) aid, Xi,t   −   1 is a set of covariates, ηt are panel-year effects, ζi are recipient country effects, and εi,t is the error term. This specification attempts to account for potential confounders, including unobservable country- specific factors, and uses a lagged of the treatment variable to address simultaneity bias and reverse causation.Footnote 31

2.3 OLS results

The first column of Table 1 reports the OLS estimates, with no covariates. The estimate for Democracy aid is positive and statistically significant at the 0.05 level, indicating that, on aver- age, democracy aid is positively associated with judicial independence. The second column adds covariates; and the estimate for Democracy aid is small and not significant. To test the main empirical expectation, we add an interaction term to the specifications, in columns (3) and (4): Aid × Capacity. In these models, the estimate of βAid   +   βAid   ×   Capacity reflects the marginal effect of aid at varying levels of state capacity.Footnote 32 The estimate for the interaction term in both columns is negative and statistically significant, indicating that the marginal effect of democracy aid declines as state capacity increases. The estimated marginal effect from the model in column (4) for low capacity states (10th percentile of state capacity) is 0.167 and statistically significant, while the marginal effect in high capacity states (90th percentile) is slightly negative (−0.031).

Table 1 Democracy aid and judicial independence

One estimates of a covariate is in the expected direction in column (4): democracy is more judicial independence. Other covariates are not significant, in part because the effect of elections and coups may be short-lived. The estimate for democracy (0.255) is larger than the marginal effect estimate for democracy aid at low capacity levels (0.167), but of the same order of magnitude. This suggests that the substantive effect of democracy aid in low capacity states may slightly smaller than the democracy effect.

2.4 Estimate sensitivity with selection on unobservables

Estimates of the effect of observed aid flows on macro-political outcomes, such as judicial independence, may be biased from selection on unobservable factors. Following the work of Altonji et al. (2005) and Oster (2017), we calculate the bounds of this potential bias in the OLS estimate of βDemocracyAid. This analysis uses information from changes in the point estimates and R2 values derived from a model specification without any ‘controls’ and from a specification that includes covariates as ‘controls’, provided the ‘control’ variables are added to the specification to mitigate bias. Importantly, the test only provides credible bounds for causal interpretation of the estimate of interest if “the omitted variable bias after inclusion of controls is proportional to the coefficient movements and the ratio of the movement in R-squared with inclusion of the observable control to the expected movement in R-squared with the inclusion of the unobservable controls” (Oster, 2017: 2). While we cannot directly estimate how including unobservables in the specification (in addition to the observed control variables) would influence the estimate of βDemocracyAid and the resulting R2, we can make plausible assumptions about (a) the extent to which the R2 would change when adding unobservables to the specification, and (b) the extent to which the resulting change in the estimate of βDemocracyAid is proportional to the change in βDemocracyAid when adding observed covariates (i.e. ‘controls’) to a baseline specification that only includes the treatment variable of interest.

Three-year panels from 1992 to 2015; 117 countries; N   ×   T   =   775; HAC errors reported; *p   <   = 0.05. Region time-trend in (10) is time   +   time2.

Define δ as the extent to which unobserved variables are as important as the observed variables in producing a treatment effect that is zero. When δ   =   1, the unobserved variables are equally important as the observed ones; and δ   >   1 implies the unobserved variables are more important than the observed ones. Oster (2017: 20) suggests that δ   =   1 is an appropriate upper bound on δ because the control variables in the specification should already be selected because researchers believe ex ante these are the most important. Now define the hypothetical R2 of a model with both observed and unobserved covariates as Rmax. If Rmax   =   1, the observed and unobserved covariates explain all the variation in the outcome, with no idiosyncratic component to the outcome data generating process.Footnote 33 In this application, we set Rmax   =   1 because including the recipient country- and year- effects in the specification yields an R2   >   0.95; thus we allow unobservables to explain the remaining variation in the outcome variable.

We then estimate the treatment effect under the assumption that Rmax   =   1 and δ   =   1. In the OLS model reported in column 2 of Table 1 (no interaction term), the estimate of βDemocracyAid is 0.037; and the estimated treatment effect when setting Rmax   =   1 and δ   =   1 is almost the same (0.029). Next, we split the sample into two groups: low capacity and high capacity states.Footnote 34 We then estimate a treatment effect for each sub-sample under the assumption that Rmax   =   1 and δ   =   1. For low capacity states, the estimate is 0.051 – roughly one-third the size of the estimate (0.162) when setting δ   =   0 (i.e. no unobservables). In high capacity states, the treatment effect when setting Rmax   =   1 and δ   =   1 is −0.029, which almost identical to the estimate assuming no unobservables (−0.023).

To illustrate how the estimates change under different assumptions, we conduct similar tests but vary δ from 0 (which implies unobservables have no effect on the outcome) to 1.25 (which implies unobservables are 25% more important than observed variables included as ‘controls’).Footnote 35

Figure 2 shows how the estimated treatment effects for βDemocracyAid for low and high capacity countries change across the range of values for δ. When δ   =   0, the estimates are similar to those reported in the bottom panel of column 4 in Table 1: 0.167 for βAid   +   (βAid   ×   Cap. × Low cap.) and   −   0.031 for βAid   +   (βAid   ×   Cap. × High cap.). As δ increases, the estimates of the treatment effect decline but the estimate for aid in low capacity states remains greater than 0 up to the point where δ   =   1.25, indicating that unobservables would have to explain all the remaining variation in the outcome but also be 25 more important than the observed covariates.

Fig. 2
figure 2

OLS estimate sensitivity

2.5 Modeling exogenous aid flows

A second approach to estimating the causal effect of aid on judicial independence addresses concerns that donors may select recipients based on unobserved time-varying factors that contribute to judicial autonomy. The OLS estimate for aid would be biased upwards if, for example, donors give more aid to recipient governments where they expect past improvements in good governance— including judicial independence—to continue apace. Rewarding countries “moving in the right direction” with more funding would result in an upwardly biased estimate for aid. Similarly, if democracy aid intended to help facilitate a fair multiparty election only flows to recipient countries where donors expect improvements in judicial autonomy, the estimate of aid would be upwardly biased. We addressed this concern in the last section by specifying a lower bound for the OLS estimate of βDemocracyAid under selection on unobservables.

However, an OLS estimate might be biased downwards if governance aid disproportionately flows to countries with a poor institutional environment. For example, donors might be more likely to fund democracy promotion activities, such as electoral and judicial administration, in countries with weak courts that are unlikely to develop judicial independence on their own. Donors, for instance, largely funded the 2006 election in the Democratic Republic of Congo (DRC), which in the decade prior to these elections had the seventh-lowest level of judicial autonomy in the world.Footnote 36

Identification with an excluded instrument

To address endogeneity concerns, we develop an instrument for use in a two-stage model. The time-varying information in the excluded instrument reflects a feature of donor governments that is plausibly exogenous to judicial politics in recipient countries: the number of women in parliament in each donor country-year (WomPj,t), from the Inter-Parliamentary Union database. Scholars are in broad agreement that the number of women in parliament in a donor country is associated with increases in the amount of aid (Breuning, 2001; Lu & Breuning, 2014; Hicks et al., 2016). There is, however, considerable debate regarding whether this is the result of differences in women’s policy preferences (the “women’s values thesis” described in Breuning (2001)), or whether the relationship between foreign aid and women in parliament is a reflection of greater gender equality in the donor country (Lu & Breuning, 2014). The cross-sectional information in the instrument is the probability that an aid-eligible country receives aid from a donor in the democracy and governance (including judicial) sector (\( {\overline{P}}_{i,j} \)). This instrument strategy therefore combines exogenous information from the donor with endogenous cross-sectional information on donor selectivity (Nunn & Qian, 2014; Dreher & Langlotz, 2020; Dreher et al., 2019). Footnote 37However, because the outcome model includes recipient country-effects, the endogenous information in \( {\overline{P}}_{i,j} \) is modeled directly, and thus the interactions of the endogenous variable (\( {\overline{P}}_{i,j} \)) with an exogenous one (WomPj,t) can be treated as exogenous (Nunn & Qian, 2014; Bun & Harrison, 2018). To construct the excluded instrument, we first estimate a “zero” stage equationFootnote 38:

$$ {Aid}_{i,j,t}={\propto}_0+{\gamma}_1\left( Wom{P}_{j,t}\times {\overline{P}}_{i,j}\right)+{\varepsilon}_{i,j,t} $$
(2)

Following Dreher and Langlotz (2020), we then aggregate the predicted values from this equation across all donors, j, for each recipient year (i,t) to construct the excluded instrument for use in a standard 2SLS model:

$$ {\hat{Aid}}_{i,t}=\sum \limits_j\left[{\hat{\gamma}}_1\left( Wom{P}_{i,t}\times {\overline{P}}_{i,j}\right)+{\varepsilon}_{i,j,t}\right] $$
(3)

This instrument strategy relies on the differential effect of women in parliament on the level of D & G aid a donor provides to a recipient country with a high relative to a low probability of receiving aid from that particular donor. The identifying assumption is that judicial independence in aid eligible countries with differing probabilities of receiving D & G aid will not be affected differently by changes in the number of women in parliament in donor countries, once we model recipient country- and year-effects (Dreher & Langlotz, 2020; Dreher et al., 2019).

This identification strategy assumes that the excluded instrument, derived from \( {\overline{P}}_{i,j} \)and WomPj,t, is not spuriously correlated with the outcome, judicial independence. Spurious correlation may occur if the time trend in time-varying exogenous information (WomPj,t) is correlated with the time trend in the outcome variable (JI) and that correlated time trend varies by the level of the endogenous cross-section component of the instrument, aid regularity or \( {\overline{P}}_{i,j} \)(Christian & Barrett, 2017). Online Appendix B explores this possibility to show that while there is a strong (increasing) time trend in WomPj,t, this time trend is relatively uniformly increase across levels of aid regularity (\( {\overline{P}}_{i,j} \)). Further, the time trend in the JI outcome variable is nearly flat and consistently flat across levels of aid regularity. This evidence, shown in Fig. B-3, suggests that the instrument is not spuriously correlated with the outcome via an unobserved common time trend that varies systematically by aid regularity.Footnote 39

We further investigate the possibility of a spurious instrument by conducting a randomization placebo test in which we randomly assign aid values within each panel period to other countries in the sample for the same panel period while preserving the true values of aid receipt for all countries that receive no democracy aid in a given period (Christian & Barrett, 2017: 32). This test preserves the meta-structure of the observed data while creating pseudo-data that should not be predicted very well by the excluded instrument and thus should attenuate estimates of the endogenous variable. Online Appendix Figure B-5 shows the results of 1000 iterations of this test; we find that the distribution of the estimated pseudo-data for the endogenous variable shifts towards zero and that most of the simulationed pseudo data sets yield first stage correlations that are very weak (i.e. very small F-statistics).

This identification strategy also relies on the assumption that the instrument does not influence the outcome via mechanisms other than D & G aid, including via economic aid. In some specifications, we treat economic aid as a confounder by adjusting for it in the specification. However, even treating economic aid as a confounder cannot rule out the possibility that the instrument exclusion restriction is violated via economic aid. We therefore test whether the instrument predicts democracy aid while adjusting for economic aid (because the two types of aid are correlated) and, conversely, whether the instrument predicts economic aid while adjusting for democracy aid. This latter approach reflects the logic of a placebo test: does the excluded instrument predict another causal pathway (economic aid) through which it could shape the outcome (judicial independence)? In specifications that treat democracy aid as the endogenous variable to be predicted by the instrument and that treat economic aid as an observed confounder, we find that the F-statistic for democracy aid exceeds the weak-id critical test value, indicating a strong instrument. Conversely in a placebo test where we treat economic aid as the endogenous variable and democracy aid as an observed confounder, the F-statistic for economic aid falls far below the weak-id test value, indicating a weak instrument.Footnote 40

IV-2SLS specification

Because we use a one period lag of the three-year panel average of observed democracy aid, we do the same for the excluded instrument. The set of covariates (Xi,t     1) includes: Democracy, Coup, Regime duration, and Election; while ηt is a vector of year fixed effect a and ζi is a vector of (recipient) country fixed effects. The estimated 2SLS model is the following.

$$ {JI}_{i,t}={\propto}_0+\hat{Aid_{i,t-1}}+{X}_{i,t-1}+{\eta}_t+{\zeta}_i+{\varepsilon}_{i,t}^1 $$
(4)
$$ {Aid}_{i,t-1}={\propto}_0+\hat{Aid_{i,t-1}}+{X}_{i,t}+{\eta}_t+{\zeta}_i+{\varepsilon}_{i,t}^2 $$
(5)

Because we test a specification that includes an interaction term (Aid× Capacity) which is partially endogenous, we estimate two “first-stage” equations, one for each endogenous term: Democracy aidi,t   −   1 and Aidi,t   −   1   ×   Capacityi,t   −   1. In this system of equations, we expand the (excluded) instrument set to include \( \hat{Aid_{i,t-1}} \)× Capacityi,t   −   1. This means we estimate two “first stage” equations, each with two excluded instruments: \( \hat{Aid_{i,t-1}} \)and \( \hat{Aid_{i,t-1}} \)× Capacityi,t   −   1. For these models we employ an efficient generalized method of moments (GMM) estimator and continue to report HAC errors.

The equations for the endogenous variable(s) are reported in Online Appendix Table B-1, along with a discussion of model diagnostics. In 2SLS specifications with no interaction term, the first-stage Kleibergen-Paap rank Wald F-statistics for the excluded instruments are well above the conventional cut-point of 10 and greater than the Stock-Yogo weak ID test critical values (Stock & Watson, 2008). In specifications with the interaction term, the F-statistics are smaller, reflecting the increase in variance due to modeling two endogenous variables with two variables in the excluded instrument set, but still exceed the critical value. In sum, we find no evidence of weak instruments in our specifications.

2.6 2SLS results

Column 5 of Table 1 reports results from the specification with only the endogenous variable, Democracy aid; the 2SLS estimate is negative but not statistically different from zero. Column 6 adds potential confounders; the estimate is again negative but statistically insignificant. Because the estimate that adjusts for observed confounders is smaller, a specification that omits confounders may be biased upwards. The 2SLS estimate for Democracy aid in column (6) is negative while the OLS estimate in column (3) is positive, though neither is significant.

The seventh column reports the specification with two endogenous variables, Democracy aid and its interaction with State capacity. The estimate for the interaction term is negative and statistically significant, indicating that state capacity moderates the positive effect of democracy aid.Footnote 41 Column 8 reports results from the interaction specification with covariate adjustment. The estimated marginal effect in low capacity states (10th percentile of state capacity) is 0.17, while the marginal effect in high capacity states (90th percentile) is −0.08. These estimates of the marginal effect for low (0.17) and high (−0.08) capacity states are similar in size and direction to the OLS estimates from column 4, 0.17 and   −   0.03, respectively. Thus, the 2SLS-IV results for the interaction model are similar to the OLS interaction results.

Column 9–12 present results from important robustness tests. First, we account for possible unobserved time-varying confounding by including a non-linear, geographic region-specific time trend in the specification. The estimates for key variables remain stable. Second, we add economic aid as a potential observed confounder. D & G assistance and economic aid are positively correlated and we want to ensure that estimates for democracy aid does not capture the effect of economic aid; we therefore test specifications with economic aid as a “blocker”, reported in Column 10 of Table 1. Foreign aid, particularly when targeted at governance, can independently influence state capacity. If this occurs, then the measure of state capacity would not be an exogenous regressor. To address this issue, we measure state capacity in the pre-study period as the mean level of state capacity from 1985 to 1989 for each recipient country. Importantly, D & G aid was minimal prior to the end of the Cold War; therefore, this pre-sample measure of capacity cannot have been shaped by democracy aid. Column 11 reports the specification with an interaction between pre-1990 state capacity and Democracy aid; the constituent term of the interaction (State capacity) is omitted from the specification because it is a cross-sectional measure, the variation in which is captured by the (recipient) country effects. The estimates for key variables remain stable. Finally, column 12 reports a model that uses a measure of state capacity from the Varieties of Democracy project, again with similar results.Footnote 42

Figure 3 shows how the marginal effect of democracy aid—calculated using the 2SLS estimates in column 8 of Table 1—varies across a range of values for state capacity. For low values of state capacity (less than −0.5), the estimated marginal effect is positive and statistically significant at the 0.05 level.Footnote 43 For state capacity values greater than 0.5, the estimated effect turns negative.

Fig. 3
figure 3

Aid and judicial independence (1990–2015). 2SLS marginal effects of democracy aid

Robustness tests

The Online Appendix reports numerous robustness tests. First, we reproduce the main results using the Varieties of Democracy measure of judicial independence instead of the Linzer-Staton measure (Table D-1); the second models judicial aid instead of democracy aid as the main explanatory variable (Table D-2). We examine split sample and kernel regression tests to examine common support for the interaction model (Online Appendix C) and then model the common time trend with a non-linear time trend or period fixed effects instead of year effects (Table D-3). We also test a series of specifications that add potential confounding variables to the baseline specification (economic aid, GDP per capita, economic growth, population, media freedom, legal system duration) (Figures D-1 and D-2) and specifications that drop confounding variables from the baseline specification (Tables D-4 and D-5). We then provide dynamic estimates that include a lagged dependent variable in the specification (Table D-6). Leave-one-country-out tests (Figure D-3) shows results are not dependent on outlying countries. Finally, we restructure the data into four-year panels and an annual time series (separately) and re-estimate the OLS and 2SLS models reported in the main text (Tables E-1 and E-2), again with stable results.

3 Conclusion

The findings suggest several insights into the relationship between foreign aid and judicial autonomy in developing countries. Donor governments can strengthen the autonomy of the judicial sector through investments in judicial reforms. We show that increases in democracy and governance aid contribute to strengthening the autonomy of courts in aid-receiving countries. The independent success of donor efforts, however, is limited to environments where the capacity of state institutions—and especially the administrative capacity of states—is relatively low. In environments where the capacity of state institutions is relatively high, we expect incumbent governments to pursue indigenous reform efforts when there is the requisite political willingness to do so. In those instances we expect judicial aid may serve as a complement, but not an independent factor, in strengthening the role of courts.

Our results are consistent with previous research that shows that foreign aid can effectively promote democracy and governance under certain conditions (Dietrich & Wright, 2015; Gibson et al., 2015; Slough & Fariss, 2021). In our paper, we expand our knowledge base about these conditions by accounting for important variation in state capacity across aid recipient countries. By focusing only on democracy and governance as well as judicial aid we hold constant the mechanism of aid delivery, which operates largely through the sharing of technical expertise and capacity in institution-building. Our work also resonates with that of Lake (2018) who finds that state fragility can create openings for international human rights NGOs to influence legal processes in ways that strengthen human rights, while the same is not true for countries with strong state institutions.

On its face, our study contrasts with another strand of research that argues that foreign aid contributes to economic growth only under conditions of good policy or institutions (e.g. Burnside and Dollar (2000)); although this study has been shown to lack robustness to different model specifications by a number of follow up studies (Easterly et al., 2004; Rajan & Subramanian, 2008; Dreher & Langlotz, 2020). A closer look, however, reveals that the findings of the conditional effectiveness literature had direct implications for the creation of a good governance agenda. The good governance agenda extended across international development actors, insofar as they increasingly devoted their attention to the strengthening of institutions; particularly with a focus on those countries that lacked the capacity to govern themselves (The World Bank, 1997). By focusing only on democracy and governance aid, we show that donor efforts to strengthen institutions may have ultimately paid off, with donors successfully promoting the independence of courts in countries with low levels of state capacity in a post-Cold War context.

Judicial institutions represent an important area for additional research, particularly given the focus on the rule of law in many policy arenas. Future research should examine judicial institutions with respect to the domestic factors that affect judicial autonomy, such as the role played by political competitiveness and the allocation of resources to the judiciary. While fine-grained data on budgetary expenditures is difficult to collect on a global basis, a closer examination of the ways in which governments choose to allocate resources across institutions, such as the judiciary, could help to refine the arguments presented here.