1 Introduction

Governments have the tendency to attribute good outcomes to their policies (skills) and bad ones to negative external shocks outside of their control (luck). That is certainly the case in Bolivia.

As in many other dimensions, the economic debate regarding the sources of the economic performance during the (continuing) tenure of President Evo Morales, is polarized. Opponents consider that most (if not all) of the good economic indicators are due to extraordinarily favorable external conditions.Footnote 1 Acolytes consider that a major role has to be attributed to the heterodox policies that the government has implemented, and compare favorably recent economic indicators, against the ones of, what they tend to call, the “neoliberal past” (Arce 2016).

Economists have long understood that one of the most prevalent and pernicious logical fallacies is to attribute a causal effect to a correlation.Footnote 2 Thus, a rigorous effort to ascertain how important were skills (or lack thereof) and luck, requires more than informal comparisons, declarations, and charts.Footnote 3

Answering this question is not easy, as an obvious counterfactual is not readily available. That is, ideally, we would like to know how would Bolivia have fared if faced with the same external conditions, but with different internal policies than the ones pursued by President Morales. In experimental terms, we would like to quantify what were the effects of receiving the “Evo Morales treatment,” when no natural control group is available.

This paper attempts to do so, using three methodologies. For completeness, each one is described, justified, and implemented. Presenting more than one approach helps to narrow down the possible answers, highlights their strengths and weaknesses, and provides robustness checks.

The rest of the paper is organized as follows: Sect. 2 describes and implements a methodology known as the synthetic control method. Section 3 uses a panel data model. Section 4 uses a simple dynamic stochastic general equilibrium model (DSGE). Finally, Sect. 5 concludes.

2 Synthetic control approach

Establishing a counterfactual to evaluate the relative merits of the policies implemented in Bolivia since 2006 is not simple. Ideally, we would like to have Bolivia face the same external conditions, but carry out different policies. In that case, the differences in outcomes between the treatment unit (policies implemented during Morales’s Presidency) and the control unit could be, in principle, attributed to the policies.

Abadie and Gardeazabal (2003) and Abadie et al. (2010) proposed a method that creates a statistical synthetic control that can be used as a counterfactual on a given treatment. Closely related to our approach, Grier and Maynard (2016) applied this method to assess the economic consequences of Venezuela’s Hugo Chavez.

This section describes the methodology, discusses practical issues of its implementation, and presents its results, when applied to Bolivia.

2.1 The method

As the ideal experiment, in which the systematic difference among two groups is clearly defined, is generally not available in social sciences, causal inference about the effects of events requires the development of different techniques. When there are several control and treatment units, facing similar environments, with or without common trends, a number of econometric techniques can be used to measure average treatment effects on the treated.Footnote 4

In the present circumstances, there is only one treatment unit (Bolivia, under the Presidency of Evo Morales) and no natural control units that can be used as counterfactuals. As Grier and Maynard (2016) for the case of Venezuela, we want to evaluate how different variables would have evolved, without Evo Morales and his policies.

Synthetic control methods were specifically developed to address issues like this one. Intuitively, we want to construct a synthetic Bolivia that is a weighted average of other countries, and that closely resembles conditions in Bolivia prior to the “treatment,” which, in this case, is Evo Morales taking office in 2006. If the synthetic control captures other influences common to Bolivia, we use this synthetic Bolivia to compare the effect of Evo Morales on different outcomes.Footnote 5

Following Abadie and Gardeazabal (2003), let \(X_{1}\) be a k \(\times\) 1 vector of pre-treatment observations of economic and social indicators of the treatment unit (Bolivia).Footnote 6 Let \(X_{0}\) be a k \(\times\) N matrix which contains k observations of the same variables as \(X_{1}\), but for the N countries considered to build the synthetic control. Let V be a k \(\times\) k diagonal weighting matrix that reflects the relative importance of the k indicators considered in \(X_{0}\) and \(X_{1}\). Given V , the objective is to find the N \(\times\) 1 vector of weights \(W\left( V\right)\) that minimizes the objective function:

$$\begin{aligned} W\left( V\right) =\underset{W}{\arg \min }\left( X_{1}-X_{0}W\right) ^{\prime }V\left( X_{1}-X_{0}W\right) , \end{aligned}$$
(1)

subject to the constraints that each element of W satisfies that \(w_{i}\ge 0\) (\(i=1,2,...,N\)) and \(W^{\prime }\iota =1,\) where \(\iota\) is an N—vector of ones.

As in Abadie and Gardeazabal (2003), let \(Z_{1}\) be a j \(\times\) 1 vector of pre-treatment observations of the variable that we are interested in comparing. Let \(Z_{0}\) be the j \(\times\) N matrix which contains j observations of the same variable of interest, for the N potential controls. Define \({\widehat{V}}\) as the nonnegative diagonal weighting matrix that solves:

$$\begin{aligned} {\widehat{V}}=\underset{V}{\arg \min }\left( Z_{1}-Z_{0}W\left( V\right) \right) ^{\prime }\left( Z_{1}-Z_{0}W\left( V\right) \right) , \end{aligned}$$
(2)

so that \({\widehat{W}}=W\left( {\widehat{V}}\right)\) is the vector of weights that minimizes (1), given the matrix V that minimizes (2).

Several observations are in order. First, given V, the minimization of (1) is simple as it corresponds to a quadratic programming problem with linear constraints that has an analytical solution. Second, although the simultaneous optimization of (1) and (2) could be conducted, the objective function is no longer quadratic, and numerical methods would be required. Third, a simpler way to proceed is to apply a sequential approach, in which we first consider a wide variety of candidates of V, obtain the value of W that minimizes (1) for each candidate, and evaluate which of those candidates minimizes (2). This procedure is numerically more stable than the simultaneous approach, as long as the candidates of V are dense enough. This is the approach that we pursue here.Footnote 7

Once the optimal weights, \({\widehat{W}}\), are obtained, we can evaluate if, before the treatment, the synthetic control thus generated resembles the economy that we are trying to replicate. For that, we can consider the difference between \(X_{1}\) and \({\widehat{X}}_{1}\), and \(Z_{1}\) and \(\widehat{Z }_{1}\), where:

$$\begin{aligned} {\widehat{X}}_{1}=X_{0}{\widehat{W}},\quad {\widehat{Z}}_{1}=Z_{0}{\widehat{W}}. \end{aligned}$$

That is, we evaluate if the weighted average of the control group (other countries) approximates well the pre-treatment characteristics of Bolivia (\(X_{1}\)), and the behavior of the pre-treatment variable of interest (\(Z_{1}\) ).

To evaluate the effect of the treatment, we can use the vector of weights \({\widehat{W}}\) obtained using pre-treatment information, to compare the post-treatment outcomes of the variable of interest. That is, let \(Y_{1}\) be a l \(\times\) 1 vector of post-treatment observations of the variable that we are interested in comparing. Let \(Y_{0}\) be the l \(\times\) N matrix which contains l observations of the same variable of interest for the N potential controls. The goal of approximating the behavior that the outcome variable of interest would have had in the absence of Evo Morales, can be obtained by considering the counterfactual generated by our synthetic Bolivia. Thus, the effect of Evo Morales on the variable of interest can be defined as:

$$\begin{aligned} \Delta =Y_{1}-{\widehat{Y}}_{1}=Y_{1}-Y_{0}{\widehat{W}}. \end{aligned}$$
(3)

To address the issue of the significance of the results, and if the differences can be attributed to the treatment, Abadie et al. (2010) suggest performing a “placebo study.” It consists on applying the synthetic control method to all the countries in the control group (that, of course, did not have Evo Morales as their president). If the placebos generate gaps similar to the ones of (3), we would conclude that the treatment (Evo Morales) did not have a significant effect on the variable of interest. On the other hand, if the treated unit displays a different behavior than the placebos, we would conclude that there is significant evidence of the effect of the treatment.

2.2 Results

Here we present the results of applying the methodology described above to evaluate the effects of the Evo Morales Presidency on (the natural log of) GDP per capita at purchasing power parity (PPP).Footnote 8 We consider the years 1992–2005 for constructing \(Z_{1}\) in the pre-treatment period, and the period 2006–2016 as the treatment period.

Table 1 presents the results of applying the methodology described above to obtain the optimal weights \({\widehat{W}}\). Eight countries have positive weights to compose the synthetic control (Cote d’Ivoire, Kyrgyz Republic, Niger, Peru, Togo, UK, Uruguay, and Zimbabwe).

Table 1 Optimal weights for synthetic control: GPD per capita

Table 2 presents the list of pre-treatment characteristics that we seek to match. These characteristics take into account, not only, conventional factors considered as determinants of economic conditions, but also other social indicators that provide a broad characterization of the pre-treatment conditions faced by Bolivia.Footnote 9 The table shows that Bolivia is considerably poorer than the simple average of the 84 countries for which the information is available, and that are used to obtain the synthetic control. It also shows that, with the possible exception of energy use, the synthetic control does a good job replicating Bolivia’s pre-treatment characteristics. Suffice it to say that synthetic Bolivia has a RMSPE that is more than eleven times smaller than the average of all countries.

Table 2 Pre-treatment characteristics

Figures 1 and 2 display the evolution of the level of GDP per capita (at PPP) for Bolivia, the average of the 84 countries considered as possible controls, and the synthetic control. As it happened with the pre-treatment characteristics, the average corresponds to more than two times the income of Bolivia, thus not being a suitable control. However, the synthetic control matches the behavior of Bolivia very closely up to the period of the treatment. After 2005, the synthetic control and actual Bolivia sharply diverge, especially up to 2014. In particular, if synthetic Bolivia were a valid counterfactual, the gap between the actual Bolivia and the synthetic control is, on average, of US$ 270 (at PPP).

Fig. 1
figure 1

GDP per capita (at PPP): possible controls. The solid line represents Bolivia. The dashed line represents the simple average of the 84 countries considered as possible controls. The vertical line corresponds to the year prior to the treatment (2005)

Fig. 2
figure 2

GDP per capita (at PPP): Bolivia and synthetic Bolivia. The solid line represents Bolivia. The dashed line represents synthetic Bolivia. The vertical line corresponds to the year prior to the treatment (2005)

To evaluate the significance of the results we conduct the “placebo” test described in Abadie et al. (2010).Footnote 10 To do so, we conduct the same synthetic control method to the 84 countries used as our control.Footnote 11 As they did not have Evo Morales as their president since 2006, if the placebo gaps are similar to the one obtained for Bolivia, we would conclude that our results are not attributable to Morales and his policies. However, if the gap estimated for Bolivia is large compared to the gaps for the other countries, we would conclude that the Morales Presidency had a significantly negative impact on GDP per capita.

Figure 3 presents the results of this exercise. Following Abadie et al. (2010), the placebo gaps depicted exclude the countries for which their RMSEs prior to the treatment are 2.2 times higher than Bolivia’s. The reason for doing so is that we want to include only countries that have synthetic controls that can reproduce relatively well the pre-treatment behavior of (the log of) GDP per capita prior to the treatment.Footnote 12 From this exercise we conclude that the differences are consistently negative between actual Bolivia and synthetic Bolivia, and are significant. On average, the gap between actual Bolivia and synthetic Bolivia is of 4.7% of GDP per capita, with a peak of up to 6.3% of GDP per capita between 2010 and 2012.Footnote 13

Fig. 3
figure 3

Placebo test for (log of) GDP per capita (at PPP). The bold line represents the difference between the (log of) observed GDP per capita in Bolivia and the synthetic control. The gray lines represent placebo tests deviations for the other countries in the data set. The graph excludes countries with pre-treatment RMSE 2.2 times higher than Bolivia. The vertical line corresponds to the year prior to the treatment (2005)

Again, following Abadie et al. (2010), one final way to compare the Bolivia gap relative to the gaps in the placebo test, is to consider the ratios of the post-/pre-treatment RMSE for each country and their synthetic control. A large ratio indicates that the post-treatment period is significantly different than the pre-treatment period. Figure 4 shows that the post-treatment Bolivia is significantly different than the pre-treatment Bolivia when compared to its synthetic control. Indeed, the post-treatment RMSE is more than three times higher than the pre-treatment RMSE, pertaining to the right tail of the distribution.

Fig. 4
figure 4

Ratio of post- and pre-treatment RMSE. Estimation of the empirical density of post-/pre-treatment RMSE using the Epanechnikov kernel. The vertical line corresponds to the ratio of RMSE of Bolivia

Summarizing, we show that Bolivia underperformed when compared to its synthetic counterfactual, in terms of the behavior of GDP per capita. While the synthetic control replicates relatively well broad characteristics of Bolivia prior to the treatment, it performs markedly better than actual Bolivia since the year 2006. This exercise suggest that, on average, Bolivia may have lost 4.7% of GDP per capita because of the treatment (Evo Morales Presidency). Furthermore, as evidenced in Appendix 2, there is no evidence that the Morales Presidency achieved better results than its synthetic counterpart when considering outcomes such as inequality (measured by the Gini coefficient), school dropout rate, infant mortality rate, or life expectancy. Although not in the same magnitude, these results are similar in spirit, to those encountered by Grier and Maynard (2016) for Chavez’s Venezuela.

3 Panel data approach

The previous section tackles the fact that there is no obvious control group with which to evaluate the effect of the Evo Morales Presidency. That is so, because the other countries differ from Bolivia, not only on who is their President, but also on their economic structure, external shocks they face, etc. The synthetic control approach deals with this problem by building an artificial control that, hopefully, resembles the actual Bolivia, prior to the treatment, and compares an outcome variable of the actual Bolivia, with the synthetic counterfactual, after the treatment on Bolivia.

Under certain conditions, cross-country panel data models could be used to evaluate this same question, without having to construct a synthetic control.Footnote 14 This section describes the methodology followed. If anything, this approach can be used to assess the robustness of the results obtained above.

3.1 The method

Lucas (1987) describes methodological aspects that should be considered to evaluate alternative policies. First, describe the environment in which the agents interact, their preferences, technologies, and constraints they face. Second, determine their optimal plans or policy functions of the control variables (y). Then, alter the laws of motion of the state or forcing variables (x). Finally, evaluate how the agents react to these alterations.

Under certain conditions, an econometric exercise can achieve the same goal. To do so, consider the conditional density as the empirical equivalent of the policy function, and the marginal density as the law of motion of the state variables. Recalling that the joint density can be written as the product of the conditional density and the marginal density, we have:

$$\begin{aligned} f(y_{t},x_{t},\theta )=f(y_{t}\left| x_{t},\theta _{1}\right. )f(x_{t},\theta _{2}), \end{aligned}$$

where \(f(x_{t},\theta _{2})=\int _{-\infty }^{\infty }f(y_{t},x_{t},\theta )dy\) is the marginal density of x, and \(\theta\), \(\theta _{1}\), and \(\theta _{2}\) are the vectors of parameters of the joint, conditional, and marginal densities, respectively.

Regression analysis usually focuses on statistical inference of some moments of the conditional density. To do so ignoring the marginal density requires for \(\theta _{1}\) and \(\theta _{2}\) to be “variation free”. Footnote 15 This condition is not sufficient for conducting counterfactual analysis. To do so, it is required for the conditional density (or its relevant moments) to be structurally invariant. That is, that the parameters of interest in the conditional density remain unchanged, in the presence of an unstable marginal density.Footnote 16 If those conditions are met, evaluating counterfactual scenarios would imply comparing the forecasts of the variable of interest under alternative trajectories of the state variables.

We are interested in evaluating how external shocks and internal conditions (or policies) affected the trajectory of the variable of interest: (log of) GDP per capita. Considering solely information of Bolivia would be advisable if enough quality data for approximating internal conditions were available. Unfortunately, this is not the case.

An alternative approach, followed here, is to consider a panel data structure. Under certain homogeneity conditions, this structure would lead not only to consistent, but also more efficient estimates than the ones obtained with time series models for one country. Of course, panel data models tend to assume that the only source of heterogeneity (difference) among units is a fixed effect, which can be a strong assumption.

Formally, we estimate the following simple dynamic specification:

$$\begin{aligned} y_{i,t}=\alpha _{i}+\sum _{j=1}^{J}\delta _{j}y_{i,t-j}+\beta x_{i,t}+\gamma p_{i,t}+\phi x_{i,t}p_{i,t}+\theta t+u_{i,t} \end{aligned}$$
(4)

where \(y_{i,t}\) is the (log of) GDP per capita (at PPP) of country i in year t, \(x_{i,t}\) is a proxy for external conditions, p is a proxy for internal policies, t is a time trend, and J is the number of lags necessary to make \(u_{i,t}\) a white noise process for each country.

A few comments regarding (4) are in order. First, \(\alpha _{i}\) summarizes the heterogeneity considered as a fixed effect. Second, the lags of the dependent variable are intended to capture the persistence of the series. Third, the series of interest is considered to be trend stationary.Footnote 17 Fourth, this specification allows for differences in short, and long-run impacts of changes of the forcing variables. To conduct valid inference, this specification requires that x and p be weakly exogenous to the parameters of interest. Furthermore, to conduct counterfactual evaluations, these variables must be super exogenous to the parameters of interest. Finally, in the spirit of Chang et al. (2009), we consider the interaction between internal and external factors, as described by the parameter \(\phi\).Footnote 18 The main idea is that good policies may act as enhancers (complements) of good external conditions.Footnote 19

The choice of a simple structure is deliberate, as there are not many observations in the panel structure for Bolivia. If the model were misspecified (as all are), we would want to avoid systematic and persistent errors for Bolivia. Thus, after the estimation of the parameters using a panel structure, we conduct exogeneity and specification tests for the residuals of Bolivia.

Next, we describe the choice of variables and results of implementing this strategy.

3.2 Results

A natural proxy for external conditions is the evolution of (the log of) the terms of trade, which we use. Internal conditions are trickier to proxy, as they should reflect policy decisions, and their distortionary effects on the decisions of private agents. Furthermore, the variable(s) used to characterize this feature should have a time span useful for estimation and be comparable between countries.Footnote 20

Chumacero and Fuentes (2006) use the ratio of government expenditures to GDP as a proxy of these distortions. However, this is not a good proxy for government intervention for Bolivia in the recent past, as the distinction between government expenditures and investment has become increasingly blurred. Instead, we consider summary indexes that evaluate overall, and other types of freedom, constructed by the Heritage Foundation. As Fig. 5 makes clear, irrespective of the index considered, Bolivians have experienced their freedoms curtailed, and thus, distortions increased since Evo Morales became president.Footnote 21

Fig. 5
figure 5

Internal conditions (2005 vs 2016). Comparison of freedom indexes. See Appendix 1 for details

The choice of the variable used to proxy internal conditions was done following the general-to-specific approach suggested by Hendry (1995). That is, we consider the candidates presented in Fig. 5, estimate Eq. (4), perform specification tests for each candidate, and eliminate non-significant variables. Although these variables display similar patterns (in terms of direction), the Labor Market Freedom Index best captures the interaction with terms of trade, and satisfies the specification tests. Thus, this is the variable chosen as proxy of p.Footnote 22

Table 3 reports the results of estimating a panel data models with fixed country effects.Footnote 23 It also reports weak exogeneity tests for the external and internal factors. In both cases, the null hypothesis of no correlation between the residuals for Bolivia of the panel data models (conditional density) and the residuals of the marginal specification for each factor, estimated solely for Bolivia using AR(1) models, is not rejected.Footnote 24 Thus, inference, conditional on contemporary internal and external factors, is valid and no further estimation issues are considered to be problematic.

Table 3 Panel data results

To conduct the counterfactual exercise, it is required for the variables subject to intervention to be super exogenous, in the sense of Hendry (1995), to the parameters of interest. To test this, we must find evidence of structural instability in the marginal densities of the internal and external factors, while the conditional density remained stable. The AR(1) models used for the weak exogeneity tests are unstable, as judged by CUSUM tests for Bolivia, while the panel model is stable in the sample considered.

With this background, our counterfactual exercises ask the question: What would have happened with Bolivia if the conditions (internal and/or external) observed prior to the treatment (2005), would have remained unchanged after the treatment?

Table 4 shows four combinations of internal and external factors. If external factors are exogenous and can not be affected by the government, extremely favorable terms of trade as observed during the treatment (after 2005) can be labeled as “good luck” (GL). Thus, “bad luck” (BL) is defined as facing the same level of terms of trade during the treatment (after 2005) of the year 2005. On the other hand, our proxy for internal conditions that are consistent with the policies and statements of the Bolivian government tends to show increasing distortions faced by the private sector. As the panel data results and economic theory tend to predict, these distortions would (generally) be welfare deteriorating and reduce consumption, investment, and formal sector employment.Footnote 25 Thus, we label as “good skills” (GS) to maintaining the level of the Labor Market Freedom Index observed in 2005, and “bad skills” (BS) to the actual index that displays a clear deterioration on this dimension.Footnote 26

Table 4 Scenarios considered

As the specification of Table 3 evidences, there is an interaction between terms of trade and labor market freedom, thus making the effects of luck and skills nonlinear. To evaluate the effect of luck (or skills) on GDP per capita, we need to consider the behavior of the skills (or luck). For example, to evaluate the marginal effect of GL, we need to keep constant the level of skill. Thus, A–C is the effect of GL, conditional on GS, and B–D is the effect of GL, conditional on BS. Conversely, A–B is the effect of GS, conditional on GL, and C–D is the effect of GS, conditional on BL. If B were an accurate description of Bolivia after the treatment, A would be the counterfactual in which Bolivia would have benefited from the same favorable external conditions, with internal policies that would have enhanced the effect of the commodity prices bonanza.

With the estimates of the specification of Tables 3 and (4), we can compute the expected effect of comparing scenario k with scenario l as:

$$\begin{aligned} \Delta ^{k-l}&=\sum _{j=1}^{J}{\widehat{\delta }}_{j}\left( y_{i,t-j}^{k}-y_{i,t-j}^{l}\right) +{\widehat{\beta }}\left( x_{i,t}^{k}-x_{i,t}^{l}\right) \\ & \quad +{\widehat{\gamma }}\left( p_{i,t}^{k}-p_{i,t}^{l}\right) +{\widehat{\phi }} \left( x_{i,t}^{k}p_{i,t}^{k}-x_{i,t}^{l}p_{i,t}^{l}\right) , \end{aligned}$$
(5)

where \(k,l=\)A, B, C, D, and i represents Bolivia.

Figure 6 presents the results of computing the differences described in (5). As intuition would prescribe, good luck is “good,” unconditionally. However, good skills enhance the effects of a positive external environment. Given the observed path of terms of trade, GDP per capita increased in up to 4% just due to this effect. On the other hand, maintaining fewer distortions, with the external commodity prices bonanza, would have increased GDP per capita in up to 2%, on average, compared to the observed scenario. Thus, this exercise shows that Bolivia’s recent economic bonanza is mostly due to the extremely favorable external conditions it faced, and that, if anything, the internal factors prevented Bolivia from enjoying greater benefits.

Fig. 6
figure 6

Effects of skills versus luck (fraction of GDP per capita). Left panel: Solid line depicts the effect of GL conditional on GS (A–C) and dashed line depicts the effect of GL conditional on BS (B–D). Right panel: Solid line depicts the effect of GS conditional on GL (A–B) and dashed line depicts the effect of GS conditional on BL (C–D)

4 DSGE approach

The previous sections attempt to quantify the effects of Evo Morales’s Presidency relying on econometric methods that, through different means, build a counterfactual with which to compare the actual performance of Bolivia.

Although these methods have their merits, they do not provide deep insights regarding the explicit mechanisms that operate. In short, these methods may help to predict, but lack of the economic theory required to understand.

As mentioned, Lucas (1987) proposed a different approach to evaluate counterfactual scenarios, proposing to use DSGE models as tools for conducting artificial experiments. This approach considers that if there are structural parameters that are invariant to interventions, we can evaluate the effects of interventions by solving the model before the intervention, solving it again with the intervention in place (provided that it is permanent) and compare the long-run (or steady state) effects of the intervention. If the intervention is deemed transitory, a natural tool to tackle the effect of the intervention is to map it to a impulse-response surface.Footnote 27

One weakness of the approaches followed in Sects. 2 and 3 is that the quantitative results are sample dependent. One weakness of the approach of this section is that the results are theory dependent. This, however, should not demean the elegance and boldness of this approach, as it makes transparent the structure used, and the mechanisms through which an intervention operates.

This section uses a deterministic version of the DSGE model developed by Chumacero et al. (2004) to address the issue of the effects of the Free Trade Agreements signed by Chile.Footnote 28 It is general enough, so as to provide a wide variety of mechanisms to analyze, and allows us to operationalize what we mean by luck and skills. Of course, the model is calibrated to replicate some long-run characteristics of Bolivia, and then modified to evaluate the effects of counterfactual scenarios that intend to capture luck and skills.

4.1 The model

The model considers a small open economy with firms in three sectors (exportable, importable, and non-tradable), a government, and a representative household that faces an upward-sloping supply schedule for debt.

4.1.1 The households

The economy is inhabited by a representative agent, who maximizes the value of lifetime utility as given by:Footnote 29

$$\begin{aligned} \sum _{t=0}^{\infty }\beta ^{t}u\left( c_{m,t},c_{n,t}\right) , \end{aligned}$$
(6)

where \(c_{m,t}\) and \(c_{n,t}\) represent period t consumption of an importable (m) and a non-tradable good (n). The other good produced in this economy is not consumed at home. We denote this good as the exportable good (x).

The maximization of (6) is done subject to the budget constraint:Footnote 30

$$\begin{aligned}&\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) c_{m}+\left( 1+\tau _{c_{n}}\right) c_{n}p+\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) i+\left( 1+{\widetilde{r}}\right) b \\&\qquad \le \left( 1-\tau _{k}\right) \left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) rk+b_{+1}+F+\pi _{x}+\pi _{m}+\pi _{n}. \end{aligned}$$
(7)

where \(\tau _{m}\) is an import tariff, \(\tau _{c_{n}}\) and \(\tau _{c_{m}}\) are taxes on the consumption of non-tradables and importables, p is the relative price of the non-tradable good in terms of the importable good (used as numeraire), b is the amount of foreign debt that the private agent contracted from abroad on the previous period, \({\widetilde{r}}\) is the (net) interest rate paid on that debt, \(\tau _{k}\) is a tax on capital income levied by the government, r is the rental rate of capital stock that is given to the firms of the three sectors, \(\pi _{x}\), \(\pi _{m}\), and \(\pi _{n}\) are the profits of the exportable, importable, and non-tradable sectors, F is a lump sum transfer from the government to households, and i is investment, which satisfies the standard law of motion for capital:

$$\begin{aligned} k_{+1}=\left( 1-\delta \right) k+i, \end{aligned}$$
(8)

where \(\delta\) is the depreciation rate of the capital stock and k is the capital stock. As k is expressed in units of the importable good, it is also subject to the same taxes of the importable good destined to consumption (tariffs and the value-added tax).Footnote 31

The problem of the representative consumer can be summarized by the value function that satisfies:

$$\begin{aligned} V\left( s_{h}\right) =\max _{c_{m},c_{h},b_{+1},k_{+1}}\left\{ u\left( c_{m},c_{n}\right) +\beta \left[ V\left( s_{h,+1}\right) \right] \right\} , \end{aligned}$$
(9)

subject to (7, 8), and the perceived laws of motion of the states \(s_{h}\).Footnote 32

The first-order optimality conditions are:

$$\begin{aligned} p^{-1}= \,& {} \frac{u_{c_{m}}^{\prime }}{u_{c_{n}}^{\prime }}\frac{\left( 1+\tau _{c_{n}}\right) }{\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) } \nonumber \\ 1= \,& {} \beta \left[ \frac{u_{c_{m},+1}^{\prime }}{u_{c_{m}}^{\prime }}\frac{ \left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) }{\left( 1+\tau _{m,+1}\right) \left( 1+\tau _{c_{m},+1}\right) }\left( 1+{\widetilde{r}} _{+1}\right) \right] \nonumber \\ 1= & {} \beta \left[ \frac{u_{c_{m},+1}^{\prime }}{u_{c_{m}}^{\prime }}\left[ \left( 1-\tau _{k,+1}\right) r_{+1}+1-\delta \right] \right] . \end{aligned}$$
(10)

The first intratemporal optimality condition states that the relative price between importables and non-tradables (real exchange rate) must equate the ratio of marginal utilities between both goods. The next two (intertemporal) conditions are the standard Euler equations that state that the marginal rate of substitution between consumption today and tomorrow, must equate their relative price, evaluated at the cost of foreign borrowing and the rate of return of capital investment, respectively.

4.1.2 The firms

Three sectors with an equal number of representative firms produce the exportable, importable, and non-tradable goods. All sectors require capital as the only explicit production factor.Footnote 33 Next, we state the problems faced by the firms.

The importable good

The profits of the representative firm are determined by:

$$\begin{aligned} \pi _{m}=\left( 1+\tau _{m}\right) f\left( z_{m},k_{m}\right) -\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) rk_{m}, \end{aligned}$$
(11)

where \(z_{m}\) is a productive shock and \(k_{m}\) is the amount of capital demanded.

The first-order optimality condition is:

$$\begin{aligned} f_{k_{m}}^{\prime }\left( z_{m},k_{m}\right) =\left( 1+\tau _{c_{m}}\right) r, \end{aligned}$$
(12)

which states that the marginal cost of new capital must equate its marginal value.

The output of this sector can be consumed or used as capital in any of the three sector.

The exportable good

The profits of firms producing the exportable good are determined by:

$$\begin{aligned} \pi _{x}=\left( 1-\tau _{x}\right) qf\left( z_{x},k_{x}\right) -\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) rk_{x}, \end{aligned}$$
(13)

where \(\tau _{x}\) is an export tax, q is the relative price of exportables in terms of importables, \(z_{x}\) is a productive shock, and \(k_{x}\) is the amount of (importable) capital demanded by the exportable sector.

The first-order optimality condition is:

$$\begin{aligned} \left( 1-\tau _{x}\right) qf_{k_{x}}^{\prime }\left( z_{x},k_{x}\right) =\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) r, \end{aligned}$$
(14)

This equation presents the optimality condition equivalent to (12).

The output of this sector is only consumed abroad.

The non-tradable good

The profits of the representative firm are determined by:

$$\begin{aligned} \pi _{n}=pf\left( z_{n},k_{n}\right) -\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) rk_{n}, \end{aligned}$$
(15)

where \(z_{n}\) is a productive shock and \(k_{n}\) is the amount of (importable) capital demanded by the sector.

The first-order optimality condition is:

$$\begin{aligned} pf_{k_{n}}^{\prime }\left( z_{n},k_{n}\right) =\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) r, \end{aligned}$$
(16)

which states the optimality condition of the sector, and has the same interpretation of (14).

The output of this sector is only consumed in the domestic economy.

4.1.3 The government

It is assumed that the government has no explicit objective function to maximize, but satisfies the following constraint:

$$\begin{aligned} g+F= \,& {} \tau _{m}\left( c_{m}+i-f\left( z_{m},k_{m}\right) \right) +\tau _{c_{m}}\left( 1+\tau _{m}\right) \left( c_{m}+i\right) \nonumber \\&+\tau _{x}qf\left( z_{x},k_{x}\right) +\tau _{c_{n}}c_{n}p+\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) \tau _{k}rk, \end{aligned}$$
(17)

It is further assumed that a fraction \(\varkappa _{t}\) of the total government expenditures is used to consume the non-tradable good produced in the economy.

4.1.4 Market-clearing conditions

Define the productions of the exportable, importable, and non-tradable goods by:

$$\begin{aligned} y_{x}\,=\, & {} f\left( z_{x},k_{x}\right) \nonumber \\ y_{m}\,= \,& {} f\left( z_{m},k_{m}\right) \nonumber \\ y_{n}\,= \,& {} f\left( z_{n},k_{n}\right) . \end{aligned}$$
(18)

The market-clearing conditions are:

$$\begin{aligned} py_{n}\,= \,& {} pc_{n}+\varkappa g, \nonumber \\ -\left( b_{+1}-b\right)= \,& {} qy_{x}+y_{m}-c_{m}-\left( 1-\varkappa \right) g-k_{+1}+\left( 1-\delta \right) k-{\widetilde{r}}b, \end{aligned}$$
(19)

where the first equation describes the equilibrium in the non-tradable good market and the second the equilibrium in the importable good market, which shows that the current account balance must be compensated by the capital account balance.

To avoid having to model the world credit market, and following Bhandari et al. (1990), Turnovsky (1997), and Osang and Turnovsky (2000), we assume that the country faces an upward-sloping supply schedule for debt:

$$\begin{aligned} {\widetilde{r}}={\widetilde{r}}\left( b\right) ,\quad {\widetilde{r}}^{\prime }>0. \end{aligned}$$
(20)

4.1.5 Competitive equilibrium

A competitive equilibrium is a set of allocation rules \(c_{m}=C_{m}\left( s\right)\), \(c_{n}=C_{n}\left( s\right)\), \(k_{+1}=K\left( s\right)\), and \(b_{+1}=B\left( s\right)\), \(k_{x,+1}=K_{x}\left( s\right)\), \(k_{n,+1}=K_{n}\left( s\right)\), and \(k_{m,+1}=K_{m}\left( s\right)\), a set of pricing functions \(r=R\left( s\right)\), and \(p=P\left( s\right)\), and the laws of motion of the exogenous state variables \(s_{+1}=S\left( s\right) ,\) such that

  • Households solve the problem (9), taking as given s and the form of the functions \(R\left( s\right)\), \(P\left( s\right)\), and \(S\left( s\right)\), with the equilibrium solution to this problem satisfying \(c_{m}=C_{m}\left( s\right)\), \(c_{n}=C_{n}\left( s\right)\), \(k_{+1}=K\left( s\right)\), and \(b_{+1}=B\left( s\right)\).

  • Firms of the exportable, importable, and non-tradable sectors solve the problems (11), (13), (15), taking as given s and the form of the functions \(R\left( s\right)\), \(P\left( s\right)\), and \(S\left( s\right)\), with the equilibrium solutions to these problems satisfying \(k_{x,+1}=K_{x}\left( s\right)\), \(k_{n,+1}=K_{n}\left( s\right)\) , and \(k_{m,+1}=K_{m}\left( s\right)\).

  • The economy-wide resource constraints (19) hold each period, and the factor market clears:

    $$\begin{aligned} K_{x}\left( s\right) +K_{n}\left( s\right) +K_{m}\left( s\right) =K\left( s\right) . \end{aligned}$$

4.2 Functional forms

With the generic model specified, next we group functional forms in terms of preferences, production technology, government, and exogenous prices.

4.2.1 Preferences

We consider the following functional form:

$$\begin{aligned} u\left( c_{m,t},c_{n,t}\right) =\theta _{m}\ln c_{m,t}+\theta _{n}\ln c_{n,t}, \end{aligned}$$

with \(\theta _{m},\theta _{n}>0\) and \(\theta _{m}+\theta _{n}=1\).

4.2.2 Production technology

The production functions are assumed to be Cobb–Douglas:

$$\begin{aligned} f\left( z_{j,t},k_{j,t}\right) =e^{z_{j,t}}k_{j,t}^{\alpha _{j}}, \end{aligned}$$

where \(\alpha _{j}\) is the compensation for capital as a share of output of sector j for \(j=x,m,n\).

As we will compare deterministic steady states to evaluate the relative importance of skills and luck, the steady-state values of the productivity shocks (\(z_{j}\)) are calibrated to match the sectorial composition of GDP in Bolivia.

4.2.3 Fiscal variables

We calibrate different values for government expenditures (\({\overline{g}}\)) and other fiscal variables (taxes and tariffs), depending on whether or not we activate the treatment, reflecting that distortions increased during the treatment (bad skills). The specific way in which these variables are set is discussed below.

4.2.4 Exogenous prices

Next, we describe the functional forms chosen for the laws of motion of two external variables: terms of trade (q) and the borrowing rate (\(\widetilde{ r}\)) discussed in (20).

The steady state of terms of trade (\({\overline{q}}\)) is contingent on whether or not we activate the condition of a favorable terms of trade to assess the effects of “luck” . Further discussion is given below.

Finally, as discussed above, we assume that the country faces an upward-sloping supply schedule for debt and model it as:

$$\begin{aligned} {\widetilde{r}}_{t+1}={\overline{r}}+\varphi \frac{b_{t}}{y_{t}}, \end{aligned}$$
(21)

where \(y_{t}\) is total output (GDP), expressed in terms of importables.

4.3 Calibration and results

Next, we parameterize the model, distinguishing deep parameters from those that are considered to be affected by the treatment. Table 5 presents the values of the parameters that are assumed to be unchanged by the treatment and Table 6 the values of the parameters before and after the treatment.

Table 5 Deep parameters

The parameters \(\theta _{m}\) and \(\theta _{n}\) are chosen so as to reproduce the share of consumption on importables and non-tradables over total consumption in steady state. The subjective discount factor (\(\beta\)) was set to make it consistent with a 5% annual real interest rate.

The output-factor elasticities in each sector (\(\alpha\)) were set to match the sectorial shares on GDP, and consider that the exportable sector is more capital intensive than the other sectors.Footnote 34 The depreciation rate was set to 6%, while the constants of the production functions, government expenditures, and terms of trade were set to match the participation of each sector in total GDP.Footnote 35

Table 6 Values of the parameters before and after the treatment

Table 6 reports how we capture the effects of good luck and good skills. Regarding luck, it is associated with a positive terms of trade shock (increased q). During the treatment (after 2005), terms of trade were (on average) 50% higher than the average of the period before (1990–2005), and almost 40% higher (on average) than in the year before the treatment. As we are comparing steady states, it would be incorrect to assume that this increase is permanent. What we need is to obtain the level of a permanent shock that is equivalent (in present value) to a 50% temporary increase in terms of trade of 10 years. That is, we need to find:

$$\begin{aligned} \lambda _{q}=1.5\left( 1-\beta ^{9}\right) +\beta ^{10}\simeq 1.15, \end{aligned}$$
(22)

and consider a steady-state level of terms of trade 15% higher when we evaluate the effect of GL.

It is a bit more difficult to assess what the effects of the treatment were on the increased distortions faced by agents.Footnote 36 Furthermore, reliable figures for the finances of the public sector are not available.Footnote 37 What is clear is that the size of the public sector and the distortions have increased markedly, making private investment more costly, levied heavier taxes on the exportable sector and increased overall government expenditures. The magnitude of this changes is computed so as the share of government expenditure over GDP after the positive terms of trade shock increases by 2%.Footnote 38 This is equivalent to increasing government expenditures and taxes on capital and the exportable sector of 19%.Footnote 39

As with Sect. 3, here we conduct counterfactual experiments by changing parameters, solving the model with different configurations, and evaluating the effect on the variable of interest (what the model considers to be GDP).

As mentioned, there are several ways in which the exercise could be done. One, in which modifications are considered transitory, is to shock the system with a perturbation and follow the results. In this case, the laws of motion of the states (particularly their persistence) are key. As the model lacks of an analytical solution, numerical methods need to be used to solve for the optimal policies. In case second-order perturbation methods are used (as in Schmitt-Grohé and Uribe 2004), the volatility of the shocks would also be important. The other way to tackle the question is to consider that the counterfactual (or treatment) involves a permanent change in some variables. In that case, we could also evaluate the effects by comparing changes in the optimal policies, or simply evaluating the long-term effects by comparing changes in the (deterministic) steady states. The advantage of this approach is that it solves the fully fledged nonlinear steady state of the system, and does not require approximations of the policy functions. Furthermore, as far as the deterministic steady states are concerned, persistence and volatility are irrelevant. This is the approach we follow.

Concretely, we consider the same scenarios presented in Table 4. As the model is extremely nonlinear, it will be the case that changes in luck (skills) would have different effects on the economy, depending on the skills (luck) scenario that is considered.

As changes in terms of trade and/or distortions will lead to changes in allocations and relative prices, differences in GDP in each scenario are not directly comparable to the ones obtained in the previous sections. This is so, because in them, comparisons were made in dollars of a base year, while here, they are made in GDP expressed in terms of importables. One way to make the figures comparable is to compute GDP in prices of a baseline scenario. A natural baseline scenario would be Bolivia prior to the treatment, which in our case, corresponds to scenario C.

Figure 7 presents the results of comparing the changes in the steady-state GDPs of different scenarios, computed in terms of importables, and also in prices of scenario C. As previously, good luck is “good” unconditionally, and good skills enhance the effects of a positive external environment. These results suggest that the long-term effects of a substantial increase in terms of trade would have led to increases in GDP of between 8.9 and 9.9% when measured at the new relative prices. When measured at constant (scenario C) prices, the increments in GDP due to favorable terms of trade are between 3.7 and 4.1%. Figures are in line with our results of Sect. 3. On the other hand, good skills (less distortions) would amount to increases in GDP of between 6.4 and 7.4% (depending on the levels of terms of trade), when measured allowing changes of the real exchange rate, and between 5.6 and 6.1%, when measured at prices of scenario C. Thus, this exercise provides further support to the hypothesis that Bolivia’s recent economic bonanza is mostly due to the extremely favorable external conditions it faced, and that, the internal factors were very costly.

Fig. 7
figure 7

Effects of skills versus luck with DSGE (fraction of GDP per capita). A–C depicts the effect of GL conditional on GS. B–D depicts the effect of GL conditional on BS. A–B depicts the effect of GS conditional on GL. C–D depicts the effect of GS conditional on BL. The lighter bars evaluate changes in GDP with the relative prices changed due to the scenarios. The darker bars correspond to the changes evaluated at the relative prices of the baseline scenario (C)

5 Concluding remarks

This paper intends to evaluate the relative importance of internal and external conditions on the economic bonanza Bolivia experienced.

As the external conditions were extremely favorable, with increases (of the terms of trade) of, on average, more than 50% since 2006 with respect to 2005, or, for that matter, any other period in the past, it is tempting to conclude that this is the main culprit of the bonanza. Nevertheless, Evo Morales’s government has not remained still and has also conducted major policy changes. Acolytes of the regime conclude that, it is mainly the policies that should be credited for the boom. Settling this dispute requires more than charts and graphs. As Evo Morales emerged as president of Bolivia in, roughly, the same period of favorable external conditions, it is not trivial to identify the causal effect of each.

This paper provides three complementary approaches to evaluate the relative importance of luck (favorable external conditions) that can not be attributed to the government, and skills (internal policies that could have fostered or lessened the effects of the external conditions). These approaches differ on identifying assumptions, the methodological approach, information used, and foundation on economic theory.

The first approach attempts to construct the counterfactual of how would have Bolivia fared since 2006 if Evo Morales (and his policies) would not have been implemented. To construct this counterfactual, a synthetic control (comprised of a weighted average of other countries) is derived. The results indicate that Evo Morales caused, on average, a loss in the level of GDP per capita of around 4.7% per year, since in office. They also suggest that conditions in other social indicators would not have been affected in his absence.

The second approach uses a panel of countries to evaluate the precise counterfactual of changing one factor (external or internal), and leaving the other constant. This approach imposes some restrictions in terms of the degree of homogeneity in responses by the countries, the proxies considered, and the requirement of super exogeneity (in the sense of Hendry). Meeting these conditions, we find an interesting nonlinearity due to the interaction between internal and external conditions. Put simply, good luck is enhanced with fewer distortions. This approach estimates that good luck provided up to 4% more on GDP per capita, while the increased distortions in the internal conditions lead to a decrease of up to 2% of GDP per capita. Thus, not taking into account secular conditions, the bonanza was due to external conditions, with internal conditions harming, more than helping.

The third and final approach uses a DSGE model to evaluate counterfactual scenarios. The model is calibrated so as to replicate the sectorial composition of GDP, and introduces changes in the structure of the model that are intended to accommodate the internal and external conditions observed prior to the treatment (Evo Morales), and change them to compute how the agents would react to them. This approach has the main benefit of providing an optimizing and internally consistent model that has to make explicit the interventions. It also helps to provide economic insights on the mechanisms at play. The results of this approach are qualitatively consistent with the previous findings. With GDP calculated at constant relative prices of the period prior to the treatment, the commodity prices boom may have caused increases of up to 4.1% (apart from secular trends), while increased internal distortions might have caused around a 6.1% drop in GDP.

Concluding, all the exercises conducted lead to similar conclusions. Bolivia’s recent bonanza is primarily due to incredibly favorable external conditions. If anything, the boom was not fully capitalized due to the increased distortions in the internal economic policies.

Thus, paraphrasing Sir Ronald Ross, the Government’s “favorite scam is pretending that luck is skill.”Footnote 40