Introduction

Do food-for-work (FFW) programs improve diets or change production practices among participating households? The answer to this question is important because food-based transfer programs have become a standard tool for addressing the problem of chronic food insecurity in low-income settings (Alderman and Mustafa 2013). Food aid has evolved substantially from its origins in providing food surpluses for humanitarian needs to engaging donors from high-income nations in promoting food security, economic development, and social assistance and protection through a range of cash and in-kind transfers (Devereux, 2001; Food and Agriculture Organization (FAO) 2005; Adato and Hoddinott, 2008; Dercon, 2011). By engaging beneficiaries in community infrastructure projects in exchange for food or cash, food-for-work, and cash-for-work programs have become especially attractive to donors and recipients and recognized as potential vehicles for improving nutrition (Rogers and Coates 2002; Nair et al. 2016).

In theory, such programs have the potential to expand dietary diversity, especially if the food items provided by the program are not otherwise part of the staple diet. Consumption of additional varieties of food items is also possible if distributions free up spending that otherwise would have been used to purchase food items provided by the program. By raising effective incomes, cash payments also have the potential to “crowd in” purchases of nutritionally important foods (Bailey 2013; Burchi et al. 2016; de Groot et al. 2017). However, if FFW participation requires a household to divert labor away from on-farm production, such programs have the potential to undermine production diversity by altering the basic crop mix, especially if labor is withdrawn from non-staple food production.Footnote 1 The net effect of these opposing forces is unclear and is the primary investigation in this paper.

The geographic focus of this study is the Tigray Region, in northern Ethiopia, a country that has been a recipient of food assistance with FFW interventions for more than three decades. Historically, food aid provision in Ethiopia took the forms of free food and food-for-work, often in response to drought and subsequent food shortages (Jayne et al. 2001; Caeyers and Dercon 2012). As a result of chronic food insecurity, provision of long-term assistance to vulnerable rural households gradually became part of the food security program of the country. Since 2005, FFW programs in Ethiopia have been administered mainly as part of the country’s Productive Safety Net Program (PSNP), a larger and more comprehensive social protection program designed to reach more than five million chronically food-insecure individuals. Large proportions of beneficiaries receive food or cash transfers in exchange for work on public work projects. A smaller proportion (10–15%, mostly elderly or disabled individuals or pregnant women) receives unconditional transfers (Gilligan et al. 2008; Tigray Food Security Task Force 2009; Berhane et al., 2013).

Hidrobo et al. (2018) review the implications of social protection for food security and asset formation. Rigorous empirical studies conducted in Latin America show potentially positive impacts from transfers. For example, Hoddinott and Wiesmann (2008) and Hoddinott and Skoufias (2004) report that beneficiaries of conditional cash transfers in Honduras, Mexico, and Nicaragua had higher diet quality and Hidrobo et al. (2014) report that cash, food, and voucher transfers improved both the quantity and quality of food consumption in Ecuador.

The empirical record for Africa remains incomplete and mixed. Berlie (2014) argues that Ethiopia’s PSNP led to reduced dietary diversity, but Berhane et al. and Berhane et al. (2014) found no PSNP effect on caloric availability or dietary diversity. Using a dietary diversity score and a coping strategy index to classify households as either food secure or food insecure, Uraguchi (2011) found only a limited impact of emergency food aid or PSNP participation on food security. Gilligan and Hoddinott (2007) found a positive effect of emergency food aid on food consumption in the aftermath of Ethiopia’s 2002 drought, and Berhane et al. (2015) found a positive effect from a pilot program of social cash transfers on dietary diversity in the Tigray Region. Elsewhere in Africa, the Social Cash Transfer Programme pilot in Malawi, the Child Grant Program in Zambia, and the World Food Program’s food and cash transfer modalities in Mozambique were all associated with higher household dietary diversity (Miller et al. 2011; American Institutes for Research (AIR) 2013; Zhou and Hendriks 2017). Merttens et al. (2013) report that Kenya’s Hunger Safety Net Programme improved dietary diversity of the poorest households, but that the overall impact on the full set of program beneficiaries was limited.

Several empirical investigations link food-for-work programs and food production (Abdulai et al. 2005; Gelan 2007; Bezu and Holden 2008). However, few studies examine the implications of food-for-work on diversity in food production, and those that do are mainly descriptive (e.g., World Food Program 2015; World Food Program 2017; World Food Program 2019). The lack of studies that empirically measure the connection between FFW programs and production diversity is somewhat surprising given that a major requirement of all such programs is that beneficiary households provide labor to local projects, in some cases diverting individuals from other productive activities. The studies that come closest to addressing the concerns of this paper, especially in the context of Ethiopia, have faced data limitations, in terms of both the types of data available and geographic coverage. Berlie (2014) focuses on one district in the Amhara Region and employs cross-sectional data. Uraguchi (2011) uses data from one district each in Amhara and Tigray to examine the effect of transfer projects on food security status before and after the PSNP, but was unable to estimate the direct effect of the PSNP on dietary diversity.

To address this gap in the literature, this paper uses representative panel data from the Tigray Region and panel regression models to identify direct impacts on a dietary diversity indicator. Studies by Berhane et al. (2011), Berhane et al. (2013) and Berhane et al. (2014) use data from four major PSNP regions in Ethiopia to examine the implications of intensity of benefits from the PSNP, measured as the difference in receiving payments for 5 years and 1 year. The approach in this paper differs in that it uses a longer time series of data (starting in 2001 and extending through 2010) and examines the broader implications of participating in FFW programs. To further test the robustness of findings to alternative definitions of treatment, participation in FFW programs is first measured using a binary indicator and then using a continuous measure of treatment, based on total monetary payments a household received from public works participation. Overall, the current study makes two contributions. First, it provides new evidence for Ethiopia, making use of four waves of panel data including periods prior to the start of the PSNP. The use of long panel allows for the control for household fixed effects and pre-PSNP characteristics and thereby improves upon previous estimates of project impacts. Second, it measures the association between food-for-work program participation and production diversity.

Study context, research design, and data

Food-for-work programs in Ethiopia

Food aid in Ethiopia has traditionally been delivered as free food, with the major portion (80%) delivered via food-for-work programs. Able-bodied household members in FFW participant households are eligible to take part in community development activities including construction of dams, roads, and conservation structures. In return, participants receive either food (typically wheat and oil) or cash, generally at levels that equate to a sub-market wage rate (Bezu and Holden 2008).

Persistent food shortages and an increase in the number of chronically food-insecure households led donors and the government of Ethiopia to launch the Productive Safety Net Program (PSNP) in 2005 (Nega et al. 2010; Rahmato et al. 2013). The first phase of the program ran between 2005 and 2010. The main goal of the PSNP is to provide long-term support for chronically food-insecure households by providing assistance for a predictable period. Similar to earlier food aid programs, the PSNP includes food-for-work (FFW), cash-for-work (CFW), and unconditional free food. Eligibility for PSNP has generally been determined based on three conditions: (i) whether households faced food gaps or were beneficiaries of food aid three years prior to the start of the program; (ii) whether households faced shocks that caused asset depletion; or (iii) whether the household lacks external support from other safety net programs or family members (Government of Ethiopia 2009; Berhane et al., 2013). Targeting criteria used in both the emergency food aid program and the PSNP can generally be considered indicators of the poverty or food insecurity status of beneficiaries. While the public works program (FFW and CFW) require able-bodied individuals for eligibility, free food distribution targets elderly, disabled or sick individuals, and pregnant and lactating women (Gilligan and Hoddinott 2007; Government of Ethiopia 2009). Although favoritism may exist in the targeting of such programs, prior investigations have found the PSNP to be well-targeted when measured at an international standard, especially in the highlands (Coll-Black et al. 2011; World Bank. 2016). Nevertheless, one cannot rule out the potential for inclusion and exclusion errors in targeting.

Payments can be made in the form of cash, food (wheat and oil), or a combination of both (Sabates-Wheeler and Devereux 2010). The definition of receipt of benefit from FFW prior to the start of the PSNP and after 2005 might differ. While the PSNP has a long-term dimension that provides benefits for 6 months, FFW programs prior to 2005 took the form of emergency relief, whereby benefit periods were shorter. However, since participation in the public works programs was demand driven, the fact that there was high demand from beneficiaries implies that households participated in the program for at least the minimum period supplied by the program (Bezu and Holden 2008). Further, household selection into the PSNP was based on prior receipt of emergency relief program benefits. Therefore, the main impact of participation is likely to come through the total amount of benefits resulting from the program and the outreach.

Most public work programs typically operate during the agricultural off-peak season so as to avoid competing with agricultural work (Berhane et al. 2014). For this reason, one might expect that participation in such programs would not affect production decisions. However, a considerable number of anticipatory agricultural tasks occur in the slack season, among them land preparation and planting, both of which require large amounts of labor in the Ethiopian context. Furthermore, in FFW and CFW settings, smallholder production and consumption decisions are typically linked and rarely made independently (Hoddinott et al. 2014). This implies that food and cash transfers have the potential to affect the production decisions of participating households. On the one hand, cash transfers might facilitate purchases of agricultural inputs, which could promote crop diversity. On the other hand, food receipts could affect production decisions, especially for cereals, either by changing planted area or crop mix.

Research design

Data for this study come from household surveys conducted in 2001, 2003, 2006, and 2010 in the highlands of the Tigray Region, in northern Ethiopia. The initial sample was collected in 1998 using stratified random sampling to select sample households. A total of 16 villages were first sampled from four zones of Tigray Region-central, eastern, western, and south eastern zones. Sample villages are representative of population density, market access, agro-climatic conditions, and agricultural potential (Hagos and Holden 2002). From each village, 25 households were selected randomly making up a total of 400 initial sample households. Follow-up surveys were then carried out in 2001, 2003, 2006, and 2010 by tracking the same households across the survey years. The 2010 survey further included two additional villages from the southern zone.Footnote 2 The last four waves provide the data used for this analysis. The initial survey round was excluded because food reporting was less detailed than in subsequent rounds, thus precluding construction of the main variables of interest (see the next sub-section). Although the same households were followed to the extent possible, it was in some cases impossible to track some households. The main causes of attrition were non-response and refusal to respond to the questionnaires. As part of the robustness analyses, tests reported below examine the possibility of attrition bias.

Hired enumerators who spoke the local language used household and village questionnaires to conduct the surveys. Data are comparable across the survey rounds both because all rounds used the same questionnaire and because data collection was undertaken during the same period of time between May and July. Data were collected on household characteristics, food consumption, crop and livestock production, land and non-land asset ownership, livestock and crop sales, off-farm income, food-for-work participation, and PSNP membership.

PSNP membership status was collected in the 2010 survey. For purposes of the analysis, food-for-work participation refers to participation in any public works project that resulted in a household receiving food, cash, or some combination of the two. One subset of the analysis differentiates among households that received food only, cash only, or a combination of food and cash. The dataset consists of an unbalanced sample of 1426 observations (343 households for 2001, 344 for 2003, 315 for 2006, and 424 for 2010).

Measurement of household dietary diversity

Household dietary diversity was measured using annual recall data on food consumption observed at the household level. A set of 29 food items that were consistently defined and reported across all survey rounds were used to calculate the dietary diversity measure.Footnote 3 Respondents (mainly the household head or spouse) reported the amount of food items consumed in the previous year based on a list of prompted food items. For each household, a food variety score (FVS) was computed as a simple unweighted count of the number of different food items reported as being consumed by the household in the previous year.Footnote 4 The FVS is the main variable used to compare dietary diversity between households that did and did not participate in the FFW program. Using this count of food items allows us to test whether results are sensitive to the inclusion of items (primarily wheat and oil) provided directly by the food-for-work program. To further examine the diversity of food items in specific food groups, this study follows FAO (2011) and aggregates the 29 food items into nine food groups (cereals; legumes, nuts, and seeds; vegetables; meat; eggs; milk; oil and fats; sweets; spices and condiments).

Typically, payments for food-for-work activities in the study settings are delayed. This may affect measures of dietary diversity if a survey is carried out before payments are made and if it uses weekly or daily scales. For example, Berhane et al. (2011) argue that delays in payment could explain why they do not find positive impacts of payments on calorie availability. In such a case, an annual scale provides the overall quality of diet in the household and allows differentiating between those who are beneficiaries and those who are not. Put differently, using annual reported consumption to generate the FVS captures consumption that would be otherwise underreported due to delayed payment. It is possible that annual recall data may also lead to underreporting of some food items (Ruel 2002; Food and Agriculture Organization (FAO) 2011). However, annual consumption should be representative of a household’s overall dietary diversity if households have generally good recall about “hungry periods” and what they could afford to eat during the past year. Although time frames commonly used to assess dietary diversity also include 24-h and 7-day recalls, daily and weekly recall measures were not collected as part of the surveys providing data for this study and therefore it is not possible to compare the annual FVS results with those associated with alternative diet recall periods.

Finally, this study relies on a simple count of the number of food items consumed, rather than actual quantities, and hence, underreporting is not likely to be a problem. It also avoids sensitivity to seasonality in food consumption, which is especially relevant in the Ethiopian context, where fasting and food avoidance (especially of animal products) is widely practiced during some periods of the year.Footnote 5 Using an annual measure avoids underreporting that might arise if shorter recall periods were used to capture consumption that is period specific or highly seasonal.

One shortcoming of using an annual household-level FVS is that the indicator cannot account for differences in gender and age composition across households and does not account for intra-household allocation of food. However, as a broad indicator of overall availability of dietary diversity in the household, which is the focus for this study, the indicator is widely used. One should not conclude, however, that household dietary diversity is indicative of dietary diversity among all household members.

Measurement of production diversity

Production diversity in this study is measured by counting the number of crops cultivated annually by the household. Five food groups were used: (i) cereals; (ii) legumes, nuts, and seeds; (iii) vegetables; (iv) fruits; and (v) spices.

Characteristics of the sample

Table 1 presents descriptive statistics for all variables used in the analysis, separately by food-for-work participation status. Of the 1426 household observations, 741 (roughly 50%) participated in food-for-work programs. Characteristics of households in the two groups differ significantly. Participants in the food-for-work programs own smaller parcels of land and have higher labor endowments (of both female and male labor). This is in line with the requirements for participating in the public work programs whereby less well-off households and those with better labor endowment are prioritized. While livestock ownership is in most cases lower among FFW participants than FFW non-participants, the difference is statistically significant only in 2010. The empirical analysis controls for these potentially confounding factors when estimating the implication of FFW participation on consumption and production diversity.

Table 1 Descriptive statistics

Dietary diversity in the sample is summarized in Table 2, including the average number of food items in each food group (mean = 14.4; standard deviation = 3.9; min = 1; max = 25). Average dietary diversity is similar across the survey years, except for a slightly lower value observed in 2003, probably because 2003 was a drought year. Table 3 presents production diversity and the number of crops in each food group in each survey round. On average, a household produced three different crops. The maximum number of crops cultivated among the sample households was seven.Footnote 6 As with consumption diversity, production diversity in 2003 was lower than in other years, reflecting the influence of that year’s drought.

Table 2 Dietary diversity in the sample
Table 3 Production diversity in the sample

Table 4 reports average differences in food variety and production diversity scores by participation in FFW programs. FFW participants consume a significantly higher variety of foods compared with the non-participants in FFW programs (see Table 4). When disaggregating FFW participation by survey year, it appears that the difference in the food variety score is driven mostly by changes in 2003, 2006, and 2010. In contrast, Table 4 shows a slight overall difference in production diversity between FFW participants and non-participants driven by the significant difference in the measure of production diversity for the year 2001 (see Table 4). Figures 1 and 2 further illustrate patterns observed in Table 4. The distribution of the FVS is shifted to the right for participants in FFW programs compared with non-participants (Fig. 1). Figure 2 illustrates that participants and non-participants in FFW programs exhibit very similar production diversity.

Table 4 Dietary diversity and production diversity by food-for-work participation
Fig. 1
figure 1

Food-for-work (FFW) participation and household dietary diversity

Fig. 2
figure 2

Food-for-work (FFW) participation and production diversity score

Methods of data analysis

Econometric model

General setup

The goal in this paper is to estimate the implication of FFW participation on diversity in food consumption and production. The general specification employs two sets of regressions; one set each for dietary diversity (Model 1) and production diversity (Model 2). The regressions take the form:

$$ {DD}_{it}={\beta}_0+{\beta}_1^{\prime }{\mathbf{X}}_{it}+{\beta}_2^{\prime }{\mathbf{A}}_{it}+{\beta}_3{FFW}_{it}+{\beta}_4^{\prime}\mathbf{T}+{a}_i+{\varepsilon}_{it}\kern0.5em $$
(1)
$$ {PD}_{it}={\beta}_0+{\beta}_1^{\prime }{\boldsymbol{X}}_{it}+{\beta}_2^{\prime }{\mathbf{A}}_{it}+{\beta}_3{FFW}_{it}+{\beta}_4^{\prime}\mathbf{T}+{a}_i+{\varepsilon}_{it}\kern0.5em $$
(2)

where in Eqs. (1) and (2), DDit and PDit represent dietary diversity and production diversity for household i at time t, respectively. As defined in “Study context, research design, and data,” the dependent variables are measured as count variables of food items consumed and produced.Footnote 7Xit represents a vector of household characteristics (age, sex, and education of the household head; the number of children, the number of adult females and males; and a binary indicator for participation in off-farm activities), Ait denotes asset indicators (land area owned and livestock ownership). FFWit is a binary indicator for participation in food-for-work or cash-for-work programs. In this setup, the treatment groups are households that benefited either from the food-for-work or cash-for-work programs and the control groups are households that received none of these benefits. T is a vector of survey year indicators, and εit represents an idiosyncratic error with expected value of zero.

Choice of estimators

To choose an appropriate model specification for the panel data analyses, a Hausman test was used to compare the performance of random effects and fixed effects estimators for these data. The test indicates that differences in the coefficients between the two specifications are systematic, and therefore favors a household fixed effects estimator, which is used as the main model to control for time-invariant unobserved heterogeneity. In Eqs. (1) and (2), ai is a time-invariant unobserved effect, which is differenced out when performing fixed effects estimation.

It is possible that, over the course of the surveys, some households could have switched into or out of the FFW program. To address this possibility, in addition to the fixed effect models, a model using a difference-in-difference (DID) approach is also estimated by taking the first differences of the dependent and independent variables. This eliminates the unobserved effect, ai, by differencing adjacent periods (Wooldridge 2010). The model takes the following form:

$$ \Delta {DD}_{it}={\beta}_0+{\beta}_1^{\prime}\mathbf{\Delta }{\mathbf{X}}_{it}+{\beta}_2^{\prime}\mathbf{\Delta }{\mathbf{A}}_{it}+{\upbeta}_3\Delta {FFW}_{it}+{\beta}_4^{\prime}\mathbf{T}+\Delta {\varepsilon}_{it}\kern0.5em $$
(3)
$$ \Delta {PD}_{it}={\beta}_0+{\beta}_1^{\prime}\mathbf{\Delta }{\boldsymbol{X}}_{it}+{\beta}_2^{\prime}\mathbf{\Delta }{\mathbf{A}}_{it}+{\beta}_3\Delta {FFW}_{it}+{\beta}_4^{\prime}\mathbf{T}+\Delta {\varepsilon}_{it}\kern0.5em $$
(4)

where t = 2003, 2006, and 2010, and the first set of differences is taken between 2003 and 2001. T in Eqs. (3) and (4) control for years 2006 and 2010.

Interpreting observed association as evidence of causal effects of program participation is generally not possible when unobserved heterogeneity in household participation cannot be fully ruled out. As outlined above, this study attempts to address this potential endogeneity issue using fixed effects estimation and DID, both of which control for time-invariant unobserved heterogeneity. However, these approaches cannot address time-varying unobserved heterogeneity. Reported correlations should not, therefore, be read as claims of causal effects. In “Results and discussion,” results from random effects models are presented as robustness checks along with additional analyses to assess the consistency of the results under alternative specifications and variable definitions.

Analysis of linkages using continuous treatment

In order to investigate whether the intensity of participation, rather than participation itself, is associated with dietary diversity, FFWit in Eqs. (1) and (2) is replaced with the monetary equivalent of the public work benefits (FFW income). In addition, a dose-response model is fit using a control function regression to measure the relationship between FFW income and dietary diversity. The approach closely follows Cerulli (2015) and is attractive because the dose-response analysis does not require an assumption of full normality and is suitable when a substantial proportion of the sample population has a treatment level of zero. The model is specified as:

$$ \Big\{{\displaystyle \begin{array}{l}{FFW}_i=1:\kern0.75em D{D}_{1i}={\mu}_1+{g}_1\left({\mathbf{x}}_{\boldsymbol{i}}\right)+h\left({m}_i\right)+{e}_1\\ {}{FFW}_i=0:\kern1em {DD}_{0i}={\mu}_0+{g}_0\left({\mathbf{x}}_{\boldsymbol{i}}\right)+{e}_0\end{array}}\operatorname{} $$
(5)

where g1(xi) and g0(xi) represent functions of the vector of regressors for FFW participants and non-participants and h(mi) is the function of the monetary equivalent income from FFW, i.e., a continuous treatment that equals zero when FFW = 0. The dose in this case is the amount of public work income per adult equivalent and the response is the dietary diversity measure (DDi). The average treatment effect, given the level of treatment, is:

$$ ATE\left(x,m\right)=E\left({DD}_{1i}-{DD}_{0i}|x,m\right) $$
(6)

ATE(x, m) is used to calculate the dose-response function.

Analysis of possible dietary mechanisms

Multiple channels might exist affecting the link between the food-based programs and dietary outcomes. To better understand the underlying mechanisms, this study undertakes two analyses. First, it assesses whether results differ when food items provided under the FFW program (wheat and oil) are excluded from the calculation of food variety score. For this purpose, a variant of Eq. (1) is estimated that excludes FFW items (wheat and oil) from the dependent variable. Second, it examines whether the estimated impacts among food-for-work (FFW) and cash-for-work (CFW) beneficiaries differ. According to Bailey (2013), the effect of public works programs on consumption depends on the form of transfer, i.e., food or cash. To check this, this study repeats the estimations based on Eq. (1) but controlling for these groups (FFW only, CFW only, and combination of FFW and CFW).

Results and discussion

Links between FFW participation and dietary diversity

Table 5 presents fixed effects, random effects, and DID regression results for dietary diversity. The three models are presented for comparison but the main interpretations of results are based on the fixed effects specification.Footnote 8 Findings reveal that households participating in food-for-work programs have significantly higher dietary diversity compared with non-participants. Participation in the FFW program is associated with a 0.86-point higher food variety score, on average, or roughly one additional item in a basket that averages 14 items (see Model 1A). This is equivalent to 22% of a standard deviation in the food variety score. Table 5 also reveals that dietary diversity is higher for households with an educated household head. The result implies that education of the head is associated with the addition of approximately one additional food item to the households’ diet. Adult female labor is positively and significantly associated with a higher diversity of food consumption. An implication is that female members, who are primarily responsible for the purchase and preparation of food, contribute to the quality of diet in the household. Survey round indicators reveal that consumption diversity declined significantly in 2003 compared with 2001. Dietary diversity in subsequent years increased, with the largest increase in 2010.

Table 5 Effect of food-for-work participation on dietary diversity-Binary treatment

Exploring underlying dietary mechanisms

If households would not otherwise consume food items provided under a food-for-work program, improvements in dietary diversity may arise directly as a result of foods provided by the program, namely wheat and oil. In Table 6, the fixed effects regression for food variety score (FVS) excludes the FFW food items (wheat and oil). Results indicate that participation in the public works program is still positively and significantly associated with dietary diversity, although the magnitude declines by 0.15 points, or approximately 17%.

Table 6 Effect of food-for-work participation on dietary diversity (fixed effects models with and without food items (i.e., wheat and oil) from food-for-work distribution)

Table 7 summarizes results for tests of differences in the average number of food groups consumed with and without FFW food items. The significant difference in cereal consumption between FFW participants and non-participants disappears once wheat is excluded from the calculation. This implies that the difference in cereal consumption among FFW participants and non-participants is attributed to the wheat received under the FFW. Table 7 also shows that FFW participants had significantly higher consumption of other food items such as vegetables, meat, eggs, butter, spices, and condiments. One can infer from this that FFW participants were able to add other food items, possibly by reallocating expenditures that would have otherwise been used for food items provided under FFW. This has a positive implication for the food security of vulnerable rural households. In an evaluation of the pilot program of cash transfer in the Tigray Region, Berhane et al. (2015) found that the diversity of food consumed by beneficiaries improved because the program allowed them to purchase a greater diversity of food items. Consumption of milk, sweets, legumes, nuts, and seeds is not significantly different between participants and non-participants of the FFW program. One possible explanation may be that households do not readily add these food groups when expanding their diets.

Table 7 Dietary diversity with and without food items from food-for-work (wheat and oil)

To further investigate the mechanism through which higher dietary diversity is observed among public work participants, Table 8 summarizes the regression result that controls for households’ classification based on whether they receive benefits under food-for-work, cash-for-work, or both. Findings show that the benefit from food-for-work mainly contributes to the improved dietary diversity in households participating in public work programs. This finding, however, is not conclusive because the cash-for-work component of the public works program was not in full operation in all survey years but instead had greater coverage in the later survey years. This is confirmed by interaction terms between year indicators and program components, which are positive and significant for both cash and food programs in 2010.Footnote 9

Table 8 Effects of participation in food-for-work versus cash-for-work on household dietary diversity (fixed effects models)

Analysis of linkages using continuous treatment

Table 9 presents results for the link between the continuous treatment of FFW income per adult equivalent and dietary diversity. Findings reveal that dietary diversity increases with higher income from FFW. The magnitude of influence is however small. A 1% increase in FFW income per adult equivalent increases food variety score by 0.001. The dose-response model (Cerulli 2015), which is summarized in Table A2 in the Online Additional File 1, also shows a positive and significant average treatment effect. This implies that FFW has on average a positive link with food variety score when considering all values of FFW income. The dose-response function plot in Fig. 3 illustrates that FVS is weakly increasing as FFW income increases, especially at higher values of FFW income. The precision of the estimated relationship declines sharply at higher values of the treatment, for which observations are scarce.

Table 9 Effects of food-for-work income on household dietary diversity-continuous treatment
Fig. 3
figure 3

Dose-response function of food-for-work (FFW) income on dietary diversity. Dose (t) represents food-for-work income per adult equivalent divided by 25, i.e., one unit represents 25 Ethiopian Birr per adult-equivalent household size

Links between FFW participation and production diversity

Table 10 summarizes the evidence regarding the link between FFW participation and production diversity. Results indicate that FFW participation has no detectable significant association with production diversity. This implies that FFW has no measurable influence on households’ cropping decisions, and provides indirect evidence that the FFW program probably did not displace labor from on-farm agricultural production to an extent that it altered crop choices.

Table 10 Effects of food-for-work participation on production diversity

In terms of other household characteristics, households’ diversity in crop production is positively associated with ownership of land area. This is an intuitive finding which shows that the production capacity of households, in terms of the number of crops planted, depends on land endowment. In relation to crop production capacity, Table 10 also shows that livestock ownership is positively associated with production diversity. An interesting implication from this, in the context of Ethiopia, is that the diversity of crops grown depends on livestock ownership—perhaps because farm households in Ethiopia rely heavily on oxen for plowing. Further, results in Table 10 reveal that engaging in off-farm employment is positively and significantly correlated with production diversity in the sample.

Examining alternative approaches

This study undertakes five robustness checks to examine the consistency of the results. The first robustness check relies on using a balanced sample of households that appear in all survey rounds to estimate the main regressions. Findings show that major results are invariant to this change in sample and conclusions remain the same (see Table A3 in the Online Additional File 1).

Second, this study examines whether results remain consistent across two definitions of the FVS: (i) using nine food groups (i.e., the nine categories defined in Table 2); and (ii) excluding food items that have low nutritional value (i.e., oil and fats, sweets, spices and condiments) from the FVS. In the first case, a binary indicator for each food group is generated, with the indicator taking a value of 1 if a household consumed any food item in the food group (cereals; legumes, nuts, and seeds; vegetables, meat; eggs; milk; oil and fats; sweets; spices and condiments). The household dietary diversity score is then calculated by taking the sum across groups, with the score ranging from 1 to 9. In the second case, food items that have low nutritional value (oil and fats; sweets; spices and condiments) are excluded from the FVS. Regression patterns are similar (see Table A4 in the Online Additional File 1) and indicate that FFW participation remains significantly associated with dietary diversity, regardless of the FVS definition used, although the magnitude of the influence is smaller in the case of the more restricted FVS (see Table A5 in the Online Additional File 1).

Third, an alternative definition of production diversity is used by including the number of livestock species in calculating the score, thereby reflecting the number of both crop and animal species households produce. Results lead to similar conclusions as from the main model, except for a difference in the DID estimation (see Table A6 in the Online Additional File 1). Fourth, the production diversity model is estimated incorporating the one-year lagged FFW participation indicator as a possible driver of the current production diversity score. This allows examining if previous participation in FFW influences crop production in the following year. Results show that lagged FFW participation does not have a significant association with current production diversity, yielding results similar to the main model (see Table A7 in the Online Additional File 1).

A fifth and final robustness check was undertaken by controlling for potential attrition bias in the data. An attrition probit model was first estimated using a binary indicator taking a value one if the household does not belong to the balanced panel and zero otherwise as a dependent variable (see Table A8 in the Online Additional File 1). The Inverse Mills Ratio (IMR) was then calculated based on the prediction from this probit model. Estimating fixed effects regression models, including the IMR as a variable to control for the latent characteristics of attritors, is the last step for checking the attrition bias. According to the results of this model, households that are part of the balanced panel do not differ from the rest of the households in most of the socioeconomic characteristics (see Table A8 in the Online Additional File 1). Differences exist in the age of the household head and the number of adult male members. However, the IMR is not statistically significant at standard test levels when included in the main regression. Point estimates remain similar in sign, magnitude, and significance to those in a regression without the correction (Table A9, Online Additional File 1). This implies that results are not measurably affected by any attrition bias.Footnote 10

Limitations of the study

The PSNP was not static over the course of the first phase (2005–2010), either in terms of targeting or implementation. Subsequent phases also differed over time, for example by adding new components to the existing program. For example, the third phase (PSNP 3) was gender and child sensitive such that it allowed temporary status change for pregnant and lactating mothers from public work programs to free food and cash (World Bank 2016). PSNP 4 incorporated nutrition education and direct investments in nutrition as components. Particularly, PSNP 4 provides 15 kg of wheat and 4 kg of pulses as food payments (Government of Ethiopia 2014; World Bank 2016). This study has focused on the first phase of the program and therefore subsequent program changes do not affect the impacts evaluated here. However, it is acknowledged that one limitation of this study is that program changes that occurred during the implementation of the first phase are not captured. Future research incorporating longer panels of data could, in theory, examine whether nutritional outcomes were affected by changes within and between different phases of the PSNP, for example, in terms of targeting, implementation, or added components.

Conclusions

This study examines whether Ethiopia’s FFW programs contribute to the variety in food consumption and crop production. Based on four waves of survey data (2001, 2003, 2006, and 2010), findings show that participating in FFW programs improved dietary diversity. The association remains positive but smaller in magnitude when food items provided by the FFW are excluded from the food variety score (FVS). Further disentangling the food groups consumed among participants and non-participants in the FFW programs, results show that the observed difference in cereal consumption between the two groups disappears when wheat is excluded from the FVS calculation. An implication is that FFW improves dietary diversity when the food item is not part of the staple diet. Results reveal that FFW slightly crowds in consumption of other food items, possibly enhancing food security of poor rural households. A policy implication is that, by providing food items that are not part of the staple diet as part of a safety net program, the intervention will likely not only assure food availability but also improve dietary diversity. It is possible that the list of potential food items provided under FFW programs is restricted due to the cost and perishability of some food groups. Nevertheless, food-based transfer programs may want to consider providing a wider basket of food items. In truth, later phases of the PSNP (e.g., PSNP 4) have moved toward providing a more diverse basket of food items, for example by providing wheat and pulses. These results highlight the value of this approach. Food items from other groups might also be considered to further improve dietary quality and magnify nutritional benefits of the program.

Results from a dose-response model using a continuous treatment show that a higher intensity of FFW participation is associated with more diversified food consumption. Findings further reveal that FFW participation was uncorrelated with production diversity, which suggests that such programs may not necessarily compete for agricultural labor, at least not to the extent that households are making discernable changes in crop mix.