Abstract
We conducted a randomized controlled trial to determine whether an after-school program paired with a cash transfer (a conditional cash transfer) or a cash transfer alone (an unconditional cash transfer) can help improve health and economic outcomes for young men between the ages of 14 and 17 whose parents have low incomes and who live in neighborhoods with high crime rates. We find that receiving the cash transfer alone was associated with an increase in healthy behaviors (one of our primary outcome composite measures) and that the cash transfer paired with after-school programming was associated with an improvement in the financial health of participants (one of our secondary outcome composite measures). We find no differences in spending on alcohol, marijuana, cigarettes, or other drugs between either the treatment group and the control group. Neither the cash transfer alone nor the programming plus cash transfer had statistically significant effects on our other primary composite measures (physical and mental health or school attendance and disciplinary actions), or our other secondary composite measures (criminal justice engagement or social supports) but in most cases, confidence intervals were too large to rule out meaningful effects. Results suggest that cash transfers hold promise to improve the health of youth without any indication of any adverse effects.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
Homicide is the leading cause of death for non-Hispanic Black or African American youth, due in large part to the lasting effects of structural racism, which contribute to factors such as poverty, housing instability, racial wealth gaps, and a lack of prosocial outlets [1,2,3]. Youth violence is particularly pronounced in Wilmington, Delaware, where more than 3 out of every 1000 teens are injured or killed by gun violence annually—nearly double the rate of cities like Chicago, Illinois, or Trenton, New Jersey, which are known for their high crime rates [4].
In 2014, the Centers for Disease Control and Prevention (CDC) conducted an epidemic investigation in response to the disproportionately high homicide rate in Wilmington, DE compared to every other state [5]. They concluded that most individuals involved in firearm violence were young men with a substantial number of risk factors, including cumulative experience with prior violent injury, unemployment, child welfare investigation, juvenile justice involvement, and adverse school system events (e.g., drop-out, disciplinary actions).
In response, the State of Delaware Department of Health and Social Services (DHSS) began to look at new ways to meet the needs of young men with risk factors identified in the CDC’s report. The state offered opportunities for job training and subsidized employment as well as comprehensive programming that prepared youth for employment. But, there was a low uptake of these opportunities and the administration wanted to try something new. Leadership at DHSS recognized that poor youth engagement in employment opportunities was likely a result of structural inequities that not only impact employment programming participation but also increase vulnerability in the other domains, including school engagement and juvenile justice involvement. Monetary subsidies or cash transfers might help youth overcome barriers to program participation, such as money for transportation, childcare, food, stable housing, appropriate clothing, or meeting other basic needs. Structural issues are both complex and dynamic, with a multi-level, bi-directional influence between youth and their social environment (policies impact families, family functioning impacts youth, etc.), and as a result, the specific barriers faced by any individual youth and family are heterogeneous.
Alternatively, cash transfers alone might help surmount structural barriers. It is possible that youth violence is not caused by youth unemployment; but rather, youth unemployment and violence are correlated and are both caused by larger structural issues. Providing an unconditional cash transfer directly to youth that is not conditional on programming participation may allow them to address their individual and family needs that facilitate thriving in social spaces tailored to their personal goals, including school, and avoid adverse systems interactions, such as justice and/or child welfare investigation involvement. They could also directly improve outcomes by addressing challenges like unstable housing, lack of food security, limited transportation options, and insufficient funds for healthy recreational activities [6,7,8,9].
To test these hypotheses, we partnered with Delaware DHSS to implement and study a cash transfer with and without an after-school program. The “Yes! Study” involved a randomized controlled trial where 167 young men between the age of 14 and 17 were assigned to one of three study arms: (1) after-school program paired with a cash transfer that they received if they attended the first few sessions (a partially conditional cash transfer); (2) a cash transfer without any program requirements (an unconditional cash transfer); or (3) a waitlisted group that served as a control group and received no treatment until after the study was complete. Eligibility for the program was based on family income and ZIP code of residence. The after-school program consisted of activities such as tutoring, job training, conflict resolution training, financial coaching, recreational and arts programming, and training for social skills.
We focused on analysis on three primary outcomes: a physical and mental health measure based on survey responses related to mental health and violence victimization, a health behaviors measure based on questions about criminal and other risky behavior, and a measure of school attendance and disciplinary actions based on both survey data and school administrative data. A key theoretical goal of this intervention was a reduction in criminal justice engagement and violence exposure. We created a survey-based composite measure related to criminal justice but consider it a secondary outcome because we did not have the necessary sample size to estimate impacts on low-probability events and we were unable to access reliable administrative data on criminal justice engagement to augment the survey responses.
We find that receiving the UCT was associated with an increase in healthy behaviors, one of our primary outcome composite measures. This means that participants who received the cash transfer were less likely than the control group to do things like drink alcohol, use marijuana, take prescription medication without a prescription, be in a physical fight, carry a weapon, or use a vapor product. Neither the cash transfer alone nor the cash transfer paired with programming had statistically significant effects on our other composite measures for our primary outcomes of interest: physical and mental health or school attendance and disciplinary actions. But, in most cases, confidence intervals were too large to rule out meaningful effects—either positive or negative.
We also find that the cash transfer paired with programming was associated with improved financial health, one of our secondary outcome composite measures. This may be because the after-school programming included financial coaching, which has been shown through experimental data to produce a number of significant effects on a variety of outcomes that contribute to financial health, including financial stress (Theodos, Stacy, and Daniels 2018). There were no statistically significant differences between groups for our other secondary composite measures: criminal justice engagement or social supports.
Quantitative analysis from the survey data showed that participants in the cash transfer-only group spent more money over the past 30 days on electronics, accessories, food, entertainment, and “other items” than the control group. Participants in the cash transfer plus programming group spent less on books and magazines than the control group, but no differently on any other items. There were no statistically significant differences between either treatment group and the control group for spending on alcohol, marijuana, cigarettes, or other drugs, meaning that they did not report purchasing more of these items than the control group.
These results show that cash transfers alone are associated with an increase healthy behaviors and a reduction in risky behaviors for young men at risk of violence exposure, and that cash transfers plus programming are associated with improvements in the financial health of these young men. Given that the sample was small and take-up rates were not 100%, we expect our estimates to be a lower-bound estimate for the effect of the intervention on our outcomes of interest. Our study lacks the power to detect modest but meaningful changes in other composite measures such as overall physical and mental health, school attendance and disciplinary actions, criminal history, and social supports. With more power, these effects may be present. Future research should conduct similar analyses on a larger sample to determine whether these effects are present.
Methods
We conducted a three-arm RCT and pre-registered our research design with the Open Science Foundation (https://osf.io/wxtsb/). We randomized participants into the following three groups:
-
1.
Cash transfer paired with after-school programming (conditional cash transfer). This group began programming in the fall of 2021 and received six months of after-school curriculum accompanied by $150 a week if they attended enough sessions of the afterschool program to submit all of their relevant documents for the cash transfer (which was generally 2 to 4 sessions). The programming and cash transfer ended in May of 2022. There were 59 programming plus cash transfer participants; 55 excluding dropouts.
-
2.
Cash transfer alone (unconditional cash transfer). This group received $150 weekly for six months beginning in the fall of 2021, ending in May 2022. There were 56 participants in cash transfer only.
-
3.
Control group. This group was waitlisted for programming after the completion of the study. Control group programming began in the summer of 2022 and ran until November 2022. There were 57 control group participants; 56 excluding dropouts.
The after-school programming consisted of tutoring, conflict resolution training, financial coaching, recreational and arts activities, and soft skills training. DHSS provided transportation to and from the program venue, food, and tutoring before all other planned activities; between 3:30 pm and 4:30 pm. Programming took place an office park and retail center in the riverfront area of Wilmington, which was considered by the participants to be a safe, neutral location.
Study Participants
Young men eligible for the study were between the ages of 14 and 17, lived in families with low-incomes (those eligible for Medicaid), and resided in three Wilmington ZIP codes that DHSS identified as having high rates of violent crime: 19801, 19802, and 19805.
Using Medicaid enrollment data, DHSS identified close to 2000 eligible young men in the spring of 2021 to participate in the study. During summer and fall of 2021, we worked with DHSS to send an introductory flyer, e-mail, and text messages with information about the program and study to all eligible youth.
We implemented different IRB-approved methods to increase enrollment into the study:
-
Cold calls to eligible families conducted by the Urban team to explain the study and invite them to enroll.
-
A dedicated Facebook page about the study with flyer-style posts and information about how to enroll that was continuously updated.
-
A raffle for $250 for enrolled participants who successfully invited other eligible participants to enroll.
-
Partnerships with local nonprofit organizations focused on youth development to invite eligible clients to enroll in the study.
However, even with these enhanced recruitment methods, participation did not reach our sample size goal of 225. Due to COVID-19 safety protocols instituted at the time of recruitment, in person recruitment activities were not allowed. These restrictions likely had a significant impact on our final sample size since face-to-face connection is key to gaining trust amongst potential participants. Overall, 172 young men enrolled in the study; 167 excluding dropouts.
Randomization
Randomization occurred in one batch in October 2021. We used blocked (stratified) randomization to ensure balance across groups in terms of race, ethnicity, and neighborhood. Pairs of siblings were kept in the same treatment or control group. Individuals randomized into the cash transfer plus programming and cash transfer alone had a 2021 start date, and those randomized into the control group were offered to start programming in 2022, after the RCT was completed. All groups, including the waitlisted control group, took all surveys during the same time ranges. Within the first few weeks of enrollment, one youth dropped out of the control group since he was incarcerated and four dropped out of the cash transfer plus programming for unreported reasons.
Data Collection
We collected data via surveys and through administrative data from the Delaware Department of Health and Social Services on program participation and cash transfer pickup rates, and from the Delaware Department of Education on school attendance and disciplinary actions.
Surveys
Participants enrolled in this study were administered a total of six surveys: a baseline survey after enrollment but before programming began (or during the first week of programming), four consecutive monthly surveys, and a final exit survey after the completion of the program and cash transfer.
The baseline and the final exit surveys consisted of a maximum of 107 questions (inclusive of skip patterns). The baseline survey assessed demographics and self-reported school attendance, employment status, saving and spending patterns, financial stress, perceived health status, and criminal justice involvement. The measure of food insecurity was selected from the National Survey of Children’s Health [10]. Five items were used to assess housing instability consistent with the CDC definition including affordability, risk of eviction, and frequent moves [11]. Validated scales were used to assess social support and psychological distress, which was incorporated into the physical and mental health composite [12, 13]. Fifteen items with strong psychometric properties were used to measure violent and non-violent delinquency behaviors [14]. Three items were used to assess self-esteem and two items were to assess future orientation in the domains of fatalism and belief in the future [14, 15]. Self-reported lifetime use and past-30 day frequency of substance use were assessed with measures consistent with those from the Youth Risk Behavior Surveillance System [1].
The monthly survey consisted of 36 questions and was repeated for four consecutive months. Topics included income, employment status, purchasing patterns, family responsibilities and financial contributions to household expenses, food and financial security, delinquency behaviors, criminal justice involvement, substance use, self-esteem, and perceived health status for the previous 30 days. For youth in the cash transfer plus programming group, the monthly survey assessed engagement in programming, including reasons for missing program sessions.
The final exit survey repeated assessments of food insecurity, housing instability, saving and spending patterns, financial stress, social support, psychological distress, self-reported school attendance, employment status, financial stress, perceived health status, substance use, delinquency behaviors, criminal justice involvement, and future orientation. For youth in the cash transfer plus programming group, the exit survey assessed engagement in and perceived usefulness of the program.
Upon survey completion, participants were sent an e-gift card to either their cell phone or email address for time spent participating in the study. Participants received a $20 e-gift card for the baseline survey and each completed monthly survey, and $40 e-gift card for completing the exit survey. In order to increase exit survey response rates, the team increased the value of the gift card ($20 to $40), used a third-party outreach worker to visit participants at their homes to assist with completion of the exit survey, and offered a special event with food at the location of the program sessions where participants were invited to complete the survey. The increased outreach methods led to 126 participants completing the exit survey.
Administrative Data
We collected administrative data from the Delaware Department of Health and Social services on program participation and cash transfer pickup, as well as data from the Delaware Department of Education on school attendance and disciplinary actions. We also used Medicaid enrollment data to draw our sample.
Outcomes of Interest
The primary outcomes of interest for this study include those related to physical and mental health, health behaviors, and school attendance and disciplinary actions (Table 1). The secondary outcomes of interest include criminal history/involvement with the justice system, financial health, and social supports. Despite being a goal of the intervention, criminal history/involvement with the justice system is not a primary outcome in our analysis due to a lack of administrative data and the low frequency of such engagement which makes estimation challenging. Some criminal justice related measures are included in our primary measures of physical and mental health when they relate to injury and health behaviors, such as questions about fighting and carrying weapons.
To account for multiple outcomes and the probability of a type I error (a “false positive”), we combine individual measures into composite indices, as shown below. This reduces concerns about false positives for individual variables, similar to the methods used by Kling, Liebman, and Katz [16] and Karlan and Valdivia [17] (to see results for each individual measure, see the online appendix).
Analysis Methods
Our primary method for estimating the impact of the unconditional and conditional cash transfer plus programming on our outcomes of interest is an “intent to treat” model which tests the effect of being offered treatment on outcomes, whether or not the individuals participated in programming or received the cash transfer. This is estimated using the following linear regression model:
where \({Y}_{i}\) is the outcome of interested measured using the exit survey data and administrative data, \({\alpha }_{i}\) is an intercept, \(treate{d}_{i}\) is equal to 1 for the group being studied and zero otherwise, \({X}_{i}\) is a set of control variables, and \({\epsilon }_{i}\) is the error term. For control variables, we first include the education level of the participants’ mother, an indicator for whether he was in foster care, his race and ethnicity, ZIP code, and age. We include these prognostic variables as covariates to increase the precision of the effect estimate. We select these control variables based on theory rather than on baseline t-tests of differences since choosing covariates based on significance tests for baseline differences can lead to omissions of important covariates and inclusion of irrelevant covariates (de Boer et al. 2015). Second, we include each of our primary and secondary outcomes calculated using the baseline survey and set to zero if the participant did not respond to the baseline survey questions along with dummy variables identifying participants who did not respond to the baseline survey. We initially planned to include baseline survey responses in a fixed-effects model to account for heterogeneity between groups and any issues that arose with balance. However, lower than expected survey response rates for the baseline survey reduced the sample size available for a full fixed-effects model. Including baseline responses where available and dummies where they are not allows us to keep the full sample of outcome survey respondents while accounting for observable differences at baseline.
We use a regression model rather than a t-test of sample means both to include control variables and in order to estimate heteroskedastic robust standard errors which account for the likelihood that the variance of the estimated treatment effect is not constant across participants.
We estimate the above model in three ways. First, we estimate the impact with treatment defined as the cash transfer, where only the cash transfer group and the control group are included to estimate an average treatment effect for the cash transfer component alone. Second, we estimate the model with treatment defined as cash transfer plus programming and with the cash transfer only group excluded. Third, we estimate the model with treatment referring to any type of cash transfer (both conditional and unconditional) and equal to one for both the cash transfer only and the cash transfer plus programming group; this allows us to increase the sample size within this intervention component to examine it from a different angle.
We also estimate the “treatment on the treated” or the impact of actually participating in programming. This method allows us to detect effects that may have been drowned out by non-participation in the prior model. However, participants who choose to participate in programming may systematically differ in unobservable ways from those who choose not to participate, which may cause bias in the results. We correct for this potential bias by estimating the complier average causal effect, which uses an instrumental variables approach to correct for this bias [18]. In this approach, randomization into the treatment group is used as an instrument for the actual treatment. For the cash-only group and for analysis of the combined groups, we define the treatment as receiving the cash transfer. For the programming group, we define the treatment as attending at least one-third of sessions, but also ran robustness checks where treatment is defined as the number of sessions attended, attended a single session, attended half the sessions, and attended two third of sessions.
Our initial research plan included the use of fixed-effects models that would incorporate data from both the baseline and exit surveys. Fixed-effects models would have allowed us to remove any time-invariant unobserved heterogeneity that exists for each individual that may be related to their outcomes. This would account for any baseline differences between groups that existed at the beginning of the programming and cash transfer period. Analysis using this method, however, would have relied on a much smaller sample size. While 72% of participants took the exit survey, only 55% took both the baseline and the exit survey. Among the control group, only 42% of participants took both surveys (24 participants). Similarly, we do not use monthly surveys in our data analysis since response rates for the monthly survey were so low and only 21 participants in the control group took both the baseline, outcome, and at least on monthly survey. Using just the outcome survey, we have a 67% response rate for the control group, a 61% response rate for the programming plus cash transfer group and an 89% response rate in the cash transfer only group.
A reverse power analysis revealed that we would not have the power to identify less than 0.51 to 0.29 standard deviations in our key variables. Given that the sample was small and take-up rates were not 100%, we expect our estimates to be attenuated and a lower-bound estimate for the effect of the intervention on our outcomes of interest.
Group Equivalence at Baseline
To test for potential differences across cohorts even after randomization, we analyzed differences in demographic characteristics and outcome measures at baseline, presented in Table 2. We find that the groups appear balanced across key demographic characteristics included in the administrative data but there were statistically significant differences between groups in many of our key outcome measures. These differences may exist by chance. Or, they may have been produced by differential nonresponse bias across groups. As described above, we include our primary and secondary outcomes calculated using the baseline survey, where available, to account for observable differences between groups.
Results
Who Participated in Programming and Who Picked Up the Cash Transfer Card?
Out of the 55 study participants in the cash transfer plus programming group, 39 (71%) attended at least 1 session (Table 3). Of these, 38 (69%) attended enough sessions to receive the cash transfer (this varied by participant and was determined by the number of sessions needed to submit all of their paperwork for the cash transfer), 16 (29%) attended between 1 and 17 sessions (or one-third of all possible sessions), and 23 (42%) attended 18 sessions or more. The average percent of session attended was 35.14%. While these take-up rates may appear low, they are comparable to other after-school programs such as a multisite, after-school program for middle-school students in an urban school district which saw average take-up rates of 38%, and the Urban Alliance Program for which 54% of participants finished their prework and started their internship [19, 20]. Other forms of educational programing, such as financial coaching, have been shown to have take-up rates of 37% and 56%, and participants who took up coaching usually only attended one session [21].
Out of the 111 participants eligible to receive the cash transfer (those in the cash transfer only group plus those in the cash transfer plus programming group), 86 (77%) picked up the card that would enable them to receive the cash transfers. A larger share of the participants in the cash transfer only group picked up the card (86%) than those in the cash transfer plus programming group (69%); and a t-test shows this difference is statistically significant at the 0.05% level. This is likely because those in the programming group were only able to pick up the reloadable cash transfer card if they attended at least the first few weeks of programming (enough sessions for them to submit all of their forms for the cash transfer card). Not picking up the card could also reflect challenges communicating with youth after enrolling in the study (which was also present when attempting to get them to take the baseline survey), and in some cases due to lack of trust in systems that may have historically excluded them.
What Did Participants Spend the Money on?
Participants in the cash transfer-only group reported spending more money over the past 30 days on electronics, accessories, food, entertainment, and other items than the control group (Fig. 1). Participants in the cash transfer plus programming group reported spending less on books and magazines than the control group. The programming plus cash transfer group had fewer statistically significant differences from the control group than the cash alone group did. This may be due to lower cash transfer take-up rates of the cash plus programming group and due to the financial coaching components of programming that encouraged the youth to save their money rather than spend it on consumable items. There were no statistically significant differences between either the treatment group and the control group for spending on alcohol, marijuana, cigarettes, or other drugs, meaning that they did not purchase more of these items than the control group did.
Primary Outcomes
Using both an intent-to-treat and treatment on the treated model, we find that the cash transfer was associated with improved health behaviors for the young men in that group (Table 4). This means that young men who were offered and/or received the cash transfer were less likely to do things like drink alcohol, use marijuana, take prescription medications without a prescription, get in a physical fight, carry a weapon, or use an electronic vapor product. The variables that were statistically significant within this index were prescription medication usage in the ITT model, and marijuana use, prescription medication, and physical fights in the TOT model.
Additionally, while the other composite measures were not statistically significant, all of them were in the intended direction (i.e., they indicate a more positive outcome for participants in the cash transfer and cash transfer plus programming group than those in the control group). And while the overall composite measures were not significant for physical or mental health, young men in the cash transfer plus programming group were less likely to visit the ER (in both the ITT and TOT models) and young men in the cash transfer group were less likely to visit the ER and more likely to report that they felt loved and wanted in the TOT model, some of the measures within this composite.
Similarly, while the school attendance and disciplinary actions composite index was not statistically significant for any group or model, participants who received the cash transfer were less likely to get into a fight in school in the TOT model.
Secondary Outcomes
When looking at our secondary outcomes, we find that participants in the cash transfer plus programming group had higher financial health scores than the control group at outcome in both the intent to treat and the treated on the treated models (Table 5). This result was driven participants’ higher likelihood of having a bank account, lower financial stress, and in the TOT model, a higher likelihood of contributing to household finances. Among the cash transfer-only group, the estimated effect on financial health was not statistically significant at the 0.10 level. For the cash transfer plus programming group, estimates from alternative versions of the TOT model with different thresholds for treatment suggest that impacts on financial health increased with participation in the after-school program, which included a financial education component. We estimated effect sizes that rose from of 0.43 for attending any programming, to 0.62 for attending one-third of the sessions, 0.86 for attending half the sessions, and 1.19 for attending two-thirds of the sessions.
Although the other composite measures were not significant, individual measures within these composites were. For instance, young men in the cash transfer-only group were more likely to report that they had a friend they can share their joys and sorrows with (in the TOT model), and participants in the cash transfer plus programming group were more likely to say that they could talk about their problems with their family.
Discussion
Cash transfers designed to improve outcomes for people in communities with high rates of poverty and violence often prove to be difficult to implement from a political perspective. Some opponents believe that people who need financial assistance are untrustworthy stating that their financial position reflects a moral failing rather than a societal one [22]. Therefore, it is difficult for policymakers to garner support for such policies. Rigorous evidence can provide one avenue to support cash transfer policies.
This study shows that providing cash transfers directly to youth who have a high risk of violence exposure encourages healthier behaviors. Specifically, we find that offering an unconditional cash transfer of $150 each week was associated with healthier behaviors among participants (such as reducing drug and alcohol use and physical fights), and that participants that were offered a cash transfer plus after-school programming showed improvements in financial health.
This transfer was novel in that it was provided directly to youth, and that it was relatively large; each young man in the study received $3600 over 6 months (or $600 per month), which relative to the control group’s average income of $240 per month, represented a large sum. The cash transfer also represented a large sum compared to participants’ family income, which for Medicaid eligible families, is an average of $4611/month [23]. That being said, the total amount may not be a large amount given the overall costs of goods, housing, transportation, and services.
These results add to the body of evidence showing positive impacts from cash transfers. Prior research shows that unconditional cast transfers reduce hospitalizations and criminalized activity and improve nutrition, mental health, school attendance and grades, psychological well-being, and the probability of healthy birth weights [24,25,26,27,28]. More recently, early studies of guaranteed income cash transfers in the USA have shown that cash transfer recipients experienced lower rates of income volatility, food insecurity, and improved mental health, energy, and physical functioning [9, 29].
Our research builds more directly on research focused on impacts for young people. For instance, the PROGRESA/Oportunidades conditional cash transfer in Mexico had positive long-term effects on schooling for children in the families that received the transfer [6, 30]. Cash transfers have also been found to reduce school dropout rates [31], improve youth mental health [32, 33], reduce illness rates [34], reduce the likelihood of anemia, help youth grow more quickly [34], reduce child poverty [35], lengthen life spans [36], increase schooling [36], reduce the likelihood of being underweight [36], increase the likelihood of enrolling in school [37], reduce child labor [37, 38], increase psychosocial well-being [39], reduced exposure to violence [40], and increase incomes in adulthood [36]. Studies have shown that these effects are strongest for youth in families with the lowest incomes [37].
The spending results align with studies showing that cash transfer recipients are not more likely to consume temptation goods, such as drugs and alcohol [9, 26, 31, 41,42,43,44]. A meta-analysis of studies from Latin America, Africa, and Asia showed that on average cash transfers have a significant negative effect on total expenditures on temptation goods, equal to − 0.18 standard deviations [44]. Our research expands these findings to the USA and to young people.
Our study is one of only a few that have compared conditional and unconditional cash transfers in the same study. Prior research has not come to a clear consensus on which type works better. Baird, McIntosh, and Ozler [31] compared a conditional and unconditional cash transfer in Malawi targeted at adolescent girls. They found that the conditional cash transfer was more effective at reducing school dropout and improving English reading comprehension. However, the unconditional cash transfer proved more successful at improving non-school outcomes such as reducing pregnancy and early marriage. In rural Burkina Faso, Akresh, de Walque, and Kazianga [30] found that for school enrollment and most child health outcomes, conditional cash transfers outperformed unconditional cash transfers. Premand and Barry [45] studied a program in Niger and found that cash transfers alone did not alter parenting practices and did not improve early childhood development outcomes but did improve dietary diversity at the household level (but not for children). Finally, McIntosh and Zeitlin [46] studied a workforce training program in Rwanda and found that, while the workforce training program was successful in improving a number of core outcomes, cost-equivalent cash transfers improved the same outcomes as well as consumption, income, and wealth. We find greater improvement in health behavior from the cash transfer alone, but greater improvement in financial health for young men in the program.
Impacts on health behavior may have been larger for the cash-only group because participation in that group was greater—86% for the cash-only group and only 69 percent for the cash plus programming group. And we suspect that the young men who were reached by the unconditional cash transfer but not the conditional one had fewer supports at home since many program attendees reported that they only showed up because their parents made them do so. Other studies have found that youth who drop out of after-school programming are more at risk in terms of drug use and truancy than those who do not drop out, suggesting that these programs miss the young people who need supports the most [47]. Unconditional cash transfers may be better at reaching these young people.
Impacts on financial health may have been stronger for programming plus cash transfer participants because of the financial education component of the programming. Participants reported that the financial education helped them to better save their money, and findings from the TOT analysis with different dosage sizes confirmed that the more sessions a participant attended, the greater positive impact it had on their financial health. And, the financial coaching model used by the organization that provided this component of the intervention, $tand By Me, has been shown to have positive effects on financial well-being, both in their perceptions of progress and on various credit metrics [48]. But financial education was only a component of programming, so regular attendance at programming or the cash transfer may have reinforced or worked in concert with the financial component to yield these results. Unfortunately, the small sample size for our study prevented us from identifying smaller or more heterogeneous impacts. We failed to find statistically significant impacts (at even the 10% level) on our primary outcome composite measures for physical and mental health and school attendance and disciplinary actions. We also failed to find statistically significant impacts on two of our secondary outcome composite measures: criminal justice engagement and social supports. This may be due to the small sample size and less than full participation and survey response rates. Low enrollment rates in the study might imply challenges to scaling it. However, they might also reflect distrust of researchers, in which case a cash transfer and/or after-school program that is not part of a study might be more effective at recruiting participants. Or, low enrollment could reflect distrust of the State. In that case, any programs run by the state may have just as much of a challenge with participation. Or, low enrolment might have been driven by COVID since it is harder to recruit people into programs when it cannot be done face to face. In that case, future enrollment whether as part of a study or not is likely to be much more successful since in-person recruitment is now possible.
While the results are limited due to power, they show that such initiatives hold promise to improve the lives of youth. And, none of our findings suggest that youth used their cash transfer for nefarious purchases or that they increased in risky behaviors, at least allaying concerns about negative impacts. Future research should expand the sample size on such an intervention to determine whether the effects we were starting to see here are statistically significant with more power.
References
Centers for Disease Control and Prevention. Youth risk behavior surveillance system (YRBSS). Centers for Disease Control and Prevention. Published 2019. https://www.cdc.gov/healthyyouth/data/yrbs/index. Accessed 15 Dec 2023
Centers for Disease Control and Prevention. Violence Prevention Fast Facts. Published 2019. Accessed January 29, 2024. https://www.cdc.gov/violenceprevention/youthviolence/fastfact.html
Jay J. Structural racism and long-term disparities in youth exposure to firearm violence. JAMA Netw Open. 2023;6(5):e2312425. https://doi.org/10.1001/jamanetworkopen.2023.12425.
Horn B, Reyes JM, Parra E, Jedra C, Fenn L. Wilmington: most dangerous place in America for youth. The News Journal and Associated Press. Published September 8, 2017. https://www.delawareonline.com/story/news/crime/2017/09/08/our-babies-killing-each-other/100135370/
Sumner S, Mercy J, Hillis S, Maenner M, Socias C. Elevated rates of urban firearm violence and opportunities for prevention—Wilmington, Delaware. Division of Violence Prevention, National Center for Injury Prevention and Control, Centers for Disease Control and Prevention. Published November 3, 2015. https://dhss.delaware.gov/dhss/otsa/files/cdcgunviolencereport10315.pdf
Behrman JR, Parker SW, Todd PE. Do conditional cash transfers for schooling generate lasting benefits?: a five-year followup of PROGRESA/Oportunidades. J Human Resour. 2011;46(1):93–122.
Behrman JR, Sengupta P, Todd PE. Progressing through Progresa: an impact assessment of a school cash transfer experiment in Mexico. Econ Dev Cult Change. 2005;54(1):237–75.
Schultz T. School subsidies for the poor: evaluating the Mexican Progresa poverty program. J Dev Econ. 2004;74:199–250.
West S, Castro A. Impact of guaranteed income on health, finances, and agency: findings from the Stockton randomized controlled trial. J Urban Health New York Acad Med. 2023;100(2):227–44. https://doi.org/10.1007/s11524-023-00723-0.
Child and Adolescent Health Measurement Initiative. National Survey of Children’s Health (NSCH). Pulished 2021. https://www.childhealthdata.org/learn-about-the-nsch/NSCH. Accessed 3 Nov 2023
Frederick TJ, Chwalek M, Hughes J, Karabanow J, Kidd S. How stable is stable? Defining and measuring housing stability. J Community Psychol. 2014;42(8):964–79.
Zimet GD, Powell SS, Farley GK, Werkman S, Berkoff KA. Psychometric characteristics of the multidimensional scale of perceived social support. J Pers Assess. 1990;55(3/4):610–7.
Andrews G, Slade T. Interpreting scores on the Kessler psychological distress scale (K10). Aust N Z J Public Health. 2001;25(6):494–7.
Haynie DL, Soller B, Williams K. Anticipating early fatality: friends’, schoolmates’ and individual perceptions of fatality on adolescent risk behaviors. J Youth Adolesc. 2014;43:175–92.
Johnson SRL, Blum RW, Cheng TL. Future orientation: a construct with implications for adolescent health and wellbeing. Int J Adolesc Med Health. 2014;26(4):459–68.
Kling JR, Liebman JB, Katz LF. Experimental analysis of neighborhood effects. Econometrica. 2007;75(1):83–119. https://doi.org/10.1111/j.1468-0262.2007.00733.x.
Karlan D, Valdivia M. Teaching entrepreneurship: impact of business training on microfinance clients and institutions. Rev Econ Stat. 2011;93(2):510–27. https://doi.org/10.1162/rest_a_00074.
Angrist JD, Imbens GW, Rubin DB. Identification of causal effects using instrumental variables. J Am Stat Assoc. 1996;91(434):444–55. https://doi.org/10.1080/01621459.1996.10476902.
Cross AB, Gottfredson DC, Wilson DM, Rorie M, Connell N. The impact of after-school programs on the routine activities of middle-school students: results from a randomized, controlled trial. Criminol Public Policy. 2009;8(2):391–412. https://doi.org/10.1111/j.1745-9133.2009.00555.x.
Theodos B, Pergamit M, Hanson D, Teles D, Gerken M, Thomas K, Gedo S, Park J. Evaluation of the urban alliance high school internship program. Washington, DC: Urban Institute; 2023 https://www.urban.org/research/publication/evaluation-urban-alliance-high-school-internship-program. Accessed 15 Dec 2023
Theodos B, Stacy CP, Daniels R. Client led coaching: a random assignment evaluation of the impacts of financial coaching programs. J Econ Behav Organ. 2018;155:140–58. https://doi.org/10.1016/j.jebo.2018.08.019.
Marinescu I. No strings attached: the behavioral effects of U.S. unconditional cash transfer programs. Published February 19, 2018. https://www.nber.org/papers/w24337. Accessed 15 Dec 2023
ZipRecruiter. Medicaid eligibility salary. Published 2023. https://www.ziprecruiter.com/Salaries/Medicaid-Eligibility-Salary#:~:text=As%20of%20Dec%2011%2C%202023,%2Fweek%20or%20%244%2C611%2Fmonth. Accessed 15 Dec 2023
Salkind NJ, Haskins R. Negative income tax: the impact on children from low income families. J Fam Issues. 1982;3(2):165–80.
Gertler PJ (2000) Final report: the impact of Progresa on health. Washington, DC: International Food Policy Research Institute
Akee RKQ, Copeland WE, Keeler G, Angold A, Costello EJ. Parents’ incomes and children’s outcomes: a quasi-experiment using transfer payments from casino profits. Am Econ J Appl Econ. 2010;2(1):86–115. https://www.jstor.org/stable/25760194. Accessed 15 Dec 2023
Forget EL. The town with no poverty: the health effects of a Canadian guaranteed annual income field experiment. Can Public Policy. 2011;37(3):283–305. https://doi.org/10.3138/cpp.37.3.283.
Haushofer J, Shapiro J. The short-term impact of unconditional cash transfers to the poor: experimental evidence from Kenya. Q J Econ. 2016;131(4):1973–2042. https://doi.org/10.1093/qje/qjw025.
Bogle M, Bramhall E, Fiol O, Gwam P, Maag E, Noble O, Tatan PA, Triplett T, Walker F (2022) An evaluation of THRIVE East of the river: findings from a guaranteed income pilot during the COVID-19 pandemic. Washington, DC: Urban Institute. https://www.urban.org/research/publication/evaluation-thrive-east-river. Accessed 15 Dec 2023
Akresh R, de Walque D, Kazianga H. Evidence from a randomized evaluation of the household welfare impacts of conditional and unconditional cash transfers given to mothers or fathers. Policy Research Working Papers. WPS 7730 . Published online June 1, 2016. https://doi.org/10.1596/1813-9450-7730
Baird S, McIntosh C, Özler B. Cash or condition? Evidence from a cash transfer experiment. Q J Econ. 2011;126(4):1709–53. http://www.jstor.org/stable/41337177. Accessed 15 Dec 2023
Angeles G, de Hoop J, Handa S, Kilburn K, Milazzo A, Peterman A. Government of Malawi’s unconditional cash transfer improves youth mental health. Soc Sci Med. 2019;225:108–19. https://doi.org/10.1016/j.socscimed.2019.01.037.
Zimmerman A, Garman E, Avendano-Pabon M, et al. The impact of cash transfers on mental health in children and young people in low-income and middle-income countries: a systematic review and meta-analysis. BMJ Glob Health. 2021;6(4):e004661. https://doi.org/10.1136/bmjgh-2020-004661.
Gertler P. Do conditional cash transfers improve child health? Evidence from PROGRESA’s control randomized experiment. Am Econ Rev. 2004;94(2):336–41. https://doi.org/10.1257/0002828041302109.
Barrientos A, DeJong J. Reducing child poverty with cash transfers: a sure thing? Dev Policy Rev. 2006;24(5):537–52. https://doi.org/10.1111/j.1467-7679.2006.00346.x.
Aizer A, Eli S, Ferrie J, Lleras-Muney A. The long-run impact of cash transfers to poor families. Am Econ Rev. 2016;106(4):935–71. https://doi.org/10.1257/aer.20140529.
Galiani S, McEwan PJ. The heterogeneous impact of conditional cash transfers. J Public Econ. 2013;103:85–96. https://doi.org/10.1016/j.jpubeco.2013.04.004.
de Hoop J, Rosati FC. Cash transfers and child labor. World Bank Res Obs. 2014;29(2):202–34. https://www.jstor.org/stable/24582416. Accessed 15 Dec 2023
Attah R, Barca V, Kardan A, MacAuslan I, Merttens F, Pellerano L. Can social protection affect psychosocial wellbeing and why does this matter? Lessons from cash transfers in sub-Saharan Africa. J Dev Stud. 2016;52(8):1115–31. https://doi.org/10.1080/00220388.2015.1134777.
Chakrabarti A, Handa S, Angeles G, Seidenfeld D. A cash plus program reduces youth exposure to physical violence in Zimbabwe. World Dev. 2020;134:105037. https://doi.org/10.1016/j.worlddev.2020.105037.
Burtless G (1985) The work response to a guaranteed income: a survey of experimental evidence In Conference Series Proceedings, 30:22–59. Federal Reserve Bank of Boston. https://fedinprint.org/item/fedbcp/19424. Accessed 15 Dec 2023
Salehi-Isfahani D, Mostafavi-Dehzooei MH. Cash transfers and labor supply: evidence from a large-scale program in Iran. J Dev Econ. 2018;135:349–67. https://doi.org/10.1016/j.jdeveco.2018.08.005.
Gertler PJ, Martinez SW, Rubio-Codina M. Investing cash transfers to raise long-term living standards. Am Econ J Appl Econ. 2012;4(1):164–92. https://doi.org/10.1257/app.4.1.164.
Evans DK, Popova A. Cash transfers and temptation goods. Econ Dev Cult Change. 2017;65(2):189–221. https://doi.org/10.1086/689575.
Premand P, Barry O. Behavioral change promotion, cash transfers and early childhood development: experimental evidence from a government program in a low-income setting. J Dev Econ. 2022;158:102921. https://doi.org/10.1016/j.jdeveco.2022.102921.
McIntosh C, Zeitlin A. Using household grants to benchmark the cost effectiveness of a USAID workforce readiness program. J Dev Econ. 2022;157:102875. https://doi.org/10.1016/j.jdeveco.2022.102875.
Weisman SA, Gottfredson DC. Prev Sci. 2001;2(3):201–5. https://doi.org/10.1023/a:1011515024809.
Theodos B, Teles D, Docter B. Could coaching improve consumer credit use behavior? Evidence from a state program. J Financ Couns Plan. Published online June 23, 2023. https://doi.org/10.1891/JFCP-2022-0022
Acknowledgements
Funding for this research was provided by the Evidence for Action program of the Robert Wood Johnson Foundation under grant number 79355. Thank you to our partners at DHSS and Career Teams for their partnership on this work, including Janneen Boyce, Crystal Cammile, Dana Fenwick, Ray Fitzgerald, Thomas Hall, Francis Riddick, Tiffany Townsend Warrick, and Secretary Kara Walker. Thank you also to those who helped with this work along the way, including Braydon Meixell, Mica O’Brian, Kassie Scott, Eva Anambo, Brett Theodos, and Jesse Jannetta.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix Tables 6, 7, 8, 9, 10 and 11
Appendix Tables 6, 7, 8, 9, 10 and 11
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Stacy, C.P., Teles, D., González-Hermoso, J. et al. Cash Transfers and After-School Programs: A Randomized Controlled Trial for Young Men at Risk of Violence Exposure in Wilmington, Delaware. J Urban Health 101, 595–619 (2024). https://doi.org/10.1007/s11524-024-00838-y
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11524-024-00838-y