1 Introduction

Young individuals entering the labor market are generally considered to be an at-risk population. They face a higher risk of unemployment than older workers, are more likely to switch between states of joblessness, training and working, and are more likely to enter temporary or precarious types of employment (see, e.g., Quintini et al. 2007). One reason for the lower labor market attachment of youth is their initially low labor market experience. During the school-to-work transition period, labor market entrants tend to learn about their abilities and preferences by “job-shopping” (Topel and Ward 1992), resulting in higher rates of turn-over and more frequent periods of non-employment. At the same time, firms commonly face higher costs of investment and lower costs of termination when employing young workers, making the youth labor market situation more sensitive to demand-side fluctuations, which was recently demonstrated in the aftermath of the financial crisis 2007/2008 (Bell and Blanchflower 2010; Choudhry et al. 2012; Verick 2011). Between 2008 and 2009 youth unemployment rates increased by about five percentage points to a 20% average, then until 2013 they further climbed to 24%; during the same time period, adult unemployment rate changed from 6% to 10%.1

High and persistent levels of youth unemployment give rise to concern, as the negative consequences of extended spells of unemployment early in the career are well documented. On the one hand, joblessness is directly associated with psychological distress and financial hardship for the affected youth (Goldsmith et al. 1997). On the other hand, early unemployment spells may have negative effects on later-life outcomes such as lower wages (Arulampalam 2001; Gregg and Tominey 2005; Kahn 2010; Skans 2004), lower labor market attachment (Gregg 2001), lower well-being (Daly and Delaney 2013), and a higher propensity to engage in criminal activities (Bell et al. 2014; Fougère et al. 2009). The immediate monetary costs of youth unemployment include direct costs for unemployment benefits and social assistance, as well as indirect costs of foregone tax payments and social security contributions. Calculations by Eurofund (2011) suggest that the immediate public costs accruing from youth neither in education nor in employment (NEET) in the EU-26 amounted to 120 billion euros (1% of GDP) in 2008, and to 153 billion euros (1.2% of GDP) in 2011, not accounting for discounted future costs and foregone payments due to the lowered labor market attachment in the long run. In light of demographic change and increasing old-age dependency ratios, the burden of these costs are expected to further increase. Raising employment levels is seen as the most effective strategy with which countries can prepare for population ageing (European Commission 2008), making the youth unemployment problem all the more urgent.

To smooth the school-to-work transition process, to prevent extended spells of unemployment or the complete withdrawal from the labor market, and to promote entry into stable employment relationships, policy makers in many countries resort to active labor market programs (ALMP). Prominent national initiatives include the “New Deal for Young People (NDYP)” in the UK, “Jugend mit Perspektive (JUMP)” in Germany and the “Youth Unemployment Program (YUP)” in Denmark. More recently, the “Youth Guarantee (YG)” adopted by the European Union in 2013 called all member states to set up ALMP programs to ensure that unemployed youth were offered high quality employment or education opportunities within four months of entering unemployment (European Commission 2014).

The types of programs most commonly used can be divided into four categories, namely, labor market training, job search assistance and monitoring, wage subsidies and public sector work programs. Given the relatively high rates of youth unemployment, it is not surprising that large shares of the active youth population participate in ALMP, as can be seen in Fig. 1. The average youth unemployment rate in the presented countries was at 23% in 2012, and, on average, 9% of the active youth participated in ALMP. Unfortunately, however, the quantitative importance attributed to the use of ALMP to fighting youth unemployment stands in stark contrast to the low level of knowledge we have regarding their effectiveness. Grubb (1999) provides a descriptive summary of the early evidence (up to 2000) on the effectiveness of specific ALMP for disadvantaged youth in the US. He concludes that training and education measures are largely unsuccessful, but points to promising combinations of training with a close labor market link and additional support schemes. Reproducing the negative findings on training programs for OECD countries, Martin and Grubb (2001) suggest that wage subsidies are among the most promising programs for youths. Heckman et al. (1999) study the evidence of ALMP in the US and Europe, reaching the conclusion that none of the program types substantially benefit unemployed youth. A meta-analysis of European ALMP evaluation studies up to the year 2000 is provided by Kluve et al. (2002) who find that youth tend to benefit less from ALMP participation than adults. Similar results emerge in the more recent and comprehensive meta-analyses by Kluve (2010) and Card et al. (2010) showing that programs targeted at youths, and in particular those involving training, are less effective in increasing employment levels than programs targeted at the general population of unemployed.

Fig. 1
figure 1

Youth unemployment rates and stock of ALMP participants relative to the active working population in selected European countries, 2012 (a). Source: Eurostat, 2012. Note: Dark gray bars depict youth unemployment rates, light gray bars the ALMP participation among all active youth. (a) Only countries that provide information on ALMP participant numbers for the youth population. ALMP participants numbers refer to the stock of participants in ALMP types 2 to 7 (Training, Employment Incentives, Supported Employment and Rehabilitation, Direct Job Creation and Start-up Incentives) are included

The particularity of the youth labor market situation and the results from the meta-analyses suggest that assessments of the effectiveness of ALMP for adults are most likely not valid for youth. So far, no consensus exists on the effectiveness of the different ALMP programs for this age group. With this study we aim to fill this gap. Aggregating the evidence of a substantial number of recent studies assessing the effectiveness of ALMP for youth, we provide a comprehensive re-assessment of the questions revolving around which policies work for whom and under which conditions. Unlike the recent meta-analyses we thereby pay special attention to the specificity of the youth labor market situation, highlighting the particularities that might promote or mitigate the effects of ALMP programs for young individuals. In line with the previous literature, we focus on the micro-evidence of the effectiveness of ALMP, distinguishing between the four types of programs that are most commonly employed to promote a direct labor market entry: labor market training, job search assistance and monitoring, wage subsidies and public sector work programs. Besides focusing on the effect of ALMP on employment take-up, we also examine the evidence available on education participation, and the findings on the quality of the accepted employment whenever available. The paper is organized as follows. Section 2 gives a quick overview of the labor market situation of youth in Europe and discusses the role of ALMP. Section 3 presents the collected evidence on the effects of the different policies, before Section 4 concludes.

2 The labor market for youth in Europe

2.1 A quick glance at the European situation

Table 1 depicts various indicators describing the labor market situation of youth for different European countries in 2013. Column (1) shows that there exists substantial variation across countries in the unemployment rates2 for youth below 25 years, ranging from 8% in Germany to over 40% in Italy, Spain and Greece. Similarly, the share of youth in long-term unemployment in column (3) ranges from 5% to 7% in Finland and Sweden to over 50% in Italy, Greece and the Slovak Republic. As these cross-country differences are linked to differences in economic performance or the institutional set-up, youth-specific labor market patterns are highlighted when relating youth labor market outcomes to those of more senior workers. In particular, this reveals that the youth labor market situation across countries shares several common features. The youth/adult unemployment ratio in column (2) shows that youth are, on average, two to three times more likely to be unemployed than adult workers – with the largest differences observed in Sweden, the UK, and Italy. At the same time, the probability of becoming long-term unemployed is commonly substantially lower for youths than for adults. The relative shares of long-term unemployed between youth and adults depicted in column (4) show that youth long-term unemployment risk is, on average, only two thirds the value of adult long-term unemployment.

Table 1 Absolute and relative labour market indicators for youth in selected European countries, 2013

Part of the differences in the youth-adult (long-term) unemployment risk can be explained by the higher job mobility and the higher likelihood to enter inactivity among youth. As depicted in columns (5) and (6) of Table 1, the inactivity rate3 among youth ranges between below 30% (Netherlands, Switzerland and Iceland) and 70% (Greece, Hungary, Luxemburg and Italy). On average, they are hence about four times more likely to be inactive than adults. While part of this higher inactivity is driven by entry into formal education – note that countries with an extensive apprenticeship-based secondary education system in which youth are counted as working, such as Germany, Austria, Denmark and Switzerland, exhibit a much lower inactivity rate – youth are generally also less attached to the labor market, and hence more likely to withdraw from labor force. An indicator capturing the size of this risk group is the share of youth neither in education nor in employment (NEET). Column (7) shows that about one third of countries exhibit NEET shares above 20% among the age group of 20 to 24-year-olds, with the Southern European countries (Italy, Portugal, Spain and Greece), some Eastern European countries (Poland, Slovak Republic and Hungary) and Ireland being affected most heavily.

The labor market transition of youth is generally highly correlated with the levels of educational attainment (Quintini et al. 2007). Averaged European unemployment rates from 2013 suggest that youth who have obtained at most a schooling degree at the lower secondary level are 1.7-times more likely to be unemployed than youth who have at most obtained an upper secondary degree, and they about two times more likely to be unemployed than youth with a tertiary education degree. In the Southern European countries that were hit particularly hard during the economic crisis – Greece, Italy, Portugal and Spain – the unemployment rates of lower secondary and upper secondary school graduates only differ by a factor of 1.1 in favor of the higher educated. In the other European countries, the respective unemployment rates differed by a factor of 1.8 (Eurostat 2013).4

Differences in economic conditions, education and labor market policies may result in systematic cross-country differences in the chances of youth to enter the labor market. As outlined above, youth from countries that were hit hardest by the economic crisis (Southern European countries, Ireland) and that are hence plagued with structurally low labor demand, are more likely to be (long-term) unemployed, are more likely to enter inactivity, and to experience lower returns to education. Several studies underline the close relation between labor market institutions, e.g., hiring policies, minimum wages, and youth unemployment levels (Addison and Teixeira 2003; Bertola et al. 2007; Jimeno and Rodríguez-Palenzuela 2003). The close link between the schooling system and labor market entry of youth is documented most intensely. On the one hand, the general schooling system may affect the tendency of youth to leave school early, i.e. to finishing their education with a degree at the lower secondary or lower level, with the consequence of experiencing more difficulties entering the labor market.

On the other hand, the structure of post-mandatory, professional education options affects the youth labor market transition. In countries with established vocational education tracks or an extensive apprenticeship system, youth participating in vocational education tend to experience a faster entry into the labor market than youth entering the labor market after participating in mostly general education (Hanushek et al. 2011; Neuman and Ziderman 1999; Riphahn and Zibrowius 2015; Ryan 2001; Winkelmann 1996).5 The reason for this faster entry due to vocational education is attributable to an improved short-run alignment of the supply and demand for skills. In particular, skill or qualification mismatch is likely to reduce the quality and stability of initially accepted jobs (Wolbers 2003), with potentially long-lasting negative effects of later-life labor market outcomes (Liu et al. 2012). At the same time, the increasing phenomenon of over-education (Quintini 2011) may result in decreased chances of low-skilled workers finding employment due to crowding-out (Borghans et al. 2000; Dolado et al. 2000). According to Quintini (2011), the Netherlands, Greece, Spain, Sweden, Luxembourg and Portugal are amongst the countries with highest levels of over-qualification.

2.2 The role of active labor market policies

The primary objective of active labor market programs for youth is to integrate unemployed youth into the labor market, stabilize their career entry, and/or to promote the take-up of vocational training as an intermediate step to labor market entry. Column (8) in Table 1 shows that countries exhibit substantial differences with respect to participation in ALMP. While in Slovenia, Estonia and the Netherlands the share of youth in ALMP is below 10% of the unemployed youth population, it exceeds 100% in Austria, Germany and Hungary (meaning that individuals participate in more than one program on average). Column (9) relates the share of unemployed youth participating in ALMP to the share of unemployed adults participating in ALMP. An indicator larger than 1 shows that youth are over-represented in ALMP compared to adults (e.g., in Austria, France and Germany), while an indicator below 1 indicates that they are under-represented (e.g., in Denmark, Estonia and Finland).

The previous Section points to three areas of intervention depending on the source of the labor market problem: the stimulation of labor demand, the avoidance of long-term unemployment, and the elimination of educational mismatch. In case educational mismatch is at the root of the unemployment problem, ALMP training programs serve to align the skill-level of the unemployed youth to that of labor demand. As youth are more prone to engage in further formal education, it is sensible to distinguish short- and long-term training measures. While short-run programs tend to be of remedial nature, aiming to overcome minor and specific skill deficits, long-run training programs aim to overcome more structural skill deficits such as gaps in general education. As the latter types of programs stand in direct competition to formal education, their benefits need to be evaluated relative to regular schooling or training options and are thus likely to be less strong than programs for adults who would otherwise not engage in any education. Also, depending on the types of professional education options available, ALMP training may not be similarly valued as formal education by employers, and participation in them may entail negative stigmatization effects. A smaller part of training ALMP are preparatory training programs that promote the take-up of regular formal education, such as the continuation of general schooling, or participation in apprenticeship-based vocational education.

Since the returns to upgrading skills may be low if the overall demand for youth labor is low – as outlined above – a second issue to be addressed by ALMP programs is the stimulation of youth labor demand. There are several reasons why the demand for youth labor may be low. First, youth are commonly the ones most affected by economic downturn, as firms may be less willing or able to let go of workers with longer tenure. Second, even under normal economic conditions, employers may prefer hiring more experienced workers, in particular, if previous work credentials or colleague referrals allow employers to discriminate better between low and high ability workers (compare Montgomery, 1991, for a theoretical analysis of employee referrals). Third, in the presence of job-specific human capital, firms may be less willing to hire youth and invest in costly training if there is a high probability that youth leave the firm without redeeming this initial investment (see Wolter and Ryan, 2011, for an extensive summary of firm’s training involvement). Hence, if low work- or job-specific experience is a barrier to initial labor market entry, the provision of financial incentives for employers to hire and train young people may constitute an effective tool to improve labor market integration. As youth gain more experience and firms are better able to observe their ability, it is intended that youth are offered regular work contracts following the initial subsidy period. Furthermore, Cockx and Picchio (2013) suggest that stigmatization rather than the depreciation of human capital may be the source of state-dependence in long-term unemployment among youth. Following this line of reasoning, wage subsidies promoting the take-up of “real” employment, albeit subsidized, may help youth signal their employability.

A third issue to be addressed by ALMP is the avoidance of long-term unemployment spells, which were found to have particularly detrimental long-term effects for youth (see Section 1). Job search programs and tight monitoring schemes aim to achieve a fast activation of youth early in the unemployment spell. As youth are more likely to enter inactivity as a response to longer spells in unemployment, these measures may also prevent complete withdrawal of youth from the labor market in the long-run. A potential downside of these approaches is that they may result in a direct withdrawal from the labor market when monitoring and sanction are imposed too fiercely. Studies for adult unemployed find that monitoring and sanctioning increase take-up of employment, but may also result in withdrawal from the labor market (see, e.g., Arni et al. 2013; van den Berg et al. 2013). Because of the higher risk of youth of entering inactivity, higher intensity activation schemes may result in stronger drop-out responses among youths compared to adults. In a similar vein, but targeted at more disadvantaged youth, public employment schemes are used to keep youth in the labor market by offering a work-like environment including low levels of payment. While these types of programs are usually ineffective for adults, they could provide a stepping-stone for youth when combined with training for regular jobs.

A general issue arising from the previous Section is that youth tend to experience higher labor market mobility than adults, the consequences of which on labor market outcomes are ambiguous. On the one hand, job changes may allow an upward movement in the career- and wage-ladder and allow youth to become aware of their skills and preferences (Topel and Ward 1992). On the other hand, it has been found that job-changes promote further job-changes (occurrence dependence) and that early job instability significantly reduces later wages (see, e.g., Doiron and Gørgens 2008; Neumark and Wascher 2006). Consequently, ALMP programs should also be measured by their ability to improve the job match quality and stability of accepted employment. If participation in ALMP helps youth to learn about their preferences, career or schooling opportunities, or allow to signal their abilities to employers, this is likely to improve choices and stability of subsequent employment. Against this background it is particularly interesting to assess the long-run effects of, e.g., training measures or financial incentives to employers, as the benefits of these measures may lie in an increased long-run stability of employment.

3 Active labor market policies and their effects

In this Section, we summarize the findings of 37 evaluation studies assessing the impact of ALMP measures for youth in Europe (see Table 3 in the Appendix for a full list of studies). We include evaluation studies that consider programs specifically targeted at unemployed youth, as well as evaluation studies assessing the performance of general ALMP programs including a subgroup-specific analysis for youth. Tables 4 to 7 in the Appendix provide a brief overview of the studies included in the analysis, classified by the type of program under investigation. In line with the most common types of ALMP encountered in practice, four broad types of programs are distinguished: labor market training, job search assistance and monitoring, wage subsidies, and public sector work programs.

We restrict our overview to studies that convincingly address the problem of non-random selection into treatment, e.g., by conducting randomized field experiments, exploiting exogenous variation in program access, controlling for a large set of informative control variables, or using other state-of-the-art econometric evaluation techniques. The bulk of evaluation studies use the conditional independence or “unconfoundedness” assumption for identification, thus assuming that controlling for observed characteristics is sufficient to capture selection into the different treatment options. The ALMP evaluation literature offers some guidelines regarding the most informative characteristics to be included to control for non-random selection (e.g., Caliendo et al. 2014; Lechner and Wunsch 2013), and we preselected studies adhering to these guidelines. However, it is clear that by the short previous labor market history of youth and the stronger variability in terms of initial labor market attachment, there is a risk that unobserved heterogeneity plays an even stronger role for the youth than for the adult working population.

Next to considering the employment effect of the ALMP programs, we also assess, where available, program impact estimates on education participation and the quality of accepted employment. On the one hand, participation in education constitutes a relevant outcome of interest as youth may wish to continue further formal education once exposed to the treatment rather than entering the labor market directly. Under the assumption that higher levels of human capital result in a better long-term labor market prospects, this may also be a desirable outcome of ALMP programs for youth. On the other hand, as youth tend to consider participation in formal education as an alternative to remaining unemployed, short-run positive employment effects of policies may arise due to the control group entering education rather than remaining unemployed. As it is not clear how the returns to labor market policy programs compare to that of formal education participation, this substitution effect should be kept in mind when evaluating the effect of ALMP for youth.

In the next four subsections we briefly describe the programs under consideration, the evidence we collected on their effects, and summarize the main findings; subsection 3.5 condenses the findings across programs and outcome variables and concludes.

3.1 Labor market training

Program Description Labor market training courses are one of the main interventions used to integrate unemployed individuals into employment. The training content can be very heterogenous, ranging from purely classroom-based training to purely on-the-job training within firms, with varying durations between a couple of weeks to over one year. The purpose of these labor market training programs is to extend or to adapt the labor market relevant skill set of participants, so that a faster and more stable integration into employment can be achieved. Training programs within firms serve the additional purpose of providing youth with some level of work experience and send productivity signals to employers, making them potentially more likely to hire participants later on. This additional “foot-in-the-door” effect of within-company training may be particularly relevant for youth with limited signals of prior labor market participation. It may hence be expected that, all else equal, within-firm training has a better employment effect than formal classroom training. At the same time, by being more practically oriented, firm-based training tends to be offered predominantly to disadvantaged youth with stronger barriers towards direct labor market integration. This differential selection into classroom-based and school-based training programs suggests that the evaluation results for these two programs are not readily comparable.

Evaluation Results In total, we collected evidence from 19 studies in 8 countries. Overall, the employment effects of purely classroom-based labor market training are mixed, showing both positive and zero employment effects. Abstracting from negative locking-in effects during participation, only one of the studies (Norway) finds a negative longer-term employment effect. Three studies also assessing the effect of classroom-based training on unemployment or education show that a positive employment effect often coincides with a zero effect on the unemployment levels (see Table 4 for details) or a negative effect on education. This confirms the hypothesis that classroom-based training may result in a crowding out of formal education or serve as a substitute for it. The close link between ALMP training and formal training participation is also supported by a study from Denmark (1) assessing the effects of announcing labor market training to the unemployed. Here it is found that the “threat” of expected labor market training results in an increase in education take-up but no increase in the employment probability. It has to be noted that a large share of the evidence of classroom based training comes from Germany (five out of nine studies), but omitting these studies from the aggregation would not change the general conclusion.

The evidence of the employment effects of mixed school- and work-based training is somewhat more scarce and also more mixed: four studies find either positive, zero or negative effects. The negative results are found in the Swedish (3) and the Norwegian study, both examining a period during the early 1990’s where both economies experienced a tremendous downturn.6 Hence, the evidence is likely to be affected by these economic circumstances. The French (1) study finds zero (negative)7 effects for the higher educated and positive effects for youth with low previous education, thus suggesting that work-based training is more beneficial for the more disadvantaged and may entail stigmatization for youth with higher schooling.

Studies analyzing the effectiveness of labor market training relative to other types of ALMP tend to find that training performs better or similar to public sector job creation but worse than practical work experience, as provided, e.g., by wage subsidies. The Swedish (5) study suggests that practical training works better than school-based training. Four studies assess the effect of classroom training on the match quality of subsequent jobs, as, e.g., reflected by the wage level or duration of employment spell. These studies mostly find a positive effect, but by the limited amount of evidence, further studies are needed to support this finding.

Summary The overall effectiveness of ALMP training is heterogenous. Purely school-based training has either positive or no effects on employment but negative effects on participation in formal education. The effects of firm-based training or mixtures of firm-based and classroom training are more negative in terms of employment outcomes, but they seem to entail less of a trade-off in terms of education outcomes. While there is much less evidence for firm-based training overall, the negative evidence from Sweden and Norway may not be representative for the overall effectiveness as both pertain to periods with very negative labor market conditions, a situation in which training is likely to be less effective. However, two other studies (Germany and Finland) also show zero overall effects; the only positive evidence comes from France (for youth with low levels of previous education). A potential explanation for the lower effectiveness of mixed training is that the most disadvantaged youth for whom practical training programs are intended may require more intensive or additional support. Negative employment effects for youth with higher levels of previous education could be due to the low reputation of practical training, so that participation in such programs exhibits stigmatization effects.

3.2 Job search assistance and monitoring

Program Description Job search assistance measures comprise counseling and mentoring activities by caseworkers of the public employment services or external providers, including the provision of vacancy information as well as short-term training or coaching programs assisting youth in their application process. A primary focus of these programs is to increase the commitment and motivation of job search among youth. In most countries, this comes with higher intensity support and is also linked to higher levels of monitoring. This, in combination with implicit or explicit threats of benefit sanctioning, is expected to increase compliance with job search requirements and thus increase the exit rate out of unemployment. Previous research points to the double-edged consequences of monitoring and sanctioning schemes, as increased unemployment exit rates in the short-run tend to come at the cost of lower quality job matches and decreased employment stability in the long-run. For youth, the effectiveness of sanctioning is a-priori uncertain, as youth may be more likely to resort to their parents for financial support. Consequently, the threat of or even actual benefit withdrawal may push youth towards non-activity rather than into employment relationships.

Evaluation Results Based on evidence from 16 studies in 8 countries (see Table 5 in the Appendix), we find that counseling and monitoring results in significantly positive employment effects in the majority of evaluation studies. We distinguish between studies of combinations of counseling and monitoring (eight studies), counseling without monitoring (four studies), and monitoring or/and sanctioning only (four studies). We find that the programs involving counseling tend to yield predominantly positive effects, irrespective of whether they involve monitoring. Out of the studies combining job search assistance and monitoring, the studies from Denmark (3), Portugal and Sweden (8) are the only ones that result in a zero or even a negative effect. The Danish study assesses the effects of job search just prior to the start of the economic crisis in 2008 and suggests that the combination of unfavorable economic conditions and a very high baseline activation in the control group may have resulted in a zero effect and an increased exit rate into inactivity among the treated. In Sweden (8) zero effects are found for long-term unemployed youth under difficult economic conditions, suggesting that job search activities may not be sufficient for this difficult target group. The Portuguese study, in contrast, explores a pilot project implemented during fairly beneficial economic conditions. It hence seems more plausible that the results are attributable to other factors, such as the low connectedness of the public employment services with local economic actors (Centeno 2001).

Of the four studies assessing job search assistance alone, three studies explore the effects of changing from public to private providers of assistance. As private providers have higher monetary incentives to place the unemployed in stable employment, these studies aim to capture the effect of more intensive counseling, assuming that the provider change itself does not have an additional employment effect. The studies from Germany (3) and France (4) find positive employment effects of the provider change, while the Swedish study does not find an effect, suggesting that this is due to the high baseline activation for youth at the public employment services. Exploiting random differences in the share of youth changing from public to private providers, the French study shows that a higher counseling intensity at private providers entails significant displacement effects for youth not benefitting from the intensified counseling, in particular in areas with problematic labor market conditions. The overall labor market effect of the intensified counseling in France was zero.

Monitoring alone yields either zero results (in Hungary and Sweden (4)), or short-run positive results (in Germany (8), UK (4)) and long-run negative results due to increased long-run exits from the labor force. The studies for Hungary and Sweden evaluate the effect of an increased (announced) monitoring intensity and do not find any affect on employment rates. While the program set-up differs in many details, both interventions are reported to exhibit rather low actual risks of sanctioning for non-compliance in job search or for turning down job offers, which may hence have resulted in a low level of compliance. The study in the UK, in contrast, considers a policy reform increasing the actual risk of sanctioning, finding that after an initially positive employment effect, the medium-run effects on employment are negative, as youth tend to resort to alternative sources of social benefits, exempting them from any job search activities. Furthermore, negative effects on wage levels are found, the absolute size of which are larger for youth than for adults. The study for Germany (8) assesses the effects of temporary benefit withdrawal and finds substantial positive short-run employment effects that are increasing with the intensity of the sanction. While the effect on employment quality is not available, the authors suggest that the complete withdrawal of benefits may have had substantial negative effects on employment quality or labor force participation.

Summary In summary, the evaluation evidence suggests that job search assistance programs exhibit a similar effectiveness for youth as they do for the overall working population (Kluve 2010). Positive long-run effects of job search assistance suggest that counseling may not only help youth find employment faster but also helps them enter more stable employment of higher quality. But further research is needed to corroborate the quality aspects of job search assistance. The study from France (4) suggests that positive long-run results may arise due to displacement of non-treated youth. This would clearly lower the overall benefit of the intensified job search. At the same time, there is some evidence that job search assistance exhibits decreasing marginal returns for the treated. Several countries having developed intensified activation specifically for youth – e.g., Denmark, Sweden and Germany - report zero or even negative effects of additional activation (see for a German study on an intensified activation mix Wolff and Nivorozhkin 2012). At the same time, the effectiveness of counseling and monitoring seems to be low under bad economic conditions and for long-term unemployed youth.

The small evidence available regarding the effect of monitoring and sanctioning suggests that youth respond positively to a sanction (threat of sanctioning) in terms of employment outcomes in the short-run, but they may also leave the labor force. Accompanying qualitative evidence of the consequences of sanctions suggests that the unemployed subject to sanctions are commonly those exhibiting more profound difficulties, such as family-related problems, mental illness or drug addictions. Sanctions further tend to aggravate this problem, so it does not seem advisable to use sanctions as a method to activate the most disadvantaged.

3.3 Wage subsidies

Program Description Subsidized wages or income support schemes are primarily aimed at providing a financial incentive for employers to hire youth with lower relative initial productivity. As employers may expect costs of initial training investment, or may need to pay wages exceeding the expected initial productivity, wage subsidies are intended to compensate employers for these incurred costs. For example, in the presence of minimum wage regulations, wage subsidies may bridge the gap between a productivity equivalent payment and the minimum wage. At the same time, if youth are unwilling to work for the low wages offered to them by employers, wage subsidies may increase the wage level and thus the incentives of youth to work. Commonly, wage subsidies are paid for a limited time period (between several months up to one or two years) in the hope that by the time the subsidy expires, youth have sufficiently increased their skill set to be hired under regular working contracts by the same or a different firm. Some programs combine the payment of a wage subsidy with vocational training arrangements in an apprenticeship-type working contract. The level of the subsidy varies; in Germany and the UK it amounted to 40% to 60% of the wage costs. Additionally in the UK, a lump-sum payment was paid for additional training expenses.

Evaluation Results We have identified 8 studies in 6 countries examining wage subsidies (see Table 6 in the Appendix for details). Studies for Belgium, Germany, Norway and Sweden consider the effectiveness of subsidized wage contracts in which training is not a prominent element and find that wage subsidies either increase employment levels or have a zero employment effect. As the programs set up in Norway, Sweden and Germany were very similar, the zero employment effects found for Sweden and Norway may be linked to the very bad labor market conditions mentioned above. The set-up of the Belgium subsidy was somewhat different in that it was only for part-time working women who earned less than the full-time minimum wage. The set-up included an in-built disincentive for employers to increase the wages of subsidy-recipients, and it was paid for an unlimited duration as long as the part-time workers were willing to accept fulltime employment if it became available. Despite the risk that the program would become a “part-time trap”, the program showed substantial positive effects on the take-up of regular employment, which were most likely attributable to the work-experience during the subsidy. The beneficial labor market conditions during the observation period may have also contributed positively to this “stepping-stone” effect of the subsidy.

Three studies from France (2) and the UK (1 and 3) analyze the effects of wage subsidies in combination with training. In France, low-skilled youth benefitted less from this practical work than from regular short-term work contracts but benefitted similarly compared to public work schemes, which could again be explained by potential stigmatization of practical training schemes. The UK (1) study finds, in contrast, that recipients of wage subsidies exhibit a significantly positive wage growth in the long-run. In a comparative study for the UK (3), it is found that subsidized wages in combination with training performs best in terms of employment compared to all other ALMP programs.

Summary While most of the studies find pronounced positive employment and wage effects of wage subsidies, an obvious caveat of wage subsidy programs is the high likelihood of deadweight effects arising from employers hiring youth with a wage subsidy even though they would have hired the youth without. This is generally difficult to measure and none of the empirical studies addresses this problem. A further issue to be taken into account is the problem of worker substitution, resulting in a zero-sum game, when workers eligible for the subsidy are hired at the expense of un-eligible but substitutable workers (e.g., unemployed below 25 years vs. older than 25 years). Riley and Young (2001) and Van Reenen (2004) assess the magnitude of substitution effects in context of the NDYP in the UK and find little to no evidence of substitution of different age groups. However, as not all youth participating in the NDYP took part in the wage subsidy program, this evidence may not be transferable to more intensive uses of subsidies. Unfortunately, we are unaware of any study addressing the magnitude of the substitution effect of wage subsidies directly.

3.4 Public sector work programs

Program Description Public Sector Work programs are state-funded temporary employment opportunities in the public sector that usually involve production of socially valuable goods or services. The programs are mainly aimed at creating employment opportunities and giving youth some work experience. While they may comprise parallel participation in practical training courses, they are often intended to familiarize inexperienced, disadvantaged youth with a routine work environment. Participants usually receive a low level of remuneration during participation. While this may increase the willingness of youth to participate in the program, this may also have the unintended effect of reducing the search effort for “real” jobs. Also, as public work programs do not establish contact to “real” firms or employers, they do not offer a direct way into the labor market.

Evaluation Results The evaluation evidence for these programs is largely based on evidence from Germany and France, where we have identified five and two studies, respectively (plus one from the UK, see Table 7 in the Appendix). However, here, a rather homogenous picture arises in that work programs most commonly have zero effect on the employment outcomes. While this may result from a very negative selection of youth into these programs, comparative studies also suggest that public work programs tend to perform worse in terms of employment outcomes than other ALMP options.

Summary The results for the young unemployed participating in public work programs are rather discouraging. Very similar to the results for the adult working population, we find overwhelmingly zero or negative effects. Hence, it is very questionable whether these programs are an adequate solution – even in challenging economic situations.

3.5 Summary of results

Table 2 summarizes the findings from Sections 3.1 to 3.4 and provides a brief description of the identified effects for the four types of programs along three outcome dimensions. As we have already mentioned previously, the most common outcome examined is the integration into the first labor market, i.e., into regular employment, and (nearly) all studies provide evidence on that. Since this is not the only interesting outcome, we also summarize the effects on job quality and education where available. The first two outcome dimensions are usually also examined for the adult population, the last one is of interest in the given context of youth unemployment.

Table 2 Overview - Number of studies finding positive, zero or negative effects of ALMP for different outcomes

Table 2 not only lists the number of studies, but also the number of estimated effects. These numbers can differ because some studies contain effects for different subgroups (e.g., with/without a formal school degree) and or regions (e.g., East and West Germany). If we concentrate on the employment outcome first, we see that the most positive effects are found for job search assistance (12 positive out of 20), followed by wage subsidies (4 positive out of 8). The evidence for labor market training is mixed (11 positive, 12 insignificant and 6 negative), whereas the effect for public work programs is clearly negative (5 negative, 8 insignificant, 1 positive). With respect to education participation and employment quality, evidence is rather scarce. However, the cumulated evidence on training allows for the tentative conclusion that training has a negative effect on formal education participation (7 out of 11) and a positive effect on employment quality (5 out of 9). For the other types of programs, the evidence is too scarce to make a meaningful interpretation.

Differentiating training programs by purely classroom based training, training containing practical elements, and training within the firm, we find that purely classroom based training tends to perform somewhat better (9 positive, 9 zero, 2 negative) than mixed classroom and practical training schemes. As outlined in the text, this differential finding may be attributable to difference in characteristics of the participants or stigmatization effects related to participation in practical training. In contrast, when differentiating job search assistance evidence by studies looking at programs that include counseling versus programs that only include monitoring or sanctioning, the qualitative finding on employment outcomes does not change. Overall, it hence seems that job search assistance and wage subsidies perform similarly well in terms of improving employment outcomes of their participants. Classroom based training often performs similarly well, but risks losing effectiveness if it stands in competition to regular formal education. Unfortunately, however, a further comparison in terms of education outcomes and employment stability is not possible due to the lack of evidence.

Unfortunately, most of the evaluation studies under consideration do not address the issue of costs-effectiveness of the respective programs. It is interesting, however, to look at approximate calculations8 based on the program specific expenditure information drawn from the Eurostat Database. This suggests that the average per-capita expenditure is highest for wage subsidies (about 3,200 euros), followed by training programs (2,500 euros), job creation schemes (2,200) and job search services as the least expensive (1,200 euros). The relatively high costs of job creation schemes stand in contrast to their effectiveness, and are likely to be driven by having the disadvantaged youths as focus group. Based on the calculations by Eurofund (2011, p. 62ff.) of the country-specific costs of NEET arising due to yearly foregone earnings in 2008, the per-capita costs incurred by these ALMP programs can be compared with the costs incurred by not having youths in the labor force. This can provide a more tangible assessment of the importance of the costs of maintaining ALMP. This exercise shows that the per-capita cost of wage subsidies amount to about 40% of foregone earnings, 30% of foregone earnings in case of training programs, about 35% for job creation schemes and 10% for job search programs.9 The costs of wage subsidies are quite sizeable, but given their above average effectiveness, they stand out relative to similarly costly job creation schemes that are often found to result in zero or negative employment effects. In contrast, the low relative costs of job search measures in combination with their relatively high effectiveness suggest that they are commonly cost-effective.

4 Conclusions

Reducing youth unemployment is a key challenge in many European countries, especially in the aftermath of the most recent economic slowdown. Youth are a population at risk and exhibit a much higher risk of becoming unemployed than the adult population. The youth-adult unemployment ratio ranged from 1.6 to 3.6 in 2013, but even in relatively calm economic circumstances, as in the pre-crisis years 2005 to 2007, the youth-adult unemployment ratio was between 2 and 3 on average. Keeping in mind that unemployment at early stages can have severe long-term consequences on labor market outcomes as well as on other socio-economic factors, policy-makers use active labor market policies as a potential solution and spend significant resources on them. Most commonly, four broad types of programs are distinguished: labor market training, job search assistance and monitoring, wage subsidies, and public sector work programs.

We review the existing evidence on the effectiveness of these different ALMP programs from evaluation studies in Europe addressing the potential problem of selection bias in a convincing way. What becomes immediately apparent is that the overwhelming majority of studies only assess the effects on employment take-up. While this is understandable given the main objective (and also comparable to the adult population), it might be too shortsighted for the youth population. Here, additional outcome dimensions – such as the take-up up of higher formal education or the job quality – should also be considered.

The presented evidence shows differences in the results across but also within different ALMP types. Job search assistance with and without monitoring results in overwhelmingly positive effects. These programs are usually not very cost intensive and seem to work in many different circumstances. However, it also seems that “too much” job search activation can result in zero or even negative employment effects, suggesting that they do not provide the optimal solution for all youth. Similarly, the question of whether job search and monitoring also lead to “better” jobs has not been addressed sufficiently by the literature. The few studies considering employment quality find rather mixed effects, suggesting, however, that harsh monitoring and sanctioning schemes result in negative employment outcomes.

Labor market training programs are most commonly used for youths and have been studied most extensively. The overall results are somewhat mixed: for less than half of the programs/sub-groups, positive effects are found; and for the majority, we find insignificant or even negative effects. The negative findings are predominantly driven by the performance of combinations of classroom and practical training, as well as classroom-based training programs under adverse economic conditions in which an upgrading of skills may not be sufficient to improve labor market integration chances in the short- to medium-run. Excluding these studies, the evidence on classroom-based training is similarly positive compared to that of job search assistance. A particularity of classroom-based training ALMP is that it may reduce the take up of formal education. This crowding out of formal training is clearly an issue to be addressed in further research.

The hopes one might have had with public work programs are not met. Very similar to the results for the adult population, only one of the reviewed studies shows positive effects. Instead of providing a bridge to regular employment, they seem to entail locking-in or even stigmatization effects. It is thus questionable whether they should be used in the current (or any) situation. In contrast, the effects of wage subsidies on employment take-up are always positive (or insignificant), suggesting that subsidized “real” work experience often provides a stepping stone in regular employment. Wage subsidies evaluated under bad economic conditions were found to perform less well, suggesting that they are no panacea for stimulating labor demand. Unfortunately, little is known about the effects on job quality or stability.

Overall, the aggregate evidence of the effectiveness of ALMP is somewhat discouraging, suggesting that some – but not all – elements of ALMP programs can be a solution for the youth unemployment problem. The evidence also raises the question of whether the money spent on ALMP for the young unemployed is well invested or whether the money should be used to tackle potential problems earlier. While investing in early education is definitively favorable (Heckman 2006), these investments have a long-term horizon and will not be a solution for all youth at risk.

In particular, it remains an important challenge for policy-makers to devise activation schemes that benefit youth with very low skills and motivation and/or socially disadvantaged backgrounds. While job search and monitoring programs seem to be a very promising start for many youth, neither of the programs under study were targeted to the benefit of the most disadvantaged. Similarly, training programs with practical elements that tend to be targeted at youth with low initial schooling are found not to work very well. Promising strategies for disadvantaged youth may comprise intensive mentoring programs (see Rodriguez-Planas 2012 for evidence on the U.S.) but also programs that take into account social or health-related factors that may be at the source of a difficult labor market entry (currently ongoing projects include Crépon et al. 2015; van den Berg et al. 2015).

Similarly, more policy emphasis should be given to promoting the take-up of stable employment relationships. Helping youth to learn about their preference by personalized coaching, information about career opportunities, or structured labor market entry program could help improve the career choices made by youth. Saniter and Siedler (2014) show that the introduction of occupational counseling centers in Germany resulted in smoother labor market entry among affected school leavers. Similarly, it is expected that training programs might also bring the largest return in terms of human capital investment in the long-run. Unfortunately, most of the studies summarized here were not able to identify long-term effects. The observation period of most examined studies ranges from several months to two years (with very few exceptions), thus hardly qualifying as long-term. The review hence also highlights the shortcomings in current research with respect to the long-term consequences of policy measures. Further research should put a stronger focus on education and job quality outcomes in the long-term perspective.

5 Endnotes

1 Based on unemployment rates for youths (aged 15 and 24) and adults (aged 25 and 54) in 2008 and 2013 in the EU-27; provided by Eurostat.

2 The European Labor Force Survey defines unemployment as “without work during the reference week, currently available for work and either actively seeking work in the last four weeks, or expecting to start a job within the next three months.” The unemployment period is defined as the duration of job search or the time since the last job was held.

3 Inactivity is defined as not working and not searching for work and/or unavailable for work. The concept of inactivity is hence not related to receipt of unemployment benefits, which would affect youth disproportionately as they had less time to build up unemployment benefit claims.

4 The country-average is based on Belgium, Czech Republic, Denmark, Germany, Estonia, Ireland, Greece, Spain, France, Italy, Luxemburg, Hungary, the Netherlands, Austria, Poland, Portugal, Slovenia, Finland, Sweden and the UK.

5 European countries with the most developed vocational education and apprenticeship systems are, e.g., Germany, Austria, Switzerland, Denmark and partially also the Netherlands. See Eichhorst et al. (2015) for a more detailed definition and assessment of the role of vocational education in industrialized countries.

6 The Swedish unemployment rates more than tripled during the time period of investigation (from 3% to over 9%). In Norway, the unemployment rate during the period of investigation was at an all-time high at 5%.

7 Depending on the specification; unfortunately the authors do not provide guidance of which of the two estimates is more reliable.

8 According to the share of young participants in the respective program types, total expenditure information for youths were calculated for each country and program-type assuming that the program cost for youth and adult participants are similar. Price-differences across countries are accounted for by dividing country-specific costs by the purchasing power parities for government services. To increase reliability we only included countries that provided expenditures on at least two types of programs, and averaged expenditure information available between 2010 and 2013 whenever possible, otherwise the latest information available was used. Countries included are BE, DE, EE, ES, FR, LV, LT, AT, PL, PT, SI, SK, FI, SE.

9 The increase in relative costs of job creation schemes suggests that countries with low foregone earnings invest relatively more on job creation schemes than on other measures.

6 Appendix

Table 3 Evaluation literature by Countries
Table 4 Evaluation studies on labor market training
Table 5 Evaluation studies on job search assistance and monitoring
Table 6 Evaluation studies on wage subsidies
Table 7 Evaluation studies on public work programs