Skip to main content
Log in

Assessing the Causal Effect of Curbside Collection on Recycling Behavior in a Non-randomized Experiment with Self-reported Outcome

  • Published:
Environmental and Resource Economics Aims and scope Submit manuscript

Abstract

This paper aims at identifying the causal effect of reducing behavioral costs of participation in household waste recycling through curbside collection. Using propensity score matching and differences-in-differences estimation with individual-level panel data we estimate the effect of curbside collection, its variation between types of recyclables and sociodemographic background variables, and its elasticity with regard to the distance to collection containers in the bring scheme condition. We argue that in a quasi-experimental setting DD may be systematically upward biased due to the outcome variable being self-reported while DDD may be systematically downward biased in the presence of spillover effects. Accordingly, both estimators can be combined to derive upper and lower bounds of the true effect. We find that a curbside scheme has no effect on paper recycling but increases recycling participation by between 10 and 25% points for plastic and packaging. Moreover, we find systematic treatment effect heterogeneity with regard to pre-treatment distance to collection sites and individual environmental attitudes, but not by socio-demography. The results of our analysis therefore have important implications for effective and cost-efficient implementation of environmental protection policies in urban areas.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Notes

  1. Strictly speaking, self-selection or policy endogeneity are only an issue for the control group if one is interested in estimating an average treatment effect on the treated (ATT). In empirical applications, however, the analytical distinction between heterogeneity—and particularly selection on the pre-treatment trend—and endogeneity may be of little relevance. This is because available control variables (like, e.g., socioeconomic status) can be seen as (proxy-)measures for antecedent conditions as well as expected costs or benefits of treatment (Gangl 2010). In effect, by successfully incorporating all relevant variables the ATT will also converge to the average treatment effect (ATE).

  2. While the notion of misreported recycling behavior perceived as "socially desired" is a well-known argument against survey data, particularly among proponents of objective aggregate level data (e.g. Kuo and Perrings 2010), we are not aware of any study in the context of recycling, which has explicitly addressed this issue. Note that a general social desirability bias in the answering behavior of respondents does not create a problem when using differences-in-differences. If some people tend to always over-rate recycling participation it would only affect ξ [c.f. Eq. (3c) below], which is allowed to correlate with treatment status.

  3. The curbside scheme was not used for the collection of glass. Rather, recyclable glass continued to have to be brought to drop-off containers by participants.

  4. Official aggregate-level administrative data back the validity of our self-reported measure: Between 2005 (i.e. the pre-treatment year) and 2007 (by which curbside collection was implemented city-wide) recycling output in Cologne increased substantially while at the same time residual output decreased, resulting in a 3% drop in total waste output (for details, see Table 5 in the “Appendix”).

  5. Presented results are based on the Epanechnikov Kernel and a bandwidth of 0.06. We tested different varieties of propensity score matching (different bandwidth with the Epanechnikov Kernel (0.06 ± 0.04), different kernel types (gaussian, uniform, biweight), nearest neighbor matching, logit selection model instead of probit), and the results are robust against changes of these specifications.

  6. Note that standard errors will usually be larger when relying on reported instead of actual behavior due to random measurement error, leading to reduced statistical power. However, this qualification applies to survey research in general and we see no reason why there should be particular noise in the case of an everyday behavior like waste disposal.

  7. For glass, distance to container does not capture a reduction but an increase in behavioral cost. In the presence of substantial spillover effects, we would thus expect the treatment effect to be greater in the low distance condition. For over-reporting, distance to container should be irrelevant.

References

  • Abadie A, Imbens GW (2008) On the failure of the bootstrap for matching estimators. Econometrica 76:1537–1557

    Article  Google Scholar 

  • Abrate G, Erbetta F, Fraquelli G, Vannoni D (2014) The costs of disposal and recycling: an application to Italian municipal solid waste services. Reg Stud 48:896–909

    Article  Google Scholar 

  • Ando AW, Gosselin AY (2005) Recycling in multifamily dwellings: does convenience matter? Econ Inq 43:426–438

    Article  Google Scholar 

  • Bartelings H, Dellink RB, van Ierland EC (2004) Modeling market distortions in an applied general equilibrium framework: the case of flat fee pricing in the waste market. In: Van den Bergh JCJM, Janssen MA (eds) Economics of industrial ecology. MIT Press, Cambridge

    Google Scholar 

  • Beatty TKM, Berck P, Shimshack JP (2007) Curbside recycling in the presence of alternatives. Econ Inq 45:739–755

    Article  Google Scholar 

  • Best H, Kneip T (2011) The impact of attitudes and behavioral costs on environmental behavior: a natural experiment on household waste recycling. Soc Sci Res 40:917–930

    Article  Google Scholar 

  • Caliendo M, Kopeinig S (2008) Some practical guidance for the implementation of propensity score matching. J Economic Surv 22:31–72

    Article  Google Scholar 

  • Dillman DA (2000) Mail and internet surveys: the tailored design method, 2nd edn. Wiley, New York

    Google Scholar 

  • Dur R, Vollaard B (2015) The power of a bad example: a field experiment in household garbage disposal. Environ Behav 47:970–1000

    Article  Google Scholar 

  • EPA (2015) Advancing sustainable materials management: facts and figures 2013. United States Environmental Protection Agency, Washington, DC. https://www.epa.gov/sites/production/files/2015-09/documents/2013_advncng_smm_rpt.pdf. Last Accessed 22 March 2018

  • Fullerton D, Kinnaman TC (1995) Garbage, recycling, and illicit burning or dumping. J Environ Econ Manag 29:78–91

    Article  Google Scholar 

  • Fullerton D, Kinnaman TC (1996) Household responses to pricing garbage by the bag. Am Econ Rev 86:971–984

    Google Scholar 

  • Gangl M (2006) Scar effects of unemployment: an assessment of institutional complementarities. Am Sociol Rev 71:986–1013

    Article  Google Scholar 

  • Gangl M (2010) Causal inference in sociological research. Annu Rev Sociol 36:21–47

    Article  Google Scholar 

  • Guagnano GA, Stern PC, Dietz T (1995) Influences on attitude-behavior relationships. A natural experiment with curbside recycling. Environ Behav 27:699–718

    Article  Google Scholar 

  • Heckman JJ, Ichimura H, Todd PE (1997) Matching as an econometric evaluation estimator: evidence from evaluating a job training program. Rev Econ Stud 64:605–654

    Article  Google Scholar 

  • Heckman JJ, Ichimura H, Todd PE (1998) Matching as an econometric evaluation estimator. Rev Econ Stud 65:261–294

    Article  Google Scholar 

  • Hopewell J, Dvorak R, Kosior E (2009) Plastics recycling: challenges and opportunities. Philos Trans R Soc B 364:2115–2126

    Article  Google Scholar 

  • Jenkins RR, Martinez SA, Palmer K, Podolsky MJ (2003) The determinants of household recycling: a material specific analysis of recycling program features and unit pricing. J Environ Econ Manag 45:294–318

    Article  Google Scholar 

  • Kinnaman TC, Fullerton D (2000) Garbage and recycling with endogenous local policy. J Urban Econ 48:419–442

    Article  Google Scholar 

  • Kuo Y-L, Perrings C (2010) Wasting time? Recycling incentives in urban Taiwan and Japan. Environ Resour Econ 47:423–437

    Article  Google Scholar 

  • Lee M (2016) Generalized difference in differences with panel data and least squares estimator. Sociol Methods Res 45:134–157

    Article  Google Scholar 

  • Ravaillion M, Chen S (2005) Hidden impact? Household saving in response to a poor-area development project. J Public Econ 89:2183–2204

    Article  Google Scholar 

  • Reschovsky JD, Stone SE (1994) Market incentives to encourage household waste recycling: paying for what you throw away. J Policy Anal Manag 13:120–139

    Article  Google Scholar 

  • Rosenbaum PR, Rubin DB (1983) The central role of the propensity score in observational studies for causal effects. Biometrika 70:41–55

    Article  Google Scholar 

  • Rosenbaum PR, Rubin DB (1985) Constructing a control group using multivariate matched sampling methods that incorporate the propensity score. Am Stat 39:33–38

    Google Scholar 

  • Sidique SF, Joshi SV, Lupi F (2010) Factors influencing the rate of recycling: an analysis of Minnesota counties. Resour Conserv Recycl 54:242–249

    Article  Google Scholar 

  • Tsai T-H, Sheu S-J (2009) Will unit-pricing enhance recycling? Int J Sustain Dev World Ecol 16:102–108

    Article  Google Scholar 

  • van den Bergh JCJM (2008) Environmental regulation of households: an empirical review of economic and psychological factors. Ecol Econ 66:559–574

    Article  Google Scholar 

  • Winship C, Morgan SL (1999) The estimation of causal effects from observational data. Ann Rev Sociol 25:659–706

    Article  Google Scholar 

  • World Bank (2012) What a waste. A global review of solid waste management. Urban development series knowledge papers. World Bank, Washington, DC

Download references

Acknowledgements

This work was supported by the Fritz-Thyssen-Foundation, Cologne, Germany. We thank Tobias Rüttenauer, Susumu Shikano, Martin Spindler, several anonymous reviewers and the editor for helpful comments.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Henning Best.

Appendix

Appendix

See Fig. 2 and Tables 4, 5, 6, 7 and 8.

Fig. 2
figure 2

Common support and distribution of propensity scores

Table 4 Selection models for estimating the propensity score
Table 5 Development of waste output in Cologne 2005–2007
Table 6 Proportions of materials recycled, t1
Table 7 Robustness by specification of outcome variable
Table 8 Treatment effect heterogeneity by socioeconomic background

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Best, H., Kneip, T. Assessing the Causal Effect of Curbside Collection on Recycling Behavior in a Non-randomized Experiment with Self-reported Outcome. Environ Resource Econ 72, 1203–1223 (2019). https://doi.org/10.1007/s10640-018-0244-x

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10640-018-0244-x

Keywords

Navigation