Skip to main content
Log in

Does Mandatory Diversion to Drug Treatment Eliminate Racial Disparities in the Incarceration of Drug Offenders? An Examination of California’s Proposition 36

  • Original Paper
  • Published:
Journal of Quantitative Criminology Aims and scope Submit manuscript

Abstract

Objective

This paper addresses previous shortcomings in the literature on racial disparities in incarceration for drug offenders by taking advantage of a change in sentencing policy in California and a rich administrative dataset that is able to create a sample of comparable White and Black offenders.

Method

We use a nonparametric propensity weighting approach to identify similarly situated White and Black male offenders charged with drug-related offenses. We combine this approach with a difference-in-differences model to estimate the effect that a change in California sentencing law for convicted non-violent drug offenders had on racial disparities in prison and drug treatment dispositions.

Results

We find substantial reductions in the probability of a prison sentence after the policy change, but not differentially for Blacks. Blacks remain more likely to go to prison than similarly situated Whites after the policy, although the policy does lead to more referrals to treatment for Blacks.

Conclusions

This paper shows that even after comparing Blacks and Whites in similarly situated contexts that racial disparities in prison commitments remain after sentencing law changes that mandate diversion to drug treatment. The results suggests that addressing racial gaps in the commitments to state prisons will likely require more than shifting the eligibility of drug convictions for prison, as accumulated criminal histories are the primary driver of prison sentences. This means that expanding diversion options from prison alone will not reduce the racial gap in commitments to prison for drug offenses more than incrementally.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. (http://bjs.ojp.usdoj.gov/content/glance/tables/corr2tab.cfm).

  2. On May 27, 2005, California’s Supreme Court ruled that driving under the influence of an illicit drug would not be an eligible offense and offenders could not be sent to treatment in lieu of prison.

  3. http://www.adp.ca.gov/sacpa/prop36.shtml, accessed 12/16/2011.

  4. http://www.adp.ca.gov/DrugCourts/overview.shtml.

  5. Three-month moving averages are weighted .5 for the current and .25 for the previous and subsequent months.

  6. The single largest other ethnic group to compare comprised of Hispanic males. The Hispanic-White disparities in outcomes were less pronounced in the unadjusted data.

  7. Cal DOJ provided the list of Proposition 36 eligible offenses that linked to health and safety code violations.

  8. Because our sample of arrests is drawn from a random sample of criminal histories, the same individual can appear multiple times in our sample of drug arrests. What this also means is that these individuals with repeat arrests are accumulating longer and potentially more severe criminal history records, which may affect the likelihood of diversion as well as prison dispositions especially over time.

  9. An additional 12 % (n = 13,077) of cases were removed because of a coding error, which made it impossible to tell whether the arrests occurred before or after the court dispositions. Including these cases in the analysis, however, did not materially change the results. In fact, the effective sample size for our matched sample of Whites was larger (n = 8517) when we excluded this coding error cases than when we included them (n = 8,055).

  10. The severity index is a measure used by Cal DOJ to describe the severity of a given offense with 1 equaling murder and 72 representing misdemeanor offenses.

  11. Some argue that race cannot be construed as a causal variable because it cannot be manipulated. We adopt a less conservative framework along the lines cited by the National Academy of Sciences and argue that after controlling for all confounding observables that we provide “a framework in which causal statements about nonmanipulable variables such as race are possible” (National Research Council 2004; p.79). See related arguments from Paternoster and Brame (2008) in their study of racial disparity in Maryland’s use of the death penalty.

  12. Blacks, for example, were more likely to come from urban counties. After weighting on the propensity scores, however, cases are balanced on county-level variation. The results are available from the authors.

  13. The effective sample size is calculated by \({\text{ESS}} = \frac{{\left( {\sum\limits_{{i \in {\text{comparison}}}} {w_{i} } } \right)^{2} }}{{\sum\limits_{{i \in {\text{comparison}}}} {w_{i}^{2} } }}.\)

  14. Kang and Schafer (2007) argue that using propensity score weights can be unstable, but Ridgeway and McCaffrey (2007) demonstrate that this is largely due to the use of parametric logistic regression models for estimating the propensity score rather than a deficiency in the method itself. Our use of the boosted nonparametric logistic regression model to estimate the propensity score avoids these issues. Our single largest weight (=23) is equivalent to a propensity score of 0.959 (w = p/1−p), bounded some distance from 1.0 where instability might arise. Furthermore, our ESS computation shows that we retain substantial information in our dataset.

References

  • Anglin MD, Nosyk B, Jaffe A, Urada D, Evans E (2013) Offender diversion into substance use disorder treatment: the economic impact of California’s Proposition 36. Am J Public Health 103(6):1096–1102

    Article  Google Scholar 

  • Angrist JD, Imbens GW, Rubin DB (1996) Identification of causal effects using instrumental variables. J Am Stat Assoc 91:444–455

    Article  Google Scholar 

  • Antonovics K, Knight BG (2009) A new look at racial profiling: evidence from the boston police department. Rev Econ Stat 91(1):163–177

    Article  Google Scholar 

  • Anwar S, Bayer P, Hjalmarsson R (2012) The impact of jury race in criminal trials. Q J Econ. doi:10.1093/qje/qjs014

    Google Scholar 

  • Austin RL, Allen MD (2000) Racial disparity in arrest rates as an explanation of racial disparity in commitment to Pennsylvania’s prisons. J Res Crime Delinq 37(2):200–220

    Article  Google Scholar 

  • Ayres I, Waldfogel J (1994) A market test for race discrimination in bail setting. Stanf Law Rev 46:987–1046

    Article  Google Scholar 

  • Beckett K, Nyrop K, Pfingst L (2006) Race, drugs, and policing: understanding disparities in drug delivery arrests*. Criminology 44(1):105–137

    Article  Google Scholar 

  • Binswanger IA, Redmond N, Steiner JF, Hicks LS (2012) Health disparities and the criminal justice system: an agenda for further research and action. J Urban Health 89(1):98–107

    Article  Google Scholar 

  • Blumstein A (1993) Racial disproportionality of U.S. prison populations revisited. Univ Colo Law Rev 64:743–760

    Google Scholar 

  • Blumstein A (2011) Bringing down the U.S. prison population. Prison J Suppl 91(3):12–26

    Article  Google Scholar 

  • Blumstein A, Beck AJ (2005) Reentry as a transient state between liberty and recommitment. In: Travis J, Visher C (eds) Prisoner reentry and crime in america. Cambridge University Press, Cambridge, pp 50–79

    Chapter  Google Scholar 

  • Blumstein A, Wallman J (2000) The crime drop in America. Cambridge University Press, New York

    Google Scholar 

  • Bobo LD, Thompson V (2006) Unfair by design: the war on drugs, race, and the legitimacy of the criminal justice system. Soc Res 73(2):445–472

    Google Scholar 

  • Bushway SD, Forst B (2013a) Studying discretion in the processes that generate criminal justice sanctions. Justice Q 30(2):199–222

    Article  Google Scholar 

  • Bushway SD, Forst B (2013b) Studying discretion in the processes that generate criminal justice sanctions. JQ. Justice Q 30(2):199–222. doi:10.1080/07418825.2012.682604

    Article  Google Scholar 

  • Bushway SD, Piehl AM (2001) Judging judicial discretion: legal factors and racial discrimination in sentencing. Law Soc Rev 35(4):733–764

    Article  Google Scholar 

  • Busso M, DiNardo J, McCrary J (2011) New evidence on the finite sample properties of propensity score reweighting and matching estimators. Working paper

  • California Department of Alcohol and Drug Programs (2004) Comprehensive Drug Court Implementation Act of 1999: interim report to the legislature. Sacramento, California

    Google Scholar 

  • Caulkins JP, Reuter P (2010) How drug enforcement affects drug prices. Crime and Justice 39(1):213–271

    Article  Google Scholar 

  • Demuth S, Steffensmeier D (2004) Ethnicity effects on sentence outcomes in large urban courts: comparisons among white, black, and Hispanic defendants*. Soc Sci Q 85(4):994–1011

    Article  Google Scholar 

  • Donohue J, Levitt SD (2001) The impact of race on policing and arrests. J Law Econ 44(2):367–394

    Article  Google Scholar 

  • Engen RL, Steen S (2000) The power to punish: discretion and sentencing reform in the war on drugs. Am J Sociol 105:1357–1395

    Article  Google Scholar 

  • Ettner SL, Huang D, Evans E, Ash DR, Hardy M, Jourabchi M, Hser Y (2006) Benefit-cost in the california treatment outcome project: does substance abuse treatment “pay for itself?”. Health Serv Res 41(1):192–213

    Article  Google Scholar 

  • Fosados R, Evans E, Hser YI (2007) Ethnic differences in utilization of drug treatment services and outcomes among Proposition 36 offenders in California. J Subst Abuse Treat 33(4):391–399

    Article  Google Scholar 

  • Gelman A, Fagan J, Kiss A (2007) An analysis of the New York City Police Department’s “Stop-and-Frisk” policy in the context of claims of racial bias. J Am Stat Assoc 102(479):813–823

    Article  Google Scholar 

  • Hayes JM (2012) Just the facts: California’s changing prison population. Public Policy Institute of California, San Francisco

    Google Scholar 

  • Heckman J, Todd P (2009) A note on adapting propensity score matching and selection models to choice based samples. Economic Journal 12(1):S230–S234

    Google Scholar 

  • Hirano K, Imbens G (2001) Estimation of causal effects using propensity score weighting: an application to data on right heart catheterization. Health Serv Outcomes Res Method 2:259–278

    Article  Google Scholar 

  • Hirano K, Imbens G, Ridder G (2003) Efficient estimation of average treatment effects using propensity score. Econometrica 71:1161–1189

    Article  Google Scholar 

  • Ho DE, Imai K, King G, Stuart EA (2007) Matching as nonparametric preprocessing for reducing model dependence in parametric causal inference. Political Anal 15:199–236

    Article  Google Scholar 

  • Huber PJ (1967) The behavior of maximum likelihood estimates under nonstandard conditions. In: Le Cam LM, Neyman J (eds) In: Proceedings of the fifth berkeley symposium on mathematical statistics and probability, vol I. University of California Press, Berkeley, pp 221–233

    Google Scholar 

  • Iguchi MY, Bell J, Ramchand RN, Fain T (2005) How criminal system racial disparities may translate into health disparities. J Health Care Poor Underserved 16(4):48–56

    Article  Google Scholar 

  • Imbens G, Rubin D (2008) Causal inference in statistics, and in the social and biomedical sciences. Cambridge University Press, New York

    Google Scholar 

  • Jacobs D, Carmichael JT (2001) The politics of punishment across time and space: a pooled time-series analysis of imprisonment rates. Soc Forces 80:61–89

    Article  Google Scholar 

  • Kang JDY, Schafer JL (2007) Demystifying double robustness: a comparison of alternative strategies for estimating a population mean from incomplete data. Stat Sci 22(4):523–539

    Article  Google Scholar 

  • Keen B, Jacobs D (2009) Racial threat, partisan politics, and racial disparities in prison admissions: a panel analysis. Criminology 47:209–238

    Article  Google Scholar 

  • Kingsnorth RF, MacIntosh RC, Sutherland S (2002) Criminal charge or probation violation? Prosecutorial discretion and implications for research in criminal court processing. Criminology 40:553–578. doi:10.1111/j.1745-9125.2002.tb00966.x

    Article  Google Scholar 

  • Klein S, Petersilia J, Turner S (1990) Race and imprisonment decisions in California. Science 247:812–816

    Article  Google Scholar 

  • Klein SP, Berk RA, Hickman LJ (2005) Race and the decision toseek the death penalty in federal cases. RAND Corporation, Santa Monica

    Google Scholar 

  • Klepper S, Nagin DS, Tierney L (1983) Discrimination in the criminal justice system: a critical appraisal of the literature. In: Blumstein A, Cohen J, Martin S, Tonry M (eds) Research on sentencing: the search for reform, vol 2. National Academy Press, Washington, DC, pp 55–128

    Google Scholar 

  • Knowles J, Persico N, Todd P (2001) Racial bias in motor vehicle searches: theory and evidence. J Polit Econ 109(1):203–229

    Article  Google Scholar 

  • Langan P (1985) Racism on trial: new evidence to explain the racial compositions of prisons in the United States. J Crim Law Criminol 76:666–683

    Article  Google Scholar 

  • Lê Cook B, Alegría M (2015) Racial-ethnic disparities in substance abuse treatment: the role of criminal history and socioeconomic status. Psychiatr Serv 62(11):1273–1281

    Article  Google Scholar 

  • Lee BK, Lessler J, Stuart EA (2009) Improving propensity score weighting using machine learning. Stat Med 29(3):337–346

    Google Scholar 

  • MacDonald J, Arkes J, Nicosia N, Pacula RL (2014) Decomposing racial disparities in prison and drug treatment commitments for criminal offenders in California. J Legal Stu 43(1):155–187

    Article  Google Scholar 

  • McCaffrey DF, Ridgeway G, Morral AR (2004) Propensity score estimation with boosted regression for evaluation adolescent substance abuse treatment. Psychol Methods 9:403–425

    Article  Google Scholar 

  • Mitchell O (2005) A meta-analysis of race and sentencing research: explaining the inconsistencies. J Quant Criminol 21:439–466

    Article  Google Scholar 

  • Morgan SL, Winship C (2007) Counterfactuals and causal inference: methods and principles for social research. Cambridge University Press, Cambridge

    Book  Google Scholar 

  • Mustard D (2001) Racial, ethnic and gender disparities in sentencing: evidence from the U.S. federal courts. J Law Econ 44:285–314

    Article  Google Scholar 

  • National Research Council (2004) Measuring racial discrimination. National Academies Press, Washington, DC

    Google Scholar 

  • Nicosia N, MacDonald J, Arkes J (2013) Disparities in criminal court referrals to drug treatment and prison for minority men. Am J Public Health 103(6):77–84

    Article  Google Scholar 

  • O’Hear MM (2009) Rethinking drug courts: restorative justice as a response to racial injustice. Stanf Law Policy Rev 20(2):09–10

    Google Scholar 

  • Paternoster R, Brame R (2008) Reassessing race disparities in Maryland capital cases. Criminology 46:971–1008

    Article  Google Scholar 

  • Ramchand R, Pacula RL, Iguchi M (2006) Racial differences in marijuana-users’ risk of arrest in the United States. Drug Alcohol Depend 84(3):264–272

    Article  Google Scholar 

  • Raphael S, Stoll MA (2013) Why are so many Americans in prison?. Russell Sage Foundation, New York

    Google Scholar 

  • Reuter P, Hirschfield P, Davies C (2001) Assessing the crack-down on marijuana in Maryland. The Abell Foundation, Baltimore

    Google Scholar 

  • Ridgeway G, MacDonald JM (2009) Doubly robust internal benchmarking and false discovery rates for detecting racial bias in police stops. J Am Stat Assoc 104(486):661–668

    Article  Google Scholar 

  • Ridgeway G, McCaffrey DF (2007) Comment on ‘Demystifying double robustness: a comparison of alternative strategies for estimating a population mean from incomplete data’ by Kang and Schafer. Stat Sci 22(4):540–543

    Article  Google Scholar 

  • Riley JK (1997) Crack, powder cocaine, and heroin: purchase and use patterns in six cities. Washington DC: U.S. Department of Justice, National Institute of Justice and Office of National Drug Control Policy

  • Rodriguez SF, Curry T, Lee G (2006) Gender differences in criminal sentencing: do effects vary across violent, property, and drug offenses? Soc Sci Q 87:318–339

    Article  Google Scholar 

  • Rosenbaum P (2010) Design of observational studies. Springer series in statistics. Springer, New York

    Book  Google Scholar 

  • Rosenbaum PR, Rubin DB (1983) The central role of the propensity score in observational studies for causal effects. Biometrika 70(1):41–55

    Article  Google Scholar 

  • Rubin DB (1974) Estimating causal effects of treatments in randomized and nonrandomized studies. J Educ Psychol 66(5):688–701

    Article  Google Scholar 

  • Smith JA, Todd PE (2005) Does matching overcome LaLonde’s critique of nonexperimental estimators? J Econom 125:305–353

    Article  Google Scholar 

  • Spohn C (1999) Gender and sentencing of drug offenders: is chivalry dead? Crim Justice Policy Rev 9:365–399

    Google Scholar 

  • Spohn C, Fornango R (2009) U.S. attorneys and substantial assistance departures: testing for interprosecutor disparity. Criminology 47(3):813–846

    Article  Google Scholar 

  • Steen S, Engen RL, Gainey RR (2005) Images of danger and culpability: racial stereotyping, case processing, and criminal sentencing. Criminology 43:435

    Article  Google Scholar 

  • Steffensmeier D, Demuth S (2001) Ethnicity and judges’ sentencing decisions: hispanic-black-white comparisons. Criminology 39(1):145–178

    Article  Google Scholar 

  • Stuart EA (2010) Matching methods for causal inference: a review and a look forward. Stat Sci 25:1–21

    Article  Google Scholar 

  • Tibshirani R (1995) Regression selection and shrinkage via the lasso. J Roy Stat Soc B 57:267–288

    Google Scholar 

  • Tonry M (1995) Malign neglect: race, crime, and punishment in America. Oxford University Press, New York

    Google Scholar 

  • Tonry M (2010) The social, psychological, and political causes of racial disparities in the American criminal justice system. Crime Justice 39(1):273–312

    Article  Google Scholar 

  • Tonry M, Melewski M (2008) The malign effects of drug and crime control policies on black Americans. Crime Justice 37(1):1–44

    Article  Google Scholar 

  • Unnever JD, Hembroff LA (1988) The prediction of racial/ethnic sentencing disparities: an expectation states approach. J Res Crime Delinq 25:53–82

    Article  Google Scholar 

  • Unnever JD, Cullen FT, Jonson CL (2008) Race, racism, and support for capital punishment. Crime Justice 37(1):45–96

    Article  Google Scholar 

  • Western B (2006) Punishment and inequality in America. Russell Sage Foundation, New York

    Google Scholar 

  • Wintemute GJ, Wright MA, Drake CM, Beaumont JJ (2001) Subsequent criminal activity among violent misdemeanants who seek to purchase handguns: risk factors and effectiveness of denying handgun purchase. J Am Med Assoc 285(8):1019–1026

    Article  Google Scholar 

  • Wooldridge J (2002) Econometric analysis of cross section and panel data. MIT Press, Cambridge

    Google Scholar 

  • Wooldridge J (2012) Distinguishing race effects on pre-trial release and sentencing decisions. Justice Q 29(1):41–75. doi:10.1080/07418825.2011.559480

    Article  Google Scholar 

Download references

Acknowledgments

The authors gratefully acknowledge comments from RAND’s Drug Policy Research Center’s brownbag seminar series, the NBER Summer Institute Economics of Crime Working Group participants, Christopher Carpenter, and Patrick Bayer for comments on earlier drafts of this paper. Finally, we would like to acknowledge Joseph Hayes from CDCR for his help. Points of view are those of the authors and do not reflect the opinions of NIDA or the RAND Corporation.

Funding

Support for this project was provided by the National Institute on Drug Abuse (NIDA) (grant R01DA022719).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to John M. MacDonald.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nicosia, N., MacDonald, J.M. & Pacula, R.L. Does Mandatory Diversion to Drug Treatment Eliminate Racial Disparities in the Incarceration of Drug Offenders? An Examination of California’s Proposition 36. J Quant Criminol 33, 179–205 (2017). https://doi.org/10.1007/s10940-016-9293-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10940-016-9293-x

Keywords

Navigation