Abstract
Objective
This paper addresses previous shortcomings in the literature on racial disparities in incarceration for drug offenders by taking advantage of a change in sentencing policy in California and a rich administrative dataset that is able to create a sample of comparable White and Black offenders.
Method
We use a nonparametric propensity weighting approach to identify similarly situated White and Black male offenders charged with drug-related offenses. We combine this approach with a difference-in-differences model to estimate the effect that a change in California sentencing law for convicted non-violent drug offenders had on racial disparities in prison and drug treatment dispositions.
Results
We find substantial reductions in the probability of a prison sentence after the policy change, but not differentially for Blacks. Blacks remain more likely to go to prison than similarly situated Whites after the policy, although the policy does lead to more referrals to treatment for Blacks.
Conclusions
This paper shows that even after comparing Blacks and Whites in similarly situated contexts that racial disparities in prison commitments remain after sentencing law changes that mandate diversion to drug treatment. The results suggests that addressing racial gaps in the commitments to state prisons will likely require more than shifting the eligibility of drug convictions for prison, as accumulated criminal histories are the primary driver of prison sentences. This means that expanding diversion options from prison alone will not reduce the racial gap in commitments to prison for drug offenses more than incrementally.
Similar content being viewed by others
Notes
On May 27, 2005, California’s Supreme Court ruled that driving under the influence of an illicit drug would not be an eligible offense and offenders could not be sent to treatment in lieu of prison.
http://www.adp.ca.gov/sacpa/prop36.shtml, accessed 12/16/2011.
Three-month moving averages are weighted .5 for the current and .25 for the previous and subsequent months.
The single largest other ethnic group to compare comprised of Hispanic males. The Hispanic-White disparities in outcomes were less pronounced in the unadjusted data.
Cal DOJ provided the list of Proposition 36 eligible offenses that linked to health and safety code violations.
Because our sample of arrests is drawn from a random sample of criminal histories, the same individual can appear multiple times in our sample of drug arrests. What this also means is that these individuals with repeat arrests are accumulating longer and potentially more severe criminal history records, which may affect the likelihood of diversion as well as prison dispositions especially over time.
An additional 12 % (n = 13,077) of cases were removed because of a coding error, which made it impossible to tell whether the arrests occurred before or after the court dispositions. Including these cases in the analysis, however, did not materially change the results. In fact, the effective sample size for our matched sample of Whites was larger (n = 8517) when we excluded this coding error cases than when we included them (n = 8,055).
The severity index is a measure used by Cal DOJ to describe the severity of a given offense with 1 equaling murder and 72 representing misdemeanor offenses.
Some argue that race cannot be construed as a causal variable because it cannot be manipulated. We adopt a less conservative framework along the lines cited by the National Academy of Sciences and argue that after controlling for all confounding observables that we provide “a framework in which causal statements about nonmanipulable variables such as race are possible” (National Research Council 2004; p.79). See related arguments from Paternoster and Brame (2008) in their study of racial disparity in Maryland’s use of the death penalty.
Blacks, for example, were more likely to come from urban counties. After weighting on the propensity scores, however, cases are balanced on county-level variation. The results are available from the authors.
The effective sample size is calculated by \({\text{ESS}} = \frac{{\left( {\sum\limits_{{i \in {\text{comparison}}}} {w_{i} } } \right)^{2} }}{{\sum\limits_{{i \in {\text{comparison}}}} {w_{i}^{2} } }}.\)
Kang and Schafer (2007) argue that using propensity score weights can be unstable, but Ridgeway and McCaffrey (2007) demonstrate that this is largely due to the use of parametric logistic regression models for estimating the propensity score rather than a deficiency in the method itself. Our use of the boosted nonparametric logistic regression model to estimate the propensity score avoids these issues. Our single largest weight (=23) is equivalent to a propensity score of 0.959 (w = p/1−p), bounded some distance from 1.0 where instability might arise. Furthermore, our ESS computation shows that we retain substantial information in our dataset.
References
Anglin MD, Nosyk B, Jaffe A, Urada D, Evans E (2013) Offender diversion into substance use disorder treatment: the economic impact of California’s Proposition 36. Am J Public Health 103(6):1096–1102
Angrist JD, Imbens GW, Rubin DB (1996) Identification of causal effects using instrumental variables. J Am Stat Assoc 91:444–455
Antonovics K, Knight BG (2009) A new look at racial profiling: evidence from the boston police department. Rev Econ Stat 91(1):163–177
Anwar S, Bayer P, Hjalmarsson R (2012) The impact of jury race in criminal trials. Q J Econ. doi:10.1093/qje/qjs014
Austin RL, Allen MD (2000) Racial disparity in arrest rates as an explanation of racial disparity in commitment to Pennsylvania’s prisons. J Res Crime Delinq 37(2):200–220
Ayres I, Waldfogel J (1994) A market test for race discrimination in bail setting. Stanf Law Rev 46:987–1046
Beckett K, Nyrop K, Pfingst L (2006) Race, drugs, and policing: understanding disparities in drug delivery arrests*. Criminology 44(1):105–137
Binswanger IA, Redmond N, Steiner JF, Hicks LS (2012) Health disparities and the criminal justice system: an agenda for further research and action. J Urban Health 89(1):98–107
Blumstein A (1993) Racial disproportionality of U.S. prison populations revisited. Univ Colo Law Rev 64:743–760
Blumstein A (2011) Bringing down the U.S. prison population. Prison J Suppl 91(3):12–26
Blumstein A, Beck AJ (2005) Reentry as a transient state between liberty and recommitment. In: Travis J, Visher C (eds) Prisoner reentry and crime in america. Cambridge University Press, Cambridge, pp 50–79
Blumstein A, Wallman J (2000) The crime drop in America. Cambridge University Press, New York
Bobo LD, Thompson V (2006) Unfair by design: the war on drugs, race, and the legitimacy of the criminal justice system. Soc Res 73(2):445–472
Bushway SD, Forst B (2013a) Studying discretion in the processes that generate criminal justice sanctions. Justice Q 30(2):199–222
Bushway SD, Forst B (2013b) Studying discretion in the processes that generate criminal justice sanctions. JQ. Justice Q 30(2):199–222. doi:10.1080/07418825.2012.682604
Bushway SD, Piehl AM (2001) Judging judicial discretion: legal factors and racial discrimination in sentencing. Law Soc Rev 35(4):733–764
Busso M, DiNardo J, McCrary J (2011) New evidence on the finite sample properties of propensity score reweighting and matching estimators. Working paper
California Department of Alcohol and Drug Programs (2004) Comprehensive Drug Court Implementation Act of 1999: interim report to the legislature. Sacramento, California
Caulkins JP, Reuter P (2010) How drug enforcement affects drug prices. Crime and Justice 39(1):213–271
Demuth S, Steffensmeier D (2004) Ethnicity effects on sentence outcomes in large urban courts: comparisons among white, black, and Hispanic defendants*. Soc Sci Q 85(4):994–1011
Donohue J, Levitt SD (2001) The impact of race on policing and arrests. J Law Econ 44(2):367–394
Engen RL, Steen S (2000) The power to punish: discretion and sentencing reform in the war on drugs. Am J Sociol 105:1357–1395
Ettner SL, Huang D, Evans E, Ash DR, Hardy M, Jourabchi M, Hser Y (2006) Benefit-cost in the california treatment outcome project: does substance abuse treatment “pay for itself?”. Health Serv Res 41(1):192–213
Fosados R, Evans E, Hser YI (2007) Ethnic differences in utilization of drug treatment services and outcomes among Proposition 36 offenders in California. J Subst Abuse Treat 33(4):391–399
Gelman A, Fagan J, Kiss A (2007) An analysis of the New York City Police Department’s “Stop-and-Frisk” policy in the context of claims of racial bias. J Am Stat Assoc 102(479):813–823
Hayes JM (2012) Just the facts: California’s changing prison population. Public Policy Institute of California, San Francisco
Heckman J, Todd P (2009) A note on adapting propensity score matching and selection models to choice based samples. Economic Journal 12(1):S230–S234
Hirano K, Imbens G (2001) Estimation of causal effects using propensity score weighting: an application to data on right heart catheterization. Health Serv Outcomes Res Method 2:259–278
Hirano K, Imbens G, Ridder G (2003) Efficient estimation of average treatment effects using propensity score. Econometrica 71:1161–1189
Ho DE, Imai K, King G, Stuart EA (2007) Matching as nonparametric preprocessing for reducing model dependence in parametric causal inference. Political Anal 15:199–236
Huber PJ (1967) The behavior of maximum likelihood estimates under nonstandard conditions. In: Le Cam LM, Neyman J (eds) In: Proceedings of the fifth berkeley symposium on mathematical statistics and probability, vol I. University of California Press, Berkeley, pp 221–233
Iguchi MY, Bell J, Ramchand RN, Fain T (2005) How criminal system racial disparities may translate into health disparities. J Health Care Poor Underserved 16(4):48–56
Imbens G, Rubin D (2008) Causal inference in statistics, and in the social and biomedical sciences. Cambridge University Press, New York
Jacobs D, Carmichael JT (2001) The politics of punishment across time and space: a pooled time-series analysis of imprisonment rates. Soc Forces 80:61–89
Kang JDY, Schafer JL (2007) Demystifying double robustness: a comparison of alternative strategies for estimating a population mean from incomplete data. Stat Sci 22(4):523–539
Keen B, Jacobs D (2009) Racial threat, partisan politics, and racial disparities in prison admissions: a panel analysis. Criminology 47:209–238
Kingsnorth RF, MacIntosh RC, Sutherland S (2002) Criminal charge or probation violation? Prosecutorial discretion and implications for research in criminal court processing. Criminology 40:553–578. doi:10.1111/j.1745-9125.2002.tb00966.x
Klein S, Petersilia J, Turner S (1990) Race and imprisonment decisions in California. Science 247:812–816
Klein SP, Berk RA, Hickman LJ (2005) Race and the decision toseek the death penalty in federal cases. RAND Corporation, Santa Monica
Klepper S, Nagin DS, Tierney L (1983) Discrimination in the criminal justice system: a critical appraisal of the literature. In: Blumstein A, Cohen J, Martin S, Tonry M (eds) Research on sentencing: the search for reform, vol 2. National Academy Press, Washington, DC, pp 55–128
Knowles J, Persico N, Todd P (2001) Racial bias in motor vehicle searches: theory and evidence. J Polit Econ 109(1):203–229
Langan P (1985) Racism on trial: new evidence to explain the racial compositions of prisons in the United States. J Crim Law Criminol 76:666–683
Lê Cook B, Alegría M (2015) Racial-ethnic disparities in substance abuse treatment: the role of criminal history and socioeconomic status. Psychiatr Serv 62(11):1273–1281
Lee BK, Lessler J, Stuart EA (2009) Improving propensity score weighting using machine learning. Stat Med 29(3):337–346
MacDonald J, Arkes J, Nicosia N, Pacula RL (2014) Decomposing racial disparities in prison and drug treatment commitments for criminal offenders in California. J Legal Stu 43(1):155–187
McCaffrey DF, Ridgeway G, Morral AR (2004) Propensity score estimation with boosted regression for evaluation adolescent substance abuse treatment. Psychol Methods 9:403–425
Mitchell O (2005) A meta-analysis of race and sentencing research: explaining the inconsistencies. J Quant Criminol 21:439–466
Morgan SL, Winship C (2007) Counterfactuals and causal inference: methods and principles for social research. Cambridge University Press, Cambridge
Mustard D (2001) Racial, ethnic and gender disparities in sentencing: evidence from the U.S. federal courts. J Law Econ 44:285–314
National Research Council (2004) Measuring racial discrimination. National Academies Press, Washington, DC
Nicosia N, MacDonald J, Arkes J (2013) Disparities in criminal court referrals to drug treatment and prison for minority men. Am J Public Health 103(6):77–84
O’Hear MM (2009) Rethinking drug courts: restorative justice as a response to racial injustice. Stanf Law Policy Rev 20(2):09–10
Paternoster R, Brame R (2008) Reassessing race disparities in Maryland capital cases. Criminology 46:971–1008
Ramchand R, Pacula RL, Iguchi M (2006) Racial differences in marijuana-users’ risk of arrest in the United States. Drug Alcohol Depend 84(3):264–272
Raphael S, Stoll MA (2013) Why are so many Americans in prison?. Russell Sage Foundation, New York
Reuter P, Hirschfield P, Davies C (2001) Assessing the crack-down on marijuana in Maryland. The Abell Foundation, Baltimore
Ridgeway G, MacDonald JM (2009) Doubly robust internal benchmarking and false discovery rates for detecting racial bias in police stops. J Am Stat Assoc 104(486):661–668
Ridgeway G, McCaffrey DF (2007) Comment on ‘Demystifying double robustness: a comparison of alternative strategies for estimating a population mean from incomplete data’ by Kang and Schafer. Stat Sci 22(4):540–543
Riley JK (1997) Crack, powder cocaine, and heroin: purchase and use patterns in six cities. Washington DC: U.S. Department of Justice, National Institute of Justice and Office of National Drug Control Policy
Rodriguez SF, Curry T, Lee G (2006) Gender differences in criminal sentencing: do effects vary across violent, property, and drug offenses? Soc Sci Q 87:318–339
Rosenbaum P (2010) Design of observational studies. Springer series in statistics. Springer, New York
Rosenbaum PR, Rubin DB (1983) The central role of the propensity score in observational studies for causal effects. Biometrika 70(1):41–55
Rubin DB (1974) Estimating causal effects of treatments in randomized and nonrandomized studies. J Educ Psychol 66(5):688–701
Smith JA, Todd PE (2005) Does matching overcome LaLonde’s critique of nonexperimental estimators? J Econom 125:305–353
Spohn C (1999) Gender and sentencing of drug offenders: is chivalry dead? Crim Justice Policy Rev 9:365–399
Spohn C, Fornango R (2009) U.S. attorneys and substantial assistance departures: testing for interprosecutor disparity. Criminology 47(3):813–846
Steen S, Engen RL, Gainey RR (2005) Images of danger and culpability: racial stereotyping, case processing, and criminal sentencing. Criminology 43:435
Steffensmeier D, Demuth S (2001) Ethnicity and judges’ sentencing decisions: hispanic-black-white comparisons. Criminology 39(1):145–178
Stuart EA (2010) Matching methods for causal inference: a review and a look forward. Stat Sci 25:1–21
Tibshirani R (1995) Regression selection and shrinkage via the lasso. J Roy Stat Soc B 57:267–288
Tonry M (1995) Malign neglect: race, crime, and punishment in America. Oxford University Press, New York
Tonry M (2010) The social, psychological, and political causes of racial disparities in the American criminal justice system. Crime Justice 39(1):273–312
Tonry M, Melewski M (2008) The malign effects of drug and crime control policies on black Americans. Crime Justice 37(1):1–44
Unnever JD, Hembroff LA (1988) The prediction of racial/ethnic sentencing disparities: an expectation states approach. J Res Crime Delinq 25:53–82
Unnever JD, Cullen FT, Jonson CL (2008) Race, racism, and support for capital punishment. Crime Justice 37(1):45–96
Western B (2006) Punishment and inequality in America. Russell Sage Foundation, New York
Wintemute GJ, Wright MA, Drake CM, Beaumont JJ (2001) Subsequent criminal activity among violent misdemeanants who seek to purchase handguns: risk factors and effectiveness of denying handgun purchase. J Am Med Assoc 285(8):1019–1026
Wooldridge J (2002) Econometric analysis of cross section and panel data. MIT Press, Cambridge
Wooldridge J (2012) Distinguishing race effects on pre-trial release and sentencing decisions. Justice Q 29(1):41–75. doi:10.1080/07418825.2011.559480
Acknowledgments
The authors gratefully acknowledge comments from RAND’s Drug Policy Research Center’s brownbag seminar series, the NBER Summer Institute Economics of Crime Working Group participants, Christopher Carpenter, and Patrick Bayer for comments on earlier drafts of this paper. Finally, we would like to acknowledge Joseph Hayes from CDCR for his help. Points of view are those of the authors and do not reflect the opinions of NIDA or the RAND Corporation.
Funding
Support for this project was provided by the National Institute on Drug Abuse (NIDA) (grant R01DA022719).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Nicosia, N., MacDonald, J.M. & Pacula, R.L. Does Mandatory Diversion to Drug Treatment Eliminate Racial Disparities in the Incarceration of Drug Offenders? An Examination of California’s Proposition 36. J Quant Criminol 33, 179–205 (2017). https://doi.org/10.1007/s10940-016-9293-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10940-016-9293-x