Abstract
Objective
Joan McCord was a very influential criminologist and strong advocate for measuring potentially harmful effects in well-meaning crime prevention programs. This paper demonstrates the continued importance of measuring adverse program effects by reviewing the available research evidence on classic and contemporary gang streetworker programs.
Methods
This paper draws upon the evaluation findings of existing gang streetworker evaluations and presents the unpublished results of a rigorous quasi-experimental evaluation of a contemporary gang streetworker program that directly measured whether the intervention impacted the violent gun behaviors of treated gangs relative to untreated gangs.
Results
Evaluations of classic pre-1970s gang streetworker programs generally found that these interventions increased gang delinquency by reinforcing group identity and enhancing gang cohesion. Evaluations of contemporary gang streetworker programs are mixed, with several studies documenting concerning increases in gang violence. An unpublished evaluation found that the streetworker program was well-implemented and executed. However, the intervention was associated with increased shootings by and against treatment gangs relative to control gangs.
Conclusion
These findings suggest that contemporary gang streetworker programs are at high risk of generating unintended adverse outcomes for treated gang members relative to their untreated counterparts. Existing and planned programs should be monitored with a high degree of vigilance and evaluated with controlled evaluation designs.
Similar content being viewed by others
Notes
Beyond the application of construct theory to understand the strong backfire effects of summer camp, McCord (1981) developed other hypotheses to explain the harmful effects of the Cambridge-Somerville Youth Study on treated boys relative to untreated boys. Most notably, McCord (1981) suggested that the Cambridge-Somerville Youth Study boys in the treatment group may have suffered a labeling effect. Other possible explanations included (1) the counselors imposed middle-class values on lower-class youth that simply did not work for them, (2) the boys in the treatment group became dependent on the counselors and lost a key source of support when the program ended, and (3) the support of the counselors raised the treatment boys’ expectations that could not be sustained, and disillusionment set in after the program was completed.
The well-known Chicago Area Project (CAP), designed by University of Chicago sociologist Clifford Shaw, was one of the earliest and most influential gang streetworker programs. The CAP model employed local adults to outreach gang youth with group activities and social service opportunities in order to drive down neighborhood crime. Spergel (2007) has noted that CAP’s outreach workers were among the first “curbstone counselors”—individuals with ties to both the neighborhood and gangs dedicated toward group and individual transformation. Unfortunately, CAP was never rigorously evaluated to establish its impacts on gang delinquency.
The scientific evidence reviewed here excludes the evaluation of the “Save Our Streets” (SOS) streetworker program in the Crown Heights neighborhood of Brooklyn (Picard-Fritsche and Cerniglia 2013) due to a very weak evaluation design that did not adequately control for rival causal factors. The evaluation also made implausibly large violence reduction claims for a police district of some 96,000 residents given the scale of the program (only four outreach workers who managed just 96 clients—only 68 % of whom were classified as “high risk” for involvement in gun violence).
Using the Maryland Scientific Methods Scale (Sherman et al. 1997) as a standard, the SSB quasi-experimental design with matched treatment and control groups would be considered a “Level 4” evaluation as it measured outcomes before and after the program in multiple treatment and control condition units. These types of designs have better statistical control of extraneous influences on outcomes and, relative to lower-level evaluations, deal with selection and regression threats more adequately. The Scientific Methods Scale ranked scientific studies from Level 1 (weakest) to Level 5 (strongest) on overall internal validity. Properly implemented randomized experiments were rated highest on the scale and observational studies lowest.
References
Allan, E. (2014). Boston to overhaul street worker programs. The Boston Globe, https://www.bostonglobe.com/metro/2014/12/06/boston-overhaul-street-worker-programs/E1cw5SHFwnXaPXVUiCGISJ/story.html (Accessed July 3, 2015).
Becker, H. (1973). Outsiders. New York: Free Press.
Berger, R. J., Crowley, J. E., Gold, M., Gray, J., & Arnold, M. (1975). Experiment in a juvenile court: a study of program volunteers working with juvenile probationers. Ann Arbor: Institute for Social Research, University of Michigan.
Blackwell, M., Iacus, S., King, G., & Poro, G. (2009). CEM: coarsened exact matching in STATA. Stata Journal, 9, 524–546.
Boyle, D., Lanterman, J., Pascarella, J., & Cheng, C. (2010). The impact of Newark’s operation ceasefire on trauma center gunshot wound admissions. Justice Research and Policy, 12, 105–123.
Braga, A. A. (2003). Serious youth gun offenders and the epidemic of youth violence in Boston. Journal of Quantitative Criminology, 19, 33–54.
Braga, A. A., & Weisburd, D. L. (2012). The effects of focused deterrence strategies on crime: a systematic review and meta-analysis of the empirical evidence. Journal of Research in Crime and Delinquency, 49, 323–358.
Braga, A. A., Kennedy, D. M., Waring, E., & Piehl, A. M. (2001). Problem-oriented policing, deterrence, and youth violence: an evaluation of Boston’s operation ceasefire. Journal of Research in Crime and Delinquency, 38, 195–225.
Braga, A. A., Hureau, D. M., & Winship, C. (2008). Losing faith? police, black churches, and the resurgence of youth violence in Boston. Ohio State Journal of Criminal Law, 6, 141–172.
Braga, A. A., Apel, R., & Welsh, B. C. (2013). The spillover effects of focused deterrence on gang violence. Evaluation Review, 37, 314–342.
Braga, A. A., Hureau, D. M., & Papachristos, A. V. (2014a). Deterring gang-involved gun violence: measuring the impact of Boston’s operation ceasefire on street gang behavior. Journal of Quantitative Criminology, 30, 113–139.
Braga, A. A., Hureau, D. M., & Grossman, L. (2014b). Managing the group violence intervention: using shooting scorecards to track group violence. Washington, DC: U.S. Department of Justice, Office of Community Oriented Policing Services.
Bursik, R. J., & Grasmick, H. G. (1993). Neighborhoods and crime. Lexington: Lexington Books.
Card, D., & Krueger, A. (1994). Minimum wages and employment: a case study of the fast-food industry in New Jersey and Pennsylvania. American Economic Review, 84, 772–793.
Cécile, M., & Born, M. (2009). Intervention in juvenile delinquency: danger of iatrogenic effects? Children and Youth Services Review, 31, 1217–1221.
Dishion, T. J., & Andrews, D. (1995). Preventing escalation in problem behaviors in high-risk young adolescents: immediate and 1-year outcomes. Journal of Consulting and Clinical Psychology, 63, 538–548.
Dishion, T. J., McCord, J., & Poulin, F. (1999). When interventions harm: peer groups and problem behavior. American Psychologist, 54, 755–764.
Dufty, B. J., & Richard, W. (1978). Evaluation of SOFTLY. Unpublished manuscript. Canberra: Australian Institute of Criminology.
Ekblom, P., & Pease, K. (1995). Evaluating crime prevention. In M. Tonry & D. P. Farrington (Eds.), Building a safer society: strategic approaches to crime prevention (pp. 585–662). Chicago: University of Chicago Press.
Farrington, D. (2009). Joan McCord (1940-2004). In K. Heyward, S. Maruna, & J. Mooney (Eds.), Fifty key thinkers in criminology (pp. 179–185). London: Taylor & Francis.
Finckenauer, J. O. (1982). Scared straight and the panacea phenomenon. Englewood Cliffs: Prentice-Hall.
Fox, A. M., Katz, C. M., Choate, D., & Hedberg, E. (2015). Evaluation of the phoenix TRUCE project: a replication of Chicago CeaseFire. Justice Quarterly, 31, 85–115.
Gatti, U., Tremblay, R. E., & Vitaro, F. (2009). Iatrogenic effect of juvenile justice. Journal of Child Psychology and Psychiatry, 50, 991–998.
Gelman, A. (2005). Analysis of variance: why it is more important than ever. Annals of Statistics, 33, 1–53.
Gold, M., & Mattick, H. W. (1974). Experiment in the streets: The Chicago youth development project. Final report. Ann Arbor: Institute for Social Research, University of Michigan.
Gottfredson, G. D. (1987). Peer group interventions to reduce the risk of delinquent behavior: a selective review and a new evaluation. Criminology, 25, 671–714.
Gottfredson, D. C. (2010). Deviancy training: understanding how preventive interventions harm: the academy of experimental criminology 2009 Joan McCord award lecture. Journal of Experimental Criminology, 6, 229–243.
Henry, D. B., Knoblauch, S., & Sigurvinsdottir, R. (2014). The effect of intensive CeaseFire intervention on crime in four Chicago police beats: quantitative assessment. Unpublished report to the McCormick foundation. Chicago: University of Chicago, University of Illinois at Chicago.
Hureau, D. M., Braga, A. A., & Winship, C. (2014). Evaluating StreetSafe Boston. Unpublished final report to The Boston Foundation. Cambridge: Harvard Kennedy School.
Iacus, S., King, G., & Porro, G. (2012). Causal inference without balance checking: coarsened exact matching. Political Analysis, 20, 1–24.
Kennedy, D. M. (2011). Whither streetwork? The place of outreach workers in communityviolence prevention. Criminology & Public Policy, 10, 1045–1052.
Kennedy, D. M., Piehl, A. M., & Braga, A. A. (1996). Youth violence in Boston: gun markets, serious youth offenders, and a use-reduction strategy. Law and Contemporary Problems, 59, 147–196.
Klein, M. W. (1969). Gang cohesiveness, delinquency, and a street-work program. Journal of Research in Crime and Delinquency, 6, 135–166.
Klein, M. W. (1971). Street gangs and street workers. Englewood Cliffs: Prentice-Hall.
Klein, M. W. (1995). The American street gang. New York: Oxford University Press.
Klein, M. W. (2011). Comprehensive gang and violence reduction programs: reinventing the square wheel. Criminology & Public Policy, 10, 1037–1044.
Klein, M. W., & Maxson, C. L. (2006). Street gangs: patterns and policies. New York: Oxford University Press.
Klofas, J., & Hipple, N. (2006). Crime incident reviews. Project safe neighborhoods: strategic interventions case study 3. Washington, DC: US Department of Justice.
Lemert, E. M. (1951). Social pathology. New York: McGraw-Hill.
Lewis, R. V. (1983). Scared straight – California style. Criminal Justice and Behavior, 10, 284–289.
Lopes, G., Krohn, M. D., Lizotte, A. J., Schmidt, N. M., Vasquez, B. E., & Bernberg, J. G. (2012). Labeling and cumulative disadvantage: the impact of formal police intervention on life chances and crime during emerging adulthood. Journal of Research in Crime and Delinquency, 58, 456–488.
McCord, J. (1978). A thirty-year follow-up of treatment effects. American Psychologist, 33, 284–289.
McCord, J. (1979). Some childrearing antecedents of criminal behavior in adult men. Journal of Personality and Social Psychology, 37, 1477–1486.
McCord, J. (1981). Consideration of some effects of a counseling program. In S. E. Martin, L. B. Sechrest, & R. Redner (Eds.), New directions in the rehabilitation of criminal offenders (pp. 394–405). Washington, DC: National Academy of Sciences.
McCord, J. (1992). The Cambridge-Somerville study: a pioneering longitudinal experimental study of delinquency prevention. In J. McCord & R. E. Tremblay (Eds.), Preventing antisocial behavior: interventions from birth through adolescence (pp. 196–206). New York: Guilford Press.
McCord, J. (1997). He did it because he wanted to. In W. Osgood (Ed.), Motivation and delinquency (Nebraska symposium on motivation, Vol. 44, pp. 1–43). Lincoln: University of Nebraska Press.
McCord, J. (1999). Understanding childhood and subsequent crime. Aggressive Behavior, 25, 241–253.
McCord, J. (2000). A theory of motivation and the life course. In S. Karstedt & K. Bussmann (Eds.), Social dynamics of crime and control: new theories for a world in transition (pp. 229–241). Portland: Hart Publishing.
McCord, J. (2003). Cures that harm: unanticipated outcomes of crime prevention programs. The Annals of the American Academy of Political and Social Science, 587, 16–30.
McCord, W., & McCord, J. (1959). Origins of crime. New York: Columbia University Press.
Miller, W. B. (1962). The impact of a 'total-community' delinquency control project. Social Problems, 10, 168–191.
Moore, M. H. (2002). Creating networks of capacity: the challenge of managing society’s response to youth violence. In G. Katzmann (Ed.), Securing our children’s future (pp. 338–385). Washington, DC: Brookings Institution.
Papachristos, A. V. (2011). Too big to fail: the science and politics of violence prevention. Criminology & Public Policy, 10, 1053–1061.
Papachristos, A. V. (2013). The importance of group cohesion for gang prevention, policy, and research. Criminology & Public Policy, 12, 49–58.
Paternoster, R., & Iovanni, L. (1989). The labeling perspective and delinquency: an elaboration of the theory and an assessment of the evidence. Justice Quarterly, 6, 359–394.
Petrosino, A., Turpin-Petrosino, C., & Buehler, J. (2004). “Scared straight” and other juvenile awareness programs for preventing juvenile delinquency. Campbell Collaboration. doi:10.4073/csr.2004.2.
Picard-Fritsche, S., & Cerniglia, L. (2013). Testing a public health approach to gun violence. New York: Center for Court Innovation.
Powers, E., & Witmer, H. (1951). An experiment in the prevention of delinquency: the Cambridge-Somerville youth study. New York: Columbia University Press.
Rhule, D. M. (2005). Take care to do no harm: harmful interventions for youth problem behavior. Professional Psychology: Research and Practice, 36, 618–625.
Rorie, M., Gottfredson, D. C., Cross, A., Wilson, D., & Connell, N. (2011). Structure and deviancy training in after-school programs. Journal of Adolescence, 34, 105–117.
Rosenbaum, P., & Rubin, D. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70, 41–55.
Rosenbaum, P., & Rubin, D. (1985). Constructing a control group using multivariate matched sampling methods that incorporate the propensity score. American Statistician, 39, 33–38.
Rosenthal, R. (1979). The ‘file drawer problem’ and tolerance of null results. Psychological Bulletin, 86, 638–641.
Rossi, P. H., Lipsey, M., & Freeman, H. (2006). Evaluation: a systematic approach (7th ed.). Newbury Park: Sage.
Sampson, R. J., & Laub, J. H. (1997). A life-course theory of cumulative disadvantage and the stability of delinquency. In T. P. Thornberry (Ed.), Developmental theories of crime and delinquency. Advances in criminological theory (Vol. 7, pp. 133–161). Transaction: New Brunswick.
Sayre-McCord, G. (Ed.). (2007). Crime and family: selected essays of Joan McCord. Philadelphia: Temple University Press.
Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin.
Sherman, L. W. (2007). The power few: experimental criminology and the reduction of harm. Journal of Experimental Criminology, 3, 299–321.
Sherman, L. W., Gottfredson, D., MacKenzie, D. L., Eck, J. E., Reuter, P., & Bushway, S. (1997). Preventing crime: what works, what doesn’t, what’s promising. Washington, DC: U.S. Department of Justice, National Institute of Justice.
Singer, J. D., & Willet, J. (2003). Applied longitudinal data analysis: modeling change and event occurrence. New York: Oxford University Press.
Skogan, W. G., Hartnett, S. M., Bump, N., & Dubois, J. (2009). Evaluation of cease fire Chicago. Washington, DC: U.S. Department of Justice, National Institute of Justice.
Spergel, I. A. (1966). Street gang work: theory and practice. Reading: Addison-Wesley.
Spergel, I. A. (1995). The youth gang problem: a community approach. New York: Oxford University Press.
Spergel, I. A. (2007). Reducing gang violence: the little village gang project in Chicago. Lanham: Altamira Press.
Tannenbaum, F. (1938). Crime and community. New York: Columbia University Press.
Thornberry, T. P., Krohn, M. D., Lizotte, A. J., Smith, C. A., & Tolin, K. (2003). Gangs and delinquency in developmental perspective. New York: Cambridge University Press.
Thrasher, F. M. (1927). The gang: a study of 1,313 gang in Chicago. Chicago: University of Chicago Press.
Webster, D. W., Whitehill, J. M., Vernick, J. S., & Parker, E. (2012). Evaluation of Baltimore’s safe streets program. Baltimore: Johns Hopkins University, Bloomberg School of Public Health.
Webster, D. W., Whitehill, J. M., Vernick, J. S., & Parker, E. (2013). Effects of Baltimore’s safe streets program on gun violence: a replication of Chicago’s CeaseFire program. Journal of Urban Health, 90, 27–40.
Weiss, B., Caron, A., Ball, S., Tapp, J., Johnson, J., & Weisz, J. R. (2005). Iatrogenic effects of group treatment for antisocial youth. Journal of Consulting and Clinical Psychology, 73, 1036–1044.
Welsh, B. C., & Rocque, M. (2014). When crime prevention harms: a review of systematic reviews. Journal of Experimental Criminology, 10, 245–266.
Werch, C. E., & Owen, D. M. (2002). Iatrogenic effects of alcohol and drug prevention programs. Journal of Studies on Alcohol, 63, 581–590.
Wilson, J., & Chermak, S. (2011). Community-driven violence reduction programs: examining Pittsburgh’s one vision one life. Criminology & Public Policy, 10, 993–1028.
Zane, S., Welsh, B. C., & Zimmerman, G. (2015). Examining the iatrogenic effects of the Cambridge-Somerville youth study. British Journal of Criminology. doi:10.1093/bjc/azv033.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Braga, A.A. The continued importance of measuring potentially harmful impacts of crime prevention programs: the academy of experimental criminology 2014 Joan McCord lecture. J Exp Criminol 12, 1–20 (2016). https://doi.org/10.1007/s11292-016-9252-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11292-016-9252-4