Skip to main content

Advertisement

Log in

The continued importance of measuring potentially harmful impacts of crime prevention programs: the academy of experimental criminology 2014 Joan McCord lecture

  • Published:
Journal of Experimental Criminology Aims and scope Submit manuscript

Abstract

Objective

Joan McCord was a very influential criminologist and strong advocate for measuring potentially harmful effects in well-meaning crime prevention programs. This paper demonstrates the continued importance of measuring adverse program effects by reviewing the available research evidence on classic and contemporary gang streetworker programs.

Methods

This paper draws upon the evaluation findings of existing gang streetworker evaluations and presents the unpublished results of a rigorous quasi-experimental evaluation of a contemporary gang streetworker program that directly measured whether the intervention impacted the violent gun behaviors of treated gangs relative to untreated gangs.

Results

Evaluations of classic pre-1970s gang streetworker programs generally found that these interventions increased gang delinquency by reinforcing group identity and enhancing gang cohesion. Evaluations of contemporary gang streetworker programs are mixed, with several studies documenting concerning increases in gang violence. An unpublished evaluation found that the streetworker program was well-implemented and executed. However, the intervention was associated with increased shootings by and against treatment gangs relative to control gangs.

Conclusion

These findings suggest that contemporary gang streetworker programs are at high risk of generating unintended adverse outcomes for treated gang members relative to their untreated counterparts. Existing and planned programs should be monitored with a high degree of vigilance and evaluated with controlled evaluation designs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Notes

  1. Beyond the application of construct theory to understand the strong backfire effects of summer camp, McCord (1981) developed other hypotheses to explain the harmful effects of the Cambridge-Somerville Youth Study on treated boys relative to untreated boys. Most notably, McCord (1981) suggested that the Cambridge-Somerville Youth Study boys in the treatment group may have suffered a labeling effect. Other possible explanations included (1) the counselors imposed middle-class values on lower-class youth that simply did not work for them, (2) the boys in the treatment group became dependent on the counselors and lost a key source of support when the program ended, and (3) the support of the counselors raised the treatment boys’ expectations that could not be sustained, and disillusionment set in after the program was completed.

  2. The well-known Chicago Area Project (CAP), designed by University of Chicago sociologist Clifford Shaw, was one of the earliest and most influential gang streetworker programs. The CAP model employed local adults to outreach gang youth with group activities and social service opportunities in order to drive down neighborhood crime. Spergel (2007) has noted that CAP’s outreach workers were among the first “curbstone counselors”—individuals with ties to both the neighborhood and gangs dedicated toward group and individual transformation. Unfortunately, CAP was never rigorously evaluated to establish its impacts on gang delinquency.

  3. The scientific evidence reviewed here excludes the evaluation of the “Save Our Streets” (SOS) streetworker program in the Crown Heights neighborhood of Brooklyn (Picard-Fritsche and Cerniglia 2013) due to a very weak evaluation design that did not adequately control for rival causal factors. The evaluation also made implausibly large violence reduction claims for a police district of some 96,000 residents given the scale of the program (only four outreach workers who managed just 96 clients—only 68 % of whom were classified as “high risk” for involvement in gun violence).

  4. Using the Maryland Scientific Methods Scale (Sherman et al. 1997) as a standard, the SSB quasi-experimental design with matched treatment and control groups would be considered a “Level 4” evaluation as it measured outcomes before and after the program in multiple treatment and control condition units. These types of designs have better statistical control of extraneous influences on outcomes and, relative to lower-level evaluations, deal with selection and regression threats more adequately. The Scientific Methods Scale ranked scientific studies from Level 1 (weakest) to Level 5 (strongest) on overall internal validity. Properly implemented randomized experiments were rated highest on the scale and observational studies lowest.

References

  • Allan, E. (2014). Boston to overhaul street worker programs. The Boston Globe, https://www.bostonglobe.com/metro/2014/12/06/boston-overhaul-street-worker-programs/E1cw5SHFwnXaPXVUiCGISJ/story.html (Accessed July 3, 2015).

  • Becker, H. (1973). Outsiders. New York: Free Press.

    Google Scholar 

  • Berger, R. J., Crowley, J. E., Gold, M., Gray, J., & Arnold, M. (1975). Experiment in a juvenile court: a study of program volunteers working with juvenile probationers. Ann Arbor: Institute for Social Research, University of Michigan.

    Google Scholar 

  • Blackwell, M., Iacus, S., King, G., & Poro, G. (2009). CEM: coarsened exact matching in STATA. Stata Journal, 9, 524–546.

    Google Scholar 

  • Boyle, D., Lanterman, J., Pascarella, J., & Cheng, C. (2010). The impact of Newark’s operation ceasefire on trauma center gunshot wound admissions. Justice Research and Policy, 12, 105–123.

    Article  Google Scholar 

  • Braga, A. A. (2003). Serious youth gun offenders and the epidemic of youth violence in Boston. Journal of Quantitative Criminology, 19, 33–54.

    Article  Google Scholar 

  • Braga, A. A., & Weisburd, D. L. (2012). The effects of focused deterrence strategies on crime: a systematic review and meta-analysis of the empirical evidence. Journal of Research in Crime and Delinquency, 49, 323–358.

    Article  Google Scholar 

  • Braga, A. A., Kennedy, D. M., Waring, E., & Piehl, A. M. (2001). Problem-oriented policing, deterrence, and youth violence: an evaluation of Boston’s operation ceasefire. Journal of Research in Crime and Delinquency, 38, 195–225.

    Article  Google Scholar 

  • Braga, A. A., Hureau, D. M., & Winship, C. (2008). Losing faith? police, black churches, and the resurgence of youth violence in Boston. Ohio State Journal of Criminal Law, 6, 141–172.

    Google Scholar 

  • Braga, A. A., Apel, R., & Welsh, B. C. (2013). The spillover effects of focused deterrence on gang violence. Evaluation Review, 37, 314–342.

    Article  Google Scholar 

  • Braga, A. A., Hureau, D. M., & Papachristos, A. V. (2014a). Deterring gang-involved gun violence: measuring the impact of Boston’s operation ceasefire on street gang behavior. Journal of Quantitative Criminology, 30, 113–139.

    Article  Google Scholar 

  • Braga, A. A., Hureau, D. M., & Grossman, L. (2014b). Managing the group violence intervention: using shooting scorecards to track group violence. Washington, DC: U.S. Department of Justice, Office of Community Oriented Policing Services.

    Google Scholar 

  • Bursik, R. J., & Grasmick, H. G. (1993). Neighborhoods and crime. Lexington: Lexington Books.

    Google Scholar 

  • Card, D., & Krueger, A. (1994). Minimum wages and employment: a case study of the fast-food industry in New Jersey and Pennsylvania. American Economic Review, 84, 772–793.

    Google Scholar 

  • Cécile, M., & Born, M. (2009). Intervention in juvenile delinquency: danger of iatrogenic effects? Children and Youth Services Review, 31, 1217–1221.

    Article  Google Scholar 

  • Dishion, T. J., & Andrews, D. (1995). Preventing escalation in problem behaviors in high-risk young adolescents: immediate and 1-year outcomes. Journal of Consulting and Clinical Psychology, 63, 538–548.

    Article  Google Scholar 

  • Dishion, T. J., McCord, J., & Poulin, F. (1999). When interventions harm: peer groups and problem behavior. American Psychologist, 54, 755–764.

    Article  Google Scholar 

  • Dufty, B. J., & Richard, W. (1978). Evaluation of SOFTLY. Unpublished manuscript. Canberra: Australian Institute of Criminology.

    Google Scholar 

  • Ekblom, P., & Pease, K. (1995). Evaluating crime prevention. In M. Tonry & D. P. Farrington (Eds.), Building a safer society: strategic approaches to crime prevention (pp. 585–662). Chicago: University of Chicago Press.

    Google Scholar 

  • Farrington, D. (2009). Joan McCord (1940-2004). In K. Heyward, S. Maruna, & J. Mooney (Eds.), Fifty key thinkers in criminology (pp. 179–185). London: Taylor & Francis.

    Google Scholar 

  • Finckenauer, J. O. (1982). Scared straight and the panacea phenomenon. Englewood Cliffs: Prentice-Hall.

    Google Scholar 

  • Fox, A. M., Katz, C. M., Choate, D., & Hedberg, E. (2015). Evaluation of the phoenix TRUCE project: a replication of Chicago CeaseFire. Justice Quarterly, 31, 85–115.

    Article  Google Scholar 

  • Gatti, U., Tremblay, R. E., & Vitaro, F. (2009). Iatrogenic effect of juvenile justice. Journal of Child Psychology and Psychiatry, 50, 991–998.

    Article  Google Scholar 

  • Gelman, A. (2005). Analysis of variance: why it is more important than ever. Annals of Statistics, 33, 1–53.

    Article  Google Scholar 

  • Gold, M., & Mattick, H. W. (1974). Experiment in the streets: The Chicago youth development project. Final report. Ann Arbor: Institute for Social Research, University of Michigan.

    Google Scholar 

  • Gottfredson, G. D. (1987). Peer group interventions to reduce the risk of delinquent behavior: a selective review and a new evaluation. Criminology, 25, 671–714.

    Article  Google Scholar 

  • Gottfredson, D. C. (2010). Deviancy training: understanding how preventive interventions harm: the academy of experimental criminology 2009 Joan McCord award lecture. Journal of Experimental Criminology, 6, 229–243.

    Article  Google Scholar 

  • Henry, D. B., Knoblauch, S., & Sigurvinsdottir, R. (2014). The effect of intensive CeaseFire intervention on crime in four Chicago police beats: quantitative assessment. Unpublished report to the McCormick foundation. Chicago: University of Chicago, University of Illinois at Chicago.

    Google Scholar 

  • Hureau, D. M., Braga, A. A., & Winship, C. (2014). Evaluating StreetSafe Boston. Unpublished final report to The Boston Foundation. Cambridge: Harvard Kennedy School.

    Google Scholar 

  • Iacus, S., King, G., & Porro, G. (2012). Causal inference without balance checking: coarsened exact matching. Political Analysis, 20, 1–24.

    Article  Google Scholar 

  • Kennedy, D. M. (2011). Whither streetwork? The place of outreach workers in communityviolence prevention. Criminology & Public Policy, 10, 1045–1052.

    Article  Google Scholar 

  • Kennedy, D. M., Piehl, A. M., & Braga, A. A. (1996). Youth violence in Boston: gun markets, serious youth offenders, and a use-reduction strategy. Law and Contemporary Problems, 59, 147–196.

    Article  Google Scholar 

  • Klein, M. W. (1969). Gang cohesiveness, delinquency, and a street-work program. Journal of Research in Crime and Delinquency, 6, 135–166.

    Article  Google Scholar 

  • Klein, M. W. (1971). Street gangs and street workers. Englewood Cliffs: Prentice-Hall.

    Google Scholar 

  • Klein, M. W. (1995). The American street gang. New York: Oxford University Press.

    Google Scholar 

  • Klein, M. W. (2011). Comprehensive gang and violence reduction programs: reinventing the square wheel. Criminology & Public Policy, 10, 1037–1044.

    Article  Google Scholar 

  • Klein, M. W., & Maxson, C. L. (2006). Street gangs: patterns and policies. New York: Oxford University Press.

    Book  Google Scholar 

  • Klofas, J., & Hipple, N. (2006). Crime incident reviews. Project safe neighborhoods: strategic interventions case study 3. Washington, DC: US Department of Justice.

    Google Scholar 

  • Lemert, E. M. (1951). Social pathology. New York: McGraw-Hill.

    Google Scholar 

  • Lewis, R. V. (1983). Scared straight – California style. Criminal Justice and Behavior, 10, 284–289.

    Article  Google Scholar 

  • Lopes, G., Krohn, M. D., Lizotte, A. J., Schmidt, N. M., Vasquez, B. E., & Bernberg, J. G. (2012). Labeling and cumulative disadvantage: the impact of formal police intervention on life chances and crime during emerging adulthood. Journal of Research in Crime and Delinquency, 58, 456–488.

    Article  Google Scholar 

  • McCord, J. (1978). A thirty-year follow-up of treatment effects. American Psychologist, 33, 284–289.

    Article  Google Scholar 

  • McCord, J. (1979). Some childrearing antecedents of criminal behavior in adult men. Journal of Personality and Social Psychology, 37, 1477–1486.

    Article  Google Scholar 

  • McCord, J. (1981). Consideration of some effects of a counseling program. In S. E. Martin, L. B. Sechrest, & R. Redner (Eds.), New directions in the rehabilitation of criminal offenders (pp. 394–405). Washington, DC: National Academy of Sciences.

    Google Scholar 

  • McCord, J. (1992). The Cambridge-Somerville study: a pioneering longitudinal experimental study of delinquency prevention. In J. McCord & R. E. Tremblay (Eds.), Preventing antisocial behavior: interventions from birth through adolescence (pp. 196–206). New York: Guilford Press.

    Google Scholar 

  • McCord, J. (1997). He did it because he wanted to. In W. Osgood (Ed.), Motivation and delinquency (Nebraska symposium on motivation, Vol. 44, pp. 1–43). Lincoln: University of Nebraska Press.

    Google Scholar 

  • McCord, J. (1999). Understanding childhood and subsequent crime. Aggressive Behavior, 25, 241–253.

    Article  Google Scholar 

  • McCord, J. (2000). A theory of motivation and the life course. In S. Karstedt & K. Bussmann (Eds.), Social dynamics of crime and control: new theories for a world in transition (pp. 229–241). Portland: Hart Publishing.

    Google Scholar 

  • McCord, J. (2003). Cures that harm: unanticipated outcomes of crime prevention programs. The Annals of the American Academy of Political and Social Science, 587, 16–30.

    Article  Google Scholar 

  • McCord, W., & McCord, J. (1959). Origins of crime. New York: Columbia University Press.

    Google Scholar 

  • Miller, W. B. (1962). The impact of a 'total-community' delinquency control project. Social Problems, 10, 168–191.

    Article  Google Scholar 

  • Moore, M. H. (2002). Creating networks of capacity: the challenge of managing society’s response to youth violence. In G. Katzmann (Ed.), Securing our children’s future (pp. 338–385). Washington, DC: Brookings Institution.

    Google Scholar 

  • Papachristos, A. V. (2011). Too big to fail: the science and politics of violence prevention. Criminology & Public Policy, 10, 1053–1061.

    Article  Google Scholar 

  • Papachristos, A. V. (2013). The importance of group cohesion for gang prevention, policy, and research. Criminology & Public Policy, 12, 49–58.

    Article  Google Scholar 

  • Paternoster, R., & Iovanni, L. (1989). The labeling perspective and delinquency: an elaboration of the theory and an assessment of the evidence. Justice Quarterly, 6, 359–394.

    Article  Google Scholar 

  • Petrosino, A., Turpin-Petrosino, C., & Buehler, J. (2004). “Scared straight” and other juvenile awareness programs for preventing juvenile delinquency. Campbell Collaboration. doi:10.4073/csr.2004.2.

    Google Scholar 

  • Picard-Fritsche, S., & Cerniglia, L. (2013). Testing a public health approach to gun violence. New York: Center for Court Innovation.

    Google Scholar 

  • Powers, E., & Witmer, H. (1951). An experiment in the prevention of delinquency: the Cambridge-Somerville youth study. New York: Columbia University Press.

    Google Scholar 

  • Rhule, D. M. (2005). Take care to do no harm: harmful interventions for youth problem behavior. Professional Psychology: Research and Practice, 36, 618–625.

    Article  Google Scholar 

  • Rorie, M., Gottfredson, D. C., Cross, A., Wilson, D., & Connell, N. (2011). Structure and deviancy training in after-school programs. Journal of Adolescence, 34, 105–117.

    Article  Google Scholar 

  • Rosenbaum, P., & Rubin, D. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70, 41–55.

    Article  Google Scholar 

  • Rosenbaum, P., & Rubin, D. (1985). Constructing a control group using multivariate matched sampling methods that incorporate the propensity score. American Statistician, 39, 33–38.

    Google Scholar 

  • Rosenthal, R. (1979). The ‘file drawer problem’ and tolerance of null results. Psychological Bulletin, 86, 638–641.

    Article  Google Scholar 

  • Rossi, P. H., Lipsey, M., & Freeman, H. (2006). Evaluation: a systematic approach (7th ed.). Newbury Park: Sage.

    Google Scholar 

  • Sampson, R. J., & Laub, J. H. (1997). A life-course theory of cumulative disadvantage and the stability of delinquency. In T. P. Thornberry (Ed.), Developmental theories of crime and delinquency. Advances in criminological theory (Vol. 7, pp. 133–161). Transaction: New Brunswick.

    Google Scholar 

  • Sayre-McCord, G. (Ed.). (2007). Crime and family: selected essays of Joan McCord. Philadelphia: Temple University Press.

    Google Scholar 

  • Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin.

    Google Scholar 

  • Sherman, L. W. (2007). The power few: experimental criminology and the reduction of harm. Journal of Experimental Criminology, 3, 299–321.

    Article  Google Scholar 

  • Sherman, L. W., Gottfredson, D., MacKenzie, D. L., Eck, J. E., Reuter, P., & Bushway, S. (1997). Preventing crime: what works, what doesn’t, what’s promising. Washington, DC: U.S. Department of Justice, National Institute of Justice.

    Google Scholar 

  • Singer, J. D., & Willet, J. (2003). Applied longitudinal data analysis: modeling change and event occurrence. New York: Oxford University Press.

    Book  Google Scholar 

  • Skogan, W. G., Hartnett, S. M., Bump, N., & Dubois, J. (2009). Evaluation of cease fire Chicago. Washington, DC: U.S. Department of Justice, National Institute of Justice.

    Google Scholar 

  • Spergel, I. A. (1966). Street gang work: theory and practice. Reading: Addison-Wesley.

    Google Scholar 

  • Spergel, I. A. (1995). The youth gang problem: a community approach. New York: Oxford University Press.

    Google Scholar 

  • Spergel, I. A. (2007). Reducing gang violence: the little village gang project in Chicago. Lanham: Altamira Press.

    Google Scholar 

  • Tannenbaum, F. (1938). Crime and community. New York: Columbia University Press.

    Google Scholar 

  • Thornberry, T. P., Krohn, M. D., Lizotte, A. J., Smith, C. A., & Tolin, K. (2003). Gangs and delinquency in developmental perspective. New York: Cambridge University Press.

    Google Scholar 

  • Thrasher, F. M. (1927). The gang: a study of 1,313 gang in Chicago. Chicago: University of Chicago Press.

    Google Scholar 

  • Webster, D. W., Whitehill, J. M., Vernick, J. S., & Parker, E. (2012). Evaluation of Baltimore’s safe streets program. Baltimore: Johns Hopkins University, Bloomberg School of Public Health.

    Google Scholar 

  • Webster, D. W., Whitehill, J. M., Vernick, J. S., & Parker, E. (2013). Effects of Baltimore’s safe streets program on gun violence: a replication of Chicago’s CeaseFire program. Journal of Urban Health, 90, 27–40.

    Article  Google Scholar 

  • Weiss, B., Caron, A., Ball, S., Tapp, J., Johnson, J., & Weisz, J. R. (2005). Iatrogenic effects of group treatment for antisocial youth. Journal of Consulting and Clinical Psychology, 73, 1036–1044.

    Article  Google Scholar 

  • Welsh, B. C., & Rocque, M. (2014). When crime prevention harms: a review of systematic reviews. Journal of Experimental Criminology, 10, 245–266.

    Article  Google Scholar 

  • Werch, C. E., & Owen, D. M. (2002). Iatrogenic effects of alcohol and drug prevention programs. Journal of Studies on Alcohol, 63, 581–590.

    Article  Google Scholar 

  • Wilson, J., & Chermak, S. (2011). Community-driven violence reduction programs: examining Pittsburgh’s one vision one life. Criminology & Public Policy, 10, 993–1028.

    Article  Google Scholar 

  • Zane, S., Welsh, B. C., & Zimmerman, G. (2015). Examining the iatrogenic effects of the Cambridge-Somerville youth study. British Journal of Criminology. doi:10.1093/bjc/azv033.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anthony A. Braga.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Braga, A.A. The continued importance of measuring potentially harmful impacts of crime prevention programs: the academy of experimental criminology 2014 Joan McCord lecture. J Exp Criminol 12, 1–20 (2016). https://doi.org/10.1007/s11292-016-9252-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11292-016-9252-4

Keywords

Navigation