Can “disciplined passion” overcome the cynical view? An empirical inquiry of evaluator influence on police crime prevention program outcomes
Investigate the degree and nature of influence that researchers have in police crime prevention programs and whether a high degree of influence is associated with biased reporting of results.
Meta-analytic inquiry of experimental and quasi-experimental studies (n = 42), drawn from four Campbell Collaboration systematic reviews of leading police crime prevention strategies: problem-oriented policing, “hot spots” policing, “pulling levers” policing, and street-level drug enforcement.
Larger program effects are not associated with studies with higher involvement on the part of the evaluator (e.g., assisting in strategy design, monitoring implementation, overcoming implementation problems).
This study does not find support for the cynical view, which holds that researchers have a personal stake in the program or are pressured to report positive results. Importantly, the evaluator’s involvement in the implementation of the program may be a necessary condition of successfully executed police experiments in complex field settings.
KeywordsAcademic–practitioner partnerships Conflict of interest Crime prevention Evaluator influence Policing
We are grateful to the editor, David Wilson, and the anonymous reviewers for helpful comments.
- Braga, A. A. (2007). The effects of hot spots policing on crime. Campbell Collaboration. doi: 10.4073/csr.2007.1.
- Braga, A. A., & Weisburd, D. (2010). Policing problem places: Crime hot spots and effective prevention. New York: Oxford University Press.Google Scholar
- Braga, A. A., & Weisburd, D. (2011). The effects of focused deterrence strategies on crime: A systematic review and meta-analysis of the empirical evidence. Journal of Research in Crime and Delinquency, 48, in press.Google Scholar
- Caeti, T. J. (1999). Houston’s targeted beat program. Unpublished Ph.D. dissertation. Huntsville, TX: Sam Houston State University.Google Scholar
- Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale: Erlbaum.Google Scholar
- Criminal Justice Commission. (1998). Beenleigh calls for service project. Brisbane: Criminal Justice Commission.Google Scholar
- Duval, S., & Tweedie, R. (2000). A nonparametric ‘trim and fill’ method of accounting for publication bias in meta-analysis. Journal of the American Statistical Association, 95, 89–98.Google Scholar
- Eisner, M., & Humphreys, D. (2011). Measuring conflict of interest in prevention and intervention research: A feasibility study. In T. Bliesener, A. Beelmann, & M. Stemmler (Eds.), Antisocial behavior and crime: Contributions of developmental and evaluation research to prevention and intervention (pp. 165–180). Cambridge: Hogrefe Publishing.Google Scholar
- Farrington, D. P., Gottfredson, D. C., Sherman, L. W., & Welsh, B. C. (2006). The Maryland scientific methods scale. In L. W. Sherman, D. P. Farrington, B. C. Welsh, & D. L. MacKenzie (Eds.), Evidence-based crime prevention (rev. ed., pp. 13–21). New York: Routledge.Google Scholar
- Goldstein, H. (1990). Problem-oriented policing. Philadelphia: Temple University Press.Google Scholar
- Green, L. (1996). Policing places with drug problems. Thousand Oaks: Sage.Google Scholar
- Hawken, A. & Kleiman, M. (2009). Managing drug involved probationers with swift and certain sanctions. Final report submitted to the National Institute of Justice. Unpublished report.Google Scholar
- Hope, T. (1994). Problem-oriented policing and drug market locations: three case studies. Crime Prevention Studies, 2, 5–32.Google Scholar
- Kennedy, D. (2008). Deterrence and crime prevention. New York: Routledge.Google Scholar
- Lipsey, M. W. (1995). What do we learn from 400 research studies on the effectiveness of treatment with juvenile delinquents? In J. McGuire (Ed.), What works: Reducing reoffending (pp. 63–78). New York: Wiley.Google Scholar
- Lipsey, M. W. (2000). Statistical conclusion validity for intervention research: A significant (p<.05) problem. In L. Bickman (Ed.), Validity and social experimentation: Donald Campbell’s legacy (pp. 101–120). Thousand Oaks: Sage.Google Scholar
- Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks: Sage.Google Scholar
- Mazerolle, L., Soole, D. W., & Rombouts, S. (2007). Street-level drug law enforcement: a meta-analytic review. Campbell Collaboration. doi: 10.4073/csr.2007:2.
- Moore, M. H., Prothrow-Stith, D., Guyer, B., & Spivak, H. (1994). Violence and intentional injuries: Criminal justice and public health perspectives on an urgent national problem. In A. J. Reiss & J. Roth (Eds.), Consequences and control (Vol. 4, pp. 167–216). Washington, DC: National Academy Press.Google Scholar
- National Research Council. (2008). Parole, desistence from crime, and community integration. Washington, DC: National Academies Press.Google Scholar
- Reason, P., & Bradbury, H. (2008). The handbook of action research (2nd ed.). London: Sage.Google Scholar
- Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin.Google Scholar
- Sherman, L. W., Buerger, M., & Gartin, P. (1989). Beyond dial-a-cop: A randomized test of Repeat Call Policing (RECAP). Washington, DC: Crime Control Institute.Google Scholar
- Skogan, W. G., & Frydl, K. (Eds.). (2004). Fairness and effectiveness in policing: The evidence. Washington, DC: The National Academies Press.Google Scholar
- Spector, P. E. (1992). Summated rating scale construction. Newbury Park: Sage.Google Scholar
- Sviridoff, M., Sadd, S., Curtis, R., & Grinc, R. (1992). The neighborhood effects of street-level drug enforcement: Tactical Narcotics Teams in New York. New York: Vera Institute of Justice.Google Scholar
- Weisburd, D., Telep, C. W., Hinkle, J. C., & Eck, J. E. (2008). The effects of problem-oriented policing on crime and disorder. Campbell Collaboration. doi: 10.4073/csr.2008.14.