Abstract
Objectives
This paper presents the findings from a retrospective qualitative process evaluation to the Scottish Community Engagement Trial (ScotCET). The study explores the unanticipated results of a randomized field trial testing the effect of ‘procedurally just’ modes of road policing on public perceptions of police. The ScotCET intervention failed to produce the hypothesized results, producing instead significant, and unexplained, negative effects on key aspects of public perception. The present study seeks to examine, from the perspectives of officers implementing the experiment, what the impacts (intended or otherwise) of participation were.
Methods
Group interviews were held within the ScotCET experiment ‘units’ to explore how officers had collectively interpreted and framed ScotCET, and responded as a group to its requirements/demands. Nine groups were held over a 5-month period post experiment completion.
Results
Findings indicate that communication breakdowns during the ScotCET implementation led to misunderstandings of its aims and objectives, and of the requirements placed on officers. Within the context of organizational reform and perceived organizational ‘injustice’, commonly cited aspects of police culture were invoked to facilitate non-compliance with aspects of the experimental intervention, leading to implementation failures, and, possibly, a diffuse negative effect on the attitudes and behaviors of experiment officers.
Conclusions
Organizational structures and processes, and coercive top-down direction, are insufficient to ensure successful implementation of policing research, and, by implication, policing reforms, particularly those that demand alternative ways of ‘doing’ policing and ‘seeing’ citizens. Greater investment in organizational justice and encouraging openness to evidence-led knowledge is needed to promote change.
Similar content being viewed by others
Notes
A leaflet was also provided to drivers in the experimental condition of QCET.
No official report is available but see http://www.bbc.co.uk/news/uk-scotland-34424206 (last accessed 13th August 2016)
Two groups had been completed at an earlier date in order to scope the feasibility of the evaluative study.
Including, in two units, senior officers as noted in Appendix 3.
References
Bonell, C., Fletcher, A., Morton, M., Lorenc, T., & Moore, L. (2012). Realist randomised controlled trials: a new approach to evaluating complex public health interventions. Social Science and Medicine, 75(12), 2,299–2,306.
Bradford, B., Quinton, P., Myhill, A., & Porter, G. (2014). Why do the law comply? Procedural justice, group identification and officer motivation in police organisations. European Journal of Criminology, 11(1), 110–113.
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101.
Colquitt, J. (2001). On the dimensionality of organizational justice: a construct validation of a measure. Journal of Applied Psychology, 86(3), 386–400.
Cordner, G. (2000). Community policing: Elements and effects. In G. Alpert & A. Piquero (Eds.), Community policing: Contemporary readings. Prospect Heights: Waveland Press.
Farrington, D. P., & Welsh, B. C. (2005). Randomised experiments in criminology: what have we learned over the last two decades? Journal of Experimental Criminology, 1(1), 9–38.
Fereday, J., & Muir-Cochrane, E. (2006). Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. International Journal of Qualitative Methods, 5(1), 1–11.
Fielding, N. (1988). Joining forces: Police training, socialization and occupational competence. London: Routledge.
Fielding, N. (1989). Police culture and police practice. In M. Weatheritt (Ed.), Police research: Some future prospects. Aldershot: Avebury.
Folger, R., & Bies, R. J. (1989). Managerial responsibilities and procedural justice. Employee Responsibilities and Rights Journal, 2, 79–89.
Gartin, P. R. (1995). Dealing with design failures in randomised field experiments: analytic issues regarding the evaluation of treatment effects. Journal of Research in Crime and Delinquency, 32(4), 425–445.
Greenberg, J. (2011). Organisational justice: The dynamics of fairness in the workplace. In Z. Sheldon (Ed.), APA handbook of industrial and organisational psychology (Maintaining, expanding and contracting the organisation, Vol. 3). Washington DC: American Psychological Association.
Haas, N. E., Van Craen, M., Skogan, W. G., & Fleitas, D. M. (2015). Explaining officer compliance: the importance of procedural justice and trust inside a police organisation. Criminology and Criminal Justice, 15(4), 442–463.
Hassall, K. D., & Lovell, R. D. (2015). Fidelity of implementation: important considerations for policing scholars. Policing and Society, 25(5), 504–520.
Hasson, H. (2010). Systematic evaluation of implementation and fidelity of complex interventions in health and social care. Implementation Science, 5, 67–76.
Hohl, K., Bradford, B., & Stanko, E. A. (2010). Influencing trust and confidence in the London Metropolitan Police: results from an experiment testing the effect of leaflet-drops on public opinion. British Journal of Criminology, 50(3), 491–513.
Lavie-Ajayi, M. (2014). I didn’t know I was isolated until I wasn’t isolated anymore: the use of groups in qualitative psychology research. Qualitative Inquiry, 20(2), 175–182.
Loftus, B. (2009). Police culture in a changing world. Oxford: Oxford University Press.
Loftus, B. (2010). Police occupational culture: classic themes, altered times. Policing and Society, 20(1), 1–20.
MacQueen, S., & Bradford, B. (2015). Enhancing public trust and police legitimacy during road traffic encounters: results from a randomised controlled trial in Scotland. Journal of Experimental Criminology, 11(3), 419–443.
Mazerolle, L., Bennett, S., Antrobus, E., & Eggins, E. (2012). Procedural justice, routine encounters and citizen perceptions of the police: main findings from the Queensland Community Engagement Trial (QCET). Journal of Experimental Criminology, 8(4), 343–366.
Mazerolle, L., Bates, L., Bennett, S., White, G., Ferris, J., & Antrobus, E. (2014). Optimising the length of random breath tests: results from the Queensland Community Engagement Trial. Australian and New Zealand Journal of Criminology, 48(2), 256–276.
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O’Cathain, A., Tinati, T., Wight, D., & Baird, J. (2015) Process evaluation of complex interventions: Medical Research Council guidance. BMJ 350(h1258).
Murray, K. (2014) Stop and search in Scotland: An evaluation of police practice, SCCJR Research Report: University of Glasgow.
Myhill, A., & Bradford, B. (2013). Overcoming cop culture? Organisational justice and police officers’ attitudes toward the public. Policing: An international Journal of Police Strategies and Management, 36(2), 338–356.
Reiner, R. (2010). The politics of the police. Oxford: Oxford University Press.
Scottish Government. (2012). The strategy for justice in Scotland. Edinburgh: Scottish Government.
Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalised causal inference. Boston: Houghton Mifflin Company.
Sherman, L. W., & Strang, H. (2004). Experimental ethnography: the marriage of qualitative and quantitative research. The Annals of the American Academy in Political and Social Science, 595, 204–222.
Skogan, W. G. (2008). Why reforms fail. Policing and Society, 18(1), 23–34.
Skogan, W. G., Van Craen, M., & Hennessy, C. (2014). Training police for procedural justice. Journal of Experimental Criminology, 11(3), 319–334.
Tankebe, J. (2010). Identifying the correlates of police organisational commitment in Ghana. Justice Quarterly, 13(1), 79–91.
Terpstra, J., & Fyfe, N. (2015). Mind the implementation gap: police reform and local policing in the Netherlands and Scotland. Criminology and Criminal Justice, 15(5), 527–544.
Trinkner, R., Tyler, T. R., & Goff, P. A. (2016). Justice from within: the relations between a procedurally just organizational climate and police organizational efficiency, endorsement of democratic policing, and officer well-being. Psychology, Public Policy, and Law, 22(2), 158–172.
Tyler, T. R. (2006). Why people obey the law. Princeton: Princeton University Press.
Tyler, T. R., & Blader, S. (2000). Procedural justice, social identity, and cooperative behaviour. Personality and Social Psychology Review, 7, 349–361.
Tyler, T. R., & Huo, Y. J. (2002). Trust in the law: Encouraging public cooperation with the police and courts. New York: Russell Sage.
Waddington, P. A. J. (1999). Police (canteen) sub-culture: an appreciation. British Journal of Criminology, 39(2), 287–309.
Weisburd, D. (2000). Randomised experiments in criminal justice policy: prospects and problems. Crime and Delinquency, 46(2), 181–193.
Weisburd, D. (2005). Hot spots policing experiments and criminal justice research: lessons from the field. The Annals of the American Academy in Political and Social Science, 599, 220–245.
Weisburd, D., & Neyroud, P. (2011) Police science: Towards a new paradigm. Cambridge: Harvard University https://www.ncjrs.gov/pdffiles1/nij/228922.pdf.
Wheller, L., Quinton, P., Fildes, A., & Mills, A. (2013). The Greater Manchester Police procedural justice training experiment. London: College of Policing.
Wilkinson, S. (1998). Focus groups in feminist research: power, interaction and the co-construction of meaning. Women’s Studies International Forum, 21(1), 111–125.
Wolfe, S. E., & Piquero, A. R. (2011). Organisational justice and police misconduct. Criminal Justice and Behaviour, 38, 322–353.
Wünsch, D., & Hohl, K. (2009). Evidencing a “good practice model” of police communication: the impact of local policing newsletters on public confidence. Policing: A Journal of Policy and Practice, 3(4), 331–339.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Appendix 1
(DOCX 20 kb)
Appendix 2
(DOCX 16.5 kb)
Appendix 3
(DOCX 12 kb)
Rights and permissions
About this article
Cite this article
MacQueen, S., Bradford, B. Where did it all go wrong? Implementation failure—and more—in a field experiment of procedural justice policing. J Exp Criminol 13, 321–345 (2017). https://doi.org/10.1007/s11292-016-9278-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11292-016-9278-7