Where did it all go wrong? Implementation failure—and more—in a field experiment of procedural justice policing

Abstract

Objectives

This paper presents the findings from a retrospective qualitative process evaluation to the Scottish Community Engagement Trial (ScotCET). The study explores the unanticipated results of a randomized field trial testing the effect of ‘procedurally just’ modes of road policing on public perceptions of police. The ScotCET intervention failed to produce the hypothesized results, producing instead significant, and unexplained, negative effects on key aspects of public perception. The present study seeks to examine, from the perspectives of officers implementing the experiment, what the impacts (intended or otherwise) of participation were.

Methods

Group interviews were held within the ScotCET experiment ‘units’ to explore how officers had collectively interpreted and framed ScotCET, and responded as a group to its requirements/demands. Nine groups were held over a 5-month period post experiment completion.

Results

Findings indicate that communication breakdowns during the ScotCET implementation led to misunderstandings of its aims and objectives, and of the requirements placed on officers. Within the context of organizational reform and perceived organizational ‘injustice’, commonly cited aspects of police culture were invoked to facilitate non-compliance with aspects of the experimental intervention, leading to implementation failures, and, possibly, a diffuse negative effect on the attitudes and behaviors of experiment officers.

Conclusions

Organizational structures and processes, and coercive top-down direction, are insufficient to ensure successful implementation of policing research, and, by implication, policing reforms, particularly those that demand alternative ways of ‘doing’ policing and ‘seeing’ citizens. Greater investment in organizational justice and encouraging openness to evidence-led knowledge is needed to promote change.