Skip to main content
Log in

The effect of checklists on evidence collection during initial investigations: a randomized controlled trial in virtual reality

  • Published:
Journal of Experimental Criminology Aims and scope Submit manuscript

Abstract

Objective

To examine the impact of an investigative checklist on evidence collection by police officers responding to a routine burglary investigation.

Methods

A randomized control trial was conducted in virtual reality to test the effectiveness of an investigative checklist. Officers in the randomly assigned treatment group (n = 25) were provided with a checklist during the simulated investigation. Officers in the control group (n = 26) did not have access to the checklist at any time. The checklist included five evidence items commonly associated with burglary investigations.

Results

Officers who were randomly provided with an investigative checklist were significantly more likely to collect two evidence items located outside of the virtual victim’s home. Both treatment and control officers were about equally as likely to collect three evidence items located inside the residence.

Conclusions

Investigative checklists represent a promising new tool officers can use to improve evidence collection during routine investigations. More research is needed, however, to determine whether checklists improve evidence collection or case clearances in real-life settings. Virtual reality simulations provide a promising tool for collecting data in otherwise difficult or complex situations to simulate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

Notes

  1. While discussing preliminary results from this study and during the review process, we heard anecdotal reports that some police agencies previously adopted and informally tested investigative checklists with varying levels of success. However, our literature search did not surface any official reports/studies that can be cited to inform the current study.

  2. The evidentiary item images are provided for reference, but do not adequately capture the realism and presence users typically experienced in VR. Honestly, one of the worst ways to sell the realism of VR is to show 2D images and/or video. We remain confident that all users could equally collect/experience all five evidentiary items regardless of assignment group.

  3. The initial plan was to have the footprint in the mud outside the broken window, but it proved difficult to achieve for the developers. Placing the footprint inside was more feasible.

  4. In response to a reviewer, we note the choice to include five evidentiary items was arbitrary but provided a logically round number that balanced having enough items to make the investigation interesting but not so many that the experience would be burdensome for participants. Future studies should vary the number of evidentiary items to determine if it has any impact on the results.

  5. One officer was called to a crime in progress before completing the simulation and post-survey. Another officer spent most of their time comparing another VR experience they were familiar with rather than completing the task at hand. Finally, one officer failed to complete the post-survey.

  6. Data collection took place in the late 2022 and early 2023.

  7. The participants’ view within the VR experience was simultaneously cast to a computer monitor in the data collection room and recorded as a backup plan as well, but it was not necessary to view the recordings to collect the outcome data.

  8. The authors thank one of the anonymous reviewers for raising this important point.

References

  • Bailenson, J. (2018). Experience on demand: what virtual reality is, how it works, and what it can do. Norton.

    Google Scholar 

  • Braga, A. A., & MacDonald, J. (2019). Improving police effectiveness in ensuring justice. Criminology & Public Policy, 18(3), 511–523.

    Article  Google Scholar 

  • Chaiken, J. M., Greenwood, P. W., & Petersilia, J. (1977). The criminal investigation process: a summary report. Policy Analysis, 3(2), 187–217.

    Google Scholar 

  • de Vries, E. N., Prins, H. A., Crolla, R. M. P. H., den Outer, A. J., van Andel, G., van Helden, S. H., Schlack, W. S., van Putten, M. A., Gouma, D. J., & Dijkgraaf, M. G. W. (2010). Effect of a comprehensive surgical safety system on patient outcomes. New England Journal of Medicine, 363(20), 1928–1937.

    Article  Google Scholar 

  • Donnellan, P. G., & Ariel, B. (2019). Assessing solvability factors in greater manchester, england: the case of residential burglaries. In T. Coupe, B. Ariel, & K. Mueller-Johnson (Eds.), Crime Solvability Factors (pp. 35–51). Springer International Publishing.

    Chapter  Google Scholar 

  • Eck, J. E. (1979). Managing case assignments: the burglary investigation decision model replication. Police Executive Research Forum.

    Google Scholar 

  • Eck, J. E. (1983). Solving crimes: the investigation of burglary and robbery. Police Executive Research Forum.

    Google Scholar 

  • Eck, J. E., & Rossmo, D. K. (2019). The new detective: rethinking criminal investigations. Criminology & Public Policy, 18(3), 601–622.

    Article  Google Scholar 

  • Gawande, A. (2010). The checklist manifesto. Penguin Books.

    Google Scholar 

  • Greenwood, P. W. (1970). An analysis of the spprehension activities of the New York City Police Department. Rand Corporation.

    Google Scholar 

  • Greenwood, P. W., Chaiken, J. M., Petersilia, J., & Prusoff, L. (1975). The criminal investigation process volume III: observation and analysis. Rand Corporation.

    Google Scholar 

  • Greenwood, P. W., & Petersilia, J. (1975). The criminal investigation process volume III: summary and policy implications. Rand Corporation.

    Google Scholar 

  • Greer, S. (2014). Improving police investigations in burglary and theft from motor vehicle cases using checklists: a phase-one implementation trial in a medium-sized police agency. Cambridge University.

    Google Scholar 

  • Horvath, F., Meesig, R. T., & Lee, H. Y. (2001). National survey of police policies and practices regarding the criminal investigations process: twenty-five years after Rand. National Institute of Justice.

    Google Scholar 

  • Kennedy, R. S., Lane, N. E., Berbaum, K. S., & Lilienthal, M. G. (1993). Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. International Journal of Aviation Psychology, 3(3), 203–220.

    Article  Google Scholar 

  • Martaindale, M. H., Sandel, W. L., Duron, A., & McAllister, M. J. (2023). Can a virtual reality training scenario elicit similar stress response as a realistic scenario-based training scenario? Police Quarterly.

  • Moskos, P. (2008). Cop in the hood: my year policing baltimore’s eastern district. Princeton University Press.

    Google Scholar 

  • National Academies of Sciences, Engineering, and M. (2023). Behavioral economics: policy impact and future directions. National Academies Press.

    Google Scholar 

  • Peterson, J. L. (1974). The utilization of criminalistics services by the police: an analysis of the physical evidence recovery process. National Institute of Justice.

    Google Scholar 

  • President’s Commission on Law Enforcement and Justice. (1967). The challenges of crime in a free society (Vol. 4). United States Government Printing Office.

    Google Scholar 

  • Pronovost, P., Needham, D., Berenholtz, S., Sinopoli, D., Chu, H., Cosgrove, S., Sexton, B., Hyzy, R., Welsh, R., & Roth, G. (2006). An intervention to decrease catheter-related bloodstream infections in the ICU. New England Journal of Medicine, 355(26), 2725–2732.

    Article  Google Scholar 

  • Ratcliffe, J. H. (2018). Reducing crime: a companion for police leaders. Routledge.

    Book  Google Scholar 

  • Rengert, G. F., & Wasilchick, J. (1989). Space, time, and crime: ethnographic insights into residential burglary. National Institute of Justice.

    Google Scholar 

  • Sidebottom, A., Tilley, N., & Eck, J. E. (2012). Towards checklists to reduce common sources of problem-solving failure. Policing, 6(2), 194–209.

    Article  Google Scholar 

  • Thaler, R. H., & Sunstein, C. R. (2009). Nudge: improving decisions about health, wealth, and happiness. Penguin Books.

    Google Scholar 

  • Walker, S. (1993). Taming the system: the control of discretion in criminal justice 1950-1990. Oxford University Press.

    Book  Google Scholar 

  • Weiser, T. G., Haynes, A. B., Dziekan, G., Berry, W. R., Lipsitz, S. R., & Gawande, A. A. (2010). Effect of a 19-item surgical safety checklist during urgent operations in a global patient population. Annals of Surgery, 251(5), 976–980.

    Article  Google Scholar 

  • Wellford, C., & Cronin, J. (2000). Clearing up homicide clearance rates. National Institute of Justice Journal, 243, 1–7.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Cory P. Haberman.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Haberman, C.P., Tang, M., Driscoll, C. et al. The effect of checklists on evidence collection during initial investigations: a randomized controlled trial in virtual reality. J Exp Criminol (2023). https://doi.org/10.1007/s11292-023-09599-1

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11292-023-09599-1

Keywords

Navigation