Skip to main content
SpringerLink
Log in

Systematic Review and Meta-analysis of Security

  • Chapter
  • First Online:
The Handbook of Security

  • 1104 Accesses

Abstract

The varying quality and immense volume of research relating to security highlights a challenge for policymakers and practitioners who want to improve decision-making by drawing on the empirical evidence. Systematic reviews and meta-analyses have emerged as more objective techniques, compared to subjective narrative reviews, for identifying, screening and synthesising the findings of individual primary evaluations relevant to particular forms of security measures. The shift from subjective to objective analysis has resulted in an improved evidence-base summarising and estimating the overall impact(s) and identifying potential moderator(s). With a growing recognition of the benefits of these techniques, the field of security and crime prevention have benefited from their adoption resulting in better informed crime and justice policy. This chapter explains, in detail, the role of systematic reviews and meta-analyses, and how the methods produce robust evidence regarding our knowledge of security and its effectiveness. We also illustrate the use of meta-analysis via a selection of security-related studies.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 299.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    There are a few meta-analyses related to information security not included in Table 23.1. These studies examine the antecedents to security policy compliance, the predictors of the use of privacy protective measures or validate certain theories rather than evaluate the effectiveness of security interventions.

  2. 2.

    If the reference period is not indicated in the paper, we use the reference list of that paper to pick up the period covered by individual studies included in the meta-analysis.

References

  • Belur, J., Thornton, A., Tompson, L., Manning, M., Sidebottom, A., & Bowers, K. (2020). A systematic review of the effectiveness of the electronic monitoring of offenders. Journal of Criminal Justice, 68, 101686.

    Article  Google Scholar 

  • Bennett, T., Holloway, K., & Farrington, D. P. (2006). Does neighborhood watch reduce crime? A systematic review and meta-analysis. Journal of Experimental Criminology, 2(4), 437–458. https://doi.org/10.1007/s11292-006-9018-5

    Article  Google Scholar 

  • Bonell, C., Fletcher, A., Morton, M., Lorenc, T., & Moore, L. (2012). Realist randomised controlled trials: a new approach to evaluating complex public health interventions. Social Science and Medicine, 75, 2299–2306.

    Article  Google Scholar 

  • Bonell, C., Fletcher, A., Morton, M., Lorenc, T., & Moore, L. (2013). Methods don’t make assumptions, researchers do: A response to Marchal et al. Social Science and Medicine, 94, 81–82.

    Article  Google Scholar 

  • Borenstein, M., Hedges, L., Higgins, J., & Rothstein, H. (2009). Introduction to meta-analysis. West Sussex, United Kingdom: John Wiley & Sons Ltd.

    Book  Google Scholar 

  • Bowers, K. J., Johnson, S. D., Guerette, R. T., Summers, L., & Poynton, S. (2011). Spatial displacement and diffusion of benefits among geographically focused policing initiatives: A meta-analytical review. Journal of Experimental Criminology, 7(4), 347–374. https://doi.org/10.1007/s11292-011-9134-8

    Article  Google Scholar 

  • Braga, A. (2005). Hot spots policing and crime prevention: A systematic review of randomized controlled trials. Journal of Experimental Criminology, 1(3), 317–342. https://doi.org/10.1007/s11292-005-8133-z

    Article  Google Scholar 

  • Braga, A., Papachristos, A., & Hureau, D. (2012). Hot spots policing effects on crime. Campbell Systematic Reviews, 8(1), 1–96.

    Article  Google Scholar 

  • Braga, A., Turchan, B. S., Papachristos, A. V., & Hureau, D. M. (2019). Hot spots policing and crime reduction: an update of an ongoing systematic review and meta-analysis. Journal of Experimental Criminology, 15(3), 289–311. https://doi.org/10.1007/s11292-019-09372-3

    Article  Google Scholar 

  • Braga, A., Weisburd, D., & Turchan, B. (2018). Focused Deterrence Strategies and Crime Control: An Updated Systematic Review and Meta-Analysis of the Empirical Evidence. Criminology and Public Policy, 17(1), 205–250. https://doi.org/10.1111/1745-9133.12353

    Article  Google Scholar 

  • Braga, A., & Weisburd, D. L. (2012). The Effects of Focused Deterrence Strategies on Crime: A Systematic Review and Meta-Analysis of the Empirical Evidence. Journal of Research in Crime and Delinquency, 49(3), 323–358. https://doi.org/10.1177/0022427811419368

    Article  Google Scholar 

  • Braga, A., Welsh, B. C., & Schnell, C. (2015). Can Policing Disorder Reduce Crime? A Systematic Review and Meta-analysis. Journal of Research in Crime and Delinquency, 52(4), 567–588. https://doi.org/10.1177/0022427815576576

    Article  Google Scholar 

  • Brown, P., Brunnhuber, K., Chalkidou, K., Chalmers, I., Clarke, C., & Fenton, M. (2006). How to formulate research recommendations. BMJ, 333, 804–806.

    Article  Google Scholar 

  • Buschman, T. J., Siegel, M., Roy, J. E., & Miller, E. K. (2011). Neural substrates of cognitive capacity limitations. Proceedings of the National Academy of Social Sciences of the United States of America, 108, 11252–11255.

    Google Scholar 

  • Centre for Reviews and Dissemination. (2009). Systematic reviews: CRD’s guidance for undertaking reviews in health care. York, UK: CRD, University of York.

    Google Scholar 

  • Chalmers, I. (2007). The lethal consequences of failing to make use of all relevant evidence about the effects of medical treatments: the need for systematic reviews. In P. Rothwell (Ed.), Treating Individuals (pp. 37–58). London: Lancet.

    Google Scholar 

  • Cunningham, M. R., Jones, J. W., & Dreschler, B. W. (2018). Personnel risk management assessment for newly emerging forms of employee crimes. International Journal of Selection and Assessment, 26(1), 5–16. https://doi.org/10.1111/ijsa.12202

    Article  Google Scholar 

  • Dölling, D., Entorf, H., Hermann, D., & Rupp, T. (2009). Is deterrence effective? Results of a meta-analysis of punishment. European Journal on Criminal Policy and Research, 15(1–2), 201–224. https://doi.org/10.1007/s10610-008-9097-0

    Article  Google Scholar 

  • Durlak, J. A., & Lipsey, M. W. (1991). A practitioner’s guide to meta-analysis. American Journal of Community Psychology, 19, 291–332.

    Article  Google Scholar 

  • Eysenck, H. J. (1978). An exercise in mega-silliness. American Psychologist, 33, 517.

    Article  Google Scholar 

  • Farrington, D. P., & Welsh, B. C. (2002). Improved street lighting and crime prevention. Justice quarterly, 19(2), 313–342.

    Google Scholar 

  • Farrington, D. P., Gill, M., Waples, S. J., & Argomaniz, J. (2007). The effects of closed-circuit television on crime: Meta-analysis of an English national quasi-experimental multi-site evaluation. Journal of Experimental Criminology, 3(1), 21–38. https://doi.org/10.1007/s11292-007-9024-2

    Article  Google Scholar 

  • Glass, G., McGaw, B., & Smith, M. L. (1981). Meta-analysis in social research. Newbury Park: Sage.

    Google Scholar 

  • Johnson, S. D., Tilley, N., & Bowers, K. J. (2015). Introducing EMMIE: an evidence rating scale to encourage mixed-method crime prevention synthesis reviews. Journal of Experimental Criminology, 11(3), 459–473. https://doi.org/10.1007/s11292-015-9238-7

    Article  Google Scholar 

  • Kontopantelis, E., & Reeves, D. (2012). Performance of statistical methods for meta-analysis when true study effects are non-normally distributed: A simulation study. Statistical Methods in Medical Research, 21, 409–426.

    Article  Google Scholar 

  • Kontopantelis, E., Springate, D., & Reeves, D. (2013). A Re-Analysis of the Cochrane Library Data: The Dangers of Unobserved Heterogeneity in Meta-Analyses. PloS one, 8, 1–12.

    Article  Google Scholar 

  • Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis (Vol. 49). Thousand Oaks, CA: SAGE Publications.

    Google Scholar 

  • Makarios, M. D., & Pratt, T. C. (2008). The Effectiveness of Policies and Programs That Attempt to Reduce Firearm Violence. Crime & Delinquency, 58(2), 222–244. https://doi.org/10.1177/0011128708321321

    Article  Google Scholar 

  • Marchal, B., Westhorp, G., Wong, G., Van Belle, S., Greenhalgh, T., Kegels, G., & Pawson, R. (2013). Realistic RCTs of complex interventions—An oxymoron. Social Science and Medicine, 94, 124–128.

    Article  Google Scholar 

  • Mazerolle, L., Soole, D. W., & Rombouts, S. (2006). Street-level drug law enforcement: A meta-analytical review. Journal of Experimental Criminology, 2(4), 409–435. https://doi.org/10.1007/s11292-006-9017-6

    Article  Google Scholar 

  • Pawson, R., & Tilley, N. (1997). Realistic evaluation. London: Sage.

    Google Scholar 

  • Pawson, R., & Tilley, N. (2001). Realistic evaluation bloodlines. American Journal of Evaluation, 22, 317–324.

    Article  Google Scholar 

  • Piza, E. L., Welsh, B. C., Farrington, D. P., & Thomas, A. L. (2019). CCTV surveillance for crime prevention: A 40-year systematic review with meta-analysis. Criminology and Public Policy, 18(1), 135–159. https://doi.org/10.1111/1745-9133.12419

    Article  Google Scholar 

  • Rachman, S. J., & Wilson, G. T. (1980). The effects of psychological therapy (2nd ed.). Oxford: Pergaman.

    Google Scholar 

  • Renzema, M., & Mayo-Wilson, E. (2005). Can electronic monitoring reduce crime for moderate to high-risk offenders? Journal of Experimental Criminology, 1(2), 215–237. https://doi.org/10.1007/s11292-005-1615-1

    Article  Google Scholar 

  • Rosenthal, R. (1979). The “file drawer problem” and tolerance for null results. Psychological Bulletin, 86, 638–641.

    Article  Google Scholar 

  • Rosenthal, R. (1994). Parametric measures of effect size. In H. Cooper & L. Hedges (Eds.), The handbook of research synthesis (pp. 231–244). New York: Russell Sage Foundation.

    Google Scholar 

  • Shadish, W., & Sweeney, R. (1991). Mediators and moderators in meta-analysis: There’s a reason we don’t let Dodo birds tell us which psychotherapies should have prizes. Journal of Consulting and Clinical Psychology, 59, 883–893.

    Article  Google Scholar 

  • Sharpe, D. (1997). Of apples and oranges, file drawers and garbage: Why validity issues in meta-analysis will not go away. Clinical Psychology Review, 17(8), 881–901.

    Google Scholar 

  • Sidebottom, A., Tompson, L., Thornton, A., Bullock, K., Tilley, N., Bowers, K., & Johnson, S. D. (2017a). Gating Alleys to Reduce Crime: A Meta-Analysis and Realist Synthesis. Justice Quarterly, 35(1), 55–86. https://doi.org/10.1080/07418825.2017.1293135

    Article  Google Scholar 

  • Sidebottom, A., Thornton, A., Tompson, L., Belur, J., Tilley, N., & Bowers, K. (2017b). A systematic review of tagging as a method to reduce theft in retail environments. Crime Science, 6(1). https://doi.org/10.1186/s40163-017-0068-y

  • Smith, M., & Glass, G. (1977). Meta-analysis of psychotherapy outcome studies. American Psychologist, 32(7), 752–760.

    Article  Google Scholar 

  • Taheri, S. A. (2016). Do Crisis Intervention Teams Reduce Arrests and Improve Officer Safety? A Systematic Review and Meta-Analysis. Criminal Justice Policy Review, 27(1), 76–96. https://doi.org/10.1177/0887403414556289

    Article  Google Scholar 

  • Telep, C. W., Weisburd, D., Gill, C. E., Vitter, Z., & Teichman, D. (2014). Displacement of crime and diffusion of crime control benefits in large-scale geographic areas: a systematic review. Journal of Experimental Criminology, 10(4), 515–548. https://doi.org/10.1007/s11292-014-9208-5

    Article  Google Scholar 

  • Trang, S., & Brendel, B. (2019). A Meta-Analysis of Deterrence Theory in Information Security Policy Compliance Research. Information Systems Frontiers, 21(6), 1265–1284. https://doi.org/10.1007/s10796-019-09956-4

    Article  Google Scholar 

  • Welsh, B. C., & Farrington, D. P. (2008). Effects of improved street lighting on crime. Campbell Systematic Reviews, 4(1), 1–51.

    Google Scholar 

  • Welsh, B. C., & Farrington, D. P. (2009). Public area CCTV and crime prevention: an updated systematic review and meta-analysis. Justice Quarterly, 26(4), 716–745.

    Article  Google Scholar 

  • Wolf, F. M. (1986). Meta-Analysis: Quantitative methods for research synthesis. Newbury Park, California: Sage Publications.

    Book  Google Scholar 

  • Wortman, P. M. (1994). Judging research quality. In H. Cooper & L. Hedges (Eds.), The handbook of research synthesis (pp. 97–110). New York: Russell Sage Foundation.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Australian National University, Canberra, ACT, Australia

    Matthew Manning

  2. Tunbridge Wells, UK

    Gabriel T. W. Wong & Hien-Thuc Pham

Authors
  1. Matthew Manning
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gabriel T. W. Wong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hien-Thuc Pham
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Matthew Manning .

Editor information

Editors and Affiliations

  1. Perpetuity Research, Tunbridge Wells, UK

    Martin Gill

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Manning, M., Wong, G.T.W., Pham, HT. (2022). Systematic Review and Meta-analysis of Security. In: Gill, M. (eds) The Handbook of Security. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-030-91735-7_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-91735-7_23

  • Published:

  • Publisher Name: Palgrave Macmillan, Cham

  • Print ISBN: 978-3-030-91734-0

  • Online ISBN: 978-3-030-91735-7

  • eBook Packages: Law and CriminologyLaw and Criminology (R0)

Publish with us

Policies and ethics

Search

Navigation