Skip to main content
SpringerLink
Log in

Who are the heavy hitters? A citation analysis of the most impactful research in the Journal of Experimental Criminology over the past two decades

  • Published:
Journal of Experimental Criminology Aims and scope Submit manuscript

Abstract

Objectives

This study conducts the first known citation analysis of the most impactful research in the Journal of Experimental Criminology (JOEX). Citation analysis is used to increase our understanding of “research quality” as it pertains to the experimental literature base in criminology and criminal justice.

Methods

Using Web of Science, Google Scholar, and Crossref, citation counts were performed on all articles published in JOEX from its inception in 2005 to 2023 (n = 552), excluding self-citations. Once data were gathered, several forms of analyses were undertaken. First, a calculation of the average number of citations per year was determined between 2005 and 2023. In addition, a temporal analysis was used to assess whether citations decay over time after initial publication. For purposes of this research, the top 10 most cited systematic reviews and meta-analyses and the top 10 most cited experimental articles will be assessed.

Results

The most cited systematic review and meta-analysis were from Ttofi and Farrington (Journal of Experimental Criminology, 7, 27-56, 2011). Specifically, Ttofi and Farrington’s (Journal of Experimental Criminology, 7, 27-56, 2011) systematic review and meta-analysis on school-based programs to reduce anti-bullying amassed 2200 citations on Google Scholar and yielded an average of 183.3 citations per year. The same study had 858 citations on Web of Science, with an average of 71.5 per year, and 957 citations on Crossref, with an average of 79.8 citations per year. One of the top-cited experiments was from Mazerolle et al. (Journal of Experimental Criminology, 8, 343-367, 2012). Specifically, Mazerolle et al.’s (Journal of Experimental Criminology, 8, 343-367, 2012) experimental study of procedural justice of the police in Queensland, Australia, amassed 355 citations on Google Scholar, with an average of 32.3 per year. The same study had 174 citations on Web of Science (15.8 per year) and 177 on Crossref (16.1 per year).

Conclusion

The citation analysis presents an assessment of the most influential systematic reviews, meta-analyses, and experiments in JOEX. Ttofi and Farrington (Journal of Experimental Criminology, 7, 27-56, 2011) produced the most impactful systematic review or meta-analysis, while Mazerolle et al. (Journal of Experimental Criminology, 8, 343-367, 2012) was one of the most cited experiments. This contributes to our understanding of criminological research pertaining to quality experimental research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

References

  • Aksnes, D. W. (2005). Citations and their use as indicators in science policy: Studies of validity and applicability issues with a particular focus on highly cited papers (Doctoral thesis). University of Twente.

    Google Scholar 

  • Aksnes, D. W., Langfeldt, L., & Wouters, P. (2019). Citations, citation indicators, and research quality: An overview of basic theories and concepts. Sage Open, 1–17.

  • Ariel, B., Sutherland, A., Henstock, D., Young, J., Drover, P., Sykes, J., … & Henderson, R. (2016). Report: Increases in police use of force in the presence of body-worn cameras are driven by officer discretion: A protocol-based subgroup analysis of ten randomized experiments. Journal of Experimental Criminology, 12, 453–463.

  • Bauer, K., & Bakkalbasi, N. (2005). An examination of citation counts in a new scholarly communication environment. D-Lib magazine.

  • Caplan, J. M., Kennedy, L. W., & Petrossian, G. (2011). Police-monitored CCTV cameras in Newark, NJ: A quasi-experimental test of crime deterrence. Journal of Experimental Criminology, 7, 255–274.

    Article  Google Scholar 

  • Cohn, E. G., & Farrington, D. P. (2008). Scholarly influence in criminology and criminal justice journals in 1990–2000. Journal of Criminal Justice, 36(1), 11–21.

    Article  Google Scholar 

  • Cohn, E. G., & Farrington, D. P. (2011). Scholarly influence and prestige in criminology and criminal justice. Journal of Criminal Justice Education, 22(1), 5–11.

    Article  Google Scholar 

  • Cohn, E. G., & Worrall, J. L. (2023). Evaluating citation analysis: Introduction to the special issue. Journal of Contemporary Criminal Justice, 39(3), 324–326.

    Article  Google Scholar 

  • Cohn, E. G., Farrington, D. P., & Wright, R. A. (1998). Evaluating criminology and criminal justice. Greenwood Press.

    Google Scholar 

  • Cohn, E. G., Farrington, D. P., & Iratzoqui, A. (2020). Changes in scholarly influence in major American criminology and criminal justice journals between 1986 and 2015. Journal of Criminal Justice Education, 31(4), 580–608.

    Article  Google Scholar 

  • Cohn, E. G., Farrington, D. P., & Skinner, G. C. (2023). Most influential scholars in criminology and criminal justice, 1986–2020. Springer Nature.

  • Cole, J., & Cole, S. (1971). Measuring the quality of sociological research: Problems in the use of the “science citation index.” The American Sociologist, 6, 23–29.

    Google Scholar 

  • Cronin, B. (1984). The citation process. The role and significance of citations in scientific communication, 103.

  • Farrington, D. P., Lösel, F., Braga, A. A., Mazerolle, L., Raine, A., Sherman, L. W., & Weisburd, D. (2020). Experimental criminology: Looking back and forward on the 20th anniversary of the Academy of Experimental Criminology. Journal of Experimental Criminology, 16, 649–673.

    Article  Google Scholar 

  • Feder, L., & Wilson, D. B. (2005). A meta-analytic review of court-mandated batterer intervention programs: Can courts affect abusers’ behavior? Journal of Experimental Criminology, 1, 239–262.

    Article  Google Scholar 

  • Garfield, E. (1979). Is citation analysis a legitimate evaluation tool? Scientometrics, 1(4), 359–375.

    Article  Google Scholar 

  • Gill, C., Weisburd, D., Telep, C. W., Vitter, Z., & Bennett, T. (2014). Community-oriented policing to reduce crime, disorder and fear and increase satisfaction and legitimacy among citizens: A systematic review. Journal of Experimental Criminology, 10, 399–428.

    Article  Google Scholar 

  • Hendricks, G., Tkaczyk, D., Lin, J., & Feeney, P. (2020). Crossref: The sustainable source of community-owned scholarly metadata. Quantitative Science Studies, 1(1), 414–427.

    Article  Google Scholar 

  • Landenberger, N. A., & Lipsey, M. W. (2005). The positive effects of cognitive–behavioral programs for offenders: A meta-analysis of factors associated with effective treatment. Journal of Experimental Criminology, 1(4), 451–476.

    Article  Google Scholar 

  • Levi, M. (1995). The use and misuse of citations as a measure of influence in criminology. The British Journal of Criminology, 35(1), 138–142.

    Article  Google Scholar 

  • Lösel, F., & Schmucker, M. (2005). The effectiveness of treatment for sexual offenders: A comprehensive meta-analysis. Journal of Experimental Criminology, 1, 117–146.

    Article  Google Scholar 

  • MacQueen, S., & Bradford, B. (2015). Enhancing public trust and police legitimacy during road traffic encounters: Results from a randomised controlled trial in Scotland. Journal of Experimental Criminology, 11, 419–443.

    Article  Google Scholar 

  • Mazerolle, L., Bennett, S., Antrobus, E., & Eggins, E. (2012). Procedural justice, routine encounters and citizen perceptions of police: Main findings from the Queensland Community Engagement Trial (QCET). Journal of Experimental Criminology, 8, 343–367.

    Article  Google Scholar 

  • Mazerolle, L., Bennett, S., Davis, J., Sargeant, E., & Manning, M. (2013). Procedural justice and police legitimacy: A systematic review of the research evidence. Journal of Experimental Criminology, 9, 245–274.

    Article  Google Scholar 

  • Meho, L. I., & Yang, K. (2007). Impact of data sources on citation counts and rankings of LIS faculty: Web of Science versus Scopus and Google Scholar. Journal of the American Society for Information Science and Technology, 58(13), 2105–2125.

    Article  Google Scholar 

  • Myers, C. R. (1970). Journal citations and scientific eminence in contemporary psychology. American Psychologist, 25, 1041–1048.

    Article  Google Scholar 

  • Piquero, A. R., Farrington, D. P., Welsh, B. C., Tremblay, R., & Jennings, W. G. (2009). Effects of early family/parent training programs on antisocial behavior and delinquency. Journal of Experimental Criminology, 5, 83–120.

    Article  Google Scholar 

  • Pridemore, W. A., Makel, M. C., & Plucker, J. A. (2018). Replication in criminology and the social sciences. Annual Review of Criminology, 1, 19–38.

    Article  Google Scholar 

  • Ready, J. T., & Young, J. T. (2015). The impact of on-officer video cameras on police–citizen contacts: Findings from a controlled experiment in Mesa, AZ. Journal of Experimental Criminology, 11, 445–458.

    Article  Google Scholar 

  • Saunders, J., Hunt, P., & Hollywood, J. S. (2016). Predictions put into practice: A quasi-experimental evaluation of Chicago’s predictive policing pilot. Journal of Experimental Criminology, 12, 347–371.

    Article  Google Scholar 

  • Schmucker, M., & Lösel, F. (2015). The effects of sexual offender treatment on recidivism: An international meta-analysis of sound quality evaluations. Journal of Experimental Criminology, 11, 597–630.

    Article  Google Scholar 

  • Sherman, L. W., Strang, H., Angel, C., Woods, D., Barnes, G. C., Bennett, S., & Inkpen, N. (2005). Effects of face-to-face restorative justice on victims of crime in four randomized, controlled trials. Journal of Experimental Criminology, 1, 367–395.

    Article  Google Scholar 

  • Skogan, W. G., Van Craen, M., & Hennessy, C. (2015). Training police for procedural justice. Journal of Experimental Criminology, 11, 319–334.

    Article  Google Scholar 

  • Sloas, L. B. (2020). Thirty years onward! Citation analysis of randomized experiments in drug and mental health courts. Journal of Experimental Criminology, 16(2), 171–181.

    Article  Google Scholar 

  • Taylor, B., Koper, C. S., & Woods, D. J. (2011). A randomized controlled trial of different policing strategies at hot spots of violent crime. Journal of Experimental Criminology, 7, 149–181.

    Article  Google Scholar 

  • Telep, C. W. (2009). Citation analysis of randomized experiments in criminology and criminal justice: A research note. Journal of Experimental Criminology, 5, 441–463.

    Article  Google Scholar 

  • Ttofi, M. M., & Farrington, D. P. (2011). Effectiveness of school-based programs to reduce bullying: A systematic and meta-analytic review. Journal of Experimental Criminology, 7, 27–56.

    Article  Google Scholar 

  • Vaughan, L., & Shaw, D. (2008). A new look at evidence of scholarly citation in citation indexes and from web sources. Scientometrics, 74(2), 317–330.

    Article  Google Scholar 

  • Vine, R. (2006). Google scholar. Journal of the Medical Library Association, 94, 97–99.

  • Visher, C. A., Winterfield, L., & Coggeshall, M. B. (2005). Ex-offender employment programs and recidivism: A meta-analysis. Journal of Experimental Criminology, 1, 295–316.

    Article  Google Scholar 

  • Weisburd, D., Hinkle, J. C., Famega, C., & Ready, J. (2011). The possible “backfire” effects of hot spots policing: An experimental assessment of impacts on legitimacy, fear and collective efficacy. Journal of Experimental Criminology, 7, 297–320.

    Article  Google Scholar 

  • Weisburd, D., Lum, C. M., & Petrosino, A. (2017). Does research design affect study outcomes in criminal justice?. In Quantitative Methods in Criminology (pp. 43–63). Routledge.

  • Wilson, D. B., Mitchell, O., & MacKenzie, D. L. (2006). A systematic review of drug court effects on recidivism. Journal of Experimental Criminology, 2, 459–487.

    Article  Google Scholar 

  • Worrall, J. L., & Cohn, E. G. (2023). Citation data and analysis: Limitations and shortcomings. Journal of Contemporary Criminal Justice, 39(3), 327–340.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Criminology and Criminal Justice, Florida Atlantic University, 777 Glades Road, SO 208A, Boca Raton, FL, 33431, USA

    Lincoln B. Sloas

Authors
  1. Lincoln B. Sloas
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lincoln B. Sloas.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sloas, L.B. Who are the heavy hitters? A citation analysis of the most impactful research in the Journal of Experimental Criminology over the past two decades. J Exp Criminol (2024). https://doi.org/10.1007/s11292-024-09618-9

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11292-024-09618-9

Keywords

Search

Navigation