Skip to main content

Advertisement

Log in

Thirty years onward! Citation analysis of randomized experiments on drug and mental health courts

  • Published:
Journal of Experimental Criminology Aims and scope Submit manuscript

Abstract

Objectives

This study is meant to conduct the first known citation analysis on problem-solving courts (PSCs) using experimental designs. The use of citation analysis is meant to contribute to the experimental literature base by investigating the concept of “research quality.”

Methods

Using Web of Science, Google Scholar, and ResearchGate, citation counts were performed on drug and mental health courts, excluding self-citations. The total number of citations for the experimental research was gathered, as well as a calculation of the average number of citations per year between 1989 and 2018. Additionally, a temporal analysis was conducted to demonstrate if certain citations were cited frequently initially after publication and then decayed over time.

Results

The most cited experiments were on drug courts (n = 12). Specifically, Gottfredson et al.’s (2003) randomized controlled trial on the effectiveness of drug courts amassed 309 citations of Google Scholar and yielded an average of 20.6 citations per year. The same study had 184 citations on ResearchGate, with an average of 12.26 citations per year. For mental health courts (n = 3), the most cited experiment was Cosden et al.’s (2005) evaluation of a mental health court with assertive community treatment, which had 199 citations on Google Scholar and an average of 13.27 citations per year. The study had 133 citations of ResearchGate, which is an average of 8.87 citations per year.

Conclusion

The citation analysis presents an assessment of the most influential experiments regarding PSCs. The experimental research studies conducted by Gottfredson et al. (2003) and Cosden et al. (2005) were the most cited literature for drug court and mental health court, respectively, which contributes to the advancement of criminological research pertaining to PSCs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Notes

  1. For a full list of search terms see Appendices 1 and 2.

  2. A CONSORT diagram was created for both drug and mental health court citations included and excluded from the present study (see Appendices 3 and 4).

  3. Citations for experiments on mental health courts are omitted since Cosden et al were the only studies and Lamberti et al. was published in 2017.

References

  • Aksnes, D. W., Langfeldt, L., & Wouters, P. (2019). Citations, citation indicators, and research quality: an overview of basic theories and concepts. Sage Open, 1-17.

  • Aksnes, D. W. (2005). Citations and their use as indicators in science policy: studies of validity and applicability issues with a particular focus on highly cited papers (Doctoral thesis). Enschede: University of Twente.

    Google Scholar 

  • Banks, D., & Gottfredson, D. C. (2004). Participation in drug treatment court and time to rearrest. Justice Quarterly, 21(3), 637–658.

    Google Scholar 

  • Bauer, K., & Bakkalbasi, N. (2005). An examination of citation counts in a new scholarly communication environment. D-Lib magazine.

  • Berman, G., & Feinblatt, J. (2001). Problem-solving courts: a brief primer. Law & Policy, 23(2), 125–140.

    Google Scholar 

  • Cohn, E. G., & Farrington, D. P. (1996). Crime and justice and the criminal justice and criminology literature. Crime and Justice, 20, 265–300.

    Google Scholar 

  • Cohn, E. G., Farrington, D. P., & Wright, R. A. (1998). Evaluating criminology and criminal justice. Westport: Greenwood.

    Google Scholar 

  • Cohn, E. G., & Farrington, D. P. (2007). Changes in scholarly influence in major American criminology and criminal justice journals between 1986 and 2000. Journal of Criminal Justice Education, 18(1), 6–34.

    Google Scholar 

  • Cohn, E. G., & Farrington, D. P. (2008). Scholarly influence in criminology and criminal justice journals in 1990–2000. Journal of Criminal Justice, 36(1), 11–21.

    Google Scholar 

  • Cole, J., & Cole, S. (1971). Measuring the quality of sociological research: problems in the use of the “science citation index”. The American Sociologist, 6, 23–29.

    Google Scholar 

  • Cosden, M., Ellens, J. K., Schnell, J. L., Yamini-Diouf, Y., & Wolfe, M. M. (2003). Evaluation of a mental health treatment court with assertive community treatment. Behavioral Sciences & the Law, 21(4), 415–427.

    Google Scholar 

  • Cosden, M., Ellens, J., Schnell, J., & Yamini-Diouf, Y. (2005). Efficacy of a mental health treatment court with assertive community treatment. Behavioral Sciences & the Law, 23(2), 199–214.

    Google Scholar 

  • Cronin, B. (1984). The citation process. The Role and Significance of Citations in Scientific Communication, 103.

  • Deschenes, E. P., Turner, S., & Greenwood, P. W. (1995). Drug court or probation?: an experimental evaluation of Maricopa County’s drug court. Justice System Journal, 18(1), 55–73.

    Google Scholar 

  • Garfield, E. (1979). Is citation analysis a legitimate evaluation tool? Scientometrics, 1(4), 359–375.

    Google Scholar 

  • Gottfredson, D. C., & Exum, M. L. (2002). The Baltimore City drug treatment court: one-year results from a randomized study. Journal of Research in Crime and Delinquency, 39(3), 337–356.

    Google Scholar 

  • Gottfredson, D. C., Najaka, S. S., & Kearley, B. (2003). Effectiveness of drug treatment courts: evidence from a randomized trial. Criminology & Public Policy, 2(2), 171–196.

    Google Scholar 

  • Gottfredson, D. C., Najaka, S. S., Kearley, B. W., & Rocha, C. M. (2006). Long-term effects of participation in the Baltimore City drug treatment court: results from an experimental study. Journal of Experimental Criminology, 2(1), 67–98.

    Google Scholar 

  • Lamberti, J. S., Weisman, R. L., Cerulli, C., Williams, G. C., Jacobowitz, D. B., Mueser, K. T., Marks, P. D., Strawderman, R. L., Harrington, D., Lamberti, T. A., & Caine, E. D. (2017). A randomized controlled trial of the Rochester forensic assertive community treatment model. Psychiatric Services, 68(10), 1016–1024.

    Google Scholar 

  • Levi, M. (1995). The use and misuse of citations as a measure of influence in criminology. British Journal of Criminology, 35, 138–142.

  • Marlowe, D. B., Festinger, D. S., Lee, P. A., Schepise, M. M., Hazzard, J. E., Merrill, J. C., ..., & McLellan, A. T. (2003). Are judicial status hearings a key component of drug court? During-treatment data from a randomized trial. Criminal Justice and Behavior, 30(2), 141-162.

  • Marlowe, D. B., Festinger, D. S., Lee, P. A., Dugosh, K. L., & Benasutti, K. M. (2006). Matching judicial supervision to clients’ risk status in drug court. Crime & Delinquency, 52(1), 52–76.

    Google Scholar 

  • Marlowe, D. B., Festinger, D. S., Arabia, P. L., Dugosh, K. L., Benasutti, K. M., Croft, J. R., & McKay, J. R. (2008). Adaptive interventions in drug court: a pilot experiment. Criminal Justice Review, 33(3), 343–360.

    Google Scholar 

  • Marlowe, D. B., Festinger, D. S., Dugosh, K. L., Benasutti, K. M., Fox, G., & Croft, J. R. (2012). Adaptive programming improves outcomes in drug court: an experimental trial. Criminal Justice and Behavior, 39(4), 514–532.

    Google Scholar 

  • Marlowe, D. B., Festinger, D. S., Dugosh, K. L., Benasutti, K. M., Fox, G., & Harron, A. (2014). An experimental trial of adaptive programming in drug court: outcomes at 6, 12 and 18 months. Journal of Experimental Criminology, 10(2), 129–149.

    Google Scholar 

  • Meho, L. I., & Yang, K. (2007). Impact of data sources on citation counts and rankings of LIS faculty: web of Science versus Scopus and Google Scholar. Journal of the American Society for Information Science and Technology, 58(13), 2105–2125.

    Google Scholar 

  • Mitchell, O., Wilson, D. B., Eggers, A., & MacKenzie, D. L. (2012). Assessing the effectiveness of drug courts on recidivism: a meta-analytic review of traditional and non-traditional drug courts. Journal of Criminal Justice, 40(1), 60–71.

    Google Scholar 

  • Myers, C. R. (1970). Journal citations and scientific eminence in contemporary psychology. American Psychologist, 25, 1041–1048.

    Google Scholar 

  • Rempel, M., Green, M., & Kralstein, D. (2012). The impact of adult drug courts on crime and incarceration: findings from a multi-site quasi-experimental design. Journal of Experimental Criminology, 8(2), 165–192.

    Google Scholar 

  • Rodriguez, N., & Webb, V. J. (2004). Multiple measures of juvenile drug court effectiveness: results of a quasi-experimental design. Crime & Delinquency, 50(2), 292–314.

    Google Scholar 

  • Shanahan, M., Lancsar, E., Haas, M., Lind, B., Weatherburn, D., & Chen, S. (2004). Cost-effectiveness analysis of the New South Wales adult drug court program. Evaluation Review, 28(1), 3–27.

    Google Scholar 

  • Sherman, L. W., Gottfredson, D. C., MacKenzie, D. L., Eck, J., Reuter, P., & Bushway, S. (1997) Preventing crime: what works, what doesn't, what's promising: a report to the United States Congress. Washington: US Department of Justice, Office of Justice Programs.

  • Strong, S. M., Rantala, R. R., & Kyckelhahn, T. (2016). Census of problem-solving courts, 2012. Washington: US Department of Justice, Office of Justice Programs, Bureau of Justice Statistics.

    Google Scholar 

  • Telep, C. W. (2009). Citation analysis of randomized experiments in criminology and criminal justice: a research note. Journal of Experimental Criminology, 5(4), 441–463.

    Google Scholar 

  • Thelwall, M., & Kousha, K. (2017). ResearchGate versus Google Scholar: which finds more early citations? Scientometrics, 112(2), 1125–1131.

    Google Scholar 

  • Turner, S., Greenwood, P., Fain, T., & Deschenes, E. (1999). Perceptions of drug court: how offenders view ease of program completion, strengths and weaknesses, and the impact on their lives. National Drug Court Institute Review, 2(1), 61–85.

    Google Scholar 

  • Vaughan, L., & Shaw, D. (2007). A new look at evidence of scholarly citation in citation indexes and from web sources. Scientometrics, 74(2), 317–330.

    Google Scholar 

  • Vine, R. (2006). Google scholar. Journal of the Medical Library Association, 94, 97–99.

    Google Scholar 

  • Weisburd, D., Lum, C. M., & Petrosino, A. (2001). Does research design affect study outcomes in criminal justice? The Annals of the American Academy of Political and Social Science, 578(1), 50–70.

    Google Scholar 

  • Weisburd, D., Ajzenstadt, M., Mazerolle, L., Wilson, D. B., Maxwell, C., & Schnurr, R. (2005) Editors’ introduction. Journal of Experimental Criminology, 1, 1–8.

  • Wexler, D. B. (1998). Practicing therapeutic jurisprudence: psycholegal soft spots and strategies. Rev. Jur. UPR, 67, 317.

    Google Scholar 

  • Wilson, D. B., Mitchell, O., & MacKenzie, D. L. (2006). A systematic review of drug court effects on recidivism. Journal of Experimental Criminology, 2(4), 459–487.

    Google Scholar 

  • Winick, B. J. (1999). Therapeutic jurisprudence and the civil commitment hearing. J. Contemp. Legal Issues, 10, 37.

    Google Scholar 

  • Winick, B. J. (2002). Therapeutic jurisprudence and problem solving courts. Fordham Urb. LJ, 30, 1055.

    Google Scholar 

  • Wolfgang, M. E., Figlio, R. M., & Thornberry, T. P. (1978). Evaluating criminology. New York: Elsevier.

    Google Scholar 

Download references

Acknowledgements

Thank you to Breanna Eason for her assistance during the data collection process for this project. Also, thank you to Dr. Cody Telep for his willingness to review and provide adivce on earlier drafts of this manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lincoln B. Sloas.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

ESM 1

(DOCX 14 kb)

ESM 2

(DOCX 13 kb)

ESM 3

(DOCX 20 kb)

ESM 4

(DOCX 19 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sloas, L.B. Thirty years onward! Citation analysis of randomized experiments on drug and mental health courts. J Exp Criminol 16, 171–181 (2020). https://doi.org/10.1007/s11292-019-09388-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11292-019-09388-9

Keywords

Navigation