Abstract
Treatment fidelity is a crucial consideration within randomized controlled trials (RCTs). The present study relies on data from a feasibility RCT conducted with 62 treatment-seeking suicidal college students. Issues of experimental fidelity were germane in this investigation because the same clinicians provided both the experimental (the Collaborative Assessment and Management of Suicidality—CAMS) and the control (treatment as usual—TAU) care. The first aim of the current study was to determine adherence to the CAMS model within the experimental (CAMS) and control (TAU) treatment conditions. A second exploratory aim was included to examine how treatment fidelity impacted treatment outcomes (i.e., depression, suicidal ideation, hopelessness, and potential treatment moderators). The CAMS Rating Scale (CRS.3-R) was used to determine treatment adherence to the CAMS model and to ensure between-group fidelity within the trial. The CRS.3-R was completed throughout the course of care based on reviews of a selected number of video recordings of both CAMS and TAU sessions to measure treatment fidelity. Mean CRS.3-R scores revealed differences across treatment conditions such that clinicians were successfully able to provide each treatment separately without contamination. Further, higher CRS.3-R scores in CAMS sessions resulted in decreased hopelessness over the treatment period. Higher CRS.3-R scores in TAU sessions resulted in an increased likelihood of suicidal ideation and less reduction in hopelessness over the treatment period. Overall, clinicians can serve as their own controls in a RCT and levels of adherence to the CAMS model have different effects on suicidal ideation and hopelessness.
Similar content being viewed by others
References
Andreasson, K., Krogh, J., Wenneberg, C., Jessen, H. K., Krakauer, K., Gluud, C., Thomsen, R. R., Randers, L., & Nordentoft, M. (2016). Effectiveness of dialectical behavior therapy versus collaborative assessment and management of suicidality treatment for reduction of self-harm in adults with borderline personality traits and disorder: A randomized observer-blinded clinical trial. Depression and Anxiety, 33(6), 520–530. https://doi.org/10.1002/da.22472/pdf
Arkov, K., Rosenbaum, B., Christiansen, L., Jønsson, H., & Münchow, M. (2008). Treatment of suicidal patients: The collaborative assessment and management of suicidality. Ugeskrift for Laeger, 170(3), 149–153.
Barlow, D. H. (2010). Negative effects from psychological treatments: A perspective. American Psychologist, 65(1), 13.
Beck, A. T., & Steer, R. A. (1988). Beck hopelessness scale. Psychological corporation San Antonio, TX. Retrieved August 26, 2016, from http://www.iscmr.org/content/beck-hopelessness-scale
Brown, G. K., & Green, K. L. (2014). A review of evidence-based follow-up care for suicide prevention: Where do we go from here? American Journal of Preventive Medicine, 47(3, Supplement 2), S209–S215. https://doi.org/10.1016/j.amepre.2014.06.006
Comtois, K. A., Jobes, D. A., S. O’Connor, S., Atkins, D. C., Janis, K., E. Chessen, C., Landes, S. J., Holen, A., & Yuodelis-Flores, C. (2011). Collaborative assessment and management of suicidality (CAMS): Feasibility trial for next-day appointment services. Depression and Anxiety, 28(11), 963–972https://doi.org/10.1002/da.20895
Corona, C. D. (2017). A psychometric evaluation of the CAMS rating scale (dissertation).
Corona, C. D., Gutierrez, P. M., Wagner, B. M., & Jobes, D. A. (2019a). The psychometric properties of the collaborative assessment and management of suicidality rating scale. Journal of Clinical Psychology, 75(1), 190–201. https://doi.org/10.1002/jclp.22699
Corona, C. D., Gutierrez, P. M., Wagner, B. M., & Jobes, D. A. (2019b). Assessing the reliability of the CAMS rating scale using a generalizability study. Crisis, 40(4), 273–279. https://doi.org/10.1027/0227-5910/a000565
Ellis, T. E., Green, K. L., Allen, J. G., Jobes, D. A., & Nadorff, M. R. (2012). Collaborative assessment and management of suicidality in an inpatient setting: Results of a pilot study. Psychotherapy, 49(1), 72.
Ellis, T. E., Rufino, K. A., & Allen, J. G. (2017). A controlled comparison trial of the collaborative assessment and management of suicidality (CAMS) in an inpatient setting: Outcomes at discharge and six-month follow-up. Psychiatry Research, 249, 252–260.
Ellis, T. E., Rufino, K. A., Allen, J. G., Fowler, J. C., & Jobes, D. A. (2015). Impact of a suicide-specific intervention within inpatient psychiatric care: The collaborative assessment and management of suicidality. Suicide and Life-Threatening Behavior, 45(5), 556–566.
Enders, C. K., & Tofighi, D. (2007). Centering predictors variables in cross-sectional multilevel models: A new look at an old issue. Psychological Methods, 12, 121–138.
Fox, K. R., Huang, X., Guzmán, E. M., Funsch, K. M., Cha, C. B., Ribeiro, J. D., & Franklin, J. C. (2020). Interventions for suicide and self-injury: A meta-analysis of randomized controlled trials across nearly 50 years of research. Psychological Bulletin, 146(12), 1117–1145.
Fritz, J. M., & Cleland, J. (2003). Effectiveness versus efficacy: More than a debate over language. Journal of Orthopaedic and Sports Physical Therapy, 33(4), 163–165.
Gibbons, R. D., Hedeker, D., Elkin, I., Waternaux, C., Kramer, H. C., Greenhouse, J. B., Shea, T., Imber, S. D., Sotsky, S. M., & Watkins, J. T. (1993). Some conceptual and statistical issues in analysis of longitudinal psychiatric data. Archives of General Psychiatry, 50, 739–750.
Jobes, D. A. (2006). Managing suicidal risk: A collaborative approach. Guilford Press.
Jobes, D. A. (2016). Managing suicidal risk: A collaborative approach (2nd ed.). Guilford Press.
Jobes, D. A., Comtois, K. A., Gutierrez, P. M., Brenner, L. A., Huh, D., Chalker, S. A., Ruhe, G., Kerbrat, A. H., Atkins, D. C., Jennings, K., Crumlish, J., Corona, C. D., Connor, S. O., Hendricks, K. E., Schembari, B., Singer, B., & Crow, B. (2017). A randomized controlled trial of the collaborative assessment and management of suicidality versus enhanced care as usual with suicidal soldiers. Psychiatry, 80(4), 339–356. https://doi.org/10.1080/00332747.2017.1354607
Jobes, D. A., Jacoby, A. M., Cimbolic, P., & Hustead, L. A. T. (1997). Assessment and treatment of suicidal clients in a university counseling center. Journal of Counseling Psychology, 44(4), 368.
Jobes, D. A., Kahn-Greene, E., Greene, J. A., & Goeke-Morey, M. (2009). Clinical improvements of suicidal outpatients: Examining suicide status form responses as predictors and moderators. Archives of Suicide Research, 13(2), 147–159.
Jobes, D. A., Wong, S. A., Conrad, A. K., Drozd, J. F., & Neal-Walden, T. (2005). The collaborative assessment and management of suicidality versus treatment as usual: A retrospective study with suicidal outpatients. Suicide and Life-Threatening Behavior, 35(5), 483–497.
Keogh-Brown, M. R., Bachmann, M. O., Shepstone, L., Hewitt, C., Howe, A., Ramsay, C. R., Song, F., Miles, J. N. V., Torgerson, D. J., Miles, S., Elbourne, D., Harvey, I., & Campbell, M. J. (2007). Contamination in trials of educational interventions. Health Technology Assessment (winchester, England), 11(43), iii–107. https://doi.org/10.3310/hta11430
Kraemer, H. C., Wilson, G. T., Fairburn, C. G., & Agras, W. S. (2002). Mediators and moderators of treatment effects in randomized clinical trials. Archives of General Psychiatry, 59(10), 877–883. https://doi.org/10.1001/archpsyc.59.10.877
Locke, B. D., McAleavey, A. A., Zhao, Y., Lei, P., Hayes, J. A., Castonguay, L. G., Li, H., Tate, R., & Lin, Y. (2012). Development and initial validation of the counseling center assessment of psychological symptoms–34. Measurement and Evaluation in Counseling and Development, 45(3), 151–169. https://doi.org/10.1177/0748175611432642
Magill, N., Knight, R., McCrone, P., Ismail, K., & Landau, S. (2019). A scoping review of the problems and solutions associated with contamination in trials of complex interventions in mental health. BMC Medical Research Methodology, 19(1), 4–4. https://doi.org/10.1186/s12874-018-0646-z
McCullagh, P., & Nelder, J. A. (1986). Generalized linear models (2nd ed.). Chapman and Hall.
Nielsen, A. C., Alberdi, F., & Rosenbaum, B. (2011). Collaborative assessment and management of suicidality method shows effect. Danish Medical Bulletin, 58(8), A4300.
Pistorello, J., Jobes, D. A., Compton, S. N., Locey, N. S., Walloch, J. C., Gallop, R., Au, J. S., Noose, S. K., Young, M., Johnson, J., Dickens, Y., Chatham, P., Jeffcoat, T., Dalto, G., & Goswami, S. (2017). Developing adaptive treatment strategies to address suicidal risk in college students: A pilot sequential, multiple assignment, randomized trial (SMART). Archives of Suicide Research, 22(4), 644–664. https://doi.org/10.1080/13811118.2017.1392915
Pistorello, J., Jobes, D. A., Gallop, R., Compton, S. N., Locey, N. S., Au, J. S., Noose, S. K., Walloch, J. C., Johnson, J., Young, M., Dickens, Y., Chatham, P., & Jeffcoat, T. (2020). A randomized controlled trial of the collaborative assessment and management of suicidality (CAMS) versus treatment as usual (TAU) for suicidal college students. Archives of Suicide Research. https://doi.org/10.1080/13811118.2020.1749742
Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models (2nd ed.). Sage.
Rothman, K. J. (1990). No Adjustments are needed for multiple comparisons. Epidemiology, 1, 43–46.
Ryberg, W., Zahl, P. H., Diep, L. M., Landrø, N. I., & Fosee, R. (2019). Managing suicidality within specialized care: A randomized controlled trial. Journal of Affective Disorders, 249, 112–120. https://doi.org/10.1016/j.jad.2019.02.022
Singal, A. G., Higgins, P. D. R., & Waljee, A. K. (2014). A primer on effectiveness and efficacy trials. Clinical and Translational Gastroenterology, 5(1), e45. https://doi.org/10.1038/ctg.2013.13
Steed, L. (2001). Further validity and reliability evidence for Beck hopelessness scale scores in a nonclinical sample. Educational and Psychological Measurement, 61(2), 303–316.
Acknowledgements
The research reported in the present study was supported by the National Institute of Mental Health of the National Institutes of Health under Award Number R34MH104714 (PI: J. Pistorello). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The authors would like to thank the clinicians who participated in this study.
Funding
This study was funded by Foundation for the National Institutes of Health (R34MH104714).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Chalker, S.A., Gallop, R., Jobes, D.A. et al. Treatment Fidelity of a Randomized Controlled Trial for Suicidal Risk. J Contemp Psychother 52, 99–107 (2022). https://doi.org/10.1007/s10879-021-09528-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10879-021-09528-1