A Pilot Study Examining Outcomes Associated with the Implementation of Progress Monitoring at a Substance Use Disorder Treatment Program for Adolescents
- 483 Downloads
Progress monitoring (PM) is the periodic and reliable assessment of client progress to evaluate and inform psychotherapeutic treatment. PM’s use in a variety of treatment contexts show improved treatment outcome, dropout rate reduction, moderated treatment deterioration, and more efficient treatment delivery.
This study reports the preliminary results of a PM implementation initiative at a youth care program that focuses on substance use disorder treatment.
Participants were 70 adolescent clients (mean age 16.6 years, 56% male, 58% White, 30% Aboriginal or Mètis). A time series evaluation design guided the study, where data were collected at admission, periodic intervals during treatment, and at discharge. Descriptive analysis was performed on all demographic variables. Pairwise t tests and effect sizes were calculated to determine clinically significant change.
PM was successfully implemented in the youth care program and the outcomes associated with PM were statistically and clinically significant with large effect sizes reported. Changes in the development of mindfulness related-skills were positively associated with changes in outcome. Case studies illustrate how PM can identify clients who are not responding to treatment.
PM in adolescent substance use treatment programs is an important consideration for program providers. Implementation needs to involve staff, be flexible, empower clients, and be integrated into the culture of programs. The successful implementation of PM can help identify clients who are not responding to treatment and generate useful and reliable outcome data. Recommendations for how PM can be implemented in similar youth care programs are also discussed.
KeywordsProgress monitoring Adventure therapy Youth Outcome Questionnaire Mindfulness practices
This study was funded by a grant from Health Canada and Alberta Health Services (Grant# 005470). K.C. Russell and H.L. Gillis, received funding to conduct this evaluation from Health Canada and Alberta Health Services (Grant# 005470). L. Law and J. Couillard both work for ENVIROS, the Organization with which the research was coordinated and conducted.
Compliance with Ethical Standards
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants included in the study and the study was approved by the Institutional Review Board of Georgia College and State University (#656206: Evaluation of Enviros Base Camp Program Co-Principal Investigator: Lee Gillis, Ph.D.).
- Base Camp. (2017). Retrieved November 20, 2017, from http://www.enviros.org/programmenu/base-camp/.
- Bedard, R. M., Rosen, L. A., & Vacha-Haase, T. (2003). Wilderness therapy programs for juvenile delinquents: A meta-analysis. Journal of Therapeutic Wilderness Camping, 3, 7–13.Google Scholar
- Bickman, L., Kelley, S. D., Breda, C., Regina de Andrade, A., & Riemer, M. (2011). Effects of routine feedback to clinicians on mental health outcomes of youths: Results of a randomized trial. Psychiatric Services, 62(12), 1423–1429. https://doi.org/10.1176/appi.ps.002052011.CrossRefPubMedGoogle Scholar
- Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015). Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychotherapy Research: Journal of the Society for Psychotherapy Research. https://doi.org/10.1080/10503307.2013.817696.Google Scholar
- Burlingame, G., Cox, J., Wells, G., Latkowski, M., Justice, D., Carter, C., et al. (2005). The administration and scoring manual of the Youth Outcome Questionnaire. Salt Lake City, Utah: OQ Measures.Google Scholar
- Carlier, I. V., Meuldijk, D., Van Vliet, I. M., Van Fenema, E., Van der Wee, N. J. A., & Zitman, F. G. (2012). ROM and feedback on physical or mental health status: Evidence and theory. Journal of Evaluation in Clinical Practice, 18, 104–110. https://doi.org/10.1111/j.1365-2753.2010.01543.x.CrossRefPubMedGoogle Scholar
- Fernandez, A. C., Wood, M. D., Stein, L. A. R., & Rossi, J. S. (2010). Measuring mindfulness and examining its relationship with alcohol use and negative consequences. Psychology of Addictive Behaviors : Journal of the Society of Psychologists in Addictive Behaviors, 24(4), 608–616.CrossRefGoogle Scholar
- Gass, M., Gillis, H. L., & Russell, K. C. (2012). Adventure therapy: Theory, practice and research. New York: Routledge Mental Health Publishing.Google Scholar
- Gillis, H. L., Speelman, E., Linville, N., Bailey, E., Kalle, A., Oglesbee, N., et al. (2016). Meta-analysis of treatment outcomes measured by the Y-OQ and Y-OQ SR comparing wilderness and non-wilderness treatment programs. Child & Youth Care Forum, 45(6), 851–863. https://doi.org/10.1007/s10566-016-9360-3.CrossRefGoogle Scholar
- Gironda, M. A. (2000). A validity study of the Youth-Outcome Questionnaire and the Ohio Scales. Dissertation Abstracts International: Section B: The Sciences & Engineering, 61(5-B).Google Scholar
- Goldberg, S. B., Babins-Wagner, R., Rousmaniere, T., Berzins, S., Hoyt, W. T., Whipple, J. L., et al. (2016). Creating a climate for therapist improvement: A case study of an agency focused on outcomes and deliberate practice. Psychotherapy, 53(3), 367–375. https://doi.org/10.1037/pst0000060.CrossRefPubMedGoogle Scholar
- Harris, N., Brazeau, J. N. R., Rawana, E. P., Brownlee, K., & Mazmanian, D. (2016). A preliminary examination of a strengths-based treatment for adolescent substance use issues. Canadian Journal of Counselling and Psychotherapy (Online), 50(2), 145–163.Google Scholar
- IBM. (2017). IBM: How to cite IBM SPSS statistics or earlier versions of SPSS. http://www-01.ibm.com/support/docview.wss?uid=swg21476197. Accessed June 21, 2017.
- Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10(3), 288–301.Google Scholar
- Miller, S. D., & Hubble, M. (2011). The road to mastery. Psychotherapy Networker, 35, 22–60.Google Scholar
- Park, N. (2009). Building strengths of character: Keys to positive youth development. Reclaiming Children and Youth, 18, 42–47.Google Scholar
- Patton, M. (2008). Utilization-focused evaluation (4th ed.). Thousand Oaks, CA: Sage Publications.Google Scholar
- Russell, K. C., Gillis, H. L., & Kivligan, D. (2017, August). Process factors explaining psycho-social outcomes in adventure therapy. Psychotherapy, http://dx.doi.org/10.1037/pst0000047.
- Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78(3), 298–311. https://doi.org/10.1037/a0019247.CrossRefPubMedGoogle Scholar
- Solstad, S. M., Castonguay, L. G., & Moltu, C. (2017). Patients’ experiences with routine outcome monitoring and clinical feedback systems: A systematic review and synthesis of qualitative empirical literature. Psychotherapy Research. https://doi.org/10.1080/10503307.2017.1326645.PubMedGoogle Scholar
- van Sonsbeek, M. A. M. S., Hutschemaekers, G. G. J. M., Veerman, J. W., & Tiemens, B. B. G. (2014). Effective components of feedback from routine outcome monitoring (ROM) in youth mental health care: Study protocol of a three-arm parallel-group randomized controlled trial. BMC Psychiatry, 14(1), 3. https://doi.org/10.1186/1471-244X-14-3.CrossRefPubMedPubMedCentralGoogle Scholar
- Winters, K. C., & Henly, G. A. (1989). Personal experience inventory and manual. Los Angeles: Western Psychological Services.Google Scholar