When the Right Measure Doesn’t Exist: A Novel Motivational Interviewing Tool for Community Programs
- 16 Downloads
This report describes the reliability and validity of the Motivational Interviewing Evaluation Rubric (MIER). The MIER is a novel MI evaluation tool for use in supervision with community-based providers. In the MIER, there are 15 items targeting the following sub-dimensions: Spirit (four items), Process (six items), and Skills (five items). Two raters engaged in 10 h of training and practice on the use of the MIER. Data were session audio-files from youth justice program providers. Inter-rater reliability results showed good performance for the measure. Specifically, 2-way mixed Intraclass Coefficients were excellent, ranging from 0.81 to 0.92 for sub-dimension scores, and Kappa ratings per item were fair to substantial (k = 0.35 to 0.87). Internal consistency reliability for Spirit, Process, and Skills scores ranged from a = .72 to 0.78. In concurrent validity analyses, MIER sub-dimension scores were positively and moderately correlated with relevant Motivational Interviewing Treatment Integrity (4.2) criterion scores (rs = .45 to 0.67; p < .005). The MIER is a promising observational measure for guiding supervision in community youth programs.
KeywordsFidelity monitoring Community based programs Implementation science Motivational Interviewing Psychometric
We would like to specifically acknowledge Elizabeth Zarate and Jada Nyankson for their heartfelt work on this project, along with the staff at Southwest Key Programs Milwaukee. We would also like to acknowledge those who supported the initial work, Hillary England and DeAna Swan, and to Cassandra Harper and Justin Walthers who helped with project management and assisted with data collection, respectively. Lastly, thanks to Matthea Marquart for introducing Dr. Magill to our community-based work.
Dr. Magill was paid a consultation fee by Southwest Key Programs Inc.
Compliance with Ethical Standards
Conflicts of interest
Dr. Baez was employed at Southwest Key Programs Inc. for part of this research project and Rachel Galanis was a Clinical Director at Southwest Key Programs Inc. during this research project.
- Cronbach, L. J. (1970). Essentials of psychological testing (3rd ed.). New York: Harper & Row.Google Scholar
- Leeman, J., Calancie, L., Hartman, M. A., Escoffery, C. T., Herrmann, A. K., Tague, L. E., … Samuel-Hodge, C. (2015). What strategies are used to build practitioners’ capacity to implement community-based interventions and are they effective? A systematic review. Implementation Science,10, 80.CrossRefGoogle Scholar
- Manuel, J. K., Moyers, T. B., & Houck, J. M. (2011). Motivational interviewing: A review of coding systems. Poster session presented at the Motivational Interviewing Network of Trainers (MINT), Fort Wayne, IN.Google Scholar
- Miller, W. R., & Rollnick, S. (2013). Motivational interviewing: Helping people change (3rd ed.). New York: Guilford Press.Google Scholar
- Moyers, T. B., Manuel, J. K., & Ernst, D. (2014). Motivational interviewing treatment integrity coding manual 4.1. Unpublished Manual.Google Scholar
- Moyers, T. B., Martin, T., Manuel, J. K., Miller, W. R., & Ernst, D. (2010). Revised global scales: Motivational interviewing treatment integrity 3.1.1 (MITI 3.1.1) [Unpublished manuscript]. Center on Alcoholism, Substance Abuse and Addictions (CASAA), University of New Mexico.Google Scholar
- Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.Google Scholar
- Nuro, K. F., Maccarelli, L., Martino, S., Ball, S. A., Baker, S. M., Rounsaville, B. J., & Carroll, K. M. (2005). Yale adherence and competence scale (YACSII) guidelines. West Haven, CT: Yale University.Google Scholar
- Pecukonis, E., Greeno, E., Hodorowicz, M., Park, H., Ting, L., Moyers, T., … Wirt, C. (2016). Teaching motivational interviewing to child welfare social work students using live supervision and standardized clients: A randomized controlled trial. Journal of the Society for Social Work and Research,7(3), 479–505.CrossRefGoogle Scholar