Abstract
State mental health authorities have a leadership role in implementing evidence-based practices (EBPs), but few instruments are available to assess the impact of this role. We describe the development of the State Mental Health Authority Yardstick (SHAY), a behaviorally anchored instrument designed to assess state-level facilitating conditions associated with successful implementation of EBPs in community mental health centers. The SHAY assesses the SMHA role in seven domains: Planning, Financing, Training, Leadership, Policies and Regulations, Quality Improvement, and Stakeholders. Preliminary evidence from the National Evidence-Based Practices Project partially supports the construct and criterion-oriented validity of this instrument for rating state-level activities supporting or blocking the implementation of evidence-based practices.
Similar content being viewed by others
References
Atlas.ti 2.0. (2002). Atlas.ti 2.0 [Computer software]. Berlin, Germany: GmbH.
Becker, D. R., Smith, J., Tanzman, B., Drake, R. E., & Tremblay, T. (2001). Fidelity of supported employment programs and employment outcomes. Psychiatric Services, 52, 834–836.
Becker, D. R., Xie, H., McHugo, G. J., Halliday, J., & Martinez, R. A. (2006). What predicts supported employment program outcomes? Community Mental Health Journal, 42, 303–313.
Bond, G. R., Evans, L., Salyers, M. P., Williams, J., & Kim, H. K. (2000). Measurement of fidelity in psychiatric rehabilitation. Mental Health Services Research, 2(2), 75–87.
Bond, G. R., Drake, R. E., McHugo, G. J., Rapp, C. A., Whitley, R., & National Evidence-Based Practices Project Research Group (2009). Strategies for improving fidelity in the national evidence-based practices project. Research on Social Work Practice (in press).
Bond, G. R., & Salyers, M. P. (2004). Prediction of outcome from the Dartmouth ACT fidelity scale. CNS Spectrums, 9, 937–942.
Dawes, R. M. (1979). The robust beauty of improper linear models in decision making. American Psychologist, 34, 571–582.
Drake, R. E., Becker, D. R., Goldman, H., & Martinez, R. A. (2006). The Johnson & Johnson-Dartmouth community mental health program: Best practices in disseminating an evidence-based practice. Psychiatric Services, 57, 302–304.
Drake, R. E., Goldman, H. H., Leff, H. S., Lehman, A. F., Dixon, L., Mueser, K. T., et al. (2001). Implementing evidence-based practices in routine mental health service settings. Psychiatric Services, 52, 179–182.
Drake, R. E., Teague, G. B., & Gersing, K. (2005). State mental health authorities and informatics. Community Mental Health Journal, 41, 365–369.
Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida.
Ganju, V. (2003). Implementation of evidence-based practices in state mental health systems: Implications for research and effectiveness studies. Schizophrenia Bulletin, 29, 125–131.
Hoge, M. A., Tondora, J., & Stuart, G. W. (2003). Training in evidence-based practice. Psychiatric Clinics of North America, 26, 851–865.
Isett, K. R., Burnam, M. A., Coleman-Beattie, B., Hyde, P. S., Morrissey, J. P., Magnabosco, J., Rapp, C. A., Ganju, V., & H. H. Goldman (2008). The role of state mental health authorities in managing change for the implementation of evidence-based practices. Community Mental Health Journal, 44, 195–211.
Isett, K. R., Burnam, M. A., Coleman-Beattie, B., Hyde, P. S., Morrissey, J. P., Magnabosco, J., et al. (2007). The state policy context of implementation issues for evidence-based practices in mental health. Psychiatric Services, 58, 914–921.
Mancini, A. D., Moser, L. L., Whitley, R., McHugo, G. J., Bond, G. R., Finnerty, M. T., & Burns, B. J. (2009). Assertive community treatment: Facilitators and barriers to implementation in routine mental health settings. Psychiatric Services, 60, 189–195.
Marty, D., Rapp, C. A., McHugo, G., & Whitley, R. (2008). Factors influencing consumer outcome monitoring in implementation of evidence-based practices: Results from the National EBP Implementation Project. Administration and Policy in Mental Health and Mental Health Services Research, 35, 204–211.
McFarlane, W. R., McNary, S., Dixon, L., Hornby, H., & Cimett, E. (2001). Predictors of dissemination of family psychoeducation in community mental health centers in Maine and Illinois. Psychiatric Services, 52, 935–942.
McGrew, J. H., Bond, G. R., Dietzen, L. L., & Salyers, M. P. (1994). Measuring the fidelity of implementation of a mental health program model. Journal of Consulting and Clinical Psychology, 62, 670–678.
McGrew, J. H., & Griss, M. (2005). Concurrent and predictive validity of two scales to assess the fidelity of implementation of supported employment. Psychiatric Rehabilitation Journal, 29, 41–47.
McHugo, G. J., Drake, R. E., Teague, G. B., & Xie, H. (1999). Fidelity to assertive community treatment and client outcomes in the New Hampshire dual disorders study. Psychiatric Services, 50, 818–824.
McHugo, G. J., Drake, R. E., Whitley, R., Bond, G. R., Campbell, K., Rapp, C. A., et al. (2007). Fidelity outcomes in the National Implementing Evidence-Based Practices Project. Psychiatric Services, 58, 1279–1284.
Moser, L. L., DeLuca, N. L., Bond, G. R., & Rollins, A. L. (2004). Implementing evidence based psychosocial practices: Lessons learned from statewide implementation of two practices. CNS Spectrums, 9, 926–936.
Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.
Rapp, C. A., Bond, G. R., Becker, D. R., Carpinello, S. E., Nikkel, R. E., & Gintoli, G. (2005). The role of state mental health authorities in promoting improved client outcomes through evidence-based practice. Community Mental Health Journal, 41, 347–363.
Substance Abuse and Mental Health Services Administration (2003). Evidence-based Practices Implementation Resource Kits (Publication no. SMA#3838). US Department of Health and Human Services, Rockville, MD. www.mentalhealth.SAMHSA.gov.
Torrey, W. C., Finnerty, M., Evans, A., & Wyzik, P. (2003). Strategies for leading the implementation of evidence-based practices. Psychiatric Clinics of North America, 26, 883–897.
Torrey, W. C., Lynde, D. W., & Gorman, P. (2005). Promoting the implementation of practices that are supported by research: The National Implementing Evidence-Based Practices Project. Child and Adolescent Psychiatric Clinics of North America, 14, 297–306.
Wainer, H. (1976). Estimating coefficients in linear models: It don’t make no nevermind. Psychological Bulletin, 83, 213–217.
Wang, P. S., Demler, O., & Kessler, R. C. (2002). Adequacy of treatment for serious mental illness in the United States. American Journal of Public Health, 92, 92–98.
Woltmann, E., & Whitley, R. (2007). The role of staffing stability in the implementation of integrated dual disorders treatment: An exploratory study. Journal of Mental Health, 16, 697–701.
Acknowledgments
This work was supported in part by the MacArthur Foundation Network on Mental Health Policy Research. The author Howard H. Goldman is the Director of the MacArthur Foundation Network on Mental Health Policy Research.
Author information
Authors and Affiliations
Corresponding author
Additional information
The Shay can be accessed at: http://www.socwel.ku.edu/mentalhealth/.
Rights and permissions
About this article
Cite this article
Finnerty, M.T., Rapp, C.A., Bond, G.R. et al. The State Health Authority Yardstick (SHAY). Community Ment Health J 45, 228–236 (2009). https://doi.org/10.1007/s10597-009-9181-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10597-009-9181-z