Community Mental Health Journal

, Volume 45, Issue 3, pp 228–236 | Cite as

The State Health Authority Yardstick (SHAY)

  • Molly T. Finnerty
  • Charles A. Rapp
  • Gary R. Bond
  • David W. Lynde
  • Vijay Ganju
  • Howard H. Goldman
Original Paper


State mental health authorities have a leadership role in implementing evidence-based practices (EBPs), but few instruments are available to assess the impact of this role. We describe the development of the State Mental Health Authority Yardstick (SHAY), a behaviorally anchored instrument designed to assess state-level facilitating conditions associated with successful implementation of EBPs in community mental health centers. The SHAY assesses the SMHA role in seven domains: Planning, Financing, Training, Leadership, Policies and Regulations, Quality Improvement, and Stakeholders. Preliminary evidence from the National Evidence-Based Practices Project partially supports the construct and criterion-oriented validity of this instrument for rating state-level activities supporting or blocking the implementation of evidence-based practices.


Evidence-based practices Implementation State mental health authority Policy 



This work was supported in part by the MacArthur Foundation Network on Mental Health Policy Research. The author Howard H. Goldman is the Director of the MacArthur Foundation Network on Mental Health Policy Research.


  1. Atlas.ti 2.0. (2002). Atlas.ti 2.0 [Computer software]. Berlin, Germany: GmbH.Google Scholar
  2. Becker, D. R., Smith, J., Tanzman, B., Drake, R. E., & Tremblay, T. (2001). Fidelity of supported employment programs and employment outcomes. Psychiatric Services, 52, 834–836.PubMedCrossRefGoogle Scholar
  3. Becker, D. R., Xie, H., McHugo, G. J., Halliday, J., & Martinez, R. A. (2006). What predicts supported employment program outcomes? Community Mental Health Journal, 42, 303–313.PubMedCrossRefGoogle Scholar
  4. Bond, G. R., Evans, L., Salyers, M. P., Williams, J., & Kim, H. K. (2000). Measurement of fidelity in psychiatric rehabilitation. Mental Health Services Research, 2(2), 75–87.PubMedCrossRefGoogle Scholar
  5. Bond, G. R., Drake, R. E., McHugo, G. J., Rapp, C. A., Whitley, R., & National Evidence-Based Practices Project Research Group (2009). Strategies for improving fidelity in the national evidence-based practices project. Research on Social Work Practice (in press).Google Scholar
  6. Bond, G. R., & Salyers, M. P. (2004). Prediction of outcome from the Dartmouth ACT fidelity scale. CNS Spectrums, 9, 937–942.PubMedGoogle Scholar
  7. Dawes, R. M. (1979). The robust beauty of improper linear models in decision making. American Psychologist, 34, 571–582.CrossRefGoogle Scholar
  8. Drake, R. E., Becker, D. R., Goldman, H., & Martinez, R. A. (2006). The Johnson & Johnson-Dartmouth community mental health program: Best practices in disseminating an evidence-based practice. Psychiatric Services, 57, 302–304.PubMedCrossRefGoogle Scholar
  9. Drake, R. E., Goldman, H. H., Leff, H. S., Lehman, A. F., Dixon, L., Mueser, K. T., et al. (2001). Implementing evidence-based practices in routine mental health service settings. Psychiatric Services, 52, 179–182.PubMedCrossRefGoogle Scholar
  10. Drake, R. E., Teague, G. B., & Gersing, K. (2005). State mental health authorities and informatics. Community Mental Health Journal, 41, 365–369.PubMedCrossRefGoogle Scholar
  11. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida.Google Scholar
  12. Ganju, V. (2003). Implementation of evidence-based practices in state mental health systems: Implications for research and effectiveness studies. Schizophrenia Bulletin, 29, 125–131.PubMedGoogle Scholar
  13. Hoge, M. A., Tondora, J., & Stuart, G. W. (2003). Training in evidence-based practice. Psychiatric Clinics of North America, 26, 851–865.PubMedCrossRefGoogle Scholar
  14. Isett, K. R., Burnam, M. A., Coleman-Beattie, B., Hyde, P. S., Morrissey, J. P., Magnabosco, J., Rapp, C. A., Ganju, V., & H. H. Goldman (2008). The role of state mental health authorities in managing change for the implementation of evidence-based practices. Community Mental Health Journal, 44, 195–211.Google Scholar
  15. Isett, K. R., Burnam, M. A., Coleman-Beattie, B., Hyde, P. S., Morrissey, J. P., Magnabosco, J., et al. (2007). The state policy context of implementation issues for evidence-based practices in mental health. Psychiatric Services, 58, 914–921.PubMedCrossRefGoogle Scholar
  16. Mancini, A. D., Moser, L. L., Whitley, R., McHugo, G. J., Bond, G. R., Finnerty, M. T., & Burns, B. J. (2009). Assertive community treatment: Facilitators and barriers to implementation in routine mental health settings. Psychiatric Services, 60, 189–195.Google Scholar
  17. Marty, D., Rapp, C. A., McHugo, G., & Whitley, R. (2008). Factors influencing consumer outcome monitoring in implementation of evidence-based practices: Results from the National EBP Implementation Project. Administration and Policy in Mental Health and Mental Health Services Research, 35, 204–211.PubMedCrossRefGoogle Scholar
  18. McFarlane, W. R., McNary, S., Dixon, L., Hornby, H., & Cimett, E. (2001). Predictors of dissemination of family psychoeducation in community mental health centers in Maine and Illinois. Psychiatric Services, 52, 935–942.PubMedCrossRefGoogle Scholar
  19. McGrew, J. H., Bond, G. R., Dietzen, L. L., & Salyers, M. P. (1994). Measuring the fidelity of implementation of a mental health program model. Journal of Consulting and Clinical Psychology, 62, 670–678.PubMedCrossRefGoogle Scholar
  20. McGrew, J. H., & Griss, M. (2005). Concurrent and predictive validity of two scales to assess the fidelity of implementation of supported employment. Psychiatric Rehabilitation Journal, 29, 41–47.PubMedCrossRefGoogle Scholar
  21. McHugo, G. J., Drake, R. E., Teague, G. B., & Xie, H. (1999). Fidelity to assertive community treatment and client outcomes in the New Hampshire dual disorders study. Psychiatric Services, 50, 818–824.PubMedGoogle Scholar
  22. McHugo, G. J., Drake, R. E., Whitley, R., Bond, G. R., Campbell, K., Rapp, C. A., et al. (2007). Fidelity outcomes in the National Implementing Evidence-Based Practices Project. Psychiatric Services, 58, 1279–1284.PubMedCrossRefGoogle Scholar
  23. Moser, L. L., DeLuca, N. L., Bond, G. R., & Rollins, A. L. (2004). Implementing evidence based psychosocial practices: Lessons learned from statewide implementation of two practices. CNS Spectrums, 9, 926–936.PubMedGoogle Scholar
  24. Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.Google Scholar
  25. Rapp, C. A., Bond, G. R., Becker, D. R., Carpinello, S. E., Nikkel, R. E., & Gintoli, G. (2005). The role of state mental health authorities in promoting improved client outcomes through evidence-based practice. Community Mental Health Journal, 41, 347–363.PubMedCrossRefGoogle Scholar
  26. Substance Abuse and Mental Health Services Administration (2003). Evidence-based Practices Implementation Resource Kits (Publication no. SMA#3838). US Department of Health and Human Services, Rockville, MD.
  27. Torrey, W. C., Finnerty, M., Evans, A., & Wyzik, P. (2003). Strategies for leading the implementation of evidence-based practices. Psychiatric Clinics of North America, 26, 883–897.PubMedCrossRefGoogle Scholar
  28. Torrey, W. C., Lynde, D. W., & Gorman, P. (2005). Promoting the implementation of practices that are supported by research: The National Implementing Evidence-Based Practices Project. Child and Adolescent Psychiatric Clinics of North America, 14, 297–306.PubMedCrossRefGoogle Scholar
  29. Wainer, H. (1976). Estimating coefficients in linear models: It don’t make no nevermind. Psychological Bulletin, 83, 213–217.CrossRefGoogle Scholar
  30. Wang, P. S., Demler, O., & Kessler, R. C. (2002). Adequacy of treatment for serious mental illness in the United States. American Journal of Public Health, 92, 92–98.PubMedCrossRefGoogle Scholar
  31. Woltmann, E., & Whitley, R. (2007). The role of staffing stability in the implementation of integrated dual disorders treatment: An exploratory study. Journal of Mental Health, 16, 697–701.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  • Molly T. Finnerty
    • 1
    • 2
  • Charles A. Rapp
    • 3
  • Gary R. Bond
    • 4
  • David W. Lynde
    • 5
  • Vijay Ganju
    • 6
  • Howard H. Goldman
    • 7
  1. 1.Bureau of Evidence-Based Services and Implementation ScienceNew York State Office of Mental HealthAlbanyUSA
  2. 2.Mental Health Services and Policy ResearchNew York State Psychiatric Institute/ColumbiaNew YorkUSA
  3. 3.Office of Mental Health and TrainingThe University of KansasLawrenceUSA
  4. 4.Department of PsychologyIndiana University Purdue University IndianapolisIndianapolisUSA
  5. 5.Dartmouth Psychiatric Research CenterLebanonUSA
  6. 6.AustinUSA
  7. 7.University of Maryland School of MedicineBaltimoreUSA

Personalised recommendations