Skip to main content

Development of a Scale to Assess Practitioner Knowledge in Providing Integrated Dual Disorders Treatment

Abstract

As mental health providers increasingly adopt evidence-based practices, tools are needed to assess practitioner knowledge of these practices. We describe the development and psychometric evaluation of a paper-and-pencil test to assess provider attitudes and knowledge about Integrated Dual Disorders Treatment (IDDT). In this sample of clinicians who were implementing IDDT in two mental health centers, the test showed good internal consistency, inter-rater reliability, and for a subsample who took the test twice, significant improvement over time. Higher scores on the scale were correlated with greater education, but not greater experience or lower burnout. This test is a promising tool for assessing provider knowledge of a specific evidence-based practice.

This is a preview of subscription content, access via your institution.

References

  • Alverson, H., Alverson, M., & Drake, R. E. (2000). An ethnographic study of the longitudinal course of substance abuse among people with severe mental illness. Community Mental Health Journal, 36(6), 557–569.

    PubMed  Article  CAS  Google Scholar 

  • Baer, J. S., Ball, S. A., Campbell, B. K., Miele, G. M., Schoener, E. P., & Tracy, K. (2007). Training and fidelity monitoring of behavioral interventions in multi-site addictions research. Drug Alcohol Dependence, 87(2–3), 107–118.

    Article  Google Scholar 

  • Bashook, P. G. (2005). Best practices for assessing competence and performance of the behavioral health workforce. Administration and Policy in Mental Health, 32, 563–592.

    PubMed  Article  Google Scholar 

  • Bond, G. R., Evans, L., Salyers, M. P., Williams, J., & Kim, H. K. (2000). Measurement of fidelity in psychiatric rehabilitation. Mental Health Services Research, 2, 75–87.

    PubMed  Article  CAS  Google Scholar 

  • Bond, G. R., & Moser, L. L. (2006). Final report for community action initiative to implement integrated dual disorders treatment: Phase II. Indianapolis: Indiana University Purdue University, Indianapolis.

  • Brunette, M., Drake, R. E., & Lynde, D. W. (Eds.). (2002). Integrated dual disorders treatment implementation resource kit. Rockville, MD: Center for Mental Health Services, Substance Abuse and Mental Health Services Administration.

    Google Scholar 

  • Casper, E. S., Oursler, J., Schmidt, L. T., & Gill, K. J. (2002). Measuring practitioners’ beliefs, goals, and practices in psychiatric rehabilitation. Psychiatric Rehabilitation Journal, 25(3), 223–234.

    PubMed  Google Scholar 

  • Casper, E. S., & Oursler, J. D. (2003). The Psychiatric Rehabilitation Beliefs, Goals, and Practices Scale: Sensitivity to change. Psychiatric Rehabilitation Journal, 26(3), 311–314.

    PubMed  Article  Google Scholar 

  • Chinman, M., Young, A. S., Rowe, M., Forquer, S., Knight, E., & Miller, A. (2003). An instrument to assess competencies of providers treating severe mental illness. Mental Health Services Research, 5(2), 97–108.

    PubMed  Article  Google Scholar 

  • Drake, R. E., Bond, G. R., & Rapp, C. (2006). Explaining the variance within supported employment programs: comment on “What predicts supported employment outcomes?” Community Mental Health Journal, 42(3), 315–318.

    PubMed  Article  Google Scholar 

  • Drake, R. E., Essock, S. M., Shaner, A., Carey, K. B., Minkoff, K., Kola, L., et al. (2001). Implementing dual diagnosis services for clients with severe mental illness. Psychiatric Services, 52, 469–476.

    PubMed  Article  CAS  Google Scholar 

  • Drake, R. E., & Goldman, H. H. (Eds.). (2003). Evidence-based practices in mental health care. Arlington, VA: American Psychiatric Association.

    Google Scholar 

  • Drake, R. E., Mercer-McFadden, C., Mueser, K. T., McHugo, G. J., & Bond, G. R. (1998). Review of integrated mental health and substance abuse treatment for patients with dual disorders. Schizophrenia Bulletin, 24(4), 589–608.

    PubMed  CAS  Google Scholar 

  • Drake, R. E., Mueser, K. T., Brunette, M. F., & McHugo, G. J. (2004). A review of treatments for people with severe mental illnesses and co-occurring substance use disorders. Psychiatric Rehabilitation Journal, 27, 360–374.

    PubMed  Article  Google Scholar 

  • Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231).

  • Gowdy, E. A., Carlson, L. S., & Rapp, C. A. (2003). Practices differentiating high-performing from low-performing supported employment programs. Psychiatric Rehabilitation Journal, 26, 232–239.

    PubMed  Article  Google Scholar 

  • Lehman, A. F., Kreyenbuhl, J., Buchanan, R. W., Dickerson, F. B., Dixon, L. B., Goldberg, R., et al. (2004). The Schizophrenia Patient Outcomes Research Team (PORT): Updated treatment recommendations 2003. Schizophrenia Bulletin, 30, 193–217.

    PubMed  Google Scholar 

  • Maslach, C. (1978). The client role in staff burn-out. Journal of Social Issues, 34, 111–124.

    Article  Google Scholar 

  • Maslach, C. (1993). Burnout: A multidimensional perspective. In W. B. Schaufeli, C. Maslach, & T. Marek (Eds.), Professional burnout: Recent developments in theory and research (pp. 19–32). Washington, DC: Taylor & Francis.

    Google Scholar 

  • Maslach, C., & Jackson, S. E. (1986). Maslach burnout inventory manual. Palo Alto, CA: Consulting Psychologist Press.

    Google Scholar 

  • McHugo, G. J., Drake, R. E., Whitley, R., Bond, G. R., Campbell, K., Rapp, C. A., et al. (2007). Fidelity outcomes in the National Evidence-Based Practices Project. Psychiatric Services, 58, 1279–1284.

    PubMed  Article  Google Scholar 

  • Mowbray, C. T., Holder, M., Teague, G. B., & Bybee, D. (2003). Fidelity criteria: Development, measurement, and validation. American Journal of Evaluation, 24, 315–340.

    Google Scholar 

  • Nunnelly, J. C., & Bernstein, I. H. (1994). Psychometric theory. New York: McGraw-Hill.

    Google Scholar 

  • Ortqvist, D., & Wincent, J. (2006). Prominent consequences of role stress: A meta-analytic review. International Journal of Stress Management, 13(4), 399–422.

    Article  Google Scholar 

  • Taormina, R. J., & Law, C. M. (2000). Approaches to preventing burnout: The effects of personal stress management and organizational socialization. Journal of Nursing Management, 8(2), 89–99.

    PubMed  Article  CAS  Google Scholar 

  • Teague, G. B., Bond, G. R., & Drake, R. E. (1998). Program fidelity in assertive community treatment: Development and use of a measure. American Journal of Orthopsychiatry, 68, 216–232.

    PubMed  Article  CAS  Google Scholar 

  • Torrey, W. C., Lynde, D. W., & Gorman, P. (2005). Promoting the implementation of practices that are supported by research: The National Implementing Evidence-Based Practice Project. Child and Adolescent Psychiatric Clinics of North America, 14, 297–306.

    PubMed  Article  Google Scholar 

  • Webster, L., & Hackett, R. K. (1999). Burnout and leadership in community mental health systems. Administration and Policy in Mental Health, 26(6), 387–399.

    PubMed  Article  CAS  Google Scholar 

  • Wieder, B. L., & Kruszynski, R. (2007). The salience of staffing in IDDT implementation: One agency’s experience. American Journal of Psychiatric Rehabilitation, 10(2), 103–112.

    Article  Google Scholar 

Download references

Acknowledgements

The study was funded in part by a Substance Abuse and Mental Health Services Administration (SAMHSA) Community Action Grant—Phase II (SM55976-01), entitled: Integrated Dual Disorders Treatment (IDDT) Community Action Grant (PI: Bond). We would like to thank the COE writing group for their helpful suggestions on this paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Michelle P. Salyers.

 

 

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Salyers, M.P., Rollins, A.L., Bond, G.R. et al. Development of a Scale to Assess Practitioner Knowledge in Providing Integrated Dual Disorders Treatment. Adm Policy Ment Health 34, 570–581 (2007). https://doi.org/10.1007/s10488-007-0140-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-007-0140-0

Keywords

  • Provider knowledge
  • Dual disorders treatment
  • Severe mental illness