Dual Diagnosis Capability in Mental Health and Addiction Treatment Services: An Assessment of Programs Across Multiple State Systems

  • Mark P. McGovern
  • Chantal Lambert-Harris
  • Heather J. Gotham
  • Ronald E. Claus
  • Haiyi Xie
Original Article

Abstract

Despite increased awareness of the benefits of integrated services for persons with co-occurring substance use and psychiatric disorders, estimates of the availability of integrated services vary widely. The present study utilized standardized measures of program capacity to address co-occurring disorders, the dual diagnosis capability in addiction treatment and dual diagnosis capability in mental health treatment indexes, and sampled 256 programs across the United States. Approximately 18 % of addiction treatment and 9 % of mental health programs met criteria for dual diagnosis capable services. This is the first report on public access to integrated services using objective measures.

Keywords

Behavioral health Co-occurring disorders Dual diagnosis Integrated treatment 

Among public health concerns, the disease burden associated with alcohol, illicit and prescription drug problems, as well as mental health disorders, such as depression, posttraumatic stress disorder and schizophrenia, is substantial (Kehoe et al. 2007; World Health Organization 2003, 2008, 2009). Although substance use and mental health disorders frequently co-occur within any one given individual, historically, the treatment delivery system has been bifurcated, attending to one or the other disorder as if unrelated (McGovern and McLellan 2008). For the past decade, considerable attention has been dedicated to improving policy and services to persons with co-occurring psychiatric and substance use disorders (Center for Substance Abuse Treatment (CSAT) 2005; New Freedom Commission on Mental Health 2003; Substance Abuse and Mental Health Services Administration 2002). Although public awareness has been raised, and systemic motivation enhanced, recent findings from a national study conducted by the Substance Abuse and Mental Health Services Administration (SAMHSA) suggest individuals with co-occurring substance use and psychiatric disorders continue to receive disparate care that targets either the psychiatric or substance use disorder (Substance Abuse and Mental Health Services Administration 2007, 2010). This remains the case despite the preponderance of evidence that suggests integrated treatments are associated with improved patient outcomes (Drake et al. 2001; Mangrum et al. 2006; McGovern and McLellan 2008; McGovern and Carroll 2003; O’Brien et al. 2004; Sacks et al. 2008; Stilen and Baehni 2002, 4th edition; Substance Abuse and Mental Health Services Administration 2003; Watkins et al. 2004).

The SAMHSA (2010) data were gathered via survey methods directly from individuals in the community, the majority of individuals with co-occurring mental health and substance use problems (55.8 %) had not received any treatment (Substance Abuse and Mental Health Services Administration 2010). In contrast, survey data obtained directly from treatment providers suggest that integrated treatment for co-occurring disorders is common, ranging from 47 to 84 % (Ducharme et al. 2006, 2007; Gil-Rivas and Grella 2005; Knudsen et al. 2004; McGovern et al. 2006, 2007; Mojtabai 2004; Timko et al. 2005). Most of these provider-report surveys have sampled traditional addiction treatment providers from public (3), private (3), both a public and private (1), or the U.S. Veterans Affairs (VA) (1). The Timko et al. (2005) survey of program managers in the VA system sampled psychiatric inpatient and residential programs (n = 298) as well as outpatient programs (n = 547). These data were compared with surveys from 114 VA substance abuse inpatient and residential and 176 outpatient programs (Timko et al. 2005).

Across all these community provider and VA program manager surveys, there lies an obvious contradiction with the SAMHSA report drawn from individuals in the community with co-occurring disorders.

What may account for this difference?

Recent research has examined the difference between self-assessment versus external assessment of program level integrated services capacity (Lee and Cameron 2009; McGovern et al. 2007). These findings are consistent with differences found in psychiatric evidence-based practice fidelity studies that have examined self-report versus independent objective ratings of adherence to the practice in question (Bond et al. 2000; Brunette et al. 2008). Both sets of research demonstrate a positive response bias associated with provider self-report about their own programs.

In the case of program level dual diagnosis capability, using the dual diagnosis capability in addiction treatment (DDCAT) index, Lee and Cameron (2009) found close to an average 2-point difference on a 5-point scale of ratings of capacity by program directors and independent evaluators across 13 programs in Australia. Also using the DDCAT, McGovern and Giard (2007) found that across 16 addiction treatment programs, 12 program leaders categorized their program as Dual Diagnosis Capable (DDC)(75 %) versus 25 % Addiction Only Services (AOS) on the DDCAT index. In contrast, objective evaluators rated only 4 of the programs as DDC (25 %) and 75 % as AOS. The findings from these two studies suggest that at least part of the explanation for the apparent disconnection between provider and prospective patient report about co-occurring services is related to the source of data (source variance). In addition, the variability in how providers are queried about services may likewise account for the discrepancy (method variance).

As noted previously, with the exception of the Timko et al. study of the VA systems, most existing data pertain to traditional community addiction treatment providers (Timko et al. 2005). Little information exists about the range of integrated services available to persons with co-occurring disorders in traditional public and/or private sector mental health service settings.

The present study utilizes two comparable objective measures designed to assess the dual diagnosis capability of addiction (DDCAT index) and mental health treatment programs (dual diagnosis capability in mental health treatment [DDCMHT] index)(Giard et al. 2011; Gotham et al. 2011). These measures are structured similarly, use the same rating scale and have the same number of items. The DDCAT and DDCMHT measures therefore afford the opportunity to address the following research questions:
  1. (1)

    Across a large sample of community addiction and mental health treatment programs, what is the variation in dual diagnosis services?

     
  2. (2)

    Is there a difference between the dual diagnosis capability of community addiction versus mental health programs?

     

Methods

Design

This study sampled addiction treatment programs and mental health programs using a cross-sectional design. The addiction treatment programs were assessed using the DDCAT index and the mental health treatment programs were assessed using the DDCMHT index.

Sample

Data were obtained from a total of 256 programs. One hundred and eighty addiction treatment programs were assessed across 11 states, and 76 mental health treatment programs were assessed across 8 states. The 8 states that provided mental health treatment program data also contributed addiction treatment program data. Mental health and addiction treatment programs were assessed by teams composed of state agency personnel, academic evaluators and/or technical assistance center staff members. Each state had a unique plan for selecting programs, varying from collected standardized DDCAT/DDCMHT assessments from volunteer programs, by releasing a Request For Proposals (RFP) or by selecting all programs within their state. Sixty-one percent of programs were urban focused, 18 % were large rural city/town focused, 13 % were small rural town focused, and 8 % were isolated small rural towns. Ninety-two percent of the programs assessed by the states were private, non-profits. Programs accepted payments from Medicaid (78 %), Medicare (70 %), Military (46 %), State (75 %), Individual (86 %), Other Public funds (81 %), and Other funds (57 %). Of the programs assessed, 69 % provided outpatient or intensive outpatient services, while the remaining 31 % provided residential or inpatient services. The states involved were members of a learning collaborative funded by The Robert Wood Johnson Foundation and SAMHSA designed to improve services for persons with co-occurring disorders by using common data collection protocol (DDCAT and DDCMHT measures). The learning collaborative was organized using methods similar to the Institute for Healthcare Improvement (IHI) model (Institute for Healthcare Improvement 2003), and as implemented in behavioral health quality improvement (Becker et al. 2011; Vannoy et al. 2011). The learning collaborative consisted of members of state or tribal systems of care who meet monthly via conference call. There were 3 in person meetings as well. The calls and in-person meetings afforded learning collaborative members the opportunity to share lessons learned, strategies for increasing co-occurring capability. Data sharing agreements were developed across a subsample of the 16 states in the learning collaborative that contributed to a combined dataset through Dartmouth.

Measures

DDCAT and DDCMHT

The DDCAT and DDCMHT indexes were used to assess dual diagnosis capability in community addiction treatment and community mental health treatment programs respectively. The DDCAT and DDCMHT ratings are derived from a site visit to a treatment program at which data are gathered via ethnographic observation, interview of staff and patients, and document review. Thirty-five benchmark items encompassing policy, practice and workforce factors are scored using a 5-point Likert type scale that ranges from 1—AOS or MHOS to 3—DDC to 5—DDE. Intermediate scores of 2 and 4 are used to reflect observations in between the 3 and 5 categories. Precise and objective scoring anchors have been developed (Giard et al. 2011; Gotham et al. 2011). Each measure consists of 7 dimensions: I. Program Structure, II. Program Milieu, III. Clinical Process: Assessment, IV. Clinical Process: Treatment, V. Continuity of Care, VI. Staffing, and VII. Training. Summary scores are derived on each of these dimensions. Based on the sum of the 35 items the program assessed can be categorized as AOS or MHOS, DDC or DDE. AOS/MHOS level of care is indicated when at least 80 % (28) of the items are rated at a “1”. To meet criterion for the DDC level, at least 80 % (28) of 35 benchmark items must be rated at a “3” (DDC) or higher level. To be categorized at the DDE level, at least 80 % (28) of the 35 benchmark items must be rated at a “5” (DDE). In addition, a DDCAT or DDCMHT Total Score can be computed.

The psychometric properties of the DDCAT and DDCMHT have been reported and its evidence-base for reliability and validity steadily accumulating (Gotham et al. 2004, 2008, 2009, 2010; Brown and Comaty 2007; McGovern et al. 2007; Claus 2010; McGovern and Giard 2007; Mangrum 2007).

Community Addiction and Mental Health Treatment Program Characteristics

Program descriptive characteristics were gathered from each program director by the DDCAT and DDCMHT assessment team. Most of these descriptors are based on items in the SAMHSA National Survey of Substance Abuse Treatment Services (N-SSATS) format. These characteristics include: (1) urban/rural (RUCAS; version 1.11) (Hart et al. 2005); (2) type of payments accepted by the agency; (3) primary focus of the agency (addiction treatment services, mental health services, mix of addiction treatment and mental health services, general health services, hospital); (4) agency type (private, public, non-profit, for-profit, government operated, Veterans Health Administration); (5) size of program (total admission in past year, highest number of clients served, average length of stay, typical planned length of stay, number of unduplicated clients); (6) level of care (addiction treatment: outpatient, intensive outpatient/partial hospitalization, residential, medically managed intensive inpatient/hospitalization; mental health treatment: outpatient, partial hospitalization, inpatient/hospitalization); and (7) any exclusive admission criteria (adolescent, co-occurring mental health and substance use disorders, HIV/AIDS, gay and lesbian, seniors, pregnant/postpartum women, women, residential setting for patients and their children, men, DUI/DWI, criminal justice clients, or general adult services).

Procedures

Addiction and mental health treatment programs were voluntary participants. Programs participated in either a DDCAT or DDCMHT assessment between 2004 and 2011. State agency staff or academic partners assessed programs based on representativeness, and interest in improving co-occurring capacity as a component of quality improvement efforts.

Once identified, a site visit was arranged. The assessment was conducted by a trained DDCAT or DDCMHT assessment team, typically consisting of two individuals. Training was consistent across all states contributing data to the study, and included a didactic session, shadowing and observing a trained DDCAT/DDCMHT evaluator conducting an assessment, and then being observed by an experienced assessor. Studies of both measures have found inter-rater reliability to be excellent (Brown and Comaty 2007; Gotham et al. 2004).

The site visit typically took place over the course of 1 day, during which, in adherence with DDCAT and DDCMHT protocol, agency leadership, clinical staff, support staff and patients are interviewed, an environmental and milieu scan conducted, and program documents, including medical records, reviewed. The evaluators provided the program with preliminary feedback at the end of the visit, and many programs used the data for quality improvement planning.

State agency level evaluators submitted the aggregate information on each program, de-identified, to the research team at Dartmouth. Data at the patient, staff member, and program levels were de-identified. The study has been reviewed and approved by the Committee for the Protection of Human Subjects, Trustees of Dartmouth College.

Data Analyses

Uni-variate analyses were used to calculate categorical data, program characteristics and dual diagnosis capability by category. Differences between program types on individual and overall dimension scores were examined using two-tailed t tests. Given the number of t test comparison there is increased risk for Type I error. To adjust for this possibility, post hoc Bonferroni corrections were conducted (Westfall et al. 2011). An acceptable significance level of differences between groups on the 35 benchmark items was set at p < .001 (.05/35) and for the seven dimensions was set at p < .007 (.05/7) to conservatively reject the null hypotheses. Using regression techniques, the State variable did not significantly account for the variance in overall DDCAT/DDCMHT Total Scores, so State was not selected for use as a covariate in subsequent comparison tests. Missing data was not included in the analysis. Data analysis was conducted using SPSS 17.0 (SPSS 2008).

Results

Program Characteristics

As shown in Table 1, the majority of the programs were private and outpatient/intensive outpatient levels of care. Based on number served the mental health programs were larger than the addiction treatment programs: 1127 patients (sd = 2572.9) versus 155 patients (sd = 504.7) (See Table 1).
Table 1

Program characteristics (n of programs = 256)

Program characteristics by treatment program type

 

Addiction treatment (n = 180)

Mental health treatment (n = 76)

Agency typea

N (%)

N (%)

 Private

131 (74.0)

39 (51.3)

 Public

35 (19.8)

23 (30.3)

 Non-profit

156 (87.6)

47 (61.8)

 Government operated

30 (16.9)

28 (36.8)

Level of care

 Outpatient/intensive outpatient

103 (57.2)

74 (97.4)

 Residential/inpatient

77 (42.7)

2 (2.6)

Size of program

M (sd)

M (sd)

 Admission (last fiscal year)

345.5 (375.7)

1232.6 (2294.7)

 Highest # of patients served

154.9 (504.7)

1127.3 (2572.9)

 Average LOS

136.3 (238.0)

433.5 (489.7)

 Typical Planned LOS

139.5 (218.7)

615.5 (441.4)

 # of unduplicated patients

399.9 (516.0)

1505.4 (1826.2)

aDue to overlap among categories counts do not add up to the total n

Range of Program Dual Diagnosis Capability by Category and Dimension Profiles

Eighty-one percent of the addiction treatment programs were at the Addiction Only Services (AOS) level of dual diagnosis capability (n = 146), eighteen percent were at the Dual Diagnosis Capable (DDC) level of dual diagnosis capability (n = 33), and 1 % were at the Dual Diagnosis Enhanced (DDE) level (n = 1). Among the mental health programs, 91 % (n = 69) were at the MHOS level of dual diagnosis capability, and 9 % (n = 7) scored at the DDC. None of the mental health programs met the DDE level of capability (See Table 2).
Table 2

Dual diagnosis capability of programs by DDCAT and DDCMHT category

Dual diagnosis capability by category

 

Addiction treatment (n = 180)

Mental health treatment (n = 76)

DDCAT/DDCMHT category

N (%)

N (%)

AOS/MHOS

146 (81.1)

69 (90.8)

DDC

33 (18.3)

7 (9.2)

DDE

1 (0.6)

0 (0.0)

As shown in Fig. 1, the DDCAT and DDCMHT dimension scores were similar across most domains. However, the mental health programs scored significantly lower on one dimension: VI. Staffing (M = 2.89 vs. M = 2.59; p < .007).
Fig. 1

Profile of dual diagnosis capability of programs by DDCAT and DDCMHT dimension and total score (N = 256)

Range of Program Dual Diagnosis Capability by Benchmark Items

Significant differences between addiction and mental health programs are found on benchmark items within the following dimensions: III. Clinical Process: Assessment; IV. Clinical Process: Treatment; V. Continuity of Care; and VI. Staffing. Within the Clinical Process: Assessment dimension the addiction treatment programs scored significantly higher on assessing for stage of motivation to address substance use and mental health concerns. In the Clinical Process: Treatment dimension, relative to the mental health programs, addiction treatment programs scored significantly higher on the benchmark item pertaining to stage-wise treatment: adjusting treatment approach based on patients’ stage of motivation (Table 3).
Table 3

Dual diagnosis capability of programs by dimension and benchmark items

 

Addiction treatment (n = 180)

Mental health treatment (n = 76)

t test

M (sd)

M (sd)

I. Program structure

 IA. Organizational identity and documented focus

2.78 (1.25)

2.83 (1.25)

−0.30

 IB. Program certification, licensure and/or accreditation

2.99 (1.30)

2.82 (1.40)

0.95

 IC. Relationship between mental health and addiction services

2.87 (1.04)

2.87 (1.04)

0.27

 ID. Financial and reimbursement provisions

2.61 (1.41)

2.82 (1.30)

1.11

 Dimension I Score

2.83 (1.01)

2.83 (0.97)

−0.03

II. Program milieu

 IIA. Cultural expectation of co-occurring disorders

3.51 (0.82)

3.49 (0.90)

0.16

 IIB. Evidence of materials promoting integrated services

2.09 (0.96)

2.29 (1.12)

−1.33

 Dimension II Score

2.80 (0.72)

2.89 (0.89)

−0.79

III. Clinical process: assessment

 IIIA. Routine screening methods

3.20 (1.01)

2.76 (1.03)

3.14

 IIIB. Integrated assessment

2.72 (0.99)

2.62 (0.89)

0.74

 IIIC. Both diagnoses made and documented

2.94 (1.19)

3.43 (1.14)

−3.06

 IIID. Chronology of both disorders examined

2.69 (0.81)

2.89 (0.81)

−1.86

 IIIE. Access to program based on symptom acuity

3.22 (0.79)

3.51 (0.84)

−2.57

 IIIF. Access to program based on overall severity and persistence

3.47 (0.94)

3.72 (0.92)

−2.01

 IIIG. Assessment of motivation for both disorders

2.13 (0.96)

1.54 (0.79)

4.72***

 Dimension III Score

2.91 (0.65)

2.93 (0.60)

−0.20

IV. Clinical process: treatment

 IVA. Integrated treatment/recovery plans

2.81 (1.03)

2.71 (1.02)

0.72

 IVB. Monitor interactive treatment response for both disorders

2.46 (0.96)

2.43 (1.00)

0.20

 IVC. Procedures for emergencies and crises

3.01 (1.03)

2.67 (1.14)

2.21

 IVD. Adjusting treatment based on stage of motivation

1.89 (0.90)

1.49 (0.84)

3.34***

 IVE. Policies/Procedures: medication evaluation and management

3.16 (1.07)

2.95 (1.28)

1.24

 IVF. Integrated psychosocial interventions

2.78 (0.98)

2.42 (1.09)

2.62

 IVG. Patient education about co-occurring disorders and treatment

2.41 (0.91)

2.41 (1.02)

0.03

 IVH. Family education and support

1.86 (0.87)

1.66 (0.72)

1.74

 IVI. Facilitation to community peer recovery support groups

2.39 (0.91)

2.09 (0.90)

2.42

 IVJ. Exposure to peer recovery support individuals

2.02 (1.16)

1.68 (0.82)

2.65

 Dimension IV Score

2.47 (0.61)

2.25 (0.64)

2.63

V. Continuity of care

 VA. Integrated discharge planning

3.02 (1.21)

2.28 (1.20)

4.51***

 VB. Capacity to maintain treatment continuity

2.48 (1.29)

2.41 (1.16)

0.41

 VC. Focus on recovery issues for both disorders

3.11 (1.10)

2.43 (1.07)

4.52***

 VD. Facilitation of peer-recovery support post-treatment

2.12 (0.95)

1.76 (0.83)

2.86

 VE. Sufficient supply and adherence plan for medications

2.73 (1.24)

3.03 (1.58)

−1.47

 Dimension V Score

2.69 (0.87)

2.38 (0.87)

2.61

VI. Staffing

 VIA. Psychiatric or other prescriber

3.02 (1.38)

3.46 (1.43)

−2.33

 VIB. Onsite staff with dual licensure

3.08 (1.32)

2.55 (1.16)

3.01

 VIC. Access to integrated supervision or consultation

3.30 (1.13)

2.57 (1.01)

4.87***

 VID. Case review, staffing, quality assurance for integrated treatment

2.90 (1.08)

2.79 (1.12)

0.74

 VIE. Access to peer support persons

2.16 (1.28)

1.58 (1.04)

3.79***

 Dimension VI Score

2.89 (0.82)

2.59 (0.75)

2.73**

VII. Training

 VIIA. Basic training on co-occurring disorders: All staff

2.42 (0.81)

2.63 (0.80)

−1.90

 VIIB. Advanced training on co-occurring disorders: Clinical staff

2.42 (1.20)

2.01 (1.08)

2.65

 Dimension VII Score

2.42 (0.84)

2.32 (0.79)

0.86

DDCAT OR DDCMHT TOTAL SCORE

2.71 (0.63)

2.60 (0.64)

1.33

** p ≤ .007; With Bonferroni correction applied to dimension scores, .05/7. *** p ≤ .001; With Bonferroni correction applied to benchmark items, .05/35

In the Continuity of Care dimension, addiction programs also scored significantly higher than mental health programs on: (1) discharge planning addressing both substance use and psychiatric problems; and, (2) a focus on recovery issues for both disorders. Finally, the addiction treatment programs scored higher than the mental health programs on two benchmark items in the Staffing dimension: (1) access to integrated supervision or consultation; and (2) access to peer recovery support person(s).

Discussion

Summary of Findings

Using the observational and objective methodology inherent in the DDCAT and DDCMHT, the majority of addiction and mental health treatment programs in this sample were operating at the Addiction Only or Mental Health Only services level. These findings are not congruent with previous estimates from community provider surveys about the co-occurring capability of their services. The results are more consistent with estimates that were obtained directly from potential consumers of services. Across this present sample, 18 % of addiction treatment programs and 9 % of mental health treatment programs were Dual Diagnosis Capable. This suggests that patients and families seeking care in these programs have a 1 in 10 to 2 in 10 chance of having both disorders addressed adequately. Despite the national and perhaps international call to action for integrated services (i.e. “no wrong door”), these data suggest that the opportunity for systemic improvement persists.

Examining the specific DDCAT and DDCMHT dimensions and benchmark items reveals several significant differences at the more molecular level. These differences are measured similarly but not identically by the two measures. For instance, admitting or deflecting patients based on symptom acuity pertains to psychiatric symptom acuity (e.g. active psychotic symptoms) on the DDCAT and substance use acuity (e.g. withdrawal or intoxication symptoms) on the DDCMHT. Nonetheless, the structure on meaning of the measures across settings is comparable. Using the Bonferroni correction approach, only one dimension score (Staffing) was found to be significantly different between groups (p < .007). Also using the Bonferroni correction, of the 35 benchmark items, 6 (17.1 %) were significant at the p < .001 level; all favored the addiction treatment programs in capability. On most items and all dimensions the addiction providers scored higher, with the exception of those related to physician or psychiatrist role and potentially related practices (diagnosis, access to medications).

Although there is no data about mental health treatment programs in the public or private system sector, given what has been reported by addiction treatment providers, we found the findings from the present study surprising. In part due to the size of the agencies, as well as the likely advanced education and training of clinical personnel, we expected mental health programs to be more dual diagnosis capable than addiction treatment programs. This was not the case. It is possible that the DDCAT and DDCMHT measures are too conservative or restrictive in classifying programs as DDC or especially DDE. It is also possible that the measures are positively biased towards addiction treatment providers, particularly since four items evaluate aspects of peer recovery support. Clearly there is more of an emphasis on peer recovery support groups, such as Alcoholics Anonymous, in traditional addiction treatment programs. The peer recovery support movement is more recent among those with mental health issues. Nonetheless, in both the DDCAT and DDCMHT, the yardstick is similar.

The findings may also point to each measure’s recovery value orientation. Peer recovery supports, stage-wise assessment and treatment, and ongoing chronic disease management approaches are in greater use by addiction providers, and more recently being adopted by mental health agencies.

The differential findings overall are similar to those reported by Timko et al. (2005) in the differences in integrated service components in VA psychiatric and substance abuse residential, inpatient and outpatient programs.

Although 18 % DDC in addiction programs is greater than 9 % in mental health programs, neither is close to the minimally adequate criteria of DDC as suggested by Minkoff and Cline (2004). Given the high rates of co-occurring psychiatric disorders among those in addiction treatment settings, as well as the high rates of active substance use disorders among those in traditional mental health programs, co-morbidity is the norm. DDC and integrated services should be in place to match the needs of patients already under care.

There are multiple potential benefits to a psychometrically supported and objective metric with which to evaluate services for dual diagnosis capability. The first is a data-based description of the disparity and variation in services across a given geographic territory: national, state, county or city. This information is useful for program planning, quality improvement, resource distribution and possibly differential reimbursement strategies. Second, having an objective indicator of capability provides a pragmatic opportunity to measurably improve policy, practice and workforce to address co-occurring disorders. In fact, both the DDCAT and DDCMHT indexes have been designed with this purpose in mind (McGovern et al. 2008). Data on quality improvement and significant enhancement of dual diagnosis capacity across mental health and addiction treatment programs has been reported (Gotham et al. 2010; McGovern et al. 2010). In a study of change in capability over time in the DDCAT and DDCMHT learning community, addiction treatment programs went from 11 % DDC capacity at baseline to 48 % capacity at 18 month follow-up DDCAT assessment. Likewise 3 % of mental health programs scored at the DDC level at baseline versus 38 % at follow-up (McGovern et al. 2010). These applications of the indexes suggest their utility to guide and measure improvement in co-occurring organizational capacity across systems with minimal to no additional resources. Finally, having an objective measure of the capability of services may be useful to potential patients and families seeking services. A categorization of programs as AOS or MHOS, DDC or DDE can assist consumers in making informed choices about where to obtain care.

Limitations

Although each state/academic partnership had similar training in administering and scoring the DDCAT and DDCMHT measures, each state from which programs were recruited undoubtedly had some sampling biases. These biases may have included volunteer or Hawthorne effects, pre-selecting programs that were innovative or early adopters of integrated treatments, or programs that were geographically accessible to evaluator offices, for example. Neither programs nor states that participated were systematically selected for range and representativeness. In essence, this is a convenience sample. The programs sampled represent a very small number of agencies relative to the population of behavioral health organizations across the United States and internationally. The generalizability of these findings can only be verified with study replication, particularly with a larger and more diverse sample of programs. For instance and in contrast, the SAMHSA data are drawn from a sample of over 13,000 addiction treatment agencies, and the National Treatment Center Study from over 750 addiction treatment programs (Ducharme et al. 2006, 2007). In the study of VA programs, Timko et al. (2005) surveyed 1135 mental health and substance abuse treatment programs in the VA. The present study sampled from a variety of states of different sizes and from different regions of the United States, most serving ethnically diverse clientele in the public and private not-for-profit sector, and with considerable urban/rural variation. The programs sampled within the states ranged in size, characteristics and focus. The sampling of addiction treatment programs matches the population of programs as cataloged in the SAMHSA Center for Substance Abuse Treatment directory. Unfortunately no similar catalogue of agencies exists from the SAMHSA Center for Mental Health Services.

Finally, some of the DDCAT and DDCMHT assessors were affiliated with the single state authorities who fund and regulate the programs sampled. This may have influenced the level of candor with which the programs presented themselves. To circumvent this effect, assessors were clear in communicating in advance of the visit that findings would not be utilized to determine funding, but would more so be used for quality improvement purposes. Emphasis was placed on the voluntary nature of participation. The findings of the proportion of AOS and MHOS programs support the likelihood that agencies were not pre-selected for co-occurring capacity and did not appear to misrepresent capacity in a favorable light. Additionally, by design, the observational methods of the measures serve to reduce the impact of any positive response bias.

This study did not directly compare integrated service capability perceptions of providers versus consumers of services. As observational measures, the DDCAT and DDCMHT capitalize on the experiences of both “players” in the organizations assessed. Although the findings suggest that the observational measure findings are closer to those in consumer interviews vs. provider surveys, the present study did not directly test this hypothesis.

Future Research

As suggested by the research limitations, future studies should consider a broader range of programs and more systematic sampling. Although the psychometric properties of the DDCAT and DDCMHT have been studied, including reliability and criterion-related validity, more research is necessary to link program level performance with services and patient level outcomes. There is an underlying assumption that programs that are more capable, as measured on the DDCAT and DDCMHT, they produce more favorable outcomes for the patients they serve with co-occurring disorders. Several studies have found that dual diagnosis capable programs admit and treat patients of more significant severity, but the link with patient outcomes (i.e. benefit from treatment) remains for study. Similar research is needed for fidelity to other evidence-based treatments, including Integrated Dual Disorders Treatment (Mueser et al. 2003).

Future research might also evaluate under what circumstances provider-patient discrepancies in integrated service capacity are most and least likely to occur, and likewise to develop methods to increase efficiency and reduce costs of independent objective assessments of services.

Implications for Behavioral Health

The pragmatic and measurable benchmarks of the DDCAT and DDCMHT can serve systems and treatment providers alike, first by determining co-occurring capacity at baseline, and second, by guiding and measuring evidence-based practice implementation initiatives. Community mental health and addiction treatment programs can use these policy, practice and workforce benchmarks to provide integrated care. Doing so will increase the chances that a person with a co-occurring substance use and psychiatric disorder will receive evidence-based treatment that are most effective.

The potential benefits of standardized observational level measures to evaluate true organizational capacity are underscored with this study’s findings. Although the use of self-report and provider surveys to assess capacity is economical and efficient, the dubious reliability and validity of these approaches merit significant caution.

Finally, despite nearly a two decade effort to integrate services and systems for persons with co-occurring disorders, these data reveal there is considerable room for improvement. The availability of practical and objective benchmark measures may serve to organize and guide the process beyond rhetoric and platitude.

Notes

Acknowledgments

This research was supported by The Robert Wood Johnson Foundation Substance Abuse Policy Research Program (#63110) and by the Substance Abuse and Mental Health Services Administration Co-Occurring Disorder Implementation and Innovation (#8732). The authors are grateful to the states, tribes and other organizations participating in the DDCAT/DDCMHT/DDCHCS Learning Collaborative, as well as the treatment providers and patients in the community programs. The data reported in this manuscript were presented at the annual meeting of the American Psychiatric Association, Philadelphia, PA, on May 7th, 2012.

References

  1. Becker, D. R., Drake, R. E., Bond, G. R., Nawaz, S., Haslett, W. R., & Martinez, R. A. (2011). A national mental health learning collaborative on supported employment. Psychiatric Services, 62, 704–706.PubMedCrossRefGoogle Scholar
  2. Bond, G. R., Evans, L., Salyers, M. P., Williams, J., & Kim, H. W. (2000). Measurement of fidelity in psychiatric rehabilitation. Mental Health Services Research, 2(2), 75–87.PubMedCrossRefGoogle Scholar
  3. Brown, J. L., & Comaty, J. (2007, October). Statewide utilization of the DDCAT: Reliability & Feasability. Paper presented at the Addiction Health Services Research Annual Meeting, Athens, GA.Google Scholar
  4. Brunette, M. F., Asher, D., Whitley, R., Lutz, W. J., Wieder, B. L., Jones, A. M., et al. (2008). Implementation of integrated dual disorders treatment: A qualitative analysis of facilitators and barriers. Psychiatric Services, 59(9), 989–995. doi:10.1176/appi.ps.59.9.989.PubMedCrossRefGoogle Scholar
  5. Center for Substance Abuse Treatment (CSAT). (2005). Substance abuse treatment for persons with co-occurring disorders, treatment improvement protocol (TIP) series 42. (DHHS publication No. SMA-05-3992). Substance Abuse and Mental Health Services Administration, Rockville, MD.Google Scholar
  6. Claus, R. (2010, June). The DDCAT and DDCMHT: Building a framework to guide co-occurring implementation. Paper presented at the 6th National COSIG Grantee Meeting, Bethesda, MD.Google Scholar
  7. Drake, R. E., Essock, S. M., Shaner, A., Carey, K. B., Minkoff, K., Kola, L., et al. (2001). Implementing dual diagnosis services for clients with severe mental illness. Psychiatric Services, 52(4), 469–476. doi:10.1176/appi.ps.52.4.469.PubMedCrossRefGoogle Scholar
  8. Ducharme, L., Knudsen, H., & Roman, P. (2006). Availability of integrated care for co-occurring substance abuse and psychiatric conditions. Community Mental Health Journal, 42(4), 363–375.PubMedCrossRefGoogle Scholar
  9. Ducharme, L., Mello, H., Roman, P., Knudsen, H., & Johnson, J. (2007). Service delivery in substance abuse treatment: Reexamining comprehensive care. The Journal of Behavioral Health Services & Research, 34(2), 121–136.CrossRefGoogle Scholar
  10. Giard, J., Kincaid, R., Gotham, H. J., Claus, R., Lambert-Harris, C., McGovern, M. P., … Brown, J. L. (2011). The dual diagnosis capability in addiction treatment (DDCAT) toolkit. Retrieved December 21, 2011, from http://www.samhsa.gov/co-occurring/ddcat/.
  11. Gil-Rivas, V., & Grella, C. E. (2005). Addictions services treatment services and service delivery models for dually diagnosed clients: Variations across mental health and substance abuse providers. Community Mental Health Journal, 41(3), 251–266.PubMedCrossRefGoogle Scholar
  12. Gotham, H. J., Brown, J. L., Comaty, J., & McGovern, M. P. (2008). The dual diagnosis capability in mental health treatment (DDCMHT) index version 3.2. Kansas City, MO: Mid-American Addiction Technology Transfer Center.Google Scholar
  13. Gotham, H. J., Brown, J. L., Comaty, J. E., McGovern, M. P., & Claus, R. E. (2009, October). The dual diagnosis capability in mental health treatment (DDCMHT) index. Paper presented at Addiction Health Services Research Annual Meeting, San Francisco, CA.Google Scholar
  14. Gotham, H. J., Claus, R., Giard, J., Kincaid, R., Lambert-Harris, C., McGovern, M. P., … Brown, J. L. (2011). The dual diagnosis capability in mental health treatment (DDCMHT) toolkit. Retrieved December 21, 2011, from http://www.samhsa.gov/co-occurring/ddcmht/.
  15. Gotham, H. J., Claus, R. E., Selig, K., & Homer, A. L. (2010). Increasing program capability to provide treatment for co-occurring substance use and mental disorders: Organizational characteristics. Journal of Substance Abuse Treatment, 38(2), 160–169. doi:10.1016/j.jsat.2009.07.005.PubMedCrossRefGoogle Scholar
  16. Gotham, H., Haden, A., & Owens, C. (2004, July). Report on the 2004 annual visits to COSIG sites. Missouri institute of mental health. Presented to the Governor’s steering committee on co-occurring mental illness and substance use disorders, MO.Google Scholar
  17. Hart, L. G., Larson, E. H., & Lishner, D. M. (2005). Rural definitions for health policy and research. American Journal of Public Health, 95(7), 1149–1155. doi:10.2105/AJPH.2004.042432.PubMedCrossRefGoogle Scholar
  18. SPSS, Inc. (2008). SPSS 17.0 for Windows. Chicago, IL.Google Scholar
  19. Institute for Healthcare Improvement. (2003). The breakthrough series: IHI’s collaborative model for achieving breakthrough improvement. Cambridge, MA: Institute for Healthcare Improvement.Google Scholar
  20. Kehoe, T., Rehm, J., & Chatterji, S. (2007). Global burden of alcohol use disorders in year 2004. Report prepared for World Health Organization. Zurich: World Health Organization.Google Scholar
  21. Knudsen, H. K., Roman, P. M., & Ducharme, L. J. (2004). The availability of psychiatric programs in private substance abuse treatment centers, 1995 to 2001. Psychiatric Services, 55(3), 270–273. doi:10.1176/appi.ps.55.3.270.PubMedCrossRefGoogle Scholar
  22. Lee, N., & Cameron, J. (2009). Differences in self and independent ratings on an organisational dual diagnosis capacity measure. Drug and Alcohol Review, 28(6), 682–684.PubMedCrossRefGoogle Scholar
  23. Mangrum, L. (2007, October). Dual diagnosis capability in addiction treatment: A comparison of client characteristics and treatment outcomes. Paper presented at the Addiction Health Services Research Annual Meeting, Athens, GA.Google Scholar
  24. Mangrum, L. F., Spence, R. T., & Lopez, M. (2006). Integrated versus parallel treatment of co-occurring psychiatric and substance use disorders. Journal of Substance Abuse Treatment, 30(1), 79–84.PubMedCrossRefGoogle Scholar
  25. McGovern, M. P., & Carroll, K. M. (2003). Evidence-based practices for substance use disorders. Psychiatric Clinics of North America. Special Issue: Evidence-Based Practices in Mental Health Care, 26(4), 991–1010. doi:10.1016/S0193-953X(03)00073-X.
  26. McGovern, M. P., Drake, R. E., Merrens, M., Mueser, K. T., & Brunette, M. F. (2008). Clinical administrator’s guidebook: Integrated services for substance use and mental health disorders. Center City, MN: Hazelden Foundation.Google Scholar
  27. McGovern, M. P., & Giard, J. (2007, October). Services research on co-occurring disorders: Applications of the dual diagnosis capability in addiction treatment (DDCAT) index. Paper presented at the Addiction Health Services Research Annual Meeting, Athens, GA.Google Scholar
  28. McGovern, M. P., Lambert-Harris, C., McHugo, G. J., Giard, J., & Mangrum, L. (2010). Improving the dual diagnosis capability of addiction and mental health treatment services: Implementation factors associated with program level changes. Journal of Dual Diagnosis, 6, 237–250.CrossRefGoogle Scholar
  29. McGovern, M. P., Matzkin, A. L., & Giard, J. (2007a). Assessing the dual diagnosis capability of addiction treatment services: The dual diagnosis capability in addiction treatment (DDCAT) index. Journal of Dual Diagnosis, 3, 111–123.CrossRefGoogle Scholar
  30. McGovern, M. P., & McLellan, A. T. (2008). The status of addiction treatment research with co-occurring substance use and psychiatric disorders. Journal of Substance Abuse Treatment, 34(1), 1–2. doi:10.1016/j.jsat.2007.03.007.PubMedCrossRefGoogle Scholar
  31. McGovern, M. P., Xie, H., Acquilano, S., Segal, S. R., Siembab, L., & Drake, R. E. (2007b). Addiction treatment services and co-occurring disorders: The ASAM-PPC-2R taxonomy of program dual diagnosis capability. Journal of Addictive Diseases, 26(3), 27–37.PubMedCrossRefGoogle Scholar
  32. McGovern, M. P., Xie, H., Segal, S. R., Siembab, L., & Drake, R. E. (2006). Addiction treatment services and co-occurring disorders: Prevalence estimates, treatment practices, and barriers. Journal of Substance Abuse Treatment, 31(3), 267–275.PubMedCrossRefGoogle Scholar
  33. Minkoff, K., & Cline, C. A. (2004). Changing the world: The design and implementation of comprehensive continuous integrated systems of care for individuals with co-occurring disorders. Psychiatric Clinics of North America, 27(4), 727–743.PubMedCrossRefGoogle Scholar
  34. Mojtabai, R. (2004). Which substance abuse treatment facilities offer dual diagnosis programs? American Journal of Drug and Alcohol Abuse, 30(3), 525–536. doi:10.1081/ADA-200032281.PubMedCrossRefGoogle Scholar
  35. Mueser, K. T., Noordsy, D. L., Drake, R. E., Fox, L., & Barlow, D. H. (2003). Integrated treatment for dual disorders: A guide to effective practice. New York, NY, US: Guilford Press.Google Scholar
  36. New Freedom Commission on Mental Health. (2003). Achieving the promise: Transforming mental health care in America. (DHHS publication No. SMA-03-3832). Rockville, MD.Google Scholar
  37. O’Brien, C. P., Charney, D. S., Lewis, L., Cornish, J. W., Post, R. M., Woody, G. E., et al. (2004). Priority actions to improve the care of persons with co-occurring substance abuse and other mental disorders: A call to action. Biological Psychiatry, 56(10), 703–713.PubMedCrossRefGoogle Scholar
  38. Sacks, S., Chandler, R., & Gonzales, J. (2008). Responding to the challenge of co-occurring disorders: Suggestions for future research. Journal of Substance Abuse Treatment, 34(1), 139–146.PubMedCentralPubMedCrossRefGoogle Scholar
  39. Stilen, P., & Baehni, S. A. (2002, 4th edition). Collaborative response: Addressing the needs of consumers with co-occurring substance use and mental health disorders. Kansas City, MO: Mid-America Addiction Technology Transfer Center.Google Scholar
  40. Substance Abuse and Mental Health Services Administration. (2002). Report to congress on the prevention and treatment of co-occurring substance abuse disorders and mental disorders. (November edition). Rockville, MD: SAMHSA, U.S. Department of Health and Human Services.Google Scholar
  41. Substance Abuse and Mental Health Services Administration. (2003). Strategies for developing treatment programs for people with co-occurring substance abuse and mental disorders. (No. 3782). Rockville, MD: SAMHSA, U.S. Department of Health and Human Services.Google Scholar
  42. Substance Abuse and Mental Health Services Administration. (2007). Results from the 2006 National survey on drug use and health: National findings. (NSDUH Series, H-32, HHS Publication No. SMA-07-4293). Rockville, MD: Office of Applied Studies.Google Scholar
  43. Substance Abuse and Mental Health Services Administration. (2010). Results from the 2009 National survey on drug use and health: Mental health findings. Rockville, MD: Center for Behavioral Health Statistics and Quality.Google Scholar
  44. Timko, C., Dixon, K., & Moos, R. (2005). Treatment for dual diagnosis patients in the psychiatric and substance abuse systems. Mental Health Services Research, 7(4), 229–242.PubMedCrossRefGoogle Scholar
  45. Vannoy, S. D., Mauer, B., Kern, J., Girn, K., Ingoglia, C., Campbell, J., et al. (2011). A learning collaborative of CMHCs and CHCs to support integration of behavioral health, and general medical care. Psychiatric Services, 62, 753–758.PubMedCrossRefGoogle Scholar
  46. Watkins, K. E., Hunter, S. B., Wenzel, S. L., Tu, W., Paddock, S. M., Griffin, A., et al. (2004). Prevalence and characteristics of clients with co-occurring disorders in outpatient substance abuse treatment. American Journal of Drug and Alcohol Abuse, 30(4), 749–764. doi:10.1081/ADA-200037538.PubMedCrossRefGoogle Scholar
  47. Westfall, P. H., Tobias, R. D., & Wolfinger, R. D. (2011). Multiple comparisons and multiple tests using SAS. Gary, NC: SAS Publishing, SAS Institute Inc.Google Scholar
  48. World Health Organization. (2003). Investing in mental health. Geneva: World Health Organization.Google Scholar
  49. World Health Organization. (2008). The global burden of disease: 2004 update. Geneva: World Health Organization.Google Scholar
  50. World Health Organization. (2009). Global health risks mortality and burden of disease attributable to selected major risks. Geneva: World Health Organization.Google Scholar

Copyright information

© Springer Science+Business Media New York 2012

Authors and Affiliations

  • Mark P. McGovern
    • 1
    • 4
  • Chantal Lambert-Harris
    • 1
  • Heather J. Gotham
    • 2
  • Ronald E. Claus
    • 3
  • Haiyi Xie
    • 4
  1. 1.Department of PsychiatryGeisel School of Medicine at DartmouthLebanonUSA
  2. 2.Associate Research ProfessorUniversity of MissouriKansas CityUSA
  3. 3.Westat, IncRockvilleUSA
  4. 4.Community & Family MedicineGeisel School of Medicine at DartmouthLebanonUSA

Personalised recommendations