Abstract
We used the World Health Organization’s Composite International Diagnostic Interview to determine the prevalence, comorbidity, and correlates of lifetime and 12-month behavioral health disorders in a multisite cohort of 1027 women living with HIV in the United States. Most (82.6%) had one or more lifetime disorders including 34.2% with mood disorders, 61.6% with anxiety disorders, and 58.3% with substance use disorders. Over half (53.9%) had at least one 12-month disorder, including 22.1% with mood disorders, 45.4% with anxiety disorders, and 11.1% with substance use disorders. Behavioral health disorder onset preceded HIV diagnosis by an average of 19 years. In multivariable models, likelihood of disorders was associated with women’s race/ethnicity, employment status, and income. Women with 12-month behavioral health disorders were significantly more likely than their counterparts to engage in subsequent sexual and substance use HIV risk behaviors. We discuss the complex physical and behavioral health needs of women living with HIV.
Resumen
Utilizamos la Entrevista Diagnóstica Internacional Compuesta de la Organización Mundial de la Salud para determinar la prevalencia, la comorbilidad y los correlatos de trastornos de salud conductual de la vida y de 12 meses en una cohorte multisitio de 1.027 mujeres que viven con VIH en los Estados Unidos. La mayoría (82.6%) tuvo uno o más trastornos en su vida, incluyendo 34.2% con trastornos del estado de ánimo, 61.6% con trastornos de ansiedad y 58.3% con trastornos por el uso de las sustancias. Más de la mitad (53.9%) tuvo al menos un trastorno en los últimos 12 meses, incluyendo 22.1% con trastornos del estado de ánimo, 45.4% con trastornos de ansiedad y 11.1% con trastornos por el uso de las sustancias. El inicio del trastorno de salud conductual precedió el diagnóstico de VIH en un promedio de 19 años. En modelos multivariables, la probabilidad de trastornos se asoció con la raza/etnia de las mujeres, el estado de empleo y los ingresos. Las mujeres con trastornos de salud conductual de 12 meses fueron considerablemente más probable que sus homólogas a participar en comportamientos de riesgo de VIH como el uso de las sustancias y conductas sexuales de riesgo. Discutimos las necesidades complejas de salud física y conductual de las mujeres que viven con el VIH.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
In the US, the prevalence of psychiatric disorders and substance use disorders among people living with HIV is thought to be high [1,2,3]. However, estimates typically are derived from small, non-representative samples because population-based studies are rare, and most research uses screening rather than full diagnostic assessment. Moreover, prior research has addressed a limited range of specific disorders or diagnostic groupings, with few reports on a comprehensive array of psychiatric disorders and substance use disorders. The purpose of this study was to determine the prevalence, comorbidity and correlates of a full range of behavioral health disorders in a longitudinal multisite cohort of women living with HIV participating in the Women’s Interagency HIV Study or WIHS.
To date, the sole nationally representative study of behavioral health disorders among HIV-positive US adults is the 1996–1997 HIV Cost and Services Utilization Study (HCSUS) [4]. Using the Composite International Diagnostic Interview (CIDI) Short Form, HCSUS participants were screened for major depression, dysthymia, generalized anxiety disorder, and panic disorders in the past year [5]. Close to half screened positive for one or more of these psychiatric disorders (47.9% of the weighted sample). The full CIDI diagnostic interview was administered separately to a subsample of the original cohort, and results were used to refine prevalence estimates [6] resulting in a 32.8% prevalence of any 12-month psychiatric disorder: 22.0% for major depression; 5.0% for dysthymia; 4.1% for generalized anxiety disorder; and 15.5% for panic disorder. While lower than those obtained by screening, these estimates were considerably higher than those found in a survey of the general population which used the full CIDI and found prevalence rates of 26.2% for any psychiatric disorder, 6.7% for major depression, 1.5% dysthymia, 3.1% generalized anxiety disorder, and 2.7% panic disorder [7, 8].
Clinical studies of smaller, non-representative samples report the prevalence for any current psychiatric disorder of 33–63% among HIV-positive adults [9,10,11,12,13]. Research on depressive disorders finds prevalence estimates ranging from 10 to 20% [11, 14]. Anxiety disorders also are prevalent, with estimates ranging from 5 to 15%, with the most common being generalized anxiety disorder and social anxiety disorder [9, 14, 15].
Information about the prevalence of substance use disorders among HIV-positive individuals is also lacking [1,2,3]. In the HCSUS CIDI-Short Form screening study, 50.1% of participants reported illicit drug use in the past year and 12% met criteria for drug dependence [5]. Close to a fifth (18.5%) met criteria for alcohol use disorders [4].
High rates of co-occurring psychiatric disorders and substance use disorders are reported among people living with HIV [10, 16, 17]. In the HCSUS, the 12-month prevalence of co-occurring disorders was 10% [18, 19]. Also in the HCSUS, multivariable analysis revealed that the presence of any psychiatric disorder was significantly associated with drug dependence, and vice versa [5]. However, there is very little information on co-occurrence of substance use disorders with specific psychiatric syndromes, which inhibits our understanding of how these conditions interact, and their impact on HIV transmission behaviors and outcomes [20].
Turning next to HIV-positive women, a longitudinal multisite study of 1223 HIV-infected birth mothers found that 32% screened positive for psychiatric disorder, 9% for substance use disorder, and 35% for psychiatric disorder and/or substance use disorder [21]. Another study examined electronic medical records of HIV-positive patients in California, including 738 women, in which psychiatric disorder and substance use disorder diagnoses were based on clinician judgment and patient self-report [22]. In this study, 50% of female patients had a documented psychiatric disorder, including 25% with a mood disorder, 16% with an anxiety disorder and 12% with a substance use disorder. Among 1710 participants in the longitudinal multisite HIV-positive WIHS cohort, 55% met criteria for probable depression [23] and they also reported high rates of alcohol [24] and substance use [25]. These comorbidities often occur in a context of poverty, trauma, housing instability, caregiving demands, racial/ethnic discrimination, and multiple health needs [26,27,28].
A number of studies have documented associations between behavioral health disorders and engaging in HIV transmission behaviors [29, 30]. These include sexual risk behaviors such as unprotected sex [31], having multiple sex partners [32], and receptive anal intercourse [33]. Also included are drug-related risk behaviors such as sharing needles [34], and exchanging sex for drugs, money or other material items [34, 35]. An even greater likelihood of HIV risk behaviors has been observed among people with co-occurring substance use disorders and psychiatric disorders [36,37,38], including major depressive disorder [39] and post-traumatic stress disorder [40]. Moreover, while awareness of one’s HIV positive serostatus appears to decrease the likelihood of engaging in risk behaviors [41] even among those with psychiatric and/or substance use disorders [42], a noteworthy proportion of individuals living with HIV continue to engage in high-risk sex and drug use behaviors [43], creating opportunities for viral transmission to uninfected individuals [44].
Given the foregoing research findings and the remaining gaps in our knowledge, the present study addressed three major research questions. First, what are the lifetime and 12-month prevalence and severity of a full range of DSM-IV disorders in a multisite study cohort of women living with HIV, and what syndromes are most frequently comorbid? Second, what are the individual correlates associated with psychiatric disorders and substance use disorders among these women? And third, are specific behavioral health disorders, including co-occurring conditions, associated with a greater likelihood of engaging in HIV risk behaviors, controlling for confounding factors?
Methods
Study Participants
The WIHS is a multisite cohort study of women living with or at risk of acquiring HIV infection recruited in the mid-1990s at six US sites: Brooklyn, Bronx, Chicago, Los Angeles, San Francisco/Bay Area, and Washington, DC. Details of the WIHS cohort and study design can be found in prior publications [45, 46].
For this nested study, inclusion criteria were being an active HIV-positive WIHS participant, able to understand spoken English, and capable of completing an in-person assessment. From 2010 through 2013, 1213 English-speaking women were approached and 1033 consented to participate (85.2%), providing written informed consent using procedures approved by the University of Illinois at Chicago (UIC) Institutional Review Board (IRB), and the IRBs at each study site. Data for this analysis include 1027 women, representing 74.2% of the 1385 who were active as of 2010. The remaining 358 women were not included for the following reasons: unfinished interviews (n = 6); active refusals (n = 60); passive refusals whom we were unable to locate or schedule (n = 126); and exclusively Spanish-language speakers (n = 166). Comparisons between the 1027 study participants and the remaining 358 found no significant differences in age, education, income, marital status, CD4 + cell count, HIV-1 viral load, or use of combination antiretroviral therapy (cART). However, compared to the remaining 358 non-participants, a larger proportion of study completers were African American (78.4% vs. 64.4% of non-completers, Chi square = 13.91, p < 0.001), and not employed (68.2% vs. 55.5% of non-completers, Chi square = 11.71, p = 0.001). At all but one site, response rates ranged from 71 to 89%, with the remaining site (Los Angeles) having a low response rate of 40% due to the high concentration of Spanish-only speakers.
Measures
WIHS research interviewers from each site completed 3 days of training on the use of the World Health Organization CIDI 3.0 Auto Version, a comprehensive, fully standardized battery that assessed disorders according to the criteria of the DSM-IV, hereafter referred to as the WMH-CIDI [47]. Training was provided by either the University of Michigan’s WHO-designated WMH-CIDI training center or by WHO-trained UIC research staff. Interviews were administered via laptop software programmed with skip patterns, error screening, and consistency checks. A randomly selected 5% of respondents were contacted via telephone by the UIC study manager following the interview, to verify interview process and completion.
Participant age, race/ethnicity, education, employment, income, marital status, study site, and CD4+ cell count were ascertained from the WIHS semiannual study visit closest to the WMH-CIDI assessment. Participant risk behaviors were assessed at up to 6 semiannual visits following the WMH-CIDI assessment. HIV sexual risk behavior was defined as exchanging sex for money/drugs/shelter, multiple current male partners, or receptive anal sex; and substance use risk behavior was defined as use of any illicit drug or high risk drinking defined as consumption of > 7 standard alcoholic drinks per week in accordance with the National Institute on Alcohol Abuse and Alcoholism [48].
Statistical Analysis
Frequency distributions and cross-tabulations were used to calculate prevalence, severity, and comorbidity of behavioral health diagnoses in the WIHS cohort and the 2003 National Comorbidity Survey Replication (NCS-R) women’s cohort. Prevalence and standard errors in the NCS-R data were calculated using the study documentation manual’s survey strata, clusters, and weights [49]. Adjusted logistic regression analysis examined associations between participant characteristics and behavioral health disorders. Random effects logistic regression models (RRM) analyzed the prospective relationships between 12-month diagnoses and HIV sexual and substance use risk behaviors. Analyses were conducted in IBM SPSS Statistics 23 and SAS 9.4.
Results
Lifetime DSM-IV Disorders and Age of Onset
Characteristics of the study participants are shown in Table 1. Table 2 presents the lifetime prevalence of DSM-IV disorders in our study population and compares it to that of the US adult women’s general household population in the NCS-R. As shown at the bottom of column 1, the majority of our study population (82.6%) reported a lifetime DSM-IV disorder versus just under half of the general US women’s population (45.7%) shown in column 2. Prevalence of lifetime mood disorders in the study population was considerably higher than that of the general population (34.2% vs 23.7%) as were anxiety disorders (61.6% vs 37.0%), and substance use disorders, which were 6 times more likely in the study group versus the general population (58.3% vs 8.8%). The most common specific lifetime disorders were drug abuse (49.4%), major depressive disorder (32.4%), and posttraumatic stress disorder (PTSD) (29.8%).
The average age of onset for different DSM-IV disorders is presented in column 3 of Table 2. The vast majority of mood disorders, anxiety disorders, and substance use disorders had an average age of onset in the early- to mid-20s. The exceptions to this are earlier onset for several anxiety disorders including specific phobia (9.5 years of age), social phobia (13.6 years), and agoraphobia (16.8 years). Also, by definition, childhood separation anxiety disorder has an average age of onset in childhood, at 8.4 years.
The average age of HIV diagnosis for those with particular disorders is presented in column 4. Regardless of type of psychiatric disorder or substance use disorder, the average age at HIV diagnosis was in the early 30s, with the average age being earliest for those with panic disorder (31.7 years), obsessive–compulsive disorder (OCD) (31.7 years), and adult separation anxiety disorder (31.4 years), and latest for social phobia (33.3 years), generalized anxiety disorder (33.1), and all of the substance use disorders (all > 33.3 years of age).
For the large majority of participants (95.5%) DSM-IV disorder onset preceded HIV diagnosis, and column 5 presents the average number of years between disorder onset and HIV diagnosis for this group. On average, mood disorder onset was 15.83 years prior to HIV diagnosis; anxiety disorder onset was 22.11 years prior to HIV diagnosis; and substance use disorder onset pre-dated HIV diagnosis by 14.03 years. Among the minority of women (4.5%) whose HIV diagnosis predated their DSM-IV disorder onset, as shown in column 6, onset for mood disorders was an average of 8.68 years after HIV diagnosis; onset for anxiety disorders was 9.47 years after HIV diagnosis; and onset of substance use disorders occurred earliest, an average of 6.80 years after HIV diagnosis.
12-Month DSM-IV Disorders and Severity
Turning next to 12-month DSM-IV disorders, Table 3 presents their prevalence and severity in the WIHS cohort and corresponding information regarding the US women’s general household population in the NCS-R. Mood disorder prevalence in the WIHS cohort was 22.1% compared to 10.8% in the general women’s population. Anxiety disorder prevalence was 45.4% in the WIHS compared to 23.2% in the general population, substance use disorders were 5 times as prevalent in the WIHS compared to the general women’s population (11.1% vs. 2.2%). The most common mood disorder was major depressive disorder (20.0%). The most common anxiety disorders were specific phobias (22.1%), PTSD (16.6%), and social phobia (13.9%). Among substance use disorders, drug abuse with or without dependence (5.0%) was more common than alcohol abuse with or without dependence (2.5%). Specific disorders with noticeably higher prevalence (i.e., 3 or more times) among women living with HIV than the general women’s population were dysthymia, bipolar disorders, agoraphobia, OCD, PTSD, and drug abuse.
Among women with 12-month disorders (bottom row of Table 3 columns 3–5), over half (57.6%) had at least one classified as serious, 17.2% as moderate, and 25.1% as mild in terms of highest severity level. Mood disorders had the highest percentage of serious classifications (81.1% of women with any mood disorder had at least one serious mood disorder), followed by anxiety disorders (51.1%), and substance use disorders (47.4%). Again in column 3, the specific mood disorder with the highest percentage of serious classifications was dysthymia (88.2%); the specific anxiety disorder with the highest percentage of serious classifications was panic disorder (73.3%); and the substance use disorder with the highest percentage of serious classifications was alcohol abuse (68.0%).
Regarding number of 12-month disorders (Table 3), over two-fifths (22.6%) of WIHS study participants had three or more disorders, compared to only 6.6% in the general women’s population; 11.1% of WIHS participants had 2 disorders, compared to 6.1% in the general population, and 20.2% had one disorder compared to 15.1% in the general population. In addition, as shown in the 3rd column, there was a positive relationship between severity and multiple disorders. Here, among women with three or more disorders, 84.9% had at least one disorder classified as serious on the severity scale, 58.8% of women with two disorders had at least one serious disorder, and 26.4% of women with only 1 disorder had a serious disorder.
Comorbidity of Lifetime and 12-Month Disorders
Comorbid disorders were common (not shown) for both lifetime and 12-month disorders. Lifetime mood disorders had the highest rate of comorbidity. Here, the large majority of women (87.2%) with a lifetime mood disorder also had a lifetime anxiety disorder, and over two-thirds (68.4%) of those with a lifetime mood disorder also had a lifetime substance use disorder. In contrast, less than half of women with lifetime anxiety disorders or substance use disorders had co-occurring lifetime mood disorders (48.3% and 40.1% respectively). In addition, lifetime anxiety disorders and substance use disorders were often comorbid, with 65.9% and 69.6% of each comorbid with the other, respectively. Similarly, 12-month mood disorders had the highest rate of comorbidity. Here, 79.7% of those with 12-month mood disorders also had 12-month anxiety disorders. However, 12-month mood disorders were less frequently comorbid with 12-month substance use disorders (20.3%) given the relatively low prevalence of 12-month substance use disorders. Similar to lifetime rates, 38.8% of those with 12-month anxiety disorders also had co-occurring 12-month mood disorders, and 40.4% of those with 12-month substance use disorders also had 12-month mood disorders. The frequent co-occurrence of 12-month anxiety disorders and substance use disorders also was observed, since 61.4% of those with 12-month substance use disorders had comorbid 12-month anxiety disorders.
Individual Correlates of Lifetime and 12-Month Disorders
In multivariable logistic regression analysis (Table 4) with all individual characteristics entered (age, race/ethnic group, education, employment, income, marital/cohabiting status, CD4+ cell count) and controlling for study site, lifetime mood disorder was less likely among women who were working than not working [odds ratio (95% confidence interval) OR 0.7 (0.5–1.0)]. Lifetime anxiety disorder also was less likely among women who were working than not working [OR 0.6 (0.4–0.8)], and more likely among women with CD4 cell counts higher than 200 [OR 1.5 (1.0–2.3)]. Lifetime substance use disorder was significantly more likely among women 40 years or older compared to those under age 40 [age 40–49 years OR 2.2 (1.5–3.3); age 50–59 OR 4.1 (2.6–6.3); age 60 + OR 2.0 (1.1–3.7)]. Lifetime substance use disorder was less likely among Hispanic women [OR 0.4 (0.4–0.7)] and women in Other race/ethnic groups than White women [OR 0.4 (0.2–0.9)]; less likely among women with highest levels of education compared to those with the least education [16 + years OR 0.4 (0.2–0.8)]; less likely among women who were working compared to those not working [OR 0.7 (0.5–0.9)]; and less likely among women with higher income > = $12,000 than lower income [OR 0.7 (0.5–0.9)].
Also in Table 4, 12-month mood disorder was less likely among Black women [OR 0.5 (0.3-0.9)] and Hispanic/Latina women [OR 0.5 (0.3–0.9)]; less likely among employed women than those not working [OR 0.4 (0.2–0.6)]; and less likely among women with higher income (i.e., > = $12,000) than lower income [OR 0.6 (0.4–0.9)]. Anxiety disorder was less likely among women 60 + years old compared to those < 40 years old [OR 0.4 (0.2–0.8)]; less likely among those with a high school or equivalent education compared to those with less education [OR 0.7 (0.5–0.9)]; and less likely among those who were working compared to not working [OR 0.5 (0.4–0.7)]. Substance use disorders were less likely among Black women [OR 0.5 (0.3–0.9)] and Hispanic/Latina women [OR 0.4 (0.2–0.8)], and less likely among women with higher income [OR 0.4 (0.2–0.6)] than lower income.
Association of 12-Month Disorders with Subsequent HIV Risk Behaviors
Our final research question was whether HIV-positive women with DSM-IV disorders were more likely to engage in HIV risk behaviors than those without disorders, and whether specific disorders or disorder combinations were associated with greater risk. In random effects logistic regression models adjusted for time, age, race (Latina or White vs. Black), education (< high school), and study site, we found significant associations between diagnosis of 12-month psychiatric disorders or substance use disorders, as well as their co-occurrence, and the likelihood of engaging in subsequent sexual HIV risk behaviors (Table 5). Associations were particularly strong for women with mood disorders (major depression, dysthymia, bipolar disorders) and substance use disorders (alcohol or drug abuse/dependence). For example, compared to their counterparts, women with 12-month bipolar disorders were over 13 times as likely [OR 13.6 (4.1–45.3)] and those with drug abuse disorders over 14 times as likely [OR 14.3 (4.3–47.1)] to engage in sexual risk behaviors in the ensuing 3 years. There also were significant associations with most anxiety disorders including panic, specific phobia, social phobia, PTSD, OCD, and adult separation anxiety disorder. Agoraphobia and generalized anxiety disorder were not associated with subsequent sexual risk behaviors. Women with any psychiatric disorder and co-occurring substance use disorder were over 10 times as likely to engage in risky sexual behaviors [OR 10.4 (3.7–29.7)], and women with any mood disorder and co-occurring substance use disorder were over 15 times as likely [OR 15.9 (4.4–57.9)].
By definition, strong associations were expected between substance use disorders and the subsequent occurrence of HIV drug and alcohol risk behaviors, and these are evident in Table 5. However, women with any mood disorder or any anxiety disorder also were more likely to engage in HIV drug and/or alcohol risk behaviors than others [OR 4.5 (2.0–10.1), and OR 2.8 (1.4–5.8), respectively].
Discussion
Results from this investigation confirm those of the only other large scale assessment of behavioral health disorders among adults living with HIV, which was conducted almost three decades ago. The lifetime and 12-month prevalence of behavioral health disorders in this US cohort study of HIV-positive women far exceeded that of the general population of US women, with mood disorders, anxiety disorders, and substance use disorders being two- to three-fold more common in our cohort. Also, the number of DSM-IV disorders was higher in our cohort than in the general US women’s population, with 23% having 3 or more 12-month disorders compared to only 7% in the general population. Another noteworthy difference was in the distribution of lifetime disorders, with substance use disorders being second most common in our cohort, while they were least common in the general women’s population.
This study also found a high degree of comorbidity across mood disorders, anxiety disorders, and substance use disorders. This has been noted in studies of the general population [50, 51], but the large extent to which it characterizes HIV-positive women is evident for the first time in our findings. Almost all women with lifetime mood disorders had co-occurring lifetime anxiety disorders (87%) while over two-thirds (68%) also had lifetime substance use disorders. Thus the occurrence of no behavioral health disorders or only one disorder was uncommon in this longitudinal study cohort. Among women with current 12-month disorders, the large majority with mood disorders also had a co-occurring anxiety disorder (80%), and of those with 12-month substance use disorders, almost two-thirds (61%) had a co-occurring anxiety disorder. This extremely high level of comorbidity requires complex treatment protocols and has negative prognostic implications for psychological health, medical well-being, and longevity [52, 53].
We found that sociodemographic characteristics including education, income, being Black, and being Latina were negatively associated with likelihood of behavioral health disorders which mirrors prior CIDI research on the general population [8]. Employed women were less likely to have a recent behavioral health disorder, which parallels the well-established negative relationship between behavioral health disorders and employment [54].
Finally, this study documented significant associations between behavioral health disorders and HIV sexual and drug use risk behaviors in the 3 years following diagnostic assessment. Risky sexual behaviors were more likely among women with any 12-month disorder, and were especially likely among women with diagnoses of bipolar disorder or drug use disorders. In addition, a 12-month diagnosis of co-occurring mood disorder with substance use disorder or co-occurring anxiety disorder with substance use disorder increased the likelihood of subsequent risky drug and alcohol use. Drug and alcohol risk behaviors can be associated with sexual risk behaviors, both because women exchange sex for material goods and because decision making capacity is diminished when under the influence. Thus, our results suggest that interventions addressing behavioral health may also prevent subsequent HIV risk behaviors. For example, it may be beneficial to tailor HIV risk reduction interventions for women with disorders in which impulse control can be problematic, such as bipolar and substance use disorders [55], since these had the highest odds ratios for HIV transmission behaviors. Similarly, interventions might effectively be tailored for women with high levels of negative affect and associated risk taking [56], such as major depression and obsessive–compulsive disorder [57], since our findings also showed moderately high odds ratios for these disorders and HIV risk behaviors.
A number of study limitations should be noted. The study cohort may not be generalizable to the US population of women living with HIV, and the cohort may not represent younger women or those who are not engaged in HIV care. In addition, space limitations prevent us from identifying associations between behavioral health disorders and factors such as income, race, education, and other demographic variables in the NCS-R comparator data. Another limitation is use of self-report for key study variables such as frequency and types of HIV risk behaviors. WMH-CIDI assessments were not available for the entire cohort, and this may have biased our results, especially those related to women who spoke only Spanish or those who were employed. Finally, we do not consider the effects of receiving treatment for behavioral health disorders or HIV/AIDS since these are the subject of a separate manuscript. Study strengths include the large number of participants, the multisite nature of the cohort, the diversity of geographic site locations, inclusion of a comparison population, and use of diagnostic interviews instead of screening tools.
The major implication of these results is the critical need for integrated health and behavioral health care and the importance of addressing the challenges currently faced in organizing and providing it to women living with HIV [58]. Studies have shown that screening HIV-positive adults and referring them to mental health and substance abuse treatment is largely ineffective [59], especially when psychiatric disorders and substance use disorders co-occur [60]. Moreover, the high rate of co-morbidity among HIV-positive women may make screening for discrete conditions an ineffective approach. Further, because women from diverse cultures experience and express behavioral health symptoms and role impairment differently [61, 62], screening and assessment must also be sensitive to African American, Hispanic/Latina, and other cultures [63, 64], as well as to the intersection of trauma with poor mental health and substance use in the lives of many HIV-positive women [65, 66].
The fact that women living with HIV have multiple co-occurring behavioral health disorders of high severity poses serious challenges to clinicians seeking to provide coordinated care. The term “health complexity” has been coined to refer to individuals with multiple co-morbid medical and behavioral health conditions whose care is complicated by personal and social factors such as housing, ethnicity, social support, and poverty, as well as by health system factors such as inadequate insurance coverage, gaps in specialty care, and segregated medical and behavioral health treatment [67, 68]. This characterization fits our study population especially well, and calls attention to specific challenges. One such challenge is a lack of evidence-based treatment options for people with co-occurring substance use disorders, mood disorders, and anxiety disorders. Research shows that treating only one of these disorders does not improve the others, and that when only one is treated, significant distress and disability typically remain [52, 69]. An alternative approach is concurrent treatment, in which separate therapies are delivered at the same time. For example, studies support combining cognitive behavioral therapy for substance use disorders with exposure therapy or cognitive restructuring for anxiety disorders [69]. Research also supports the use of integrated treatment approaches, where services that target multiple conditions simultaneously are delivered in a coordinated fashion. For example, a recent trial combining sertraline and naltrexone for treating co-occurring depression and alcohol dependence was effective in reducing depression and promoting alcohol abstinence [70]. However, development and evaluation of these models are in relatively early stages, meaning that we lack effective treatments for co-occurring behavioral health disorders [52], especially among women [71].
A second level of challenges involves integrating medical and behavioral health treatment in the face of multiple co-occurring conditions of each type along with personal and health system factors. Here again, there are promising models that can be applied to HIV-positive women with multi-morbidities. One is the collaborative care model in the primary care setting, where case managers or nurse practitioners work with primary care providers, mental health professionals, and substance use treatment specialists in a patient-centered, socioecologically focused approach that incorporates community and health system factors [72, 73]. Another model is integrated complex case management, which involves the longitudinal, relationship-based use of biopsychosocial and health system-based care plans that are complexity-focused, with few handoffs, and escalation of care as well as discharge based on clinical, functional, and cost outcome measurement [68]. Application of these models in the HIV field is relatively new, but they offer great promise [74,75,76], especially when designed to also address HIV-positive women’s key structural determinants including violence against women and economic insecurity [26].
In addition to the human costs of co-occurring HIV infection and behavioral health disorders, the financial costs are considerable. One recent analysis of patients in the Kaiser Permanente Northern California integrated health care system [77], reported that mean total healthcare costs were higher in HIV-positive patients who were diagnosed with psychiatric disorders and substance use disorders (per patient per year average of $32,881) compared to HIV-positive patients without these comorbidities (per patient per year average of $29,142), and that this difference remained significant after controlling for confounding individual characteristics. Taking this one step further, the strong association between having psychiatric disorders and substance use disorders and engaging in HIV risk behaviors increases the chances of viral transmission and creation of new infections, while lessening the positive potential of treatment as prevention [78], incurring additional societal costs and individual burdens.
We conclude that the development, testing, and diffusion of evidence-based, culturally sensitive, trauma-informed models of complex, integrated physical and behavioral health care should be a key public health strategy for HIV prevention and control. Also needed is further investigation of how race/ethnicity, income, education, poverty, and trauma affect the experience and expression of behavioral health disorders among women living with HIV. Finally, the impact of treatment for mental health and substance use disorders on the likelihood of engaging in HIV risk behaviors requires further exploration, in order to more effectively integrate behavioral health and antiretroviral therapies.
References
Arendt G. Affective disorders in patients with HIV infection. CNS Drug Rev. 2006;20(6):507–18.
Chander G, Himelhoch S, Moore RD. Substance abuse and psychiatric disorders in HIV-positive patients. Drugs. 2006;66(6):769–89.
Klinkenberg WD, Sacks S. The HIV/AIDS treatment adherence, health outcomes and cost study group. Mental disorders and drug abuse in persons living with HIV/AIDS. AIDS Care. 2004;16(sup1):22–42.
Bozzette SA, Berry SH, Duan N, et al. The care of HIV-infected adults in the United States. New Engl J Med. 1998;339(26):1897–904.
Bing EG, Burnam MA, Longshore D, et al. Psychiatric disorders and drug use among human immunodeficiency virus–infected adults in the United States. Arch Gen Psychiatry. 2001;58(8):721–8.
Orlando M, Burnam MA, Beckman R, Morton SC, London AS, Bing EG, Fleishman JA. Re-estimating the prevalence of psychiatric disorders in a nationally representative sample of persons receiving care for HIV: results from the HIV cost and services utilization study. Int J Method Psychiatr. 2002;11(2):75–82.
Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62(6):593–602.
Kessler RC, Chiu WT, Demler O, Walters EE. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62(6):617–27.
Gala C, Pergami A, Catalan J, et al. The psychosocial impact of HIV infection in gay men, drug users and heterosexuals. Controlled investigation. Br J Psychiatry. 1993;163(5):651–9.
Gaynes BN, Pence BW, Eron JJ Jr, Miller WC. Prevalence and comorbidity of psychiatric diagnoses based on reference standard in an HIV+ patient population. Psychosom Med. 2008;70(4):505–11.
Lyketsos CG, Hanson A, Fishman M, McHugh PR, Treisman GJ. Screening for psychiatric morbidity in a medical outpatient clinic for HIV infection: the need for a psychiatric presence. Int J Psychiatr Med. 1994;24(2):103–13.
Tegger MK, Crane HM, Tapia KA, Uldall KK, Holte SE, Kitahata MM. The effect of mental illness, substance use, and treatment for depression on the initiation of highly active antiretroviral therapy among HIV-infected individuals. AIDS Patient Care STDs. 2008;22(3):233–43.
Pence BW, Miller WC, Whetten K, Eron JJ, Gaynes BN. Prevalence of DSM-IV-defined mood, anxiety, and substance use disorders in an HIV clinic in the southeastern United States. J Acquir Immune Defic Syndr. 2006;42(3):298–306.
Rabkin JG. Prevalence of psychiatric disorders in HIV illness. Int Rev Psychiatry. 1996;8:157–66.
Dew MA, Reynolds CF, Houck PR, et al. Temporal profiles of the course of depression during treatment: predictors of pathways toward recovery in the elderly. Arch Gen Psychiatry. 1997;54(11):1016–24.
Dausey DJ, Desai RA. Psychiatric comorbidity and the prevalence of HIV infection in a sample of patients in treatment for substance abuse. J Nerv Ment Dis. 2003;191(1):10–7.
DeLorenze GN, Tsai AL, Horberg MA, Quesenberry CP. Cost of care for HIV-infected patients with co-occurring substance use disorder or psychiatric disease: report from a large, integrated health plan. AIDS Res Treat. 2014;24:1–9.
Burnam MA, Bing EG, Morton SC, et al. Use of mental health and substance abuse treatment services among adults with HIV in the United States. Arch Gen Psychiatry. 2001;58(8):729–36.
Galvan FH, Burnam MA, Bing EG. Co-occurring psychiatric symptoms and drug dependence or heavy drinking among HIV-positive people. J Psychoact Drugs. 2003;35(sup1):153–60.
DeLorenze GN, Satre DD, Quesenberry CP Jr, Tsai AL, Weisner CM. Mortality after diagnosis of psychiatric disorders and co-occurring substance use disorders among HIV-infected patients. AIDS Patient Care STDs. 2010;24(11):705–12.
Malee K, Mellins CA, Huo Y, et al. Prevalence, incidence and persistence of psychiatric and substance use disorders among mothers living with HIV. J Acquir Immune Defic Syndr. 2014;65(5):526–34.
Parhami I, Fong TW, Siani A, Carlotti C, Khanlou H. Documentation of psychiatric disorders and related factors in a large sample population of HIV-positive patients in California. AIDS Behav. 2013;17:2792–801.
Cook JA, Grey DD, Burke-Miller JK, et al. Illicit drug use, depression and their association with highly active antiretroviral therapy in HIV-positive women. Drug Alcohol Depend. 2007;89(1):74–81.
Cook RL, Zhu F, Belnap BH, et al. Longitudinal trends in hazardous alcohol consumption among women with human immunodeficiency virus infection, 1995–2006. Am J Epidemiol. 2009;169(8):1025–32.
Cook JA, Burke-Miller JK, Cohen MH, et al. Crack cocaine, disease progression, and mortality in a multi-center cohort of HIV-1 positive women. AIDS. 2008;22(11):1355–63.
Edwards A. Recognizing the influence of social determinants on HIV risk behaviors and the need for structural interventions to prevent HIV in women. J Health Dispar Res Pract. 2015;7(7):10–25.
Sharpe TT, Voûte C, Rose MA, Cleveland J, Dean HD, Fenton K. Social determinants HIV/AIDS and sexually transmitted diseases among black women: implications for health equity. J Womens Health. 2012;21(3):249–54.
Cook JA, Burke-Miller JK, Grey DD, Coccohoba J, Liu C, Schwartz R, Golub ET, Anastos K, Steigman PJ, Cohen MH. Do HIV-positive women receive depression treatment that meets best practice guidelines? AIDS Behav. 2014;18(6):1094–102.
Otto-Salaj LL, Kelly JA, Stevenson LY, Hoffmann R, Kalichman SC. Outcomes of a randomized small-group HIV prevention intervention trial for people with serious mental illness. Community Ment Health J. 2001;37(2):123–44.
Santelli JS, Robin L, Brener ND, Lowry R. Timing of alcohol and other drug use and sexual risk behaviors among unmarried adolescents and young adults. Fam Plann Perspect. 2001;33:200–5.
Metsch LR, McCoy CB, Lai S, Miles C. Continuing risk behaviors among HIV-seropositive chronic drug users in Miami, Florida. AIDS Behav. 1998;2(2):161–9.
Brewer TH, Zhao W, Metsch LR, Coltes A, Zenilman J. High-risk behaviors in women who use crack: knowledge of HIV serostatus and risk behavior. Ann Epidemiol. 2007;17(7):533–9.
Hutton HE, Lyketsos CG, Zenilman JM, Thompson RE, Erbelding EJ. Depression and HIV risk behaviors among patients in a sexually transmitted disease clinic. Am J Psychiatry. 2004;161(5):912–4.
Staton-Tindall M, Harp KL, Minieri A, et al. An exploratory study of mental health and HIV risk behavior among drug-using rural women in jail. Psychiatr Rehabil J. 2015;38(1):45–54.
Campsmith ML, Nakashima AK, Jones JL. Association between crack cocaine use and high-risk sexual behaviors after HIV diagnosis. J Acquir Immune Defic Syndr. 2000;25(2):192–8.
Newville H, Haller DL. Psychopathology and transmission risk behaviors in patients with HIV/AIDS. AIDS Care. 2010;22(10):1259–68.
Stein MD, Solomon DA, Herman DS, Anderson BJ, Miller I. Depression severity and drug injection HIV risk behaviors. Am J Psychiatry. 2003;160(9):1659–62.
Miles DR, Svikis DS, Kulstad JL, Haug NA. Psychopathology in pregnant drug-dependent women with and without comorbid alcohol dependence. Alcohol Clin Exp Res. 2001;25(7):1012–7.
Mota NP, Cox BJ, Katz LY, Sareen J. Relationship between mental disorders/suicidality and three sexual behaviors: results from the National Comorbidity Survey Replication. Arch Sex Behav. 2010;39(3):724–34.
Plotzker RE, Metzger DS, Holmes WC. Childhood sexual and physical abuse histories, PTSD, depression, and HIV risk outcomes in women injection drug users: a potential mediating pathway. Am J Addict. 2007;16(6):431–8.
Marks G, Crepaz N, Senterfitt JW, Janssen RS. Meta-analysis of high-risk sexual behavior in persons aware and unaware they are infected with HIV in the United States: implications for HIV prevention programs. J Acquir Immune Defic Syndr. 2005;39(4):446–53.
Latka MH, Wilson TE, Cook JA, Bacon MC, Richardson JL, Sohler N, Cohen MH, Greenblatt RM, Andreopoulis E, Vlahov D. Impact of drug treatment on subsequent sexual risk behavior in a multisite cohort of drug-using women: a report from the Women’s Interagency HIV Study. J Subst Abuse Treat. 2005;29(4):329–37.
Crepaz N, Marks G, Liau A, Mullins MM, Aupont LW, Marshall KJ, Jacobs ED, Wolitski RJ. HIV/AIDS Prevention Research Synthesis (PRS) Team. Prevalence of unprotected anal intercourse among HIV-diagnosed MSM in the United States: a meta-analysis. AIDS. 2009;23(13):1617–29.
Meade CS, Kershaw TS, Hansen NB, Sikkema KJ. Long-term correlates of childhood abuse among adults with severe mental illness: adult victimization, substance abuse, and HIV sexual risk behavior. AIDS Behav. 2009;13(2):207–16.
Barkan SE, Melnick SL, Preston-Martin S, Weber K, Kalish LA, Miotti P, Young M, Greenblatt R, Sacks H, Feldman J. The women’s interagency HIV study. Epidemiology. 1998;9(2):117–25.
Bacon MC, von Wyl V, Alden C, et al. The Women’s Interagency HIV Study: an observational cohort brings clinical sciences to the bench. Clin Diagn Lab Immunol. 2005;12(9):1013–9.
Kessler RC, Üstün TB. The world mental health (WMH) survey initiative version of the world health organization (WHO) composite international diagnostic interview (CIDI). Int J Methods Psychiatr Res. 2004;13(2):93–121.
US Preventive Services Task Force. Screening and behavioral counseling interventions in primary care to reduce alcohol misuse: recommendation statement. Ann Intern Med. 2004;140(7):554–6.
Alegría M, Jackson JS, Kessler RC, Takeuchi D. Collaborative Psychiatric Epidemiology Surveys (CPES), 2001–2003 [United States]. ICPSR20240-v8. Ann Arbor, MI: Inter-university Consortium for Political and Social Research [distributor]. 2015;2015-12-09. http://doi.org/10.3886/ICPSR20240.v8.
Back SE, Brady KT. Anxiety disorders with comorbid substance use disorders: diagnostic and treatment considerations. Psychiatr Ann. 2008;38(11):724–9.
Grant BF, Stinson FS, Dawson DA, et al. Prevalence and co-occurrence of substance use disorders and independent mood and anxiety disorders: results from the national epidemiologic survey on alcohol and related conditions. Arch Gen Psychiatry. 2004;61(8):807–16.
Pettinati HM, O’Brien CP, Dundon WD. Current status of co-occurring mood and substance use disorders: a new therapeutic target. Am J Psychiatry. 2013;170(1):23–30.
Sagman D, Tohen, M. Comorbidity in bipolar disorder: The complexity of diagnosis and treatment. Psychiatric Times 2009. http://www.psychiatrictimes.com/bipolar-disorder/comorbidity-bipolar-disorder. Accessed 10 Oct 2016.
Cook JA, Burke-Miller JK, Roessel E. Long-term effects of evidence-based supported employment on earnings and on SSI and SSDI participation among individuals with psychiatric disabilities. Am J Psychiatry. 2016;173(10):1007–14.
Reddy LF, Junghee L, Davis MC, Altschuler L, et al. Impulsivity and risk taking in bipolar disorder and schizophrenia. Neuropsychopharmacology. 2014;39:456–63.
Desrichard O, Denarie V. Sensation seeking and negative affectivity as predictors of risky behaviors: a distinction between occasional versus frequent risk-taking. Addict Behav. 2005;30(7):1449–53.
Abramawitz JS, Whiteside S, Lynam D, Kalsy S. Is thought-action fusion specific to obsessive-compulsive disorder?: a medicating role of negative affect. Behav Res Ther. 2003;41(9):1069–79.
Cournos F, McKinnon K, Wainberg M. What can mental health interventions contribute to the global struggle against HIV/AIDS. World Psychiatry. 2005;4(3):135–41.
Pence BW. The impact of mental health and traumatic life experiences on antiretroviral treatment outcomes for people living with HIV/AIDS. J Antimicrob Chemother. 2009;63(4):636–40.
Altice FL, Kamarulzaman A, Soriano VV, Schechter M, Friedland GH. Treatment of medical, psychiatric, and substance-use comorbidities in people infected with HIV who use drugs. Lancet. 2010;376(9738):367–87.
Nair P, Schuler ME, Black MM, Kettinger L, Harrington D. Cumulative environmental risk in substance abusing women: early intervention, parenting stress, child abuse potential and child development. Child Abuse Negl. 2003;27(9):997–1017.
Weissman MM, Bland RC, Canino GJ, Faravelli C, Greenwald S, Hwu HG, Joyce PR, Karam EG, Lee CK, Lellouch J, Lépine JP. Cross-national epidemiology of major depression and bipolar disorder. JAMA. 1996;276(4):293–9.
Alegria M, Jackson JS, Kessler RC, Takeuchi D. Collaborative Psychiatric Epidemiology Surveys (CPES), 2001–2003 [United States]. ICPSR20240-v6. Ann Arbor, MI: Inter-university Consortium for Political and Social Research [distributor]. 2008:06–19.
Delgado PL, Alegría M, Cañive JM, et al. Depression and access to treatment among US Hispanics: review of the literature and recommendations for policy and research. Focus. 2006;4(1):38–47.
Johnson SD, Cunningham-Williams RM, Cottler LB. A tripartite of HIV-risk for African American women: the intersection of drug use, violence, and depression. Drug Alcohol Depend. 2003;70(2):169–75.
Weiss JJ, Morgello S. Psychiatric management of HIV/HCV-coinfected patients beginning treatment for hepatitis C virus infection: survey of provider practices. Gen Hosp Psychiatry. 2009;31(6):531–7.
Grembowski D, Schaefer J, Johnson KE, Fischer H, Moore SL, Tai-Seale M, Ricciardi R, Fraser JR, Miller D, LeRoy L. A conceptual model of the role of complexity in the care of patients with multiple chronic conditions. Med Care. 2014;52:S7–14.
Kathol RG, Knutson KH, Dehnel PJ. Health Complexity and the Interaction Between Physical and Behavioral Health Conditions in Children and Youth. In Physician’s Guide 2016 (pp. 51–77). Springer International Publishing.
McHugh RK. Treatment of co-occurring anxiety disorders and substance use disorders. Harv Rev Psychiatry. 2015;23(2):99–111.
Pettinati HM, Oslin DW, Kampman KM, et al. A double-blind, placebo-controlled trial combining sertraline and naltrexone for treating co-occurring depression and alcohol dependence. Am J Psychiatry. 2010;167(6):668–75.
Hien DA, Wells EA, Jiang H, et al. Multisite randomized trial of behavioral interventions for women with co-occurring PTSD and substance use disorders. J Consult Clin Psychol. 2009;77(4):607–19.
Katon W, Von Korff M, Lin E, Simon G. Rethinking practitioner roles in chronic illness: the specialist, primary care physician, and the practice nurse. Gen Hosp Psychiatry. 2001;23(3):138–44.
Simon G. Collaborative care for depression. BMJ. 2006;332:249–50.
Cheever LW, Kresina TF, Cajina A, Lubran R. A model federal collaborative to increase patient access to buprenorphine treatment in HIV primary care. J Acquir Immune Defic Syndr. 2011;56:S3–6.
Curran GM, Pyne J, Fortney JC, et al. Development and implementation of collaborative care for depression in HIV clinics. AIDS Care. 2011;23(12):1626–36.
Ojikutu B, Holman J, Kunches L, et al. Interdisciplinary HIV care in a changing healthcare environment in the USA. AIDS Care. 2014;26(6):731–5.
Gaynes BN, Rush AJ, Trivedi MH, Wisniewski SR, Spencer D, Fava M. The STAR* D study: treating depression in the real world. Cleve Clin J Med. 2008;75:57–66.
Cohen MS, McCauley M, Gamble TR. HIV treatment as prevention and HPTN 052. Curr Opin HIV AIDS. 2012;7(2):99–105.
Acknowledgements
This research was funded by grant number 1R01MH089830 from the National Institute of Mental Health (NIMH). Some data used in the analysis were collected by the Women’s Interagency HIV Study (WIHS). The contents of this publication are solely the responsibility of the authors and do not represent the official views of the National Institutes of Health (NIH). WIHS (Principal Investigators): UAB-MS WIHS (Michael Saag, Mirjam-Colette Kempf, and Deborah Konkle-Parker), U01-AI-103401; Atlanta WIHS (Ighovwerha Ofotokun and Gina Wingood), U01-AI-103408; Bronx WIHS (Kathryn Anastos), U01-AI-035004; Brooklyn WIHS (Howard Minkoff and Deborah Gustafson), U01-AI-031834; Chicago WIHS (Mardge Cohen and Audrey French), U01-AI-034993; Metropolitan Washington WIHS (Mary Young and Seble Kassaye), U01-AI-034994; Miami WIHS (Margaret Fischl and Lisa Metsch), U01-AI-103397; UNC WIHS (Adaora Adimora), U01-AI-103390; Connie Wofsy Women’s HIV Study, Northern California (Ruth Greenblatt, Bradley Aouizerat, and Phyllis Tien), U01-AI-034989; WIHS Data Management and Analysis Center (Stephen Gange and Elizabeth Golub), U01-AI-042590; Southern California WIHS (Alexandra Levine and Marek Nowicki), U01-HD-032632 (WIHS I – WIHS IV). The WIHS is funded primarily by the National Institute of Allergy and Infectious Diseases (NIAID), with additional co-funding from the Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), the National Cancer Institute (NCI), the National Institute on Drug Abuse (NIDA), and the National Institute on Mental Health (NIMH). Targeted supplemental funding for specific projects is also provided by the National Institute of Dental and Craniofacial Research (NIDCR), the National Institute on Alcohol Abuse and Alcoholism (NIAAA), the National Institute on Deafness and other Communication Disorders (NIDCD), and the NIH Office of Research on Women’s Health. WIHS data collection is also supported by UL1-TR000004 (UCSF CTSA) and UL1-TR000454 (Atlanta CTSA).
Funding
This study was funded by grant number 1R01MH089830 from the National Institute of Mental Health (NIMH). Some data used in the analysis were collected by the Women’s Interagency HIV Study (WIHS). The contents of this publication are solely the responsibility of the authors and do not represent the official views of the National Institutes of Health (NIH). WIHS (Principal Investigators): UAB-MS WIHS (Michael Saag, Mirjam-Colette Kempf, and Deborah Konkle-Parker), U01-AI-103401; Atlanta WIHS (Ighovwerha Ofotokun and Gina Wingood), U01-AI-103408; Bronx WIHS (Kathryn Anastos), U01-AI-035004; Brooklyn WIHS (Howard Minkoff and Deborah Gustafson), U01-AI-031834; Chicago WIHS (Mardge Cohen and Audrey French), U01-AI-034993; Metropolitan Washington WIHS (Mary Young and Seble Kassaye), U01-AI-034994; Miami WIHS (Margaret Fischl and Lisa Metsch), U01-AI-103397; UNC WIHS (Adaora Adimora), U01-AI-103390; Connie Wofsy Women’s HIV Study, Northern California (Ruth Greenblatt, Bradley Aouizerat, and Phyllis Tien), U01-AI-034989; WIHS Data Management and Analysis Center (Stephen Gange and Elizabeth Golub), U01-AI-042590; Southern California WIHS (Alexandra Levine and Marek Nowicki), U01-HD-032632 (WIHS I – WIHS IV). The WIHS is funded primarily by the National Institute of Allergy and Infectious Diseases (NIAID), with additional co-funding from the Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), the National Cancer Institute (NCI), the National Institute on Drug Abuse (NIDA), and the National Institute on Mental Health (NIMH). Targeted supplemental funding for specific projects is also provided by the National Institute of Dental and Craniofacial Research (NIDCR), the National Institute on Alcohol Abuse and Alcoholism (NIAAA), the National Institute on Deafness and other Communication Disorders (NIDCD), and the NIH Office of Research on Women’s Health. WIHS data collection is also supported by UL1-TR000004 (UCSF CTSA) and UL1-TR000454 (Atlanta CTSA).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Cook, J.A., Burke-Miller, J.K., Steigman, P.J. et al. Prevalence, Comorbidity, and Correlates of Psychiatric and Substance Use Disorders and Associations with HIV Risk Behaviors in a Multisite Cohort of Women Living with HIV. AIDS Behav 22, 3141–3154 (2018). https://doi.org/10.1007/s10461-018-2051-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10461-018-2051-3