Teacher and School Characteristics Associated with the Identification and Referral of Adolescent Depression and Oppositional Defiant Disorders by U.S. Teachers

Abstract

Teachers contribute to the process of identifying and referring students for mental health services, however, relatively little is known about how they make those decisions and how decision-making differs across school contexts. This study used a vignette-based method to investigate individual and school contextual factors associated with the likelihood that teachers identify and refer students for mental health services. Teachers were recruited from public middle and high schools across the U.S. using a stratified random sampling strategy. Teachers (N = 462) responded to vignettes by indicating their concern for students, as well as their likelihood of providing mental health referrals. Vignettes varied by problem type (depression, oppositional defiant disorder), problem severity (moderate, severe), and student gender (male, female). Data on school characteristics were extracted from the U.S. Department of Education database. Regression models indicated several significant associations of teacher demographic characteristics and school characteristics with vignette ratings. For example, female teachers were more likely than males to rate vignettes as concerning, and middle school teachers were more likely than high school teachers to indicate they would refer students for mental health services. Teachers in schools with a higher proportion of Black students rated depression vignettes as less serious and indicated they were less likely to refer students for mental health services than teachers in majority white schools. Results suggest school characteristics may contribute to established disparities in mental health service access. Findings have implications for targeting mental health supports in schools.

Introduction

Studies are clear that there are high rates of unmet need for mental health care among U.S. children and adolescents with emotional and behavioral disorders. For example, results from the National Comorbidity Survey Adolescent Supplement (NCS-A) suggest that 70% of youth with a 12-month disorder do not receive any mental health services (Merikangas et al. 2010b, 2011) and these results are consistent with rates found in other studies in the U.S. and internationally (Benjet et al., 2016; Kovess-Masfety et al., 2017; Leaf et al., 1996; Sheppard et al., 2018; Whitney & Peterson, 2019). Research also indicates that the adolescents who use mental health services most often receive those services within their schools (Costello et al., 2014; Duong et al., 2021) or outside of school as the result of a referral from school staff (Burns et al., 1995). As such, schools serve as key settings for reducing unmet need for mental health services, both through on-site service provision and through identification and referral to treatment. Furthermore, schools have the potential to reduce some of the common barriers to accessing community-based mental health services described by youth (e.g., cost, transportation; Gulliver et al., 2010).

The current study focuses on the identification and referral decisions of teachers, as teachers interact with youth regularly and are well-positioned to notice disorders early in their course and to provide referrals to students (Aitken et al., 2017; Brown et al., 2006; De Los Reyes et al., 2015). Moreover, teachers have the potential to contribute to reducing inequities in mental health service access by referring students for services who might not otherwise access community-based services. In particular, studies of community-based mental health service use indicate disparities in access related to symptom type (e.g., youth with behavior disorders more often receive services than those with anxiety or depression), ethnicity/race (e.g., non-Latinx white students more often receive services than youth of color), and gender (e.g., gender-related differences in service use vary with symptom type; Alegría et al., 2016; Costello et al., 2014). These inequities, in part, reflect the referral decision-making process of teachers, parents, and other adults interacting daily with youth (Alegría et al., 2012). Identifying the factors that influence teacher referral decisions can have implications for improving youth access to mental health services.

Teachers’ Role in the Referral Process

The role of teachers in referral decisions can be conceptualized using the Gateway Provider Model (Stiffman et al., 2004), which posits that youth access to mental health services relies upon “gateway providers” who identify a need for services and make decisions about whether to connect youth with appropriate resources. Studies have found that decision-making by providers is influenced by a combination of characteristics of youth (e.g., need for those services, demographic characteristics), factors enabling service access (e.g., availability, acceptability), structural characteristics (e.g., organizational and management factors), and the provider’s own perceptions and knowledge of mental health and mental health resources (Stiffman et al., 2004).

Several studies have tested aspects of the Gateway Provider Model and found that teacher identification of youth with emotional and behavioral disorders indeed varies as a function of student problem type, race/ethnicity, and gender (Chang & Sue, 2003; Green et al., 1996; Loades & Mastroyannopoulou, 2010; Splett et al., 2020). For example, studies have found that teachers are less likely to identify youth of color than their non-Latinx white peers as needing mental health supports and are less likely to encourage youth of color to use those services (Alegría et al., 2012; Chang & Sue, 2003; Lau et al., 2003). These studies suggest that bias in the referral process may contribute to well-established racial and ethnic disparities in access to mental health services (Costello et al., 2014). Further, studies have shown that clinicians are more likely to diagnosis Black youth with disruptive behavior disorders than their white peers, whereas white youth more often receive diagnoses and services for internalizing disorders (Gudiño et al., 2009; Nguyen et al., 2007). These trends may also help explain why youth of color are more often subjected to exclusionary disciplinary practices (e.g., suspensions and expulsions) and less often access appropriate mental health services than their white peers (Skiba et al., 2011). Understanding how teachers conceptualize and respond to internalizing behaviors, in contrast to acting out behaviors, can provide key information about differential decision-making for mental health referrals. In particular, when teachers identify student behavior as being problematic, rather than indicative of a problem, students may be less likely to receive needed care. Teacher preconceptions about students and their behaviors may therefore be even more salient than actual need for services, when it comes to decision-making around mental health referrals (Stiffman et al., 2004).

In addition to student characteristics, several studies have highlighted teacher characteristics associated with referral decisions. For example, teacher ratings of student behavior have been found to be linked to the teachers’ own experiences of burnout and self-efficacy (McLean et al., 2019). In addition, a study by Splett et al. (2020) found significant between-teacher variance in teacher ratings of student behavior, with greater variance in ratings of internalizing than externalizing behaviors. This result suggests that the likelihood of students receiving a needed referral is dependent upon characteristics of their teacher, a finding that is consistent with data showing that teachers-in-training in the U.S. tend to receive little to no instruction in social emotional wellbeing or identification of mental health problems as part of teacher preparation (Reinke et al., 2011; State et al., 2011). Without such preparation, teachers are left to rely on their own understanding of mental health, and often describe relying on indicators of academic challenges rather than mental health symptoms (Bradshaw et al., 2008; Green et al., 2017).

Studies, however, have rarely tested how characteristics of the school context are associated with teacher referrals to mental health services. Understanding how individual and contextual factors jointly influence teacher decision-making about mental health referrals can have important implications for determining structural changes needed to improve access to mental health services for youth (Ringeisen et al., 2003). For example, identifying school characteristics associated with mental health referrals can provide information about how to situate teacher professional development in context, and can be used to generate hypotheses about structural influences on individual teacher decision-making.

Current Study

The current study uses a vignette-based approach to investigate patterns in teacher identification and referral of students with depression and oppositional defiant disorder (ODD). These two disorders were selected as examples of internalizing (depression) and externalizing (ODD) problems that are common among adolescents and often have first onset in adolescent years (Merikangas et al., 2010a, 2010b; Nock et al., 2007), which means that middle and high school teachers have the potential to identify them early in their course. Further, these diagnoses offer a contrast between behaviors that are often identified for mental health services (depression) and those that may become the subject of exclusionary discipline practices rather than a mental health referral (ODD).

Vignette-based approaches have been used in previous studies to test characteristics associated with teacher mental health referrals (Chang & Sue, 2003; M.T. Green et al., 1996; J.G. Green et al., 2018; Loades & Mastroyannopoulou, 2010; Splett et al., 2020). Vignettes have the advantage of providing a standardized scenario, which researchers can systematically vary, allowing researchers to isolate and test particular factors that may influence decision-making. In the current study, we use vignettes to examine whether reported level of concern about students and likelihood of referral for mental health services vary as a function of individual student factors (disorder type, disorder severity, student gender). In addition, and consistent with the Gateway Provider Model (Stiffman et al., 2004), we examine the association of teachers’ reported level of concern and likelihood of referral with teacher characteristics (e.g., gender, years of experience), and school organizational characteristics (e.g., urbanicity, racial/ethnic composition of the student body).

The current study examines teacher identification and referral patterns among a U.S. sample of middle and high school teachers. Prior studies of teacher identification patterns have focused almost entirely on elementary school teachers (Chang & Sue, 2003; Green et al., 1996; Loades & Mastroyannopoulou, 2010; Pearcy et al., 1993; Splett et al., 2020; Weisz et al., 1988). The few exceptions are studies of middle and high school teachers that have used geographically limited samples (Green et al., 2018) or studied only one problem type (i.e., depression; Jorm et al., 2010). However, investigating teachers’ role in mental health referrals during adolescence is particularly important because disorders increase precipitously in adolescence (Merikangas et al., 2010a, 2010b). At the same time, adolescence presents particular challenges to teacher involvement in identification and referral for mental health services, because adolescents often rotate between classrooms throughout the school day and teachers therefore may have less contact with individual students than at the elementary level. Nonetheless, some researchers have found that adolescents, and particularly adolescents of color, are more likely to access mental health services when their families are encouraged to seek out services by adults they know, including teachers (Alegría et al., 2012).

Using a sample of U.S. middle and high school teachers, and vignettes reflecting one internalizing disorder (depression) and one externalizing disorder (oppositional defiant disorder), we answer the following questions:

• 1. What student, teacher, and school characteristics are associated with teacher identification of depression, concern about a student with depression, and likelihood of referral for mental health services?

• 2. What student, teacher, and school characteristics are associated with teacher concern about a student with oppositional defiant disorder, and likelihood of referral for mental health services?

This study contributes to the existing literature by (a) providing information about teacher identification and mental health referrals specifically for adolescents, (b) using a sample of teachers across the U.S., which allows testing for regional differences, and (c) examining school-level contextual factors that may have implications for structural change. Identifying characteristics associated with teachers’ concern for students and likelihood of mental health service referral has the potential to provide information about how factors unrelated to need may influence gateway provider referrals. These characteristics can become important leverage points for teacher training and educational policy, as they may indicate pathways that underscore inequities in service access.

Method

Participants

A list of all U.S. public schools was downloaded from the Department of Education website. The list was narrowed to middle and high schools, and schools were then stratified by region of the country and urbanicity. Schools within each strata were randomly selected for participation using a random number generator, with an oversampling of schools in large cities. Research assistants went to the website of each randomly selected school and searched for a publicly available list of teacher email addresses. If there was no publicly available list of teacher email addresses, we went to the next randomly selected school. When an email list was publicly available, we randomly selected the email address of one general education teacher, using a random number generator. Each teacher was sent a postcard informing them of the study and that they would be receiving a subsequent email invitation to participate. Teachers then received an email with an online invitation to complete the web-survey. Teachers who did not respond to the initial invitation were sent up to two follow-up emails. If that teacher did not respond to our invitation, we sent a survey by mail. If we still received no response, we randomly selected a second person from the same school to contact. If they did not respond to the same series of contact attempts, we went to the next randomly selected school.

In total, because of this process of replacing and re-selecting teachers, 1386 teachers were invited to participate in the study. Those who participated in the online survey were sent a $15 gift card. Those who did not respond to the email invitations received a survey by mail, along with a $5 gift card and a stamped return envelope. If they returned the completed survey, they were mailed a second $10 gift card to receive the full incentive amount. A total of 501 teachers completed the survey either online (n = 322, 64.3%) or by mail (n = 179, 35.7%) representing a 36.1% response rate. Analyses included only teachers who provided complete data for at least one vignette (n = 460 for the depression vignette and n = 462 for the ODD vignette).

Teachers were evenly distributed across the four regions of the country (Northeast, 27.3%; Midwest, 26.8%; South, 19.3%; West, 22.7%). Consistent with U.S. national data (Taie & Goldring, 2017), teachers primarily identified as female and non-Latinx White (see Table 1 for sample demographics and Table S1 for a comparison on the current sample to US national data). The Boston University Institutional Review Board approved all study procedures.

Table 1 Individual teacher characteristics and school characteristics (N = 462)

Measures

Vignette Construction

Vignettes used in the current study (see Table 2) were adapted from vignettes developed by the Center for Multicultural Mental Health Research to study parent perceptions of child need for mental health services (Chavez et al., 2010). Initial development of vignettes is described in more detail elsewhere (Lapatin et al., 2012). We selected vignettes that focused on one internalizing disorder (depression) and one externalizing disorder [oppositional defiant disorder (ODD)].

Table 2 Depression and oppositional defiant disorder vignettes

As described elsewhere (Green et al., 2018), 19 teachers participated in focus groups during summer 2014 to review the vignettes. Teachers’ feedback on the vignettes was used to modify the text (for example, teachers suggested focusing on information that would be observable in a classroom setting, removing information about family and home-life, and adding information about academic performance). Final vignettes were 100–130 words in length with symptom descriptions based on criteria from the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 2013). We used scenarios that depicted “moderate” disorders and then modified those scenarios to include information to identify the disorders as “severe.” For example, for the vignette characterizing depression, the student in the “moderate” version of the vignette seems moody, puts their head down on their desk, has lost interest in activities they used to enjoy, and has trouble concentrating in class. In the “severe” version, the student has additionally missed school, and the teacher overhears them saying “I’m totally worthless.”

Validity of Vignettes

Vignette validity was initially assessed using expert ratings. As described in more detail elsewhere (Green et al., 2018), 14 clinical and research experts in child or adolescent mental health rated the vignettes. On a scale of 1–10 (where 1 was “not at all realistic” and 10 was “very realistic”) experts gave the vignettes an average rating of 8.7 (SD = 1.3). As in Lapatin et al., (2012) we next asked experts to use the Children’s Global Assessment Scale (C-GAS; Shaffer et al., 1983) to rate impairment experienced by students in vignettes (on a scale of 0–100, with lower scores indicating greater impairment). These ratings enabled us to calibrate the severity of vignettes (i.e., ensure that the severity of the depression and ODD vignettes were similar, and that the moderate vignettes were rated as less severe than the severe vignettes). Each expert rated two to four vignettes, providing a total of 34 vignette ratings. There were no significant differences between C-GAS ratings of depression (M = 51.5, SD = 10.4) and ODD (M = 53.8, SD = 9.0) vignettes (t(32) = –0.72, p = 0.48). Experts rated moderate vignettes as significantly less impaired (M = 56.8, SD = 8.6) than severe vignettes (M = 47.9, SD = 8.4; t(30) = 3.04, p < 0.01).

Vignettes were then sent to 500 school psychologists randomly selected from the National Association of School Psychologists (NASP) mailing list. One hundred school psychologists returned the survey (20% response rate). On a scale of 1 to 10 (where 1 was “not at all realistic” and 10 was “very realistic”) school psychologists rated the vignettes an average of 8.4 (SD = 1.5). School psychologists also used the C-GAS to rate the impairment of students in vignettes. We used these severity ratings to validate the manipulation of the moderate vs. severe versions of the vignettes. Each school psychologist completed two vignette ratings (depression and ODD), providing a total of 200 ratings. There were no significant differences between C-GAS ratings of depression (M = 50.7, SD = 9.9) and ODD (M = 52.0, SD = 10.8) vignettes (t₍₁₉₁₎ = 0.8, p = 0.40). School psychologists rated moderate vignettes as significantly less impaired (M = 54.5, SD = 11.3) than severe vignettes (M = 48.1, SD = 8.2; t₍₁₉₁₎ = 4.5, p < 0.001).

Procedure

We systematically varied the type of disorder (depression, ODD), severity of disorder (moderate, severe), and gender (male, female) of students. The order in which vignettes were presented was randomized. As in a previous study (Chavez et al., 2010), we varied the names Anna and David to indicate gender. These names were selected because, as described in Lapatin et al. (2012), they are common names used in both English and Spanish and tend not to be associated with a single race or ethnicity, but tend to be associated with male or female gender. Teachers were not provided with student demographic information other than name (as a proxy for gender) and were asked to imagine that the student in the vignette was “a student in your class” in order to make age, race/ethnicity, and grade-level of students relevant to individual respondents and their own school context.

Teacher Identification and Referral

The survey included four measures of teacher identification of student mental health need and one measure of referral likelihood. To determine whether teachers would identify youth in the vignettes as requiring mental health services, teachers were asked to rate (1) the seriousness of the problem, (2) how worried about the problem they would be, and (3) how common the problem is among their students. These ratings were identical to those in the study by Chavez et al. (2010) and were completed using a 10-point scale (with anchors ranging from, for example, not at all serious to very serious). For the depression vignette, similar to Jorm et al. (2010), teachers were asked to describe “What, if anything, is going on with [Student name]?” Teachers who responded that the vignette described “depression” were coded as (4) identifying depression. This coding was conducted by undergraduate research assistants who were trained and reached reliability. While we asked the same question following the presentation of the ODD vignette, very few respondents (n = 4, 0.8%) identified the behaviors as being associated with “ODD” or “oppositional defiant disorder” and we therefore did not construct an equivalent rating for identification for the ODD vignette to use in further analyses. In addition, (5) referral likelihood was measured by asking teachers to rate on a 10-point scale the likelihood that they would refer the student in the vignette to a mental health services provider.

Individual Characteristics

Teachers indicated their own gender identity, race, ethnicity, and number of years teaching.

School Characteristics

Data from the U.S. Department of Education Common Core of Data (https://nces.ed.gov/ccd/) were extracted to measure region of the country based on U.S. Census regions (Northeast, Midwest, South, West), school urbanicity (City, Suburb, Town, Rural), whether the school qualified for Title I funding, school level (middle, high), and student racial/ethnic composition (percent of students identifying as Black, Hispanic/Latinx, and White). Racial/ethnic composition was further categorized as majority Black, majority Hispanic/Latinx, and majority White, when 50% or more of students were identified as being of that race/ethnicity. Schools in which there was no majority were categorized as non-majority schools.

Analytic Strategy

A series of logistic and linear regressions were conducted to estimate the association of individual teacher and school characteristics with teacher identification of disorders (seriousness of the problem, worry about the problem, commonness, identification of depression) and likelihood of referral for services. The first series of models estimated bivariate associations between each individual teacher or school factor with each identification or referral variable. The second set of models tested the multivariate association of all individual teacher characteristics in one model, with each identification or referral variable. The third set of models tested the multivariate association of all school characteristics in one model, with each identification or referral variable. A final series of models, presented below, tested all individual teacher, and school characteristics together in one multivariate model. Models were estimated separately for depression and ODD vignettes and all models controlled for vignette gender and vignette severity. Subsequent analyses tested a series of interaction terms to identify whether individual teacher and school characteristics interacted with vignette gender and vignette severity in their association with identification and referral likelihood.

Results

Depression

Overall, 56.7% of the sample (n = 261) identified the depression vignette as referring to a student with depression. Teacher identification of depression and ratings of problem seriousness, worry about the student, commonness of the problem, and likelihood of referral varied significantly as a function of vignette factors, individual teacher characteristics, and school characteristics (Tables 3, 4). As expected, vignette severity was significantly associated with identification of depression (OR = 2.4, 95% CI = 1.5–3.9), higher ratings of problem seriousness (B = 0.8, SE = 0.2, b = 0.3, p < 0.001), more worry about the student (B = 0.7, SE = 0.2, b = 0.3, p < 0.001), rating the problem as less common (B = − 0.6, SE = 0.3, b = − 0.1, p = 0.024), and greater likelihood of referral for mental health services (B = 0.6, SE = 0.2, b = 0.2, p = 0.003). The only individual teacher characteristics associated with vignette ratings was gender; teachers who identified as female rated the vignette as more serious (B = 0.5, SE = 0.2, b = 0.2, p = 0.003), worrisome (B = 0.5, SE = 0.2, b = 0.2, p = 0.002), and common (B = 0.7, SE = 0.3, b = 0.2, p = 0.006), than teachers who identified as male. In terms of school characteristics, high school teachers were more likely than middle school teachers to identify depression (OR = 1.7, 95% CI = 1.0–2.7), but reported a lower likelihood of referring the student for mental health services (B = − 0.5, SE = 0.2, b = − 0.1, p = 0.017). Teachers in the West region of the country indicated they were less likely to refer students than teachers in the Northeast (B = − 0.6, SE = 0.3, b = − 0.1, p = 0.046). Having a higher proportion of Black students in the school was associated with lower ratings of problem seriousness (B = − 1.0, SE = 0.4, b = − 0.2, p = 0.012) and decreased likelihood of referral for mental health services (B = − 1.3, SE = 0.5, b = − 0.2, p = 0.018).

Table 3 Rates of teachers identifying depression and ratings of depression seriousness, worry, commonness, and likelihood of referral

Table 4 Depression: Association between individual teacher characteristics, school characteristics, and indicators of identifying depression, ratings of seriousness, worry, commonness, and likelihood of referral

For each significant main effect, we tested whether teacher and school factors interacted with vignette gender or severity. The only significant interactions were related to teacher gender. First, there was a significant interaction of teacher gender with vignette gender, in association with ratings of problem seriousness (B = − 0.9, SE = 0.3, b = − 0.3, p = 0.005) and worry (B = − 0.9, SE = 0.3, b = − 0.3, p = 0.005). Specifically, female teachers rated female vignettes as more serious and worrisome and male vignettes as less serious and less worrisome than did male teachers. Second, there was a significant interaction of teacher gender and vignette severity with ratings of vignette seriousness (B = − 0.9, SE = 0.3, b = − 0.3, p = 0.008), such that female teachers rated moderate vignettes as more serious than did male teachers.

Oppositional Defiant Disorder

As noted above, only 0.8% of respondents (n = 4) specifically identified the ODD vignette as referring to a student with ODD. Teacher ratings of problem seriousness, worry about the student, commonness of the problem, and likelihood of referral of ODD vignettes varied significantly as a function of vignette factors, individual teacher characteristics, and school characteristics (Tables 5, 6). Teachers rated severe vignettes as significantly more serious (B = 0.5, SE = 0.2, b = 0.2, p = 0.004) and worrisome than moderate vignettes (B = 0.4, SE = 0.2, b = 0.1, p = 0.035). Female teachers were more likely to rate vignettes as serious (B = 0.3, SE = 0.2, b = 0.1, p = 0.045), worrisome (B = 0.4, SE = 0.2, b = 0.1, p = 0.035), and common (B = 0.8, SE = 0.3, b = 0.2, p = 0.002) than male teachers. High school teachers rated ODD vignettes as less common (B = − 0.6, SE = 0.3, b = − 0.1, p = 0.017) and reported that they were less likely to make a referral (B = − 0.7, SE = 0.3, b = − 0.2, p = 0.007) for mental health services than middle school teachers.

Table 5 Ratings of oppositional defiant disorder seriousness, worry, commonness, and likelihood of referral

Table 6 Oppositional Defiant Disorder: Association between individual teacher characteristics, school characteristics, and ratings of seriousness, worry, commonness, and likelihood of referral

For each significant main effect, we tested whether individual and school factors interacted with vignette gender or severity. The only significant interaction was the interaction between the percent of Black students in the school and the severity of the vignette in relation to ratings of commonness of the problem (B = 2.5, SE = 0.9, b = − 0.2, p = 0.007). Specifically, in schools with a higher percent of Black students, teachers rated severe vignettes as significantly more common than did teachers in other schools.

Discussion

Understanding how teachers make decisions about mental health referrals has implications for practice and policy efforts that can target improved access to mental health services and decrease disparities in service access. Although researchers and policymakers have called for schools to conduct regular emotional and behavioral screenings, which are designed to identify any students who may need mental health supports (Auerbach et al., 2020; Briesch et al., 2018), estimates suggest that the actual usage of screenings in schools is quite low (e.g., 12.6%; Bruhn et al., 2014). As such, in most schools, receipt of mental health services relies on students to initiate services themselves or on adults to facilitate the referral process. The role of teachers in these decisions has taken particular prominence in response to the COVID-19 pandemic, as the U.S. Department of Education has issued guidance that school and district leaders prioritize addressing student mental health needs and consider using federal funding to provide professional development for educators on this topic (U.S. Department of Education, 2021).

In the current sample, more than half (56.7%) of teachers correctly identified a vignette describing depression, whereas only 0.8% of teachers correctly identified a vignette describing ODD. These results indicate that teachers are much more knowledgeable of the definition and symptoms of depression than ODD. Furthermore, our findings indicate that teacher ratings of concern for hypothetical students with depression and ODD are associated with vignette characteristics, as well as with individual teacher and school characteristics.

In terms of vignette characteristics, our finding that teachers rated severe vignettes as more concerning than moderate vignettes confirmed that our manipulation was effective and is also consistent with prior research finding that teachers effectively rate vignette severity (Loades & Mastroyannopoulou, 2010; Splett et al., 2020). We found no differences in ratings of concern based on student gender. Epidemiologic studies finding that girls are more likely to receive mental health services for depression and males are more likely to receive mental health services for oppositional defiant disorder (Merikangas et al., 2011) suggest that gender differences would be expected. Some prior studies have also found that teachers are more likely to recognize and refer vignettes of boys with externalizing problems and girls with internalizing problems, as compared with when gender and problem-type pairs are reversed (Green et al., 1996; Loades & Mastroyannopoulou, 2010). However, consistent with our findings, other vignette studies have found that student gender is not significantly associated with teacher ratings of need for intervention either in or out of school (Pearcy et al., 1993; Splett et al., 2020).

Our analysis of teacher characteristics found that female teachers consistently indicated greater concern about the students in the vignettes than did male teachers, though female and male teachers were equally likely to indicate that they would refer students for mental health services. We were unable to find any previous studies that tested the association of teacher gender with concern for student mental health or referral for services. However, this finding was generally consistent with prior research indicating that adult females have higher rates of mental health literacy than males (Cotton et al., 2006; Reavley et al., 2012). There was also a significant interaction of teacher gender with vignette gender in predicting ratings of depression vignette seriousness. The finding that female teachers were more concerned than male teachers about female students, and less concerned than male teachers about male students, supports the importance of attending to teacher-student demographic match in decision-making about supports and services for youth. Further, there was an interaction of teacher gender with depression vignette severity indicating that female teachers were more concerned than male teachers about moderate depression vignettes. In general, moderate vignettes are more ambiguous than severe vignettes (which were rated as highly concerning by both male and female teachers) and suggests that, for less clear cases of psychological distress, female teachers may be more likely to express concern.

Finally, three school characteristics were associated with teacher ratings: school level (middle vs. high), region of the country, and racial/ethnic composition of the school. First, as compared to teachers in middle schools, teachers in high schools were more likely to identify student depression correctly and to rate ODD as less common. These findings may be related to the different age of onset of the two disorders. ODD generally starts at a younger age (Nock et al., 2007) than depression (Merkinagas et al., 2010a; b; Kessler et al., 2005), therefore high school teachers may have greater knowledge of depression symptoms than do middle school teachers. Further, although ODD tends to start at a younger age, some studies have found a decline in prevalence of ODD in late childhood and early adolescence (Maughan et al., 2004), which is consistent with high school teachers reporting the behaviors as less common than middle school teachers. High school teachers were also less likely than middle school teachers to indicate that they would refer students with either problem type for mental health services. This result is consistent with previous studies finding that teacher-involved supports for students decrease as students get older (Wagner et al., 2006) and with a prior study, which found that teacher likelihood of providing referrals and other supports to students with depression and ODD declined from elementary to middle and high school (Green et al., 2018). Results suggesting that supports decline with age are concerning given evidence that many disorders increase throughout adolescence (Merikangas et al., 2010a, 2010b).

Second, teachers in US states in the West were less likely to indicate that they would refer students with depression for mental health services than teachers in the Northeast. There is limited previous research on this topic and results of prior studies have been mixed. For example, one prior study found that school-based mental health service receipt was higher in Southern states, as compared with states in the West, Midwest, and Northeast (Costello et al., 2014), whereas another study found that children in Southern states were less likely to access needed mental health services (Whitney & Peterson, 2019). A study also found that there was a higher concentration of mental health providers in the Northeast than in other regions of the country (Ellis et al., 2009), which may influence teacher knowledge of mental health services and likelihood of referral. Future research on geographical variation in mental health service use and service availability may help to elucidate structural and contextual factors that influence the likelihood of students receiving services in their schools.

Third, in the current study, teachers in schools enrolling a majority of Black students rated depression as less serious and indicated that they were less likely to refer students for mental health services, as compared to teachers in schools with a lower proportion of Black students. We purposefully did not indicate student race or ethnicity in the vignette, as we were surveying teachers from schools that varied considerably in their racial and ethnic composition. As a result, we have only a general indicator of school composition, without further data on the context of the school or the race and ethnicity that the participant attributed to the student in the vignette. Nonetheless, results from the current study raise questions about how the composition of a teacher’s school can contribute to disparities in mental health service access and reduce the likelihood that teachers will recommend a referral for mental health services.

Some previous research has found no racial/ethnic differences in use of school counseling services (Slade, 2002) or that racial/ethnic disparities in school service receipt attenuate when controlling for student symptom profile and gender (Langer et al., 2015). The findings here, however, accounted for both symptom profile and gender in the construction of the vignette manipulation and still found evidence that teachers working in schools with a higher proportion of Black students may be less likely to refer students for mental health services. Further, there was a significant interaction between the proportion of Black students in the school and vignette severity with teacher ratings of the commonness of ODD behaviors. Teachers rated severe ODD vignette behaviors as significantly more common when they worked in schools with a majority of Black students. Coupled with the prior finding for depression, this result suggests that even when presented with a standardized vignette absent information about student race, teachers in schools with a higher proportion of Black students were more likely to perceive that significant oppositional behaviors were common and were less likely to report they would refer students with depression for mental health services. These findings may reflect teacher racial biases related to mental health and mental health services (e.g., whether students behavior is assumed to indicate “trouble” vs. “needing support”), and racial biases in how teachers (who, in our sample, are primarily non-Latinx white) experience and respond to student behavior. Results also indicate the need to consider the role of teachers’ referral decisions as situated within particular school contexts. As described above, prior studies have found that Black students are less likely than their white peers to access mental health services and more likely to receive punitive exclusionary discipline, even when engaging in the same behaviors (Gudiño et al., 2009; Kataoka et al., 2002; Skiba et al., 2011). Prior studies have found that school racial composition is associated with disciplinary decisions (Curran, 2016). The current study contributes to this existing literature by similarly finding that school racial composition may be important to mental health referral decisions. Additionally, it is possible that results reflect other factors that can influence teacher decision-making, such as systemic differences in funding for and availability of mental health services, as well as disparities in the availability of high-quality, and culturally and linguistically sustaining mental health services.

The current study has several limitations. The primary limitation is the use of vignettes. We elected to use vignettes because they allowed us to assess teachers’ responses to a standard stimulus, thereby providing us with an opportunity to investigate identification and referral decisions that are difficult to precisely evaluate in the context of real cases. However, in reality, teachers might respond differently to students in their classes than they report they would respond to vignettes (Jerolmack & Khan, 2014). Second, this study evaluated some of the most common forms of internalizing (depression) and externalizing (ODD) problems. However, we did not assess a broad range of disorders or teacher responses to comorbid disorders. Response to questions about anxiety or ADHD, for example, might provide different information about patterns in teacher referrals. Third, although we broadly and systematically sampled teachers across the U.S., only one-third of recruited teachers completed our survey. This response rate was higher than many other web surveys (Van Mol, 2017), however, it is possible that the teachers who chose to participate in this study were already the most attuned to student mental health. Fourth, we were limited in the school-level data available. Although we attempted to assess mental health service availability by asking respondents about the number of mental health providers in their schools, write-in comments from teachers on our survey led us to believe that many did not have this information or were not aware of the different roles and titles of providers in their school.

Despite limitations, this study provides data on teacher responses to student psychiatric disorders and their likelihood of referring students for mental health services across the U.S. Results regarding the racial composition of schools, in particular, contribute to a broad research base finding that Black students experience greater systemic barriers to accessing mental health services than white students and underscore the need for policy and practice interventions that engage stakeholders in increasing youth access to culturally and linguistically sustaining mental health services (Alegría et al., 2016). The current study also highlights a need for more research on how the availability and accessibility of mental health services varies across schools and may influence teacher decision-making around mental health supports and referrals. In particular, results raise important questions about regional variation and differences related to school urbanicity that might have implications for more effectively targeting school policy and intervention strategies. For example, whereas urban school districts may be able to build partnerships with community-based mental health centers (Pearrow et al., 2016), these resources are often less accessible for rural districts.

The study has several additional implications. First, in terms of teacher preparation, mental health training programs for secondary school teachers have been found to improve teacher mental health knowledge and attitudes (Anderson et al., 2019). These improvements may lead to more equitable access to services for students. Results of the current study, however, suggest that a single teacher preparation or training approach might not be equally effective for different school contexts. Just as trainings have been adapted to different cultural contexts (Crooks et al., 2018), adaptations may be needed for specific school communities, for example, to address regional variation in availability of mental health services and to integrate content related to systemic racial biases in the identification and referral process.

In addition, findings provide further support for the importance of school adoption of mental health screeners, which can systematically identify youth needing mental health services, without relying on teachers to determine which students require mental healthcare. Screeners ideally are paired with data on mental health service use (Green et al., 2021), so that schools can identify local disparities in service access among students who may need services, and then can actively address barriers to care. However, as noted above, most schools do not currently use universal screeners (Auerbach et al., 2020), indicating the need to continue to improve teacher preparation, even when screeners are available.

Finally, study results suggest several key areas for future research. Identifying contextual factors that influence teacher decision-making will be important both for understanding variability in service access and for improving teacher preparation. Further, rigorous research, particularly research integrating data from multiple levels of the school and social ecology, is needed to effectively determine how teachers inform pathways to student mental health service access. Ultimately, more deeply understanding how teachers serve in important identification and referral roles, particularly for youth who are underserved by the children’s mental health services system, is necessary to enhance equitable service access.