Abstract
Differences in approaches used to deliver school-based mental health and wellbeing programs may be a key consideration for program effectiveness, yet this has not been considered in reviews and meta-analyses to date. Consistent with previous research, this systematic review of 47 studies found that wellbeing programs delivered in schools tended to show small effect sizes for mental health and wellbeing outcomes with effects often not sustained. The review considered the influence of various program factors on effectiveness, and consistent with previous findings, program-based factors like theoretical framework, program length, and session duration did not show reliable patterns for influencing effectiveness. In contrast, pedagogical factors aimed at increasing participant engagement (e.g., using student-centred and active learning approaches), appear more closely linked to improved mental health and wellbeing outcomes. This review has shown that universal programs can be effective in producing better mental health and wellbeing outcomes in secondary school settings when participant engagement is maximised.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Mental health and wellbeing programs are commonplace in secondary schools around the world (Barry et al., 2019). They aim to help adolescents build skills which allow them to effectively navigate their journey into adulthood. However, these programs often produce mixed effects and despite numerous systematic reviews and meta-analyses it has been difficult for researchers and educators to clearly identify factors associated with program effectiveness. One area that has not yet been assessed are factors connected to student engagement, a key gap given that student engagement is associated with a variety of positive learning outcomes in numerous educational settings (Finn & Zimmer, 2012). To address this gap, the present review considers how participant engagement influences the outcomes of programs delivered in secondary school settings.
Adolescence is an important developmental period in which numerous social, neurological and emotional changes take place, all of which have the potential to contribute to difficulties with mental health (Negriff, 2020). While 75% of all mental health disorders are evident before the age of 24, half of all mental disorders manifest prior to the age of 14, with early symptoms often appearing years prior to a person meeting the full diagnostic criteria (Council & Medicine, 2009). In most western countries the period of adolescence takes place during secondary school. This marks a time where social and academic stress can contribute to the development of sub-clinical levels of depression and anxiety symptoms (Anniko, 2018). Early intervention during this period may assist adolescents to develop skills to manage their own wellbeing across the lifespan (Baños et al., 2017; Gladstone et al., 2015; Preventing Mental, Emotional, and Behavioral Disorders Among Young People: Progress and Possibilities, 2009). As such, mental health education may be most effective at the time and place where it is potentially most relevant: during adolescence in secondary schools.
Whilst mental health issues such as depression and anxiety might be prevalent in the adolescent population, help seeking behaviors in this demographic are low (Aguirre Velasco et al., 2020; Singh et al., 2019). The World Health Organization (WHO), suggests that as few as 20% of adolescents in need access the treatment required (WHO, 2005). More recent studies have shown this trend improving, but a 2018 study still showed a quarter of adolescents meeting criteria for psychological distress had not accessed mental health services (Sheppard et al., 2018). Evidence-based psychological treatments have been associated with reductions in mental health symptoms of depression and anxiety in adolescents that are maintained over time (Bandelow et al., 2018; Clarke et al., 2001; Oud et al., 2019; Swain et al., 2013). Despite this, further research in clinical samples suggests that between 30% and 40% of young people with mental health concerns who do access evidence-based intervention therapy will relapse within two years (Curry et al., 2011; Evans et al., 2005). The relapse rates associated with psychological interventions in the adolescent population suggest that prevention programs may be needed as an alternative. Engaging adolescents in prevention programs can help to reduce the volume of people requiring individually delivered mental health intervention therapy which is resource intensive and can be difficult to access for many young people (Merry et al., 2004).
Mental ill-health prevention strategies tend to utilize an educative, skill development approach (Feiss et al., 2019), thus secondary schools represent a potentially suitable setting for these types of programs. Early intervention programs that target students at risk of developing mental illness, or students that have elevated but still sub-clinical symptomology have shown some success in reducing mental health symptoms post program with these effects maintained at 6 and 12 month follow up (Horowitz et al., 2007; Lawrence et al., 2017). Even so, regardless of their documented successes, these programs can contribute to risk of stigmatization, potentially creating a divide between different groups within the same educational setting if, for instance, students need to be removed from class to attend the prevention program. This division can lead to stigma for those selected to be involved, resulting in the risk of attrition or program refusal (Gronholm et al., 2018). Similarly, the lack of precise selection criteria may hinder efforts to select students for targeted prevention programs successfully (Dodge, 2020).
School-based universal prevention programs have been suggested as a solution for reducing the incidence of mental ill-health in future adult populations (Baños et al., 2017). These programs aim to provide participants with a broad background in key concepts and skills that are designed to support their mental health and wellbeing across their lifespan (Wells et al., 2003). They are designed to be delivered to the wider population and are not aimed at targeting particular symptoms; instead, they strive to protect a person’s universal mental health (de Pablo et al., 2020). In contrast to targeted prevention programs, universal programs are free from the risk of unwanted stigma that adolescents can associate with approaches that target high risk or symptomatic groups (Rapee et al., 2006).
There have been a number of systematic reviews and meta-analyses conducted to summarize the effectiveness of school-based mental health and wellbeing programs across the world. These reviews and meta-analyses examined program length and community involvement (Blank et al., 2010; Wells et al., 2003); participant age (Mackenzie & Williams, 2018); universal versus targeted programs (Feiss et al., 2019; Neil & Christensen, 2007; Caldwell, 2019); and guiding psychological theory (Dray et al., 2017; (Tejada-Gallardo et al., 2020). Collectively, these reviews have provided partial direction for educators and researchers striving to determine the best practice for implementing universal prevention programs in secondary schools. One issue that remains particularly unclear, however, is the extent to which the universal programs reviewed are delivered using techniques that promote student engagement. It has been consistently demonstrated that greater student engagement is associated with improved learning and program outcomes (Carini et al., 2006; Marks, 2000; Shernoff, 2013; Wang et al., 2020). As with other educational settings, student engagement may also influence the effectiveness of universal programs in the promotion of mental health and wellbeing.
Pedagogy refers to the method and practice of teaching and educational research has provided direction as to the pedagogical factors that may contribute to students’ engagement and therefore program efficacy (Martin, 2008). Student engagement has been defined as “the student’s psychological investment in an effort directed toward learning, understanding, or mastering the knowledge, skills, or crafts that academic work is intended to promote” (Newmann, 1992, p12). To maximize the engagement of present day adolescents, the learning material must be relevant, and the students need to be involved in the discovery of solutions to real life problems (Shernoff et al., 2014). Instructional format may also be a predictor of student engagement; that is, characteristics associated with the facilitator (e.g., teacher or psychologist) in combination with the delivery method (Shernoff et al., 2014). Further to these, two critical pedagogical considerations for student engagement in wellbeing programs are active compared to passive learning approaches and student-centered compared to facilitator (or teacher) centered learning.
Active learning describes a teaching approach in which students are actively involved in the teaching and learning process (Silberman, 1996). Students are required to regularly review their understanding through reflection, questioning, discussing, writing and problem solving. It requires the learner to be mentally and often physically active in their attainment of knowledge through participating or contributing (Grabinger & Dunlap, 1995). Bonwell and Eison (1991) have suggested that active learning environments should include opportunities for both physical active learning (including role playing, physical problem solving, and group discussion) and active learning through writing (including journaling and other self-reflection exercises). The alternative is passive learning which implies that the student submissively receives the information being delivered. This method tends to be teacher or facilitator centered and more theoretical in nature, discarding the fundamental tenet of the widely accepted constructivist view of learning (de Kock et al., 2004), which emphasizes that knowledge cannot be transmitted directly from educator to learner, but rather must be constructed by the mental activity of the learners (Driver et al., 1994).
Student-centered learning environments aim for the student to be pivotal in the teaching and learning process in the same way that a client-centered approach to psychological therapy puts the client at the heart of the therapeutic process (Cannon & Newble, 2000; Murphy & Joseph, 2016). Student engagement is influenced by student-centered learning (Reeve, 2012), it identifies the need for autonomy, competence and relatedness as important for psychological growth and wellbeing (Smit et al., 2014). In student-centered learning environments, students are expected to consider the new information in the context of familiar and authentic situations. Learning is self-regulated, and students can influence the depth of learning for different topics throughout the learning process.
The Current Study
In addition to program factors thought to influence program effectiveness considered in previous reviews and meta-analyses, this review examines factors that influence participant engagement in universal wellbeing programs delivered in secondary schools. Programs included in this review utilize evidence based psychological approaches designed to promote adolescent wellbeing and mental health. Consistent with previous reviews, it will consider only studies that have a control condition such as lessons as normal or an alternative program so that any detected effects are able to be associated with participation in the program. Program features with the potential to influence student engagement considered in the current review include session length, program duration, program facilitator (known teacher or external provider), the use of student-centered pedagogy and the prominence of an active learning pedagogy. The aim of this review is not to develop an overall estimate of program effectiveness based on specific outcome measures. Instead, it aims to provide direction for program developers and schools employing these programs through a narrative description summarizing the features that appear most important for enhancing participant engagement and program effectiveness.
Methods
The review protocol was prospectively registered with PROSPERO (registration number - CRD42021269164) and adhered to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines (Page et al., 2021).
Data Sources
A systematic literature search was performed using five databases (PubMed, Embase, PsycINFO, ERIC and Education Research Complete). Database selection and search term development was completed with the assistance of an expert research librarian. Search terms focused on prevention programs, mental health and wellbeing, adolescents, and schools (see supplementary materials, Table S1 for a detailed logic grid of search terms).
Selection of Studies
The inclusion criteria for the selected studies were formulated in accordance with the PICO approach (Patient, Intervention, Comparison, Outcome), such that studies were included based on the following criteria: (1) The program was focused on a non-clinical, naturalistic sample of secondary school students (12 to 18 years old) in their school environment; (2) the intervention was universal in nature, targeted wellbeing and/or mental health outcomes, and delivered in a school setting; (3) studies were randomized control trials and non-randomized trials that used a control condition such as lessons as usual or an alternative program; (4) program outcomes were assessed using validated instruments for one or a combination of subjective psychological wellbeing support measures (e.g., resilience, self-esteem, and life satisfaction measures) and mental health measures (e.g., anxiety, depression, and distress measures); and (5) studies were published in peer reviewed journals from the year 2000 onwards to maximize the relevance for present day educational offerings. The exclusion criteria comprised interventions designed for use with a clinical population, studies that were not peer-reviewed or did not quantitatively assess the effectiveness of the prevention program, and articles that were not published in English. Solely qualitative research was not considered for this review. Due to the heterogeneity of the outcome measures used in the included studies, a meta-analysis was not appropriate. Instead, a narrative synthesis in line with current Synthesis Without Meta-analysis (SWiM) guidance (Campbell et al., 2020) was conducted, summarizing features associated with program effects on both positive and negative indicators of mental health and wellbeing.
Data Extraction
The PRISMA flowchart is depicted in Fig. 1 and outlines the standardized procedure of the different stages of study identification and eligibility assessment. The initial search returned a total of 2533 articles. After 731 duplicates were removed, 1810 titles and abstracts were screened by the lead author. This included five relevant studies identified by manually screening the reference lists of recent systematic reviews (Blank et al., 2010; Caldwell et al., 2019; Cilar et al., 2020; Dray et al., 2017; Feiss et al., 2019; Mackenzie & Williams, 2018; Tejada-Gallardo et al., 2020) and a further three articles identified through manual screening of reference lists of the included studies for this review (Freire et al., 2018; Melnyk et al., 2013; Veltro et al., 2015). A second rater not connected to the research team independently screened a randomly selected sub-sample of 10% of studies. Inter-rater reliability was high (97%), with the small number of disagreements discussed until full consensus was reached. Following this process, full text screening was conducted for 161 articles.
A total of 114 articles were excluded for reasons shown in Fig. 1, leaving 47 studies that met inclusion criteria identified for extraction. Study characteristics were extracted using an Excel spreadsheet developed for the purposes of the present study, with data extraction conducted by the lead author and checked by the second author. Information gathered from the studies included the following: study aim, theoretical underpinnings of the program, delivery methodology including pedagogical approach, session length, program duration, program facilitator, participant demographics, and results for the measured outcome variables.
Quality Assessment
The selected studies were assessed for their methodological quality using the Cochrane Collaboration’s tool for assessing risk of bias (Munder & Barth, 2018). The tool assesses the following risks of bias: (1) Sequence generation or how the groups were randomized if at all; (2) group allocation concealment; (3) blinding of participants and all personnel; (4) blinding of outcome assessors; (5) incomplete outcome data; (6) selective reporting; (7) Treatment implementation.
Results
Study Selection
The process of study selection can be seen in the PRISMA flowchart (Fig. 1). A total of 47 studies were included for the systematic review. All included studies were either randomized control trials or non-randomized two-arm (intervention and control group) designs that were conducted in secondary schools aimed at non-clinical adolescent samples. Each study reported at least one measure of mental health or wellbeing (e.g., measures of depression, anxiety, distress, life satisfaction). The variety of measures used in the studies included in this review had all been previously validated for use with adolescent samples and are shown in the online supplementary materials (Table S2).
Quality Assessment
The quality of each study was rated using Cochrane Collaboration’s tool for assessing risk of bias (Munder & Barth, 2018) to determine potential bias, a summary of the results can be seen in Fig. 2. Each of the 47 studies included in this review were at risk of bias due to the self-report nature of the measures used, resulting in outcome assessors not being blinded. Similarly, almost every study suffered from the potential bias of missing data with attrition rates and consistent access to participants challenging for most studies. Further adding to the potential for bias was the difficulty of consistent program delivery, where 33 of the 47 (70%) included studies were deemed to be at risk of bias for intervention adherence. Just over half of the studies, 26 (55%) were either considered a high or unclear risk of bias when blinding participants during group allocation and 13 studies (28%) were a high or unclear risk of bias during the sequence generation phase of the trial. Finally, more than half of the included studies exhibited some concerns around selective reporting of results where the most encouraging data was reported allowing a more favorable reflection of the program being studied.
Description of Studies and Their Effects
The studies included in this review measured the effectiveness of programs based on a variety of mental health and wellbeing outcome measures. Each program varied in delivery method as did program length and frequency of sessions. Table 1 shows the characteristics and main findings of all programs. The outcome variables examined in the 47 studies included in this review were wide-ranging making pooling of data not feasible. One study considered anxiety alone as the outcome variable of interest post intervention, eight considered depressive symptoms in isolation, six considered both depressive symptoms and anxiety, nine measured protective wellbeing factors only, while 23 measured a combination of depression, anxiety and wellbeing measures. Adding to the heterogeneity of the studies in this review, were differences in psychological theory defining each program (Cognitive Behavioral Therapy (CBT), Acceptance Commitment Therapy (ACT), Positive Psychology (PP), Rational Emotive Behavior Therapy (REBT), Mindfulness Therapy, Growth Mindsets, and others) and participant age (12–18). Significant positive results were reported for at least one of the outcome measures considered in n = 22 studies (47%), while n = 25 (53%) did not produce significant positive effects for any mental health and wellbeing variables measured. Table 1 highlights the characteristics of these programs and the respective key findings of each study.
Program factors linked to student engagement
The studies that reported significant positive effects for participants’ mental health and wellbeing were more likely to include the key elements required for maximizing student engagement. Of the 22 programs reporting significant changes to psychological outcomes, 17/22 (77%) included at least one aspect that was based on active learning where the participant was required to be physically active in their learning experience. The same number of studies (17/22 (77%)) included an element of active learning where participants needed to reflect on and engage with the program’s content through writing. Contrary to this, the 25 studies that did not produce significant positive effects were less likely to use active learning methods. Physically active learning experiences were present in 15/25 (60%) programs and written active learning practices in 12/25 (48%).
Student-centered learning methodology was more prevalent in studies reporting on programs that produced significant positive results. These studies allowed participants to have an input into the learning process such that their learning was personalized and informed the program content. In 55% of programs reporting such results (12/22), student-centered learning was a feature. Alternatively, only five programs from the 25 studies that reported non-significant effects for the mental health and wellbeing of participants (20%), used student-centered learning methods as a part of their delivery.
Teachers trained by psychologists or using facilitation handbooks designed by psychologists had slightly more success in delivering programs that produced significant, positive outcomes when compared to those delivered either online or by external providers such as psychologists. Teacher involvement in program delivery occurred in 13 out of 22 (59%) effective programs, while 12 of 25 (48%) programs that produced non-significant results had some form of teacher involvement in program delivery.
No clear pattern emerged as to the most effective program length, session frequency, and duration. From the studies that reported positive effects, 12/22 (55%) prevention programs were at least 10 sessions in duration, 15/22 (68%) with each session no longer than one hour, and 17/22 (77%) were accessed weekly. Similar numbers were found for the 25 studies that did not produce significant, positive effects for the mental health and wellbeing outcome variables they considered. Twelve of these 25 studies (48%) consisted of at least 10 sessions, 18/25 (72%) comprised sessions that were no longer than one hour, and 14/25 (56%) were delivered weekly. Similarly, there was no consistent theme as to whether a trained psychologist or a trained teacher is more effective at delivering these programs. From the studies reporting positive effects, 7/22 (32%) were teacher delivered, 9/22 (41%) were delivered by psychologists, 3/22 (14%) were accessed online, while 16/22 (72%) had some form of teacher involvement. The studies reporting non-significant results included 11/25 (44%) delivered by teachers, 9/25 (36%) by external providers, 2/25 (8%) online, while 17/25 (68%) had some form of teacher involvement. The psychological theory driving most programs that showed positive effects was Cognitive Behavioral Therapy (CBT) with 13 of 22 (59%) studies reporting positive effects using CBT as their foundation. Studies unable to report positive effects for their programs used CBT as a base for their content in 11 of 25 (44%) studies.
Discussion
Previous reviews and meta-analyses have examined the influence of a variety of program factors on the effectiveness of school-based, universal programs designed to support mental health and wellbeing. However, the pedagogy behind program delivery has not yet been considered. Consequently, the present review additionally examined the influence factors expected to enhance student engagement had on program effectiveness. Overall, the current review of 47 control trials found that while most prevention programs were not successful in producing sustained positive effects on psychological outcomes for secondary school students, a pattern of association between the methodology used for program delivery and program effectiveness was shown. Findings from just under half of the included studies suggest that content delivered via a pedagogical framework designed to maximize student engagement, tend to be associated with larger effects for targeted mental health and wellbeing outcome variables.
Factors influencing program efficacy
Studies reporting positive effects often had some form of teacher involvement, some as the primary facilitator (e.g., Ardic & Erdogan 2017; Brunwasser et al., 2018; Merry et al., 2004; Rivet-Duval et al., 2011) and others as an observer or support to the primary facilitator (e.g., Calear et al., 2009; Phuphaibul et al., 2005; Shoshani & Steinmetz, 2014; Shoshani et al., 2016; Wahl et al., 2014). Training for teachers appears important and the above-mentioned programs most often involved teacher/facilitators who were trained by psychologists. Further support for these teacher facilitators came in the form of facilitation manuals developed by psychologists to allow for program fidelity. Whilst psychologists and other healthcare professionals who are expert in their field can provide sound, evidence-based content for prevention programs, educators are trained in classroom management and teaching methodology that can enhance student engagement (Emmer & Stough, 2001). Classroom teachers also have a prior relationship with their students that can result in more useful group discussions and personal sharing as a part of any program. Finally, these relationships between students and their teachers are ongoing, which allows support to be provided for students for the duration of their secondary schooling. Teachers can help students reflect on the program content to work through difficult life situations in real time.
In terms of theoretical framework, most programs included in the present review were grounded in Cognitive Behavioral Therapy (CBT). This is unsurprising as CBT has a strong evidence base for being effective in working with adolescents in clinical samples to reduce symptoms of depression and anxiety (Kendall & Peterman, 2015; Webb et al., 2012), and in non-clinical samples to reduce the negative effects of problematic traits such as perfectionism (Lloyd et al., 2015). The current review showed that effectiveness of programs founded on the tenets of CBT were mixed. Just over half of the programs that produced significant, positive results used Cognitive Behavioral Therapy (CBT) as the foundation for the content delivered, while just under half of the ineffective programs were based on the same psychological theory. Trials of programs driven by alternatives to CBT were much fewer in number and produced similarly mixed results; significant, positive effects were found in programs guided by Rational Emotive Behavior Therapy (David et al., 2019), Positive Psychology (Shoshani & Steinmetz, 2014; Shoshani et al., 2016) and education of growth mindsets and neuroplasticity (Miu & Yeager, 2014; Perkins et al., 2021). Additionally, programs based on ACT and mindfulness produced positive but non-significant effects (Burckhardt et al., 2017; Volanen et al., 2020).
Session duration, frequency, and program length were similar across most studies and did not appear to have a consistent influence on program effectiveness. Most programs were delivered weekly, with sessions not longer than an hour in duration and program length at least 10 sessions. It is possible that these features exist for more practical reasons (e.g., to fit within complex school timetables and optimise student attention and concentration; Hoshino & Fabris 2020; Williams & Williams, 2011), rather than specifically to enhance program effectiveness.
In the current review, every program has an element of didactic lecture style teaching to convey the psychological theory underpinning the program. In order to maximize student attention during these teaching moments, presenters need to be adept story tellers (Williams & Williams, 2011), or have expertise in delivering lectures that involve student-centered methods (Bunce et al., 2010). It is difficult to make an assessment about how the content was delivered in the different programs without observation, but it is possible to consider the activities included to assess the extent to which student-centered and active learning opportunities were used in the various programs. In programs reporting significant, positive effects, student-centered approaches were often prominent in program delivery. Examples of student-centered learning approaches included setting personal goals and actions based on understanding developed through participation in the program, student participants choosing specific topics for discussion in the program relevant to their needs, determining their own wellbeing strategies and actively reflecting on their own thoughts, feelings and behaviors as part of the program.
Similar results were found for active learning experiences in programs reporting positive effects: more than three quarters of programs reporting significant beneficial effects provided physical active learning opportunities for participants. This included role playing, participation in group discussions, or interactive games. The same proportion of effective programs incorporated some form of writing to allow participants to be active in their learning – journaling, writing to provide guidance for future students, or activities in workbooks.
In comparison, the programs that did not produce positive effects for mental health and wellbeing outcomes were less likely to use student-centered and active learning delivery methods, with passive participation a more common approach. However, the most stark contrast between effective and ineffective programs regarded the student-centered approach. More than half the programs reporting positive effects had features where participants were able to have input into what was being learned, how it was being learned or how it was related to their personal world view. By contrast, only a fifth of programs reporting no positive effects had the participants at the center of their learning experience.
Limitations and Future Directions
Although this systematic review was able to address a gap in the literature regarding the delivery method used by the different programs created, there are some limitations. The focus of this review was on quantitative data produced from controlled trial studies across the world. Due to the wide variety of psychological outcomes assessed by programs included in the review, it was not feasible to pool or meta-analyze study data. This meant that a meta-analysis, which would normally be used to provide a quantitative synthesis of the results was not used. To develop a clearer understanding of prevention programs, future review approaches could consider focusing on specific outcome variables (e.g., symptoms of anxiety or depression) to allow for meta-analysis.
Because the present review considered effectiveness of programs based on quantitative data only, it is difficult to understand exactly how the students connected with the content except for through the outcome variables examined. As these programs are delivered to non-clinical samples, it can be difficult to show significant effects and it is possible that the benefits of these programs will not be seen until those participating are faced with some form of life difficulty. Studies that include a qualitative element should be considered to provide a more thorough account of how participants engage with the programs being reviewed. Similarly, future program trials should consider using a mixed methods approach to allow participants to report their engagement with the program in greater detail specifically highlighting aspects that help them engage and aspects that make focusing on the content more difficult. This will help provide greater meaning to the self-report quantitative results these trials uncover.
Despite the best preparations and intentions of researchers, the challenges associated with research in schools may still impact the quality of each study. This review was not immune from this issue and had concerns with the quality of the included trials, particularly regarding attrition rates. It was decided not to exclude any of these studies as the assessment of pedagogical approaches described by each was more valuable than the reliability of reported effectiveness for this narrative synthesis. However, future meta-analyses may choose to exclude studies with high levels of attrition to ensure the overall results are at reduced risk of bias from incomplete data.
Another risk of bias for this review is the ‘file drawer effect’ where often, only studies producing significant, positive results are published (Rosenthal, 1979). Publication bias has been reported to be as much as 40% more likely for studies that produce significant positive results compared to studies confirming the null hypothesis (Franco et al., 2014). Consequently, it is possible that the true effects of universal prevention programs delivered in schools are actually lower than the results described in this review as unpublished studies were not able to be included.
Finally, alternatives to CBT (e.g., REBT, Positive Psychology, growth mindset education) and approaches derived from CBT (typically termed ‘third wave’ CBT approaches; e.g., ACT, mindfulness) have been successful in producing positive effects for adolescents in different settings (Anggreini et al., 2019; Burke, 2010; Carr et al., 2021; Livheim et al., 2015; Miller, 2019; Petersen et al., 2022; Reangsing et al., 2021). The findings of this review suggest that programs based on these approaches may also show promise for use within schools, however, these psychological theories have not yet been used widely in the development of universal prevention programs. As such, CBT alternatives and third wave approaches may warrant greater exploration in future studies.
Conclusion
Prior research into secondary school programs designed to prevent mental ill-health has not been able to provide clear direction for facilitators and developers regarding delivery methods most likely to produce positive outcomes. This review has shown that universal prevention programs that use techniques designed to increase participant engagement are more likely to be effective in producing better mental health and wellbeing outcomes in secondary school settings. It considered the methods used to engage secondary school students in these programs and found numerous factors were linked to program effectiveness. Teacher engagement appears important, whether involved with program delivery or reinforcing the work of program facilitators through student wellbeing practices during the school day. Similarly, more effective programs tended to deliver content using pedagogy proven to positively influence participant engagement. Programs that used a student-centered learning approach and required participants to be active in their learning were associated with more positive effects for mental health and wellbeing outcomes. Future trials should prioritize program delivery methods that allow participants to actively engage and influence the content delivered while ensuring it is guided by evidence based psychological theory.
References
Aguirre Velasco, A., Cruz, I. S. S., Billings, J., Jimenez, M., & Rowe, S. (2020). What are the barriers, facilitators and interventions targeting help-seeking behaviours for common mental health problems in adolescents? A systematic review. Bmc Psychiatry, 20(1), 1–22. https://doi.org/10.1186/s12888-020-02659-0
Anggreini, C., Daharnis, D., & Karneli, Y. (2019). The Effectiveness of group rational emotive behavior therapy to reduce student learning burnout. International Journal of Research in Counseling and Education, 3(2), 109–114
Anniko, M. K., Boersma, K., & Tillfors, M. (2018). Sources of stress and worry in the development of stress-related mental health problems: A longitudinal investigation from early to mid adolescence. Anxiety Stress and Coping, 32(2), 155–167. https://doi.org/10.1080/10615806.2018.1549657
Ardic, A., & Erdogan, S. (2017). The effectiveness of the COPE healthy lifestyles TEEN program: A school-based intervention in middle school adolescents with 12-month follow-up [Curriculum & Programs & Teaching Methods 3530]. Journal of Advanced Nursing, 73(6), 1377–1389. https://doi.org/10.1111/jan.13217
Bandelow, B., Sagebiel, A., Belz, M., Görlich, Y., Michaelis, S., & Wedekind, D. (2018). Enduring effects of psychological treatments for anxiety disorders: meta-analysis of follow-up studies. The British Journal of Psychiatry, 212(6), 333–338. https://doi.org/10.1192/bjp.2018.49
Baños, R. M., Etchemendy, E., Mira, A., Riva, G., Gaggioli, A., & Botella, C. (2017). 2017-January-30). Online Positive Interventions to Promote Well-being and Resilience in the Adolescent Population: A Narrative Review [Perspective]. Frontiers in Psychiatry, 8(10), https://doi.org/10.3389/fpsyt.2017.00010
Barry, M. M., Clarke, A. M., Petersen, I., & Jenkins, R. (2019). Implementing mental health promotion. Springer
Blank, L., Baxter, S., Goyder, E., Naylor, P., Guillaume, L., Wilkinson, A., Hummel, S., & Chilcott, J. (2010). Promoting well-being by changing behaviour: a systematic review and narrative synthesis of the effectiveness of whole secondary school behavioural interventions. Mental Health Review Journal. https://doi.org/10.5042/mhrj.2010.0371
Bonwell, C. C., & Eison, J. A. (1991). Active learning: Creating excitement in the classroom. 1991 ASHE-ERIC higher education reports. ERIC
Brunwasser, S. M., Freres, D. R., & Gillham, J. E. (2018). Youth cognitive-behavioral depression prevention: Testing theory in a randomized controlled trial [Educational/Vocational Counseling & Student Services 3580]. Cognitive Therapy and Research, 42(4), 468–482. https://doi.org/10.1007/s10608-018-9897-6
Bunce, D. M., Flens, E. A., & Neiles, K. Y. (2010). How long can students pay attention in class? A study of student attention decline using clickers. Journal of Chemical Education, 87(12), 1438–1443
Burckhardt, R., Manicavasagar, V., Batterham, P. J., Hadzi-Pavlovic, D., & Shand, F. (2017). Acceptance and commitment therapy universal prevention program for adolescents: a feasibility study. Child Adolesc Psychiatry Ment Health, 11, 27. https://doi.org/10.1186/s13034-017-0164-5
Burke, C. A. (2010). Mindfulness-based approaches with children and adolescents: A preliminary review of current research in an emergent field. Journal of Child and Family Studies, 19(2), 133–144. https://doi.org/DOI
Caldwell, D. M., Davies, S. R., Hetrick, S. E., Palmer, J. C., Caro, P., López-López, J. A., Gunnell, D., Kidger, J., Thomas, J., & French, C. (2019). School-based interventions to prevent anxiety and depression in children and young people: a systematic review and network meta-analysis. The Lancet Psychiatry, 6(12), 1011–1020. https://doi.org/10.1016/S2215-0366(19)30403-1
Calear, A. L., Christensen, H., Mackinnon, A., Griffiths, K. M., & O’Kearney, R. (2009). The YouthMood Project: A cluster randomized controlled trial of an online cognitive behavioral program with adolescents [Cognitive Therapy 3311]. Journal of consulting and clinical psychology, 77(6), 1021–1032. https://doi.org/10.1037/a0017391(Journal of Consulting Psychology)
Campbell, M., McKenzie, J. E., Sowden, A., Katikireddi, S. V., Brennan, S. E., Ellis, S., Hartmann-Boyce, J., Ryan, R., Shepperd, S., & Thomas, J. (2020). Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline. bmj, 368. https://doi.org/10.1136/bmj.l6890
Cannon, R., & Newble, D. (2000). A guide to improving teaching methods: A handbook for teachers in university and colleges. UK: Kogan Page
Carini, R. M., Kuh, G. D., & Klein, S. P. (2006). Student engagement and student learning: Testing the linkages. Research in higher education, 47(1), 1–32
Carr, A., Cullen, K., Keeney, C., Canning, C., Mooney, O., Chinseallaigh, E., & O’Dowd, A. (2021). Effectiveness of positive psychology interventions: a systematic review and meta-analysis. The Journal of Positive Psychology, 16(6), 749–769
Cilar, L., Štiglic, G., Kmetec, S., Barr, O., & Pajnkihar, M. (2020). Effectiveness of school-based mental well‐being interventions among adolescents: A systematic review. Journal of Advanced Nursing, 76(8), 2023–2045. https://doi.org/10.1111/jan.14408
Clarke, G. N., Hornbrook, M., Lynch, F., Polen, M., Gale, J., Beardslee, W., O’Connor, E., & Seeley, J. (2001). A randomized trial of a group cognitive intervention for preventing depression in adolescent offspring of depressed parents. Archives of General Psychiatry, 58(12), 1127–1134
Council, N. R., & Medicine, I. (2009). Preventing Mental, Emotional, and Behavioral Disorders Among Young People: Progress and Possibilities. The National Academies Press. https://doi.org/10.17226/12480
Curry, J., Silva, S., Rohde, P., Ginsburg, G., Kratochvil, C., Simons, A., Kirchner, J., May, D., Kennard, B., & Mayes, T. (2011). Recovery and recurrence following treatment for adolescent major depression. Archives of general psychiatry, 68(3), 263–269. https://doi.org/10.1001/archgenpsychiatry.2010.150
David, O. A., Cardoș, R. A., & Matu, S. (2019). Is REThink therapeutic game effective in preventing emotional disorders in children and adolescents? Outcomes of a randomized clinical trial. European child & adolescent psychiatry, 28(1), 111–122. https://doi.org/10.1007/s00787-018-1192-2
de Kock, A., Sleegers, P., & Voeten, M. J. (2004). New learning and the classification of learning environments in secondary education. Review of educational research, 74(2), 141–170
de Pablo, G. S., De Micheli, A., Nieman, D. H., Correll, C. U., Kessing, L. V., Pfennig, A., Bechdolf, A., Borgwardt, S., Arango, C., & Van Amelsvoort, T. (2020). Universal and selective interventions to promote good mental health in young people: systematic review and meta-analysis. European Neuropsychopharmacology, 41, 28–39. https://doi.org/10.1016/j.euroneuro.2020.10.007
Dodge, K. A. (2020). Annual research review: universal and targeted strategies for assigning interventions to achieve population impact. Journal of Child Psychology and Psychiatry, 61(3), 255–267
Dray, J., Bowman, J., Campbell, E., Freund, M., Wolfenden, L., Hodder, R. K., McElwaine, K., Tremain, D., Bartlem, K., & Bailey, J. (2017). Systematic review of universal resilience-focused interventions targeting child and adolescent mental health in the school setting. Journal of the American Academy of Child & Adolescent Psychiatry, 56(10), 813–824. https://doi.org/10.1016/j.jaac.2017.07.780
Driver, R., Asoko, H., Leach, J., Scott, P., & Mortimer, E. (1994). Constructing scientific knowledge in the classroom. Educational researcher, 23(7), 5–12
Emmer, E. T., & Stough, L. M. (2001). Classroom management: A critical part of educational psychology, with implications for teacher education. Educational psychologist, 36(2), 103–112
Evans, D. L., Foa, E. B., Gur, R. E., Hendin, H., O’Brien, C. P., Seligman, M. E., & Walsh, B. T. (2005). Treating and preventing adolescent mental health disorders: What we know and what we don’t know. Oxford University Press
Feiss, R., Dolinger, S. B., Merritt, M., Reiche, E., Martin, K., Yanes, J. A., Thomas, C. M., & Pangelinan, M. (2019). A systematic review and meta-analysis of school-based stress, anxiety, and depression prevention programs for adolescents. Journal of youth and adolescence, 48(9), 1668–1685. https://doi.org/10.1007/s10964-019-01085-0
Finn, J. D., & Zimmer, K. S. (2012). Student engagement: What is it? Why does it matter?. Handbook of research on student engagement (pp. 97–131). Springer
Franco, A., Malhotra, N., & Simonovits, G. (2014). Publication bias in the social sciences: Unlocking the file drawer. Science, 345(6203), 1502–1505
Freire, T., Lima, I., Teixeira, A., Araújo, M. R., & Machado, A. (2018). Challenge: To Be+. A group intervention program to promote the positive development of adolescents. Children and Youth Services Review, 87, 173–185
Gladstone, T. R. G., Forbes, P. W., Diehl, A., & Beardslee, W. R. (2015). Increasing understanding in children of depressed parents: Predictors and moderators of intervention response [Health & Mental Health Treatment & Prevention 3300]. Depression Research and Treatment, 2015. https://doi.org/10.1155/2015/347971
Grabinger, R. S., & Dunlap, J. C. (1995). Rich environments for active learning: A definition. ALT-J, 3(2), 5–34
Gronholm, P. C., Nye, E., & Michelson, D. (2018). Stigma related to targeted school-based mental health interventions: a systematic review of qualitative evidence. Journal of Affective Disorders, 240, 17–26. https://doi.org/10.1016/j.jad.2018.07.023
Horowitz, J. L., Garber, J., Ciesla, J. A., Young, J. F., & Mufson, L. (2007, Oct). Prevention of depressive symptoms in adolescents: a randomized trial of cognitive-behavioral and interpersonal prevention programs. Journal Of Consulting And Clinical Psychology, 75(5), 693–706. https://doi.org/10.1037/0022-006X.75.5.693
Hoshino, R., & Fabris, I. (2020). Optimizing student course preferences in school timetabling. International Conference on Integration of Constraint Programming, Artificial Intelligence, and Operations Research
Kendall, P. C., & Peterman, J. S. (2015). CBT for adolescents with anxiety: Mature yet still developing. American Journal of Psychiatry, 172(6), 519–530. https://doi.org/10.1176/appi.ajp.2015.14081061
Lawrence, P. J., Rooke, S. M., & Creswell, C. (2017). Prevention of anxiety among at-risk children and adolescents–a systematic review and meta‐analysis. Child and Adolescent Mental Health, 22(3), 118–130. https://doi.org/10.1111/camh.12226
Livheim, F., Hayes, L., Ghaderi, A., Magnusdottir, T., Högfeldt, A., Rowse, J., Turner, S., Hayes, S. C., & Tengström, A. (2015). The effectiveness of acceptance and commitment therapy for adolescent mental health: Swedish and Australian pilot outcomes. Journal of Child and Family Studies, 24(4), 1016–1030. https://doi.org/10.1007/s10826-014-9912-9
Lloyd, S., Schmidt, U., Khondoker, M., & Tchanturia, K. (2015). Can psychological interventions reduce perfectionism? A systematic review and meta-analysis. Behavioural and Cognitive Psychotherapy, 43(6), 705–731. https://doi.org/10.1017/S1352465814000162
Mackenzie, K., & Williams, C. (2018). Universal, school-based interventions to promote mental and emotional well-being: What is being done in the UK and does it work? A systematic review.BMJ open, 8(9), e022560
Marks, H. M. (2000). Student engagement in instructional activity: Patterns in the elementary, middle, and high school years. American educational research journal, 37(1), 153–184
Martin, A. J. (2008). Enhancing student motivation and engagement: The effects of a multidimensional intervention [Classroom Dynamics & Student Adjustment & Attitudes 3560]. Contemporary Educational Psychology, 33(2), 239–269. https://doi.org/10.1016/j.cedpsych.2006.11.003
Melnyk, B. M., Jacobson, D., Kelly, S., Belyea, M., Shaibi, G., Small, L., O’Haver, J., & Marsiglia, F. F. (2013). Promoting healthy lifestyles in high school adolescents: a randomized controlled trial. American Journal of Preventive Medicine, 45(4), 407–415
Merry, S., McDowell, H., Wild, C. J., Bir, J., & Cunliffe, R. (2004). A randomized placebo-controlled trial of a school-based depression prevention program. Journal of the American Academy of Child & Adolescent Psychiatry, 43(5), 538–547. https://doi.org/10.1097/00004583-200405000-00007
Miller, D. I. (2019). When do growth mindset interventions work? Trends in cognitive sciences, 23(11), 910–912
Miu, A. S., & Yeager, D. S. (2014). Preventing Symptoms of Depression by Teaching Adolescents That People Can Change. Clinical Psychological Science, 3(5), 726–743. https://doi.org/10.1177/2167702614548317
Munder, T., & Barth, J. (2018). Cochrane’s risk of bias tool in the context of psychotherapy outcome research. Psychotherapy Research, 28(3), 347–355. https://doi.org/10.1080/10503307.2017.1411628
Murphy, D., & Joseph, S. (2016). Person-centered therapy: Past, present, and future orientations
Negriff, S. (2020). ACEs are not equal: Examining the relative impact of household dysfunction versus childhood maltreatment on mental health in adolescence. Social Science & Medicine, 245, 1–8
Newmann, F. M. (1992). Student engagement and achievement in American secondary schools. ERIC
Oud, M., De Winter, L., Vermeulen-Smit, E., Bodden, D., Nauta, M., Stone, L., Van Den Heuvel, M., Taher, A., De Graaf, R., I., & Kendall, T. (2019). Effectiveness of CBT for children and adolescents with depression: A systematic review and meta-regression analysis. European psychiatry, 57, 33–45. https://doi.org/10.1016/j.eurpsy.2018.12.008
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., & Brennan, S. E. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. International Journal of Surgery, 88, 105906. https://doi.org/10.1016/j.ijsu.2021.105906
Perkins, A. M., Bowers, G., Cassidy, J., Meiser-Stedman, R., & Pass, L. (2021). An enhanced psychological mindset intervention to promote adolescent wellbeing within educational settings: A feasibility randomized controlled trial. Journal of clinical psychology, 77(4), 946–967. https://doi.org/10.1002/jclp.23104
Petersen, J. M., Davis, C. H., Renshaw, T. L., Levin, M. E., & Twohig, M. P. (2022). School-Based Acceptance and Commitment Therapy for Adolescents With Anxiety: A Pilot Trial. Cognitive and Behavioral Practice
Phuphaibul, R., Thanooruk, R., Leucha, Y., Sirapo-ngam, Y., & Kanobdee, C. (2005). The impacts of the “immune of life” for teens module application on the coping behaviors and mental health of early adolescents. Journal of pediatric nursing, 20(6), 461–468. https://doi.org/10.1016/j.pedn.2005.08.003
Preventing Mental (2009)., Emotional, and Behavioral Disorders Among Young People: Progress and Possibilities. The National Academies Press. https://doi.org/10.17226/12480
Rapee, R. M., Wignall, A., Sheffield, J., Kowalenko, N., Davis, A., McLoone, J., & Spence, S. H. (2006). Adolescents’ reactions to universal and indicated prevention programs for depression: Perceived stigma and consumer satisfaction. Prevention science, 7(2), 167–177. https://doi.org/10.1007/s11121-006-0035-4
Reangsing, C., Punsuwun, S., & Schneider, J. K. (2021). Effects of mindfulness interventions on depressive symptoms in adolescents: A meta-analysis. International journal of nursing studies, 115, 103848
Reeve, J. (2012). A self-determination theory perspective on student engagement. Handbook of research on student engagement (pp. 149–172). Springer
Rivet-Duval, E., Heriot, S., & Hunt, C. (2011). Preventing adolescent depression in Mauritius: A universal school-based program [Educational/Vocational Counseling & Student Services 3580]. Child and Adolescent Mental Health, 16(2), 86–91. https://doi.org/http://dx.doi.org/10.1111/j.1475-3588.2010.00584.x (Child Psychology & Psychiatry Review)
Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological bulletin, 86(3), 638
Sheppard, R., Deane, F. P., & Ciarrochi, J. (2018). Unmet need for professional mental health care among adolescents with high psychological distress. Australian & New Zealand Journal of Psychiatry, 52(1), 59–67. https://doi.org/10.1177/0004867417707818
Shernoff, D. J. (2013). Optimal learning environments to promote student engagement
Shernoff, D. J., Csikszentmihalyi, M., Schneider, B., & Shernoff, E. S. (2014). Student engagement in high school classrooms from the perspective of flow theory. Applications of flow in human development and education (pp. 475–494). Springer
Shoshani, A., & Steinmetz, S. (2014). Positive psychology at school: A school-based intervention to promote adolescents’ mental health and well-being [Educational/Vocational Counseling & Student Services 3580]. Journal of Happiness Studies: An Interdisciplinary Forum on Subjective Well-Being, 15(6), 1289–1311. https://doi.org/10.1007/s10902-013-9476-1
Shoshani, A., Steinmetz, S., & Kanat-Maymon, Y. (2016). Effects of the Maytiv positive psychology school program on early adolescents’ well-being, engagement, and achievement [Educational/Vocational Counseling & Student Services 3580]. Journal of School Psychology, 57, 73–92. https://doi.org/10.1016/j.jsp.2016.05.003
Silberman, M. (1996). Active Learning: 101 Strategies To Teach Any Subject. ERIC
Singh, S., Zaki, R. A., & Farid, N. D. N. (2019). A systematic review of depression literacy: Knowledge, help-seeking and stigmatising attitudes among adolescents. Journal of Adolescence, 74, 154–172. https://doi.org/10.1016/j.adolescence.2019.06.004
Smit, K., De Brabander, C. J., & Martens, R. L. (2014). Student-centred and teacher-centred learning environment in pre-vocational secondary education: Psychological needs, and motivation. Scandinavian Journal of Educational Research, 58(6), 695–712. https://doi.org/10.1080/00313831.2013.821090
Swain, J., Hancock, K., Hainsworth, C., & Bowman, J. (2013). Acceptance and commitment therapy in the treatment of anxiety: a systematic review. Clinical psychology review, 33(8), 965–978
Tejada-Gallardo, C., Blasco-Belled, A., Torrelles-Nadal, C., & Alsinet, C. (2020). Effects of school-based multicomponent positive psychology interventions on well-being and distress in adolescents: a systematic review and meta-analysis. Journal of Youth and Adolescence, 49(10), 1943–1960
Veltro, F., Ialenti, V., Iannone, C., Bonanni, E., & Morales García, M. A. (2015). Promoting the psychological well-being of Italian youth: A pilot study of a high school mental health program. Health Promotion Practice, 16(2), 169–175
Volanen, S. M., Lassander, M., Hankonen, N., Santalahti, P., Hintsanen, M., Simonsen, N., Raevuori, A., Mullola, S., Vahlberg, T., & But, A. (2020). Healthy learning mind–Effectiveness of a mindfulness program on mental health compared to a relaxation program and teaching as usual in schools: A cluster-randomised controlled trial. Journal of Affective Disorders, 260, 660–669
Wahl, M. S., Adelson, J. L., Patak, M. A., Pössel, P., & Hautzinger, M. (2014). Teachers or psychologists: who should facilitate depression prevention programs in schools? International journal of environmental research and public health, 11(5), 5294–5316. https://doi.org/10.3390/ijerph110505294
Wang, M. T., Hofkens, T., & Ye, F. (2020). Classroom quality and adolescent student engagement and performance in mathematics: A multi-method and multi-informant approach. Journal of youth and adolescence, 49(10), 1987–2002
Webb, C. A., Auerbach, R. P., & DeRubeis, R. J. (2012). Processes of change in CBT of adolescent depression: Review and recommendations. Journal of Clinical Child & Adolescent Psychology, 41(5), 654–665. https://doi.org/10.1080/15374416.2012.704842
Wells, J., Barlow, J., & Stewart-Brown, S. (2003). A systematic review of universal approaches to mental health promotion in schools. Health Education
WHO. (2005). Atlas: child and adolescent mental health resources: global concerns, implications for the future. World Health Organization
Williams, K. C., & Williams, C. C. (2011). Five key ingredients for improving student motivation. Research in Higher Education Journal, 12, 1
Acknowledgements
We would like to thank Vicki Langton for her help with the development of search terms for this review and Ria Aiyar whose contribution as an independent reviewer of the titles and abstracts of the accepted papers was greatly appreciated.
Funding
Open Access funding enabled and organized by CAUL and its Member Institutions
Author information
Authors and Affiliations
Contributions
DS conceived of the study, participated in interpreting the data and wrote the initial draft of the manuscript; AT participated in refinement of the study design and in interpreting the data as well as drafting the manuscript; PS participated in interpreting the data and drafting the manuscript. All authors read and approved the final manuscript.
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Scholz, D., Taylor, A. & Strelan, P. Factors Contributing to the Efficacy of Universal Mental Health and Wellbeing Programs in Secondary Schools: A Systematic Review. Adolescent Res Rev 8, 117–136 (2023). https://doi.org/10.1007/s40894-022-00193-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40894-022-00193-6