Developing the universal unified prevention program for diverse disorders for school-aged children
Psychological problems during childhood and adolescence are highly prevalent, frequently comorbid, and incur severe social burden. A school-based universal prevention approach is one avenue to address these issues.
The first aim of this study was the development of a novel, transdiagnostic cognitive-behavioral universal prevention program: The Universal Unified Prevention Program for Diverse Disorders (Up2-D2). The second aim of this study was to examine the acceptability and fidelity of the Up2-D2.
Classroom teachers who attended a 1-day workshop implemented the Up2-D2 independently as a part of their regular curricula. To assess the acceptability of the Up2-D2, 213 children (111 boys and 102 girls) aged 9–12 years completed questionnaires about their enjoyment, comprehension, attainment, applicability, and self-efficacy after completing Lessons 1–12. For fidelity, research assistants independently evaluated audio files that were randomly selected and assigned (27.3%).
Our preliminary evaluation revealed the program was highly enjoyable, clear, and applicable for students. In addition, self-efficacy demonstrated a trend of gradually increasing over the 12 sessions. The total fidelity observed in the two schools was sufficient (76.2%), given the length of the teacher training.
The results of this study supported the theory that the Up2-D2 could be feasible in real-world school settings when classroom teachers implement the program. We discussed current research and practical issues of using universal prevention to address mental health problems in school, based on implementation science for user-centered design.
KeywordsCognitive-behavioral therapy Universal prevention Transdiagnostic School Children
Unified Protocol for the Transdiagnostic Treatment of Emotional Disorders
Universal Unified Prevention Program for Diverse Disorders
Contrary to widespread belief, mental disorders are common during childhood and adolescence with 10–20% of all children experiencing one or more of these problems, incurring severe social burden; consequently, mental health promotion is an urgent issue, and early detection and intervention are essential . Moreover, a recent meta-analysis estimated that the worldwide prevalence of mental disorders was 13.4% (95% confidence interval 11.3–15.9) among a sample of 87,742 children . This suggests that approximately 241 million youths are affected by at least one mental disorder globally.
Although fear and anxiety are considered normal emotions that every child experiences during typical development, some children have profoundly high anxiety levels compared to typically developing children, which can cause severe impairment in their daily lives. Anxiety disorders are the most common psychological problem among children and adolescents [2, 3]. Moreover, anxiety disorders in children and adolescents predict mental health difficulties broadly in their later life including anxiety disorders, mood disorders, and substance abuse .
Children and adolescents are also currently experiencing depression at an unprecedented rate . Recently, prevalence studies in Japan have shown that 8.8% of adolescents aged 12–14 years met one or more depressive disorders based on the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision . Depression in children and adolescents often co-occurs with anxiety disorders . Furthermore, anxiety and depression are also frequently occurring in children and adolescents with neurodevelopmental disorders such as attention-deficit/hyperactivity disorders (ADHD) or autism spectrum disorder.
Finally, anger and irritability are relatively common behaviors in children and adolescents aged 9 to 16 years (51.4% showed phasic irritability in a community sample)  and are the most frequent reasons for mental health referrals . Although anger/irritability is a core symptom of oppositional defiant disorder or disruptive mood dysregulation disorder, irritability is also seen in children with anxiety disorders, depressive disorders, or ADHD . Children and adolescents frequently experience a wide variety of emotional and behavioral difficulties throughout their development. Regardless of whether the severity of these issues meet the clinical criteria for a diagnosis, preventive interventions can support behavioral and emotional regulation related to a wide variety of concerns, ultimately promoting positive youth development and even mitigating the onset or severity of later disorders.
Preventative actions in schools
Since students learn and develop their social and emotional competence in school, schools play a key role in fostering healthy social and emotional development among youths . Specifically, teachers, as models, are in a very powerful position and their opinions concerning what constitutes mental health impacts the concepts of mental health adopted by their students . School-based approaches, especially those implemented by schoolteachers, are a crucial avenue for the prevention of mental health problems .
Diverse school-based prevention programs have been developed and examined in several countries. There are three types of school prevention programs: universal, selective, and indicated . Universal prevention includes all members regardless of their risk status. Selective prevention focuses on individuals who have a risk for mental disorders, such as parental psychopathology or adverse circumstances. Indicated prevention means an intervention for individuals who already have mild to moderate symptoms.
Among the three types of prevention programs, universal prevention in school has several inherent advantages. First, a universal prevention program can access most students who are enrolled in each school district, while rarely experiencing attrition. Second, a universal approach can minimize the risk of “labeling” for students who are removed from a classroom for selective or indicated interventions. Third, a universal approach can strengthen the protective role of the school environment, which might have proximal influences on children, according to the ecological model of child mental health . Fourth, because all students can participate regardless of risk or diagnostic status, implementation of a universal prevention program can support future selective and/or indicated interventions as a framework for layered or stepped preventive approaches. Universal prevention based on a cognitive-behavioral approach is designed to enhance individuals’ specific coping strategies for current/future adversity, and encourages application of those skills to support other students. A previous trial for adult outpatients with anxiety and depressive symptoms suggested that group cognitive-behavioral therapy (CBT) can ameliorate their emotional symptoms as well as improve their self-stigma . A group-based CBT in the classroom showed increased knowledge about mental health and decreased stigma to individuals with mental disorders. Moreover, students in the 5th and 6th grades who participated in the intervention showed significant improvement in self-efficacy, indicating that they can support friends and people around them with mental health problems . Therefore, students, as well as school personnel, can acquire mental health literacy and reduce stigma for mental disorders through teaching cognitive-behavioral skills.
Evidence of prevention programs in schools
Most school prevention programs for mental health were based on cognitive-behavioral interventions . Some were created as universal programs, whereas others were originally designed for selective or indicated programs. For example, open trials for universal depression prevention interventions have shown a significant improvement in social skills and a reduction in depressive symptoms among elementary school children aged 8 to 12 years [16, 18], and the positive effect was maintained three years later .
Several systematic reviews of school-based prevention programs for depression covering ages ranging from 5 to 22 years old have been published [20, 21, 22]. These studies showed that targeted (i.e., selective and indicated) programs could be marginally superior to universal prevention programs, while the efficiency of universal prevention programs was somewhat inconsistent. The Cochrane Review in 2011 affirmed some evidence that universal, as well as targeted depression, prevention programs may prevent the onset of depressive disorders compared with no intervention in children and adolescents aged 5 to 19 years . However, the latest review of depression prevention programs concluded that prevention programs delivered universally to child and adolescent populations aged 5 to 19 years showed “a sobering lack of effect when compared with an attention placebo control” ( p. 49).
Regarding anxiety, Neil and Christensen  reviewed 27 randomized controlled trials of school-based programs for children (5–12 years) or adolescents (13–19 years). Over half the studies (59%) were universal prevention programs (30% were indicated programs and 11% were selective programs). Approximately eleven of the sixteen (69%) universal trials reported significant improvement post-intervention (ES = 0.31 to 1.37), while five trials failed to find significant improvement (ES = − 0.21 to 0.28). According to a meta-analysis of school-based prevention programs focused on both anxiety and depression for kindergarten through 12th grade, including 31 universal trials , there was no clear effect for anxiety; however, a significant improvement for depression was shown in a direct comparison between intervention and control participants (Zs = 0.99 and 2.77, respectively, p < 0.01). Whereas universal preventive actions for anger and anger-related problems have been addressed as being useful to improve children’s social and academic development in kindergarten and early childhood , there is no research using CBT-based universal prevention programs for anger-related problems in middle to late childhood (6–18 years) . Therefore, despite its promising results and partial support for its effectiveness, there is room for improvement in universal prevention research, especially concerning the magnitude of its effects.
The current research tasks for universal prevention programs in schools
Previous studies suggested two issues that should be addressed in future studies of universal prevention programs in school: (1) to optimize inherent advantages of universal prevention in school overcoming limited effects, and (2) to explore the user-centered design of a universal prevention program for enhancing participants’ motivation that might facilitate more reliable gains.
Recently, a transdiagnostic approach is gathering much attention. This approach can address comorbidities frequently seen in clinical populations and redundancies of learning distinct treatment manuals for practitioners [29, 30]. There are three types of transdiagnostic approaches: the core dysfunction approach, common elements approach, and principle-guided approach . First, the core dysfunctional approach addresses multiple psychological problems by targeting underlying common dysfunction. As a typical example, the Unified Protocol for the Transdiagnostic Treatment of Emotional Disorders (UP)  shows the frequently used approaches include treatment for problems that possess overlapping etiology, underlying shared pathological processes, or maintaining common processes . Therefore, whereas it might be one of the first-line options for anxiety and depression, it needs further consideration to expand its utilization to more diverse disorders. Second, a common elements approach intends to select as many as common components that are derived from empirically supported treatments designed for distinct disorders. The approach may be workable when the elements can be compiled as separable, independent, and structured components . Given that classroom teachers are used to teaching structured components in the classroom, the approach might be advantageous for universal prevention in schools. On the other hand, a flexible approach which allows therapists to use these components discreetly is not adequate for universal prevention programs. Third, the principle-guided approach possesses a high level of flexibility for intervention content and sequencing based on therapists’ clinical decisions. Therefore, the principle-guided approach might be efficacious for clinical settings due to its flexibility; however, it is also difficult to apply to the universal prevention protocols that are implemented by schoolteachers.
As mentioned, previous studies regarding school-based preventive CBT programs have focused on a single type of psychopathology. However, CBT programs among clinical populations can produce diverse therapeutic gains for a variety of psychological disorders that are often co-occurring in a child or adolescent . Given that CBT was originally conceived as a broad paradigm for treating psychological disorders  and that the current components of empirically supported treatments for internalizing and externalizing disorders are largely shared , a universal prevention approach based on CBT might be effective for diverse mental health domains using a transdiagnostic approach. To the best of our knowledge, no research has examined CBT’s applicability in universal preventive approaches, although several trials of targeted programs are in progress [36, 37]. Even if a transdiagnostic approach is promising, it is essential to determine which design would be suitable for, and applicable to, universal prevention programs in schools. A universal prevention program might inherently reduce motivation for attendance due to the diffusion of its focus. Therefore, we should consider these aspects during the development phase, a priori, since research is often concerned with adaptation and implementation after completion of efficacy studies . Specifically, (a) as previously stated, some efficacy trials of universal prevention programs targeting a single psychological problem failed to show clear evidence according to the rigorous criteria; (b) however, each program targeting a single psychological problem included evidence-based components derived from CBT, which is strongly empirically supported; and (c) we should explore if an entirely new transdiagnostic universal program that can be applied to diverse children and adolescents in actual school settings.
To tackle these issues, first, we developed a new school-based universal prevention program—the Universal Unified Prevention Program for Diverse Disorders (Up2-D2), which targets transdiagnostic mental health problems based on a cognitive-behavioral approach in schools. Our second purpose was to examine the acceptability and fidelity of the Up2-D2 in school settings after schoolteachers implemented the Up2-D2. Since the acceptability and fidelity of the program should be confirmed in real school settings, classroom teachers and their students evaluated the implementation of the Up2-D2 rather than researchers and clinicians.
Development of the Up2-D2
Components of the Up2-D2
Introduction of the program
Starting the program, confirmation of the rules, introduction of characters, explanation about inventions (cognitive-behavioral skills), and program orientation
Exploring pleasant events
Finding pleasant activities that students can enjoy and exploring other activities that student can engage in even when feeling depressed
Learning about kind words
Social skills training
Learning and training how to communicate with peers by using kind words through verbal instruction, modeling, behavioral rehearsal, feedback, and homework
Learning about assertive skills
Social skills training
Learning and training how to communicate with peers by use of assertive skills through verbal instruction, modeling, behavioral rehearsal, feedback, and homework
Identifying physical symptoms as a sign for psychological distress; understanding connection between psychological and physical symptoms; and exploring and training their own relaxation, such as progressive muscle relaxation and abdominal breathing techniques
Identifying one’s own and others’ strengths
Exploring strengths of everyone, understanding differences in individuals, and identifying one’s own and others’ strengths
Discovery of own cognition
Examining the relationship between situation and emotions, finding cognitions between them, and discovering one’s own thoughts
Challenging unhelpful thoughts
Understanding unhelpful thoughts that lead to emotional problems, identifying one’s own typical unhelpful thoughts, and challenging these unhelpful thoughts
Preparing behavioral challenges
Understanding differences in individuals’ difficulties, identifying the theme of challenging, and understanding the exposure mechanisms
Building-up behavioral challenges
Making up one’s own hierarchy, discussing how to attempt small challenges, and planning behavioral challenges
Learning about problem-solving skills
Introducing steps for problem solving, thinking about solutions as much as possible, evaluating each solution based on multiple criteria, and trying to select the best solution
Review and conclusion
Reviewing learned skills (inventions), discussing how to combine these skills and apply daily adversities, and graduation ceremony
A transdiagnostic approach is one of the avenues to achieve the goals of efficiency and satisfaction/reputation in addition to enhancement on coverage of diverse mental health problems. Teachers can efficiently administer the unified program targeting multiple problems instead of spending more time conducting multiple programs targeting a single problem. Reducing training load, especially for novices, is one of the inherent benefits related to efficiency in the transdiagnostic approach . Moreover, a program that can cover both internalizing and externalizing problems of students might be highly acceptable for school personnel considering Japanese educational needs. A previous study that examined depression prevention programs in schools noted that feedback from teachers stated that they need more comprehensive programs that can deal with externalizing and internalizing problems . Further, a recent national survey in Japan revealed the worst rates of school refusal, violence, and bullying in elementary schools in recorded history and suggested complex mental health problems may underlie such school issues .
Flow of each lesson for the Up2-D2
Goal of today’s lesson
Confirmation of the rule
Review of the last class (after lesson 2)
At the beginning of every lesson, the teacher should mention the program rules, such as do not make fun of someone, do not mess around, and do not be shy. A teacher starts each lesson with an explanation of today’s goal. After Lesson 2, a teacher also reviews and confirms the homework from the last lesson
Introduction of the target skills
A situation with some difficulties or distress is provided to students in the form of a cartoon. There are three children who have distinct problems in the cartoon. Their problems represent anxiety, depression, and anger, respectively. An inventor plays a role of facilitator and he shows his invention, which acts as a metaphor for the target skills
First, students practice the target skill individually. Generally, students are told to complete their worksheets. Then, after sharing, students participate in group activities including, discussion, modeling, and/or behavioral rehearsal
Summary and review of the today
A teacher makes conclusive remarks and explains homework for daily practice. Students complete a comprehension and feedback sheet
Positive orientation means that teachers and students can participate in the program with a positive mind and a warm atmosphere by using specific materials, activities, and classroom management. The perception that “childhood is cheeriness and naivety,” or the Japanese proverb to “let sleeping dogs lie,” might represent one of the cultural aspects regarding an unwillingness to tackle mental health problems in children, explicitly . A previous survey in Japan suggested that teachers exhibited less knowledge regarding mental health literacy concerning childhood psychological disorders than mental health professionals and graduate students . With this in mind, we shifted the Up2-D2 from pure cognitive-behavioral techniques to focus more on educational interventions that are positively oriented to minimize misunderstandings, enhance the self-efficacy of teaching, obtain more acceptability, and improve the general reputation of school personnel. In addition, we added works where students are encouraged to find both their own and peers’ strengths in the Up2-D2. Such activities that are derived from the positive psychological intervention for classroom  will be welcomed to the Japanese educational settings as positive-oriented classwork. Since Japanese individuals tend to emphasize interdependent aspects where a member is expected to consider and sense what others are feeling and thinking , students may find it difficult to ponder their differences rather than their commonalities. Even if they do find their differences, they are liable to be reluctant to disclose such discrepancies in front of their class, especially regarding negative thoughts and/or adversities. Rather, through strength work, students will be likely to identify some differences among individuals more smoothly in positive orientation; then, they will work on their difficulties and adversities more naturally. In addition, given the current model of mental health, which encourages assessment of both wellness and illness , universal prevention in school should focus on positive mental health promotion as well as the risk factors of psychological disorders. Since previous strength-based school interventions produced positive gains in life satisfaction and positive affects , a cognitive-behavioral intervention combined with strength work could promote positive mental health as well as decrease psychopathological problems.
In addition to the cartoon story, interpersonal practice, another facet of cultural adaptation in the Up2-D2, can ensure the satisfaction and reputation of the program as well as exploit natural constraints (see Table 2). According to a systematic review of recent CBT studies for children and adolescents in Japan , group-based interventions especially focused on interpersonal relationships were highly prevalent and were well accepted. In addition, teachers in Japan are clearly encouraged to use group activities as much as they can (especially in “integrated study” and “special activities”). Spence  noted that environmental—(e.g., peer support and positive classroom environments), as well as individual-protective factors (e.g., building children’s cognitive-behavioral skills), are essential for universal preventive intervention (i.e., the dual approach) . Although group works and activities are frequently used by the previous programs globally, environmental components should be more underscored and imperative for successful cultural adaptation of CBT originated from Western culture . In the Up2-D2, activities which are usually handled individually like cognitive restructuring (e.g., to find negative maladaptive thoughts or to find more appropriate thoughts) are also reorganized as group ones, given the interdependency of Asian culture .
A preliminary implementation: acceptability and fidelity of the Up2-D2 in schools
We examined the acceptability and fidelity the Up2-D2 when schoolteachers implemented this program in real school settings.
Participants and procedures
Upon our request, four local boards of education invited all elementary schools in their district to participate in the program; eight principals indicated their interest and consented to participate after receiving a detailed explanation of the study by the research team. Overall, eight public schools participated in the Up2-D2. The current study used feedback sheets filled out by students regarding their perceptions of the program as well as audio data of each lesson recorded by the researchers. Teachers had students complete and return the feedback sheets at the end of each lesson. At the end of this study, we obtained the sheets from 213 children aged 9 to 12 years (4th grade: 39 boys and 47 girls; 5th grade: 46 boys and 42 girls; 6th grade: 26 boys and 13 girls) in seven classes from two schools which comprised of 29.79% of the initial participants. The procedures were conducted in accordance with the ethical standards and approved by the third author’s (A2016-035) institutional research committees and only data that were obtained through an opt-out consent process from the students’ parents were analyzed.
As detailed information on socio-economic status is not usually available from Japanese schools, exact information could not be collected in this regard. Both schools are located in similar middle-class areas of Saitama prefecture, in the suburbs of Tokyo, with homogenous demographics. Before the trials, all classroom teachers attended a local one-day workshop organized by the first author. The teaching plans and visual materials were distributed to them, and they could review the DVD material on which the training session provided by the first author was recorded. Both schools provided the Up2-D2 once per week from September to October.
Acceptability questions for the Up2-D2
“Did you enjoy today’s lesson?”
“Enjoyable” = 4, “a little enjoyable” = 3, “a little unenjoyable” = 2, and “unenjoyable” = 1
Comprehension of a “gadget”
“Did you understand the XXX?”
“Understand” = 4, “a little understand” = 3, “not really understand” = 2, and “not understand at all” = 1
Attainment of the lesson
“Did you differentiate positive and negative emotions?” (Lesson 1)
“Understand” = 4, “a little understand” = 3, “not really understand” = 2, and “not understand at all” = 1
Except the last lesson
“Did you understand pleasant activities?” (Lesson 2)
“Did you understand what words were kind words?” (Lesson 3)
“Did you catch the point assertive asking? (Lesson 4)”
“Did you understand the relationship between emotion and body? (Lesson 5)”
“Did you understand what kinds of strengths existed? (Lesson 6)”
“Did you understand the relationship between emotion and thought? (Lesson 7)”
“Did you understand what kinds of unhelpful thoughts existed? (Lesson 8)”
“Did you understand how to list your difficult situations? (Lesson 9)”
“Did you understand how to challenge your difficult situations? (Lesson 10)”
“Did you understand the way for problem-solving? (Lesson 11)”
Applicability of the lesson
“Did you understand magnitude of emotions?” (Lesson 1)
“Understand” = 4, “a little understand” = 3, “not really understand” = 2, and “not understand at all” = 1
“Did you find your pleasant activities?” (Lesson 2)
“Did you understand four different kind words? (Lesson 3)”
“Did you catch the point of assertive declining? (Lesson 4)”
“Did you find your favorite relaxation skill?” (Lesson 5)
“Did you find your strengths?” (Lesson 6)
“Did you understand people think differently even in the same situation?” (Lesson 7)
“Did you understand how to cope with the unhelpful thoughts (Lesson 8)”
“Did you understand how negative emotion will change if you challenge your difficult situations? (Lesson 9)”
“Did you understand how to challenge as small steps (Lesson 10)”
“Did you try three steps of problem solving (Lesson 11)”
“Did you understand how to combine these gadgets? (Lesson 12)”
“Do you think that you can use XXX in your daily life to YYY?”
“I think I can do it” = 1, “I think I can do it a little” = 2, I do not think, I can really do it” = 3, and “I never think I can do it” = 4
We examined the fidelity in real school settings by a test of fidelity when classroom teachers implemented the Up2-D2. All lessons were recorded by IC recorders on site and the archive audio files were kept in the storage of each school. Twenty-one lessons (27.3%) were extracted for evaluation based on a table of random numbers considering the counterbalance of both schools. Research assistants had received rating training though hypothetical lessons independent from the implementation of this study until they obtained over 90% accuracy scores in accordance with the criteria that was set by the first author. Then, they visited each school and independently listened to assigned audio files to evaluate the fidelity of the classes. The first author made evaluation sheets for each class based on the teaching plan. Each sheet had approximately 30 items to evaluate (i.e., range max 24–36 points depending on each lesson), and research assistants confirmed whether a teacher followed the prepared teaching plan.
The evaluation sheets also included what must not be done by teachers in addition to what needs to be done. For example in the group activity in Lesson 2, to fulfill the fidelity criteria, the classroom teachers needed to (1) ask students to generate as many pleasant activities as possible in small groups, (2) have each group express how many activities the students found, and (3) celebrate the group which reported the greatest number of activities; however, teachers should not 4) decide which answers were correct or wrong for each activity, or (5) criticize the group which reported the fewest activities.
Cross-tabulation of feedback sheets for all lessons
X elementary school
Y elementary school
Total fidelity of the two schools was 76.2%. It meant that over 75% of the contents of the lessons that the developers had prepared in advance were implemented. X elementary school showed 70.2% and Y elementary school, 82.8%. The current results showed that the one-day workshop provided acceptable fidelity when teachers independently implemented the Up2-D2 in their classrooms given that the fidelity measurements required approximately 30 points to cover during each of the 45-min lessons.
This article described the rationale, components, and preliminary implementation of our new intervention, the Up2-D2. Outwardly, the effort of this study might be considered as usual or ordinary procedures to introduce a new intervention; however, implementation works have rarely appeared in academic papers per se, and it is difficult to share and disseminate such practical wisdom among the field . Since the elaboration tends to be accumulated exclusively within one-party, this study described the effort of implementation explicitly. Therefore, based on the relationships between principles of user-centered design and program features (Fig. 1), we discussed not only current research issues and future perspective of the Up2-D2 but also several challenges in practice and research about universal prevention programs for mental health in schools from the viewpoint of social implementation.
As a transdiagnostic approach
CBT-based universal prevention programs that typically focus on transdiagnostic approaches have not been well researched. The current study is the first report on the development of a universal transdiagnostic prevention program for both internalizing and externalizing problems in schools. Student feedback indicated that they found the Up2-D2 to be highly enjoyable, understandable, and applicable. In addition, the fidelity of the Up2-D2 was sufficient (approximately 80%), given that the length of teacher training (one-day workshop) was relatively short. Therefore, our findings suggest that the Up2-D2 could be feasible in real school settings when classroom teachers implement the program. Although our findings are encouraging, further trials are needed with larger sample sizes, comprehensive assessments, and rigorous research design for the intervention to be acknowledged as a transdiagnostic program. In particular, future studies should examine the program’s efficacy through a multi-method, multi-informant assessment on multiple domains of psychopathology, such as anxiety, depression, and anger. The current study is a preliminary study and it should be noted that we are aiming to report the efficacy of the Up2-D2 within all eight elementary schools from three prefectures and across five cities. Further trials are necessary to test the efficacy and effectiveness of the Up2-D2.
Application of teaching plans
As discussed before, teaching plans, instead of ordinary treatment manuals for psychologists, are useful to help teachers ease comprehension and monitoring because of their user-friendliness. Further, teachers are free from special efforts to learn the components of CBT and are prone to adhere to the present program. Indeed, our results showed that all the components were highly understandable for children aged 9–12 years; although, ceiling effects might be seen due to the scale range (i.e., 4-points). Moreover, the fidelity of the program was acceptable given its time-efficiency and methods of evaluation, although it was somewhat lower than those determined in previous trials regarding the prevention of depression in Japan (85–100%) . For example, one of the targeted prevention programs that focused on anxiety and depression in schools required 3 days of training for implementation and used an 11-item questionnaire to measure the competency of cognitive-behavioral practice for evaluation for fidelity . While intensive training is ideal to enhance adherence and fidelity, it is not always feasible in Japanese schools. A nationwide survey revealed that over 99% teachers work over 40 h per a week and an average of 11 h per day . Considering these conditions, it is indispensable to balance cost and benefit between launching the new program and preventive benefit for students. Therefore, one of the ways to exploit natural constraints is to rewrite evidence-based psychotherapies into a specific format that provides familiarity, approachability, and learnability, while considering the context. To enhance further program fidelity, consecutive training such as ongoing coaching, continuous consultation, or follow-up training, rather than a one-time training, may be required. Future studies should explore the elements of optimal training in terms of dose and content.
The role of positive orientation
Concerning positive orientation, the Up2-D2 was developed using educational language and integrated strength works into the lessons. Although face validity is not regarded as formal validity and almost meaningless for researchers , it might be helpful for dissemination to the public. Some teachers might feel a cognitive-behavioral program too complicated to learn and misunderstand the program as designed only for children with emotional and behavioral disorders if it excessively emphasized treatment techniques and psychopathology. If the inclusion of strength work convinces school personal to buy into the program, it might be a notable option regarding establishment in educational settings. Moreover, exposure is frequently misunderstood and misused among components of CBT techniques [55, 56], and Japanese children might be reluctant to engage in cognitive restructuring as mentioned previously. Even though, this study showed highly stable satisfaction during the latter part and minimal decrease in enjoyment in building anxiety hierarchy. Therefore, the alignment of the component in this study might be functional for teachers and students to get rid of their hesitation and misunderstandings. However, we need to further investigate the actual reputation of the program and whether potential errors are effectively precluded in the implementation.
Usability of cartoon story
We anticipated that using cartoons story could contribute to learnability, memorability, and low cognitive load for students. In accord with our hypothesis, the current results suggested that the “gadget” in the Up2-D2 enhanced children’s fun and comprehension. Enjoyment was extremely high for all lessons, except for Lesson 10, as mentioned above. Since Lesson 10 was composed of building an anxiety hierarchy for in vivo exposure to children’s difficult and challenging situations, it is appropriate to consider whether natural deterioration might be suppressed due to the characteristics of the Up2-D2. Moreover, comprehension of the gadgets was stable and high for all components. In general, older adolescents were likely to receive more therapeutic benefits from cognitive-behavioral techniques thanks to more matured cognitive development than younger children [57, 58]. Of interest, components that seem to be relevant to cognitive development such as cognitive restructuring and problem-solving were also highly understandable even when elementary school children aged younger than 13 years participated. Given that teachers generally have no specific knowledge and skills for specific psychotherapies, it is possible that the carton and gadget features of the Up2-D2 can also contribute to learnability, memorability, and low cognitive load for teachers in delivering cognitive-behavioral interventions through a realistic dose of training. Furthermore, the use of cartoons to learn cognitive-behavioral skills can exemplify one of the cultural adaptations to exploit ingenious cultural strengths in line with other health education in schools (e.g., stroke education) .
Emphasizing interpersonal practice
Interpersonal practice was another characteristic of the Up2-D2 as well as cultural adaptation along with the cartoon story. All lessons consisted of group activities to exploit natural constraints in Japanese elementary educational settings. In addition, social skills trainings were included in Lessons 3 and 4 as an active component. Regarding satisfaction/reputation, small-group activities could play a vital role in the program being highly acceptable and well-regarded in school. First, as aforementioned, group social-skills interventions are prevailing CBT approaches among Japanese schools . In a conservative society, it might be more functional to embrace the existing movements since they bear their own benefits; then, one can explore a further integrative approach with extant activities rather than drastic or expulsive ways. Second, teachers in elementary school are used to managing group activities in their classroom. As aforementioned, teachers already use group format and encourage further application in several subjects. Although there have been no empirical studies comparing mono and dual approaches, interpersonal works to enhance the protective environment in each class might lead to utilization of the strength of Japanese culture.
Limitations and future directions
There are some limitations to be noted, raising future issues related to the social implementation of universal programs for the prevention of diverse mental health problems in schools. First, for future studies using randomized controlled trial design, it is important that future issues, in which domain should be included as an outcome, examine universal transdiagnostic prevention trials. As mentioned above, a multi-method, multi-informant assessment on multiple domains of psychopathology is required to capture intervention gains for a transdiagnostic approach. However, Ollendick and his colleagues criticized that previous studies of transdiagnostic approaches have often focused on psychopathological measurements and never measured how or if changes in these presumed processes mediate treatment outcome . Moreover, universal prevention might promote active personal agency in resilience processes like self-control, self-regulation, or self-efficacy beyond the absence of psychopathological disorders . Besides, previous studies suggested that strength-based interventions in school could promote positive mental health [48, 62]. Therefore, an essential future issue to be explored is how to evaluate gains of universal transdiagnostic preventive interventions focusing on mediators and positive mental health promotion in addition to psychopathological measures.
Second, whereas the study supported social implementation of the Up2-D2, the repeated measurements regarding enjoyment comprehension, attainment, applicability and self-efficacy were used to evaluate each session. More specific and individual assessments could determine more nuanced relationships between the principals and characteristics of the Up2-D2. Since the five characteristics are composed of general features (i.e. teaching plan and cartoon story) as well as more specific aspects to each component (e.g., positive orientation and interpersonal practice), future studies should examine different aspects of social implementation for each lesson considering contextual variables.
Third, this study did not examine effect of the demographics of potential moderators such as gender, age, or school on fidelity or acceptability of the program. Given that the results suggested that a school that had a higher fidelity of the program could produce more enjoyable lessons especially during the latter part of the program, future studies should explore the more direct relationship between fidelity and acceptability. Moreover, this study only used students’ reports for the evaluation of acceptability. Teachers’ subjective reports on usability and feasibility should be examined in future studies. In addition, acceptability from parents and stake holders could be useful information for social implementation. Therefore, an important future task would be the identification of factors that contribute to acceptability, and to conduct multi-level analyses including these variables.
The manuscript was provided language help by the Editage. The authors thank the research participants, their families, and schoolteachers who made this study possible. We are also grateful to Honami Yamaguchi, Chiaki Kuwabara, Kazuki Kondo, Yukari Yokoyama, Noriko Hida, Hiroshi Sato, Honami Arai, Yo Nakanishi, Yumi Kaneyama, Nozomi Abe, Ayaka Ubara, Yusuke Nishio, Kohei Matsubara, Mihoko Nakamine, Masaya Takebe, Keiko Takemori, Chisato Kuribayashi, and Shino Takaoka for their assistance throughout this project. Finally, the first author would like to thank Susan H. Spence, Griffith University, and Jane Gillham, Swarthmore College for their helpful comments on development of the program.
KK analyzed and interpreted the acceptability data. TO and AS organized onsite works of the fidelity evaluation. SS contributed to the assessment and the development of the program. HS contributed to the recruitment of schools. NS and YK were major contributors to writing the manuscript. All authors read and approved the final manuscript.
This work was supported by JSPS KAKENHI (grant numbers: JP15H03516 and JP26590267).
Ethics approval and consent to participate
All performed procedures were in accordance with the ethical standards and approved by the institutional research committees of the first (17002) and the third author (A2016-035). The principals of the two elementary schools agreed to participate in the study. Only the data that were obtained through an opt-out consent process from the students’ parents were analyzed.
Consent for publication
The authors declare that they have no competing interests.
- 1.World Health Organization. The world health report: 2001. Switzerland: World Health Organization; 2001.Google Scholar
- 3.Higa-McMillan CK, Francis SE, Chorpita BF. Anxiety disorders. In: Mash EJ, Barkley RA, editors. Child psychopathology. 3rd ed. New York: Guilford; 2014. p. 345–428.Google Scholar
- 4.Seligman LD, Gahr JL. Course and outcome of child and adolescent anxiety. In: Essau CA, Ollendick TH, editors. Treatment of childhood and adolescent anxiety disorders. London: Wiley-Blackwell; 2013. p. 44–67.Google Scholar
- 5.Abela JRZ, Hankin BL. Handbook of depression in children and adolescents. New York: Guilford; 2008.Google Scholar
- 6.Sato H, Shimotsu S, Ishikawa S. Prevalence rate of depressive disorders in a community sample of adolescents in Japan. Seishin Igaku (Clinical Psychiatry). 2008;50(5):439–48.Google Scholar
- 11.World Health Organization. Promoting mental health: concept, emerging evidence, practice. Switzerland: World Health Organization; 2005.Google Scholar
- 12.Masia-Warner C, Nangle DW, Hansen DJ. Bringing evidence-based child mental health services to the schools: general issues and specific populations. Educ Treat Child. 2006;29(2):165–72.Google Scholar
- 13.Mrazek PJ, Haggerty RJ. Reducing risks for mental disorders: frontiers for preventive intervention research. Washington, D.C: National Academy Press; 1994.Google Scholar
- 14.Bronfenbrenner U. The ecology of human development. Cambridge: Harvard University Press; 1979.Google Scholar
- 23.Merry SN, Hetrick SE, Cox GR, Brudevold-Iversen T, McDowell H. Psychological and educational interventions for preventing depression in children and adolescents. Cochrane Database Syst Rev. 2011;12:CD003380.Google Scholar
- 24.Hetrick SE, Cox GR, Witt KG, Bir JJ, Merry SN. Cognitive behavioural therapy (CBT), third-wave CBT and interpersonal therapy (IPT) based interventions for preventing depression in children and adolescents. Cochrane Database Syst Rev. 2016;8:CD003380.Google Scholar
- 26.Mychailyszyn MP, Brodman DM, Read KL, Kendall PC. Cognitive-behavioral school-based interventions for anxious and depressed youth: a meta-analysis of outcomes. Clin Psychol. 2012;19(2):129–53.Google Scholar
- 27.Greenberg MT, Domitrovich C, Bumbarger B. The prevention of mental disorders in school-aged children: current state of the field. Prevent Treat. 2001;4(1):1a.Google Scholar
- 29.Ehrenreich-May J, Chu BC. Overview of transdiagnostic mechanism and treatments for youth psychopathology. In: Ehrenreich-May J, Chu BC, editors. Transdiagnostic treatments for children and adolescents: principles and practice. New York: Guilford; 2012. p. 3–14.Google Scholar
- 34.Kendall PC, O’Neil Rodriguez KA, Villabø MA, Martinsen KD, Stark KD, Banneyer K. Cognitive-behavioral therapy with children and adolescents. In: Ehrenreich-May J, Chu BC, editors. Transdiagnostic treatments for children and adolescents: principles and practice. New York: Guilford; 2012. p. 161–82.Google Scholar
- 35.Society of Clinical Child and Adolescent Psychology. Effective child therapy: evidence-based mental health treatment for children and adolescents. 2017. http://effectivechildtherapy.org/. Accessed 17 Dec 2017.
- 39.Ishikawa S, Sasagawa S, Chen J, Essau CA. Prevention program for depression among children and adolescents in Japan: challenges and opportunities. In: Shute RH, Slee PT, editors. Mental health and wellbeing through schools: the way forward. New York: Routledge; 2016. p. 157–70.Google Scholar
- 41.Lyon AR, Koerner K. Use-centered design for psychosocial intervention development and implementation. Clin Psychol. 2016;23:180–200.Google Scholar
- 42.Chu BC, Ehrenreich-May J. In: Ehrenreich-May J, Chu BC, editors. Transdiagnostic treatments for children and adolescents: principles and practice. New York: Guilford; 2014. p. 420–31.Google Scholar
- 43.Ministry of Education, Culture, Sports, Science and Technology. The survey of behavioral problems and related with school guidance. 2017. http://www.e-stat.go.jp/SG1/estat/NewList.do?tid=000001016708. Accessed 17 Dec 2017.
- 44.Kamio, Y, Takemori, K, Shimotsu, S, Ishikawa, S. A research of childhood mental health literacy. In: Kim Y, editor. Remodeling of community collaboration for promotion of mental health: An outcome to the public policy. Annual Report of Ministry of Health Labour Sciences Research Grant. 2017. p. 43–51.Google Scholar
- 47.Suldo SM, Shaffer EJ. Looking beyond psychopathology: the dual-factor model of mental health in youth. Sch Psychol Rev. 2008;37:52–68.Google Scholar
- 49.Kogo T, Kogo C. The effects of comic-based presentation of instructional materials on comprehension and retention. Educ Technol Res. 1998;22(2):87–94.Google Scholar
- 50.Ishikawa S, Hida N, Kishida K, Ueda Y, Nakanishi Y, Kaneyama Y. The empirical review of academic activities regarding cognitive behavioral therapies for children and adolescents in Japan: before and after the World Congress of Behavioral and Cognitive Therapies in 2004, Kobe. Jpn J Cogn Ther. 2016;9:34–43.Google Scholar
- 51.Spence SH. Integrating individual and whole-school change approaches in the prevention of depression in adolescents. In: Abela JRZ, Hankin BL, editors. Handbook of depression in children and adolescents. New York: Guilford; 2008. p. 333–53.Google Scholar
- 52.Kamio Y. Community-based participatory research for promoting children’s development and improving their mental health: towards social implementation. J Ment Health. 2017;63:5–10.Google Scholar
- 53.Ministry of Education, Culture, Sports, Science and Technology. The survey of work condition for teachers: summary. 2017. http://www.mext.go.jp/b_menu/houdou/29/04/__icsFiles/afieldfile/2017/04/28/1385174_001.pdf. Accessed 17 Dec 2017.
- 54.Kazdin AE. Research design in clinical psychology. 4th ed. Needham Heights: Allyn & Bacon; 2003.Google Scholar
- 60.Ollendick TH, Fraire MG, Spence SH. Transdiagnostic treatments: issues and commentary. In: Ehrenreich-May J, Chu BC, editors. Transdiagnostic treatments for children and adolescents: principles and practice. New York: Guilford; 2012. p. 405–19.Google Scholar
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.