Highlights

  • School children.

  • Mental health.

  • Life skills training.

  • Academic performance.

Introduction

Evidence, mainly in high income countries (HICs) demonstrates a relationship between children’s mental disorders and poor academic performance: poor concentration [1, 2]; depression, conduct disorders, substance use [1]; and anxiety or school phobia [3] and suicidality [4]. The greater the number of conditions, the poorer the academic performance [5, 6]. Mental disorders are also associated with increased school drop-out [7,8,9], and truancy [10] due to psychosocial dysfunction [11] and perception of poor academic performance leading to low self-esteem. [12]. A Dutch study found that the negative effect of externalizing problems on academic achievement was not attributable to the Intelligent Quotient (IQ) of the children i.e. not to their intellectual potential but to other factors [13]. There is a dearth of literature on comparable studies in LMIC, creating a gap in our understanding on how HIC and LMIC compare and contrast. This study seeks to contribute towards addressing this gap. The finding from the Dutch study that factors other than 1Q alone contribute to externalizing problems calls for context appropriate determination of other possible contributors to externalizing behavior, not only in a HIC but also in LMIC.

School based approach to mental health can improve academic performance [14, 15]. It can also increase the chance of the students remaining in school [16]. Mental health disorders are highly prevalent ranging from 12 to 37% depending on the type of condition in school going children in Africa, for example South Africa [17] and Kenya [18,19,20,21]. These prevalence rates are similar to that found in HICs such as the USA [22]. These comparable rates in prevalence of mental disorders in youth in both HIC and LMIC is further justification to study how mental disorders are related to academic performance in LMIC as compared to HIC. A further justification is the importance of intervention as early as possible. Preliminary data shows that life skills training reduces the level of symptoms on Youth Self-Report (YSR) scores in primary school children in Kenya [23]. This study aims to test the feasibility of applying life skills training for schools in a Kenyan setting with the view to treat mental disorders and enhance academic performance. This information can inform policy and practice on school mental health in Kenya and other similar settings.

Methods

Study design

This was a one group pre-post intervention study design implemented as a program.

Study Site

This study was part of a bigger study titled The Kenya Integrated Intervention Model for Dialogue and Screening to Promote Children’s Mental Wellbeing (KIDS). The study had identified Makueni and Machakos counties in South East Kenya. Makueni is predominantly rural whereas Machakos has large peri-urban population. In Makueni County, we randomly picked Makindu sub-county, one of the 6 sub-counties in Makueni County and in Machakos County we randomly picked Machakos sub-county. For the purpose of this study, Machakos sub-county is referred to as peri-urban study site whereas Makindu sub-county is referred to as rural study site. These two counties were chosen for KIDS because Africa Mental Health Research and Training Foundation (AMHRTF) had been undertaking community mental health implementation research at the invitation of the local County Governments. School mental health had not been part of this community mental health. In order to facilitate effective supervision of schools by the school supervisors, the schools in each of sub-county are divided into several groups; each group being referred to by MoE as a cluster. We randomly chose six clusters per sub-county and then randomly selected two schools per cluster to meet our predetermined sample. We sampled a total of 23 schools, 11 from Machakos sub-county and 12 from Makindu sub-county.

Study Participants

Participants were primary school children and their parents in the participating lower primary (classes 2-4 aged 7 - 10 years) and upper primary (classes 5-7 aged 11 - 13 years) schools. The required school entry age in Kenya is 6 years. Because we wanted to have both the end of year examination results for the previous year and the current end of year, we excluded performance analysis on first year (class 1) who did not have any results and final year (class 8) because of preparation for the National Examinations which are different from those end of year examinations that are administered by the schools.

Measures

The Socio-Demographic Questionnaire

We used a researcher-designed socio-demographic questionnaire, completed by the children on themselves and also on their parents to include age, gender, region (rural or peri-urban) and class for the pupils, and parents marital status, employment status and education level.

Mental Health Assessment

The Youth Self-Report (YSR) has good psychometric properties [24] and has been used across different and multicultural societies [25] by children aged 11-18 years. It is a self-report on mental disorders. The Child Behavior Checklist (CBCL) is administered to parents or caretakers to report mental health problems among children 6 to 18 years [26]. Both YSR and CBCL focus on the previous 2 weeks at the time of administration. [24, 26] have broken down the syndromes of CBCL and YSR, the summary scores and how to interpret the scores as follows; (i) The syndromes - Anxious/Depressed, Withdrawn/Depressed, Somatic Complaints, Social Problems, Thought Problems, Attention Problems, Rule-Breaking Behavior and Aggressive Behavior. (ii) The summary scores - Internalizing Problems (summarizing the Anxious/Depressed, Withdrawn/Depressed, and Somatic Complaints scores), Externalizing Problems (summarizing the Rule-Breaking Behavior and Aggressive Behavior scores) and Total Problems score (summarizing all 8 syndrome scale scores) and (iii) the interpretation of the scores - Each scale score is interpreted based on the T score whereby T score of (below 65) is considered to be in the normal range, (65 to 69) is considered to be in the borderline range and (70 and above) is considered to be in the clinical range.

Academic Performance

The Kenya Institute of Curriculum Development provides guidelines on subjects to be examined and how to grade them [27]. The subjects examined in the primary schools were as follows: Mathematics, English, Kiswahili, Science and Social Studies where each subject is worth a maximum of 100 marks and yielding a maximum aggregate of 500 marks for all subjects. The grading system was based on an expanded 12- letter grade ranging from A (highest) to F (Lowest). The subject letter grades and their corresponding scores were A (80-100), A-(75-79.99), B+(70-74.99), B(65-69.99), B-(60-64.99), C+(55-59.99), C(50-54.99), C-(45-49.99), D+(40-44.99), D(35-39.99), D-(30-34.99) and F(0-29.99). Alternatively, the aggregate letter grades and their corresponding marks were A(400-500), A-(375-399), B+(350-374), B(325-349), B-(300-324), C+(275-299), C(250-274), C-(225-249), D+(200-224), D(175-199), D-(150-174) and F(0-149). Cumulative end of year scores were collected for each student for the individual subject and an aggregate for all subjects. The baseline was the end of year scores before the intervention and the post-intervention score was on end of year scores in the following year. We extracted these scores from the school transcripts that normally provide this information. This extraction was part of the data collection and done at around the same time we were administering the other instruments.

The Ministry of Education (MoE) Life Skills Training Curriculum

The intervention took place early in the second term (May and June). The intervention focused on life skills training, using the standard life-skills training curriculum developed by MoE [28] with the help of expert consultants provided by World Health Organization (WHO) and United Nations International Children’s Emergency Fund (UNICEF) to the MoE Department of Curriculum Development. The joint MoE/UNICEF expert committee adapted the WHO life skills program [29] to the Kenyan socio-cultural context. The adapted curriculum had two versions; one for lower primary school (standard1-4) and one for upper primary school (standard 5-8). It was then piloted and adopted as the official standard life skills curriculum for all schools. It was designed to fit into the eight hours that are allowed for extra-curriculum activities, as part of all other curriculums by the MoE. The training was spread out with flexibility to suit the convenience of individual schools. We negotiated with each school and class the best time to train their children for the eight hours spread equally over four weeks. Thus, this curriculum has an inbuilt time line (a total of 8 h spread out to suit the convenience of each school) and has well-structured curriculum content covered in a systematic manner. Thematic lines of the adapted curriculum included: critical/creative thinking, effective communication, empathy, decision making, stress management and internal locus of control. Each student has their own booklet on items to be covered and a check out for completed skills. This approach ensured that every student in this study completed the 8 h, using a confirmed content for all students and same level of quality of fidelity of the training. This project facilitated every child in the study sites to have their own copy of the booklet so as to follow using their own copy what they were being trained by our consultant specifically hired for this project.

Study Procedures

We used consultant trainers. These trainers were professional teachers who had taken further training on life-skills and are used to train teachers, but we also used them to conduct life-skills training for the children. We sought consent from the parents during one of the parent-teacher meetings. We explained the nature of the study, the potential benefits of improving the mental health of the children and the academic performance in the children that there were no risks involved and that it was voluntary. We explained that we will conduct the interventions early in the second term (May and June) and that we will avoid the third term, which starts in September, because of the schools’ preparations for end of year examinations. All the parents consented and signed for their respective children. This was repeated for the children in the classroom situation.

Statistical analysis

We used descriptive statistics to determine socio-demographic characteristics (as summarized in Table 1) of the sample as well as CBCL and YSR syndrome scales; paired sample t-tests to assess the differences before and after intervention on the aggregate academic performance scores as well as the individual subject’s scores; linear mixed model to determine predictors of academic performance controlling for socio demographic characteristics on improvement and mental disorders. All the analyses were done using STATA version 14.

Results

Table 1 summarizes the socio-demographics of the children and their parents divided by lower and upper primary children, including the CBCL/YSR syndrome mean scores at pre- and post-intervention and the follow up completion rates (85-95%) for each variable. Only a small number of the participants were lost to follow-up while the majority were in the study from pretest to posttest as seen from the follow-up rates. The mean scores for attention, internalizing, externalizing and total scores were comparable for both lower and upper classes in pre and posttest. Fathers education level, Mothers education level, region and class are significantly associated with increase in academic performance in lower class while region, class and age are significantly associated with increase in academic performance in upper class.

Table 1 Demographic Characteristics of Participants and follow-up Rates

Table 2 summarizes comparison of mean pretest and posttest academic performance scores aggregate marks and per subject disaggregated by region for both primary and upper primary classes. There was significant improvement in all aggregate scores and in nearly all individual subjects, highlighted in bold. The only non-significant (p > 0.05) findings were on Science (rural lower classes and peri-urban upper classes), social studies (peri-urban upper classes) and Mathematics and Kiswahili - the national lingua franca (rural upper classes). There was significant change in all CBCL syndrome scores. The only non-significant change in YSR syndrome scores in were Attention and Externalizing (peri-urban).

Table 2 Academic performance and CBCL/YSR syndrome scores before and after intervention overall and by region

Table 3 summarizes the independent predictors of academic performance after the life-skills training intervention. All significant independent predictors of aggregate and individual subject scores in lower classes and upper classes are highlighted in bold.

Table 3 Independent Predictors of Academic performance in (Lower classes 2-4) and (Upper classes 5-7) after Interventiona

Table 4 summarizes the trends and significant change in academic performance after the life-skills training intervention adjusting for all the socio-demographics and CBCL indicators in the lower primary classes and YSR indicators in the upper primary classes. In almost all the scores (aggregate and individual subjects) in lower classes and upper classes, after controlling for other factors, the effect of time was significant in which there was increase in academic performance after intervention, highlighted in bold.

Table 4 Linear Mixed Model Assessing Predictors of Academic performance in (Lower classes 2-4) and (Upper classes 5-7) after Interventiona

As shown in Table 5 on correlations, there was positive association between improvement in aggregate scores; English and science scores with improvement in internalizing, externalizing and total problems. However, there was no association between academic improvement and attention problems. The same was also replicated when regressing academic performance and individual syndromes controlling for gender, guardianship, marital status, father education level, mother education level, father employment, mother employment, region, class and age. However, when all the syndromes were added to the regression model (Model 5), there was loss of this association except for attention problem on aggregate scores (< 0.05).

Table 5 Correlation between Academic Improvement and Symptom Reduction on Specific Problems and specific symptom reduction associated with improvement in Academic performance

Discussion

This is the first study in Kenya showing improvements in aggregate educational scores, English and science scores on internalizing, externalizing and total problems. It is also the first to demonstrate the impact of life-skills training, on mental health and academic performance in a Kenyan setting. An incidental positive finding of this study is that in Kenya, girls and boys are receiving equal access to education in both rural and urban areas (Table 1). We attribute this equity to the compulsory education for all children in Kenya.

There are some common findings with our and HIC studies. Firstly, attention problems were associated with least improvements even on interventions as has been found elsewhere [1, 9, 30, 31]. This is not surprising given that attention problems, regardless of whether they occur in LMICs or HICs, are associated with cognitive dysfunctions and organic brain syndromes [32, 33] and therefore less amenable to life skills training than other syndromes. This study population was drawn from LMIC where it is expected there are higher levels of malnutrition and in particular an average of 42% in Makueni County of stunted growth related to malnutrition which can be expected to result in and brain insults[34]. Another agreement with findings from HICs is that mental health syndromes that are amenable to interventions were associated with best academic outcomes confirming that mental disorders are associated with academic performance [4, 35,36,37]. Our findings further agree with findings from HICs that early treatment of mental disorders in children may improve academic performance [11, 38]. The urgency for intervention in LMICs is the same as in HICs given similar epidemiological patterns and prevalence of various mental disorders as pointed out under the Introduction. School forums allow for reach to critical numbers at much younger age, make maximal use of the resources that are available and afford more children the opportunity to manipulate and improve their trajectories in later life. We have demonstrated the feasibility of this [23, 39]. The fact that we used 2 different cohorts – rural and urban and demonstrated similar trends on outcomes on different syndromes points to the success of the interventions. We speculate that parental education (father and mother) was associated with better academic performance at lower classes (and therefore lower ages) because at lower age the children most important environment are the parents while at higher classes the physical environment becomes more noticeable by the children.

These feasibility findings have a particular relevance to a LMIC where there is a dearth of mental health expertise. The fact that these skills can be administered by teachers already operational within the existing system has implications for sustainability of the intervention using already existing resources. This is a good example of the task shifting model where complicated intervention best administered by highly qualified experts can be administered by teachers who have been trained on the administration of the skills

Strengths

There were high follow up rates (83.2 – 95.4%) which we attribute to minimal change of schools in the course of the study, also a reflection of the students’ interest in participation in the study and the support of the parents and the teachers for this study.

Limitation

The interpretations of our findings are limited in several ways. We have no prior data from Africa to compare with. Secondly, the outcomes between lower primary and upper primary classes are limited for purposes of comparison because the measures are different and by different participants in each year group. CBCL for lower primary relied on parent’s perception of problems and YSR for upper children was by the children themselves on how they perceived their own problems. Many studies from across the globe indicate disagreement between parents rating their children using CBCL and children rating themselves using YSR [40,41,42,43,44,45]. Other studies suggest some agreements on CBCL by parents and YSR [46, 47]. However, this is only applicable if there is the same cohort of parents and same cohort of students both focusing on the students at more or less the same time. Furthermore, the adapted versions for the life skills are different for lower primary and upper primary classes as they were designed to be age appropriate.

We employed a single group pretest and posttest design without a control group or waitlisted group for comparison. However, this limitation is mainly logistical to separate children in the same class to one group receiving an intervention and another one not receiving intervention – can have negative impacts – those receiving intervention being viewed as the ones with mental illness by those not receiving intervention. We used a subsample of Kenya, so our results are not necessarily representative of all Kenyan students. The socio-demographics of the guardians/ parents were given by the children. This most likely explains the high levels of missing information (7.8 – 12.8%) in both rural and peri-urban schools since the children may not be in the know of all socio-demographics of their parents.

Conclusions

Our study is an additional demonstration of the feasibility of life-skills training, in this case with the focus on academic improvement, probably mediated by improvements in mental health. We advocate for further mixed methods studies that will take into account these preliminary findings, to determine more precisely the design and then deliver randomized clinical trials to test school based interventions for mental health for impact on childhood mental health and academic performance.