Abstract
Background
Evidence on what makes the school-engaged social and behavior change communication (SBCC) interventions on malaria prevention more sustainable are limited in literature partly due to its recent emergence. Enrolling the key stakeholders, this study explored the perceived sustainability of the SBCC interventions on malaria prevention through primary school communities in rural Ethiopia.
Methods
The SBCC interventions were implemented from 2017 to 2019 in 75 primary schools and villages in rural Jimma to promote malaria preventive practices. As a part of program evaluation, this study employed a mixed-method to collect qualitative and quantitative data from 205 stakeholders following the end of the program. Data were collected using interview guides and structured questionnaires. The SPSS version 26 and Atlas ti7.1 software were used to analyze the data. Multivariable linear regression modeling was used to identify predictors of the perceived sustainability of the program (SOP).
Results
The mean score of SOP was 25.93 (SD = 4.32; range 6–30). Multivariable linear regression modeling showed that the perceived risk to malaria (β = 0.150; P = 0.029), self-efficacy (β = 0.192; P = 0.003), and perceived fidelity of implementation (β = 0.292; P = 0.000) and degree of adoption (β = 0.286; P = 0.000) were positively predicted the perceived SOP. The qualitative result identified various barriers and opportunities to sustaining the program that summarized under three themes which include perceptions about the quality of program delivery (e.g inadequate involvement of stakeholders and staffs, concerns over short project life, immature sustainability efforts), school settings (e.g schools’ malaria priority, schools’ climate and quality of coaching) and the outer settings (e.g existing structures in the health and education systems).
Conclusion
The study identified key predictive variables such as stakeholders’ perceived risk to malaria, self-efficacy, perceived fidelity of implementation and degree of adoption that could help to improve the sustainment of the school-based SBCC approach on malaria prevention and control. Further longitudinal study should be conducted to examine the rate of decline in program components over time and how improved sustainability would contribute to the effectiveness on malaria preventive behaviors among students.
Similar content being viewed by others
Introduction
Malaria is one of the top vector-borne diseases that is transmitted by the bite of infected Anopheles mosquito [1]. Globally, about 229 million malaria cases were reported in 2019, and there no significant reduction in the preceding four consecutive years [2]. For instance, the disease affected 409,000 lives in 2019 alone compared to 411,000 lives in 2018 and more than 90% of the infection occurs in Africa [2]. Nearly half (52%) of Ethiopia’s population is at risk of malaria [3]. Malaria has profound health and social effects on school-aged children affecting the critical period of learning and development [4, 5].
Malaria elimination efforts have received top priority of the global agenda by 2030 and beyond [4,5,6,7]. Essential actions such as vector control, (insecticide-treated net (ITN) and insecticide residual spray (IRS)), case management (screening and treatment), and improving the supply chain of preventive services [8] were common strategies utilized to accelerate the elimination efforts. However, applying costly strategies to eliminate malaria seems paradoxical in the context of inadequate public participation [9]. Thus, this displays the significance of intensifying sustainable multisectoral and community participatory interventions to ensure the elimination targets [4].
The SBCC approach is one of the emerging effective behavior change strategies used to advance community engagement in malaria preventive programs [4, 7]. Studies showed that the SBCC strategy effectively improved malaria preventive behaviors in the community [10, 11] and in schools [12, 13]. Ethiopia is one of the African countries striving towards elimination targets through enhanced empowerment of the community and local institutions such as schools [3, 14, 15]. Thus, the SBCC strategy was emphasized in various health strategies of Ethiopia including malaria prevention, control and elimination strategy [3, 15]. Thus, maximizing the sustained benefits of such health-promoting programs is an essential task through various participatory mechanisms [16, 17]. However, connected to its recent emergence, evidence on long-standing experiences with implementing and sustaining of the SBCC approach is limited in Africa including Ethiopia [18, 19]. Specifically, substantiation on what makes the school-based SBCC interventions sustainable is limited in the scientific literature [20].
Sustainability is defined as the capacity to maintain program services at a level that will provide ongoing prevention or treatment of health problems after the termination of major financial, managerial, and technical assistance from donors [21]. In a process evaluation sense, sustainability is considered one of the eight measures of the implementation outcomes which acts as an intermediate factor between the intervention and its effects [22, 23]. Research on program sustainability helps to understand the extent to which the interventions are being implemented in the community settings to produce the intended outcomes [24]. The sustainability indicator has retrospective implications that indicate the program process and implementation. In addition, the extent of stakeholders’ involvement and sense of ownership of the program combined with the quality of implementation (fidelity) greatly determine the sustainability of a program (SOP) [17].
Due to its very participatory nature, efforts to understand the sustainment of the school-based SBCC approach on malaria prevention requires exploring or examining the extent of stakeholders’ engagement, sense of ownership and commitment to sustain it in the future. The SOP is usually measured in objective terms based on the monitoring data collected from specific program components and activities meant to be sustainable. Subjective measures of stakeholders’ perceptions towards the SOP is also considered an alternative indicator of process outcomes [25]. However, empirical evidence on stakeholders’ perspectives regarding SOP is limited in scientific literature as far as the SBCC approach is concerned [23].
Therefore, enrolling key stakeholders, this study explored the experiences and perceived sustainability of the SBCC approach on malaria prevention through primary school communities in Jimma, rural Ethiopia. A mixed-method design was applied in this study to enable collecting and analyzing data from multiple sources to understand the issue under the study in a broader context. The quantitative design was aimed to measure the perceptions of the stakeholders about the implementation and sustainability of the program, while the qualitative one was used to explore the associated experiences and perspectives.
Methods and materials
Study area and contexts
The school-based SBCC intervention on malaria prevention and control was implemented in 75 rural primary schools and respective villages selected from five districts of Jimma, Ethiopia, from 2017 to 2019. Jimma is one the zones found in Oromia region located 352 km away from Addis Ababa, the capital city of Ethiopia. Based on the projected 2007 Census conducted by the CSA, the total population of Jimma was 2,486,155, of whom 50.3% is male and 49.7% are female. While 137,668 or 11.31% are urban inhabitants, the majority of the population was rural residents. The zone lies with an altitude ranging between 900 to 3500 m above sea level.
Having characterized by stable malaria transmission rate, about 85% of population of Jimma (i.e. 73% of the villages in Jimma) is at risk malaria. According to the health department report of Jimma, a total of 11,259 malaria cases were reported in Jimma in 2017 (a year before the program launch). Engaging primary schools, the current intervention was conducted in five selected districts of Jimma characterized by high malaria transmission rates. An annual parasite incidence (API) rate in 2017 was 16% in Chora Botor, 14.1% in Shebe Sombo, 10% in Nono Benja, 5.5% in Limmu Kossa, and 3.1% in Gera; according to the Zone’s health department. The five districts are Limmu Kossa (population = 209,261), Shebe Sombo (population = 146,805), Nono Benja (population = 77,452), Chora Botor (population = 74,756), and Gera (population = 147,120). Data was collected during the period between May 10 to 30/2020.
Description of the school-based SBCC intervention
Guided by the SBCC theoretical principles, various educational, communication, and capacity building activities were implemented for a period of 2 years (i.e. from 2017 to 2019) to empower schools, stakeholders and the local community on malaria preventive actions. It was implemented in 75 schools and respective villages in selected malaria-endemic settings. More specifically, the interventions were designed to promote the five key malaria prevention and control practices both in schools and at community levels. These were the use of insecticide nets (ITNs), appropriate & timely seeking care for malaria, appropriate use of quality anti-malaria drugs, acceptance of insecticide residual spray (IRS), and mosquito breeding habitat modifications such as gardening and solid waste management as part of vector control efforts.
The program was initiated through the consultations of various stakeholders from the target community that include key professionals from health departments, education offices, health extension workers (HEWs), and school teachers. The supervisory committee was established to conduct sound and participatory malaria situation analysis, the community needs assessment, and devising intervention strategies. Accordingly, heads of health departments, education offices, school principals, malaria focal persons (school teachers), and health extension workers (HEWs) received first-level training on community mobilization and malaria prevention and control programs. Under the supervision of health departments, trained school principals and teachers were encouraged to cascade down the training to peer educators through one-to-five peer learning networks among school students. One-to-five peer learning networks is a social network that consists of 6 individuals (1 leader and the other 5 members) in one group. The purpose is to promote supports among students through a peer learning network.
Peer education activities at school were facilitated by trained peer educators under the supervision of the teachers and school principals. All schools students were reached by malaria education through peer education before they were sent to teach their parents, neighbors, and community members. The peer education activities were aided by guides and various health learning materials (HLMs) such as flip charts and leaflets. The process by which students were first trained and educated on malaria and peer education strategies then after guided to transfer the information to parents and the local community was termed in this intervention as the peer learning and education approach (PLEA). Various educational and communication activities such as social dramas, campaigns, and role-plays were conducted within schools and in the nearby communities.
Rigorous supportive supervision, field visits, and review meetings were implemented in participatory ways to build sustainability and ownership of the SBCC activities. The intervention was integrated into the existing primary health care activities and therefore, the HEWs were actively collaborated in the SBCC activities to cascade it to the household level through women-centered health development teams (HDT) and larger community groups to ensure long-lasting sustainability. The HEWs are paid community health workers who have roles of public health education and behavior change communications on sanitation and preventions of common infectious diseases such as malaria, TB, HIV/AIDS, and maternal health services [14]. However, the HDTs are unpaid women volunteers who have the capability to carry out community mobilization tasks such as immunization campaigns, keeping track of pregnancies and illnesses for up to 30 households in the neighborhood, and in collaboration with the HEWs [26]. Details about the school-based SBCC interventions were presented in a study published somewhere else [12, 13].
Study design
As part of the school-based SBCC program evaluation, the current study employed a mixed research design to collect post-intervention data following completion of the program. The mixed-method design was applied to enable collecting and analyzing data from multiple sources to broadly understand the issue under study. The quantitative design was aimed to measure the perceptions of the key stakeholders about the implementation and sustainability of the program, while the qualitative one was used to explore the associated experiences and perspectives. The experiences and perspectives of the participants on the program implementation process, sustainment, and other broader contexts were explored based on the major domains or propositions identified in quantitative research objectives [27]. The two research approaches were supposed to complement each other in which one method would compensate for the limitations of the other one. Finally, findings of qualitative research part were used to interpret or explain the findings of the quantitative study for a better understanding of the problem.
Quantitative method
Study population and sample size
Participants encompass key stakeholders including officials from education and health offices, community health extension workers (HEWs), school directors, school malaria focal teachers and the program’s field officers. Stakeholders are defined in this study as, those individuals who received basic and ongoing training on the program contents, program delivery, and monitoring process of the SBCC interventions on malaria prevention and control. They were empowered, supported, and have given full responsibility to plan, implement and monitor the malaria prevention communications in their respective schools and villages.
There were about a total of 209 key stakeholders who have received training on the management, monitoring, and dissemination of the school-based SBCC intervention and who have been facilitating and supervising the program in collaboration. This includes 170 participants from schools directors and schools malaria focal teachers in 75 schools, 10 health professionals from health offices in five the districts, and 39 community HEWs. A total of 205 (out of 209) key stakeholders were included in the survey that was conducted following the completion the intervention.
Data collection instrument and techniques
Data were collected using a structured questionnaire adapted from relevant literature on program implementation outcomes and the sustainability [23, 28,29,30,31]. The questionnaire covered items addressing the socio-demographic characteristics, knowledge on essential malaria actions (EMAs), threat perceptions (risk and severity) regarding malaria, self-efficacy or competence, perceptions of community supports and schools climates. Further, the psychometrically measured key implementation outcomes such as fidelity of implementation (FOI), degree of program adoption, sustainability of a program (SOP) were covered. The questionnaire was developed in English and translated into Afan Oromo, the local language to facilitate understanding. The stakeholders were contacted at their workplaces and they encouraged filling the questionnaire.
Measurements and scoring
Knowledge of essential malaria actions (EMAs)
The EMAs elicited knowledge regarding the eight key malaria actions addressed in the project. The respondents were asked to mention the eight EMAs, on an open-ended format. All right responses were counted to create composite scores that ranged from “0 = zero knowledge” to “8 = highest knowledge”.
Perceived risk to malaria
Perceived risk to malaria is defined as perceptions about the likelihood of acquiring malaria. Five items were used to measure this construct on a five-point Likert scale which ranges from completely disagree = 1 to completely agree = 5. This scale produced reliable measures with an acceptable level of internal consistency (α = 0.70). Reverse scoring was done for negatively worded statements before analysis.
Perceived malaria severity
The perceived severity of malaria is defined as perception about the bad consequences of malaria infection such as severe illness, death, or interruption with their daily works and performances. This construct was measured by four items (α = 0.61).
Self-efficacy/competence
This was defined as belief about the psychological empowerment (i.e. perceived competence) related to a specific issue (i.e. about malaria and the school-based SBCC approach in this case) [32,33,34]. Eight items were used to measure the perceived personal competence, (α = 0.90). Composite scores were used in the analysis.
Perception about schools climate
This was conceptualized as stakeholders’ perceptions about the extent to which the organizational system and social supports within the school settings are responsive to the SBCC program and their expectations. These include perceptions towards school systems, social relations, decision making process and support that influence the program implementation. The measure was adapted from the organizational climate scales and designed specifically to measure the stakeholders’ perceptions in the context of the SBCC approach on malaria prevention [35]. The exploratory principal component analysis (EPCA) yield eight valid items (α = 0.83) and the composite score was used in the subsequent analysis.
Perceived community support
This taps the perceptions about the existing community such as sense of belongings (connections), community participation (active participation in community activities) and community organizations (perceived social support of in the community) that can provide opportunities for members of the community to participate in malaria preventive actions. Nine (9) items (α = 0.77) with responses rated on a 5-point scale from (1) strongly disagree to (5) strongly agree were used to measure the perceived community supports [36]. High composite scores were interpreted as a higher importance of this factor.
Perceived fidelity of implementation (FOI)
Fidelity of implementation (FOI) is defined as individuals perceptions about the degree to which an intervention is delivered as intended [31]. FOI has direct relation with outcome of an intervention as a mediating variable between context and intervention effectiveness [37]. The perceived FOI was measured by the stakeholders’ self-rating questions on five-point Likert scale. Nine items (α = 0.89) were adapted from previous study [37] and designed based on the major SBCC program components and activities.
Adoptions/degree of readiness to adopt
Adoption is defined as the degree of uptake or actual use of a program [23]. For this study, scale consisting of five items (α = 0.72) were adapted from previous studies [23, 38] to measure the degree of adoption or readiness to adopt the school-based SBCC interventions on malaria preventions. Items were designed using the five point Likert scale format. Composite was constructed with higher scores indicating high degree of adoptions or uptake by the stakeholders.
Perceived SOP
The perceived SOP was defined in this study as, the stakeholders’ perception about how likely the school-based SBCC interventions on malaria preventions will be continued functional in the area. It was measured immediately after the completion of the program from the stakeholders’ perspectives using items that were adapted from the sustainment measurement system scale [39]. Dimensions such as perceived community supports, organizational capacity and system supports of hosting organization (i.e. schools in this case) and stakeholders capability to run the program were assessed [40]. A total of 6 items ((α = 69) designed on five-point Likert scale were used in which the stakeholders are asked to rate their opinion across range of factors that affect the sustainability of this program.
Statistical data analysis
Quantitative data were analyzed using SPSS 26.0 software. Descriptive statistical measures such as frequency, mean and proportion were calculated. The Pearson’s correlation analysis was carried out to examine the relationship between the perceived SOP and other psychometrically measured variables. Similarly, an independent sample t-test was carried out to explore associations between the perceived SOP and other dichotomous variables.
Multivariable linear regression modeling was performed to identify the independent factors associated with the perceived SOP of the school-based SBCC approach on malaria prevention. Standardized regression coefficients (β) were interpreted to understand the independent effects of the selected predictors on the outcome variable. P-value less than 5% were considered for significant association.
Qualitative research part
Qualitative method participants
Participants for qualitative method were selected based on prior knowledge on the program experiences, exposure to the interventions and contexts [27]. Thus, purposive sampling technique was employed to recruit informants who were actively engaged in the program as lead stakeholders. Various segments of stakeholders were reached out with the ultimate goal of maintaining maximum variability assumptions [41] The intent was to address multiple perspectives, experiences, and factors influencing the program sustainability. Accordingly, nine key informants or key stakeholders who had administration roles in the project were selected. Furthermore, document review was conducted to collect secondary data on activities and review meetings reports regarding the school-based SBCC interventions.
Qualitative method tools and data collection
The qualitative data was collected using guides that were developed based on the contents and propositions of the quantitative studies. The guide has list of few interview points with several follow up probes used to capture beneath of the issue. The interviews were conducted in quiet spaces found in the back yard of each school and some interviews were conducted in quite offices in the schools. The interview process was interactive and participatory facilitated by experienced interviewers. Data collection was assisted by audiotape records and the data collectors took field notes. The average recorded time to run the interview was 45 min.
Qualitative method data analysis
The recordings and field notes were transcribed verbatim and translated into English. The Atlas. ti 7.1 software for analysis was used to guide the analysis process. Data analysis was done through the thematic analysis process to build conceptually defined themes [41]. Initial analysis was started with quick identification and assigning of codes to descriptive data segments based on pre-defined research questions or prepositions identified in research objectives. Further coding was done to clear out any relevant emerging segments that require assigning new codes and alternative explanations. Coding was done independently by two experienced public health researchers. Besides, quotes of participants’ expressions that exemplify key concepts were used directly during analysis and interpretation. Finally, the results and discussion are presented by triangulating the qualitative and quantitative findings.
Results
Socio-demographic characteristics
Two hundred and five stakeholders were participated in the study making the response rate of 98.10%. The majority of the participants were teachers in a profession that accounts 137 (66.83%). Male participants were 130 (63.41%) and 109 (53.17%) participants had age ranging between 25 and 29 years old. Large number of participants have Oromo ethnic background with 190 (92.68) and protestant and Muslims account major religions with 78 (38.05%) each. The majority of the participants were married, 173 (84.39%) and 95 (46.34%) have monthly salary of 4000-4999birr. Participants who reported diploma as the highest level of education attained and experience of 6–10 years account majority with 150 (73.17%) and 126 (61.46%) respectively. A large segment of the participants 119 (58.05%) was also reported having received some sort of health-related training other than that of the current project (Table 1).
Descriptive statistics and Pearson’s correlation coefficients
The mean score of the perceived SOP was 25.93 (SD = 4.32; range = 6–30) which was considerably higher score. This implies the stakeholders hold a perception that the school-based SBCC approach on malaria prevention is more likely to sustain in the schools over the coming time.
Furthermore, Pearson’s correlation coefficients (r) showed that the majority of the psychographic constructs were significantly and positively correlated with SOP; except perceived severity and school climate scores. The highest and lowest positive significant correlation was observed between FOI and SOP (r = 0.45; P < 0.01), and between perceived risk and SOP (r = 0. 14; P < 0.05), respectively (Table 2).
Predictors of the perceived SOP
The multivariable regression modeling demonstrated a significant relationship between the selected variables (during the bivariate analysis) and the perceived SOP score. Accordingly, personal factors such as the perceived risk of malaria (standardized coefficient; β =0.150; P = 0.029), self-efficacy towards program implementation (standardized coefficient; β =0.192; P = 0.003) were demonstrated positive effects on the perceived SOP. This implies; those stakeholders who have higher perceptions of malaria risks and perceptions about the ability to implement the school-based SBCC program think that the program will sustain in the future.
On the other hand, the analysis identified that the program-related dimensions such as perceived FOI (standardized coefficient; β =0.292, P = 0.000) and perceived degree of program adoption (standardized coefficient; β =0.286; P = 0.000) positively predicted the perceived SOP among the stakeholders. The idea is that, stakeholders who believe that the program was implemented very well think that higher probability to sustain it. Similarly, those who reported a higher degree of adoption hold a strong belief that the program would be implemented effectively in the future. However, none of the community settings and school climate measures were predicted the perceived SOP in this study. The highest and lowest potential predictors of perceived SOP were the perceived FOI (effects = 29.2%) and perceived risk to malaria (effects = 15%) (Table 3).
Results of the qualitative study
The qualitative result identified three major themes and respective sub-themes regarding the perceived barriers and opportunities to adoption and sustaining of the school-based SBCC intervention on malaria prevention. Theme 1: perceptions about program coordination and delivery that include inadequate involvement of key stakeholders and relevant health staffs, unprecedented turning over of the trained staffs, concern over short project life with immature sustainability efforts, flawed program monitoring and supervision, and low community promotion of the program to improve sense of ownership. Theme 2: perceptions about the inner organizational/school settings such as low schools priority, supportive schools climate, and coaching of the program. Theme 3: perceptions about the outer settings or community supports such as the existing health system, education sector structures, and community social networks.
Accordingly, the majority of the key informants mentioned that the lack of engaging key stakeholders such as village councils, political leaders who have the power to influence and mobilize the community, and the health centers (who are expected to have the authority to supervise the HEWs through the structure called primary health care unit (PHCU). Confusions in the roles and responsibilities about “who should do what” and “who should owe the program” among the stakeholders (between the schools and health sectors) were perceived as challenges to sustainability. Lack of engaging all possible and relevant staffs combined with the unprecedented turning over of these trained staffs, the short project life, immature sustainability efforts, and interrupted technical and material supports were pressing concerns of the stakeholders that might affect the continuity of the program. They mentioned that low community promotion of the program has affected the sense of ownership which might in-turn determine its sustainability.
The result also identified that the low school’s priority of a program, teachers’ skeptic behaviors on coaching of the school-based SBCC program as factors related to the inner organizational/school settings. However, they acknowledged that the benefits of the existing structure in the education system in facilitating the implementation and institutionalization of the SBCC program into the school system. At the school level, the structure was locally called “geengoo barattootaa”, which mean; “the student circle”. The circle consists of five members and a leader. It was aimed at improving students’ academic performance in primary schools by facilitating peer learning activities.
Finally, factors related to the outer settings (structures in the health and education system, community networks) were identified as opportunities to sustain the program. The existence of a formal structure (school networks) in the education system called “cluster resources center” [CRC] and the PHCU of the health sector combined with their commitment to work in collaboration on malaria prevention has provided a great opportunity for sustainability. The CRC is an inter-school network aimed at enhancing educational quality within the cluster (Table 4).
Similarly, a document review result showed that basic training was offered for 189/225 (84%) school teachers, school principals, and other key stakeholders. School peer educators among students. A total of 13,400/8842 (66%) peer leaders were trained as key facilitators of peer education, and these leaders reached 37,824/40,000 other students. Further, various school-level clubs such as anti-malarial and mini-media clubs were established, strengthened, and networked in all 75 (100%) schools. The project has reached 54, 412 households using trained students as change agents and messengers of malaria information. Besides, more than 120, 434 people were received essential malaria actions through various approaches. The project carried out about 475/298 (62.7%) small and large-scale community campaigns.
The project rendered about 74.3% (390/525) supportive supervision, 60% (15/25) review meetings, and 123.3% (2220/1800) visits of local households to monitor and track malaria-related preventive behaviors. Malaria-specific clubs are established and performing malaria preventive tasks in all 75 schools. Guided by the steering committee, functional linkage was created between education, health departments, and community health workers (HEWs) to ensure the sustainability of the program. Malaria preventive activities such as peer education, parent education, and campaign monitoring and reporting checklists were distributed to all schools. Furthermore, various communication materials such as leaflets/brochures; (56, 022), posters; (3297), flip charts; (1337), and training manuals/educational guides, (1969) were distributed to all targeted schools to support SBCC activities at the local level.
Discussion
The current study examined the stakeholders’ perceptions towards the sustainability of the SBCC on malaria prevention through school communities. The study applied a mixed research method to explore the perceived SOP and identify predictive variables used to sustain the school-based SBCC intervention on malaria prevention. The result showed that perceived malaria risk, self-efficacy, perceived FOI, and perceived degree of adoption were positively predicted the perceived SOP among the key stakeholders.
The result showed that there is a positive perception that the program would be continued implemented in the schools over the coming years. Self-efficacy was identified as one of the predictive variables to help sustain the program in this study. Accordingly, perception of competence towards the school-based SBCC on malaria prevention was positively associated with perceived SOP. Literature showed that health program sustainability is affected by the characteristics of the implementing individuals in addition to the organizational and community supports [17, 24, 42]. Specifically, the knowledge and skills of employees towards the program affected their beliefs about its suitability [43, 44]. It was reported that the quality of staff training and motivation schemes provided could empower the stakeholders for future performance [30]. For instance, an evaluation study of an intervention to reduce aggressive behavior in schools found that the provision of adequate training for school coordinators and teachers facilitated sustainability [45].
In this study, the higher perception of risk to malaria infection positively predicted the perceived sustainability of the school-based SBCC intervention. Threat perception is a potential factor that drives and motivates individuals towards implementing the threat alleviating efforts and this might have brought a commitment of the stakeholders towards a continued implementation of the program. Behavior change theories indicated that people are more motivated to approve and participate in health-promoting or disease preventive behavior when they perceive that they are vulnerable to the disease or problems [46, 47]. The study area is one of the malaria-endemic settings and this might be the reason for these positive relationships. However, it was reported that malaria incidence rates are showing a considerable reduction in Ethiopians which appears to influence public perceptions as well [9, 13]. The result of this study implicates that the need to consider individuals’ disease perceptions while dealing with program sustainability issues.
The perception stakeholders’ towards the FOI positively predicted the SOP in this study implying that promoting implementation delivery would contribute to sustainability in the future. A consistent finding was reported in previous studies that programs with higher levels of fidelity and adaptability are likely to be sustainable [16, 48]. The qualitative result identified that the program delivered an acceptable level of critical components such as training, supervision, review meetings, and peer educations. For instance, 84% of the intervention’s delivery was recorded for training activities and 60% for review meetings. Literature showed a similar result in that a minimum intervention dosage or threshold of 62% can lead to the desired outcomes [49]. The existence of discrepancies between the dosage intended and dosage offered was reported in previous literature [49].
The positive relationship between the FOI and SOP observed in this study might due to an improvement in the level of acceptability of the intervention by the stakeholders and community. This indicates the connection that exists between program fidelity and sustainability implying the need to emphasize sustainability in the early phases of program processes such as design and implementation [50]. This calls for proactive thinking for careful designing of the program components such as training, partnerships, engagement, inter-personal relations in order to enhance the continuation of the program. Evidence showed that the adoption of community-based interventions depends on the extent of community and stakeholders’ involvement and acceptance which in turn influence sustainability [40]. The effect of adoption on sustainability might be mediated by the degree of the intervention’s fit to local settings, needs, and policy (i.e. extent of feasibility and acceptability). This fact was shown in previous studies that school health program that was well integrated into school policies, plans and aligned with time available for schools, matching to schools’ communities needs to be sustained after the intervention [17, 51].
Notably, a previous un-published survey stakeholders’ conducted on the same program (i.e. the school-based SBCC intervention), showed that a high level of acceptability and feasibility of the program (Abamecha et al: Perceived implementation outcomes of the social and behavior change communication (SBCC) approach on malaria prevention through schools communities in Ethiopia, unpublished). The fact that the adoption score positively predicted the SOP in this study can be explained in many ways. First, the existence of systems and structures in the education and health systems that could promote adoption and this would in-turn the sustainability of a program. A qualitative result indicated that the existence of a formal structure in the education system called CRC and the PHCU of the health sector has provided great opportunities for sustainability. The CRC is defined as an inter-school network aimed at enhancing educational quality within the cluster [52]. Secondly, considerably higher adoption rate (100%) of critical project components such as creating health-related social networks in schools such as anti-malarial, mini-media, and sports clubs were established in all 75 schools and all the targeted schools were undertaking peer and parent education on malaria with a varying schedule that ranges from every to every 3 weeks. Thirdly, this relationship might also be moderated by the amount of perceived FOI among the stakeholders. Thus, further research is required to understand how fidelity and adoption of the program interacted to influencing the SOP.
In the current study, though the measures of community supports and school climate were not significantly associated with the SOP, the majority of the qualitative participants were described that the existing school system/structure as an opportunity to sustain the program. The key informants acknowledged that the existing structure in the education system locally called “geengoo barattootaa”; to mean “student’s circle”, helped them to facilitate the implementation and institutionalization of the SBCC into the school system. The student’s circle consists of five members and a leader which is aimed at improving the quality of education in primary schools. However, a previous study suggested that a positive school climate was associated with the continued implementation of school-based health intervention [53]. In addition, inadequate staffing and administrative support hindered the sustainment of school-based programs [54, 55] .
The finding from the qualitative study also reported some challenges to the program such as lack of involvement of community leaders (community councils and village leaders) who have power and credibility to mobilize the community, and low school priority of the program, weak coaching, and skepticism from some teachers. Furthermore, the turning over of the trained staff was one of the serious concerns of the stakeholders that could affect the sustainability of the current study. A previous qualitative study reported that low turnover of staff is associated with pursuing more knowledge and experience with the programs than those with a higher turnover [43, 44]. This might be, new decision-makers did not always share the enthusiasm for the intervention or had other priorities for sustaining the intervention [56].
Furthermore, confusion in the roles and responsibilities about “who should do what” and “who should owe the program” were identified as barriers to sustainability in this study. Having clear accountability of roles and responsibilities were reported as key facilitators influencing the sustainability of hospital-based interventions according to a recent systematic review [57]. Sustainability depends not only on the capabilities of the schools to implement the program, nor the resources and material supports; but also on the targeted community’s involvement and a building sense of ownership [58].
Implications of the study
Identifying the key predictive variables that helps to sustain the school-based SBCC intervention; the current study provided evidence that has practical implications for the school health promotion. The evidence could also help to EER schools and other stakeholders in malaria elimination efforts. More specifically, it has practical significance to ensuring the strategies of various national health policies that outlined the need to involve all those concerned and sustainability [3, 14, 15]. Therefore, exploring the stakeholders’ experiences and perceptions towards the adoption and sustainment of the school-based SBCC on malaria prevention, this study provided empirical evidence that supports various global malaria elimination initiatives.
Specifying a wide range of the SBCC components, assumptions, and activities that drew on extensive field experiences, the result of this study guides actions on how to embed such program within the existing health care, health education, and school activities to ultimately enhance ownership and sustainability. The measurements employed in this study to explore the perceived fidelity of implementation, degree of adoptions, and sustainability of the SBCC could provide methodological solutions to both the recently emerging implementation sciences and the SBCC theory [59]. Thus, this result contributes to fill gaps in evidence on the application of the SBCC approach to design, implement and sustain communication interventions on malaria preventive actions in resources limited settings. Finally, the lesson learned from the lived experiences and perspectives of the key stakeholders would help to devise effective methods to engage, empower and retain schools in malaria elimination efforts and beyond.
Limitation of the study
The current study measured or predicted the anticipated sustainability of the school-based SBCC program based on the stakeholders’ perspective or based on subjectively defined data that were collected immediately after the cessation of the program. Despite its ultimate importance in implementation science, the actual sustainability of the program or the extent to which the program components are continued for some time after phase-out of the program was not explored in this study. Nevertheless, this study conceptualized sustainability as a process outcome of an intervention which acts as an intermediate indicator between the intervention and its desired effects and this is useful to understand the relationship between the intervention and ultimate effects [23].
Researchers argue that the need to consider sustainability during the design and implementation of interventions because program implementation and sustainability are parallel and concomitant processes [50]. Having an understanding of what processes (e.g training, planning, partnerships, engagement) and factors influence the sustainability of interventions would help to plan proactively for the continuation [60]. Applying the mixed research method, the current study explored various organizational systems and interpersonal factors influencing the anticipated sustainability of the program from the stakeholders’ perspectives. Ultimately the evidence from this study would help to confidently attribute the effects or changes in the malaria preventive psychographics and behavioral outcomes (i.e. ITN utilization and prompt care-seeking behaviors) to the intervention.
Conclusion
The study identified key predictive variables such as stakeholders’ perceived risk to malaria, self-efficacy, perceived fidelity of implementation, and degree of adoption that could help to improve the sustainment of the school-based SBCC approach on malaria prevention and control. Further longitudinal study should be conducted to examine the rate of decline in program components over time and how improved sustainability would contribute to the effectiveness of malaria preventive behaviors among students.
Availability of data and materials
The datasets used and analyzed during the current study are available from the corresponding author on reasonable request.
References
World Health Organization. Malaria vector control and personal protection: Report of a WHO Study Group. WHO Technical Report Series, 936. Geneva: WHO Press, World Health Organization.
World Health Organization. World Malaria Report: Year of global progress and challenges. Vol. WHO/HTM/GM, World Health. 2020.
Federal Ministry of Health; Ethiopia. Ethiopia malaria elimination strategic plan: 2021-2025. 2021.
RBM Partnership. RBM Partnership to end malaria: the strategic framework for malaria social and behaviour Change communication 2018–2030. 2018.
USAID and CDC: Preesident’s malaria initiative. Ethiopia malaria operational plan 2019. 2019;
World Health Organization (WHO). Guidelines for malaria vector control. Geneva: World Health Organization; 2019. Licence: CC BY-NC-SA 3.0 IGO.
World Health Organization. Global technical strategy for malaria 2016–2030. Geneva: World Health Organization; 2016. Licence: CC BYNC-SA 3.0 IGO.
USAID and CDC. Presedent malaria intitiative Ethiopia: Malaria Operational Plan FY 2020. 2020.
Taffese, et al. Malaria epidemiology and interventions in Ethiopia from 2001 to 2016. Infect Dis Poverty. 2018;7. https://doi.org/10.1186/s40249-018-0487-3.
Nyunt et al. Evaluation of the behaviour change communication and community mobilization activities in Myanmar artemisinin resistance containment zones. Malar J. 2015;14:1–9.
Awantang G, Babalola S, Hannah Koenker E. Correlates of social behavior change communication on care - seeking behaviors for children with fever : an analysis of malaria household survey data from Liberia. Malar J. 2018:1–10. https://doi.org/10.1186/s12936-018-2249-x.
Abamecha F, Sudhakar M, Abebe L, Kebede Y, Alemayehu G, Birh Z. Effectiveness of the school - based social and behaviour change communication interventions on insecticide - treated nets utilization among primary school children in rural Ethiopia : a controlled quasi - experimental design; 2021. p. 1–15.
Kebede Y, Abebe L, Alemayehu G, Morankar Sudhakar ZB. School-based social and behavior change communication ( SBCC) advances community exposure to malaria messages , acceptance , and preventive practices in Ethiopia : A pre- posttest study; 2020. p. 1–21. https://doi.org/10.1371/journal.pone.0235189.
Federal Ministry of Health; Ethiopia (MOH). Health Sector Transformation Plan (HSTP) 2015/16–19/20. Addis Ababa: Ministry of Health; 2015.
Federal Ministry of Health; Ethiopia. National Health Promotion and Communication Strategy (NHPCS, 2016–2020). 2016.
Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework : addressing the paradox of sustainment amid ongoing change; 2013. p. 1–11.
Walugembe DR, Sibbald S, Janzen M, Ber L, Kothari A. Sustainability of public health interventions : where are the gaps ? Heal Res Policy Syst. 2019;17:1–7.
C-Change. 2013. C-Change Final Report. Washington DC: C-Change/FHI 360. www.c-changeproject.org/sites/default/files/C-Change-Final-Report.March2013.pdf
C-Change U. Social and behavior change communication (SBCC); 2012.
Durlak JA. Studying program implementation is not easy but it is essential. Prev Sci. 2015;16(8):1123–7. https://doi.org/10.1007/s11121-015-0606-3.
Lapelle NR, Zapka J, Ockene JK. Sustainability of public health programs: the example of tobacco treatment services in Massachusetts. Am J Public Health. 2006;96(8):1363–9.
Moore JE, Mascarenhas A, Bain J, Straus SE. Developing a comprehensive definition of sustainability; 2017. p. 1–8.
Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research : conceptual distinctions, measurement challenges , and research agenda; 2011. p. 65–76.
Savaya R, Rogers P. Projected Sustainability of Innovative Social Programs. Eval Res. 2009;33(September 2004):189–205.
Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions : Medical Research Council guidance. BMJ. 2015;350:1–7.
Federal Ministry of Health. Health Extension and Education Centre; Ethiopia. Health extension program in Ethiopia: profile. Addis Ababa: Ministry of Health; 2007.
Starman AB. The case study as a type of qualitative research. J Contemp Educ Stud. 2013;13:28–43.
Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12(108):1–12.
Keith RE, Hopp FP. Fidelity of implementation : development and testing of a measure. Implement Sci. 2010;5(1):99 Available from: http://www.implementationscience.com/content/5/1/99.
Durlak JA, Dupre ÆEP. Implementation matters : a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3-4):327–50. https://doi.org/10.1007/s10464-008-9165-0.
Carol L, O’Donnell. Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in K −12 curriculum intervention research. Am Educ Res Assoc. 2008;78:33.
Spreitzer GM. Psychological empowerment in the workplace: dimensions, measurement, and validation. Acad Manag J. 2001;38(1995):5–6.
Singh K, Kaur S. Psychological Empowerment of Teachers : Development and Validation of Multi- Dimensional Scale. Int J Recent Technol Eng. 2019;7(6):340.
Cyril S, Smith BJ, Renzaho AMN. Systematic review of empowerment measures in health promotion. Health Promot Int. 2016;31(July 2015):809–26.
Peña-suárez E, Muñiz J, Campillo-álvarez Á, Fonseca-pedrero E, García-cueto E. Assessing organizational climate: Psychometric properties of the CLIOR Scale. Psicothema. 2013;25(1):137–44.
Herrero J, Gracia E. Measuring perceived community support: factorial structure, longitudinal invariance, and predictive validity of the PCSQ (perceived community support questionnaire). J Community Psychol. 2007;35(2):197–217. https://doi.org/10.1002/jcop.20143.
Keith RE, Hopp FP. Fidelity of implementation : development and testing of a measure; 2010. p. 1–11.
Moore G, Audrey S, Barker M, Bond L, Bonell C, Cooper C, et al. Process evaluation in complex public health intervention studies : the need for guidance. J Epidemiol Community Health. 2014;68(2):1–2.
Palinkas LA, Chou C, Spear SE, Mendon SJ, Villamar J, Brown CH. Measurement of sustainment of prevention programs and initiatives : the sustainment measurement system scale; 2020. p. 1–15.
Ceptureanu SI, Luchian I. Community based programs sustainability. A multidimensional analysis of sustainability factors; 2018. p. 1–15.
Baxter P, Jack S. Qualitative case study methodology : study design and implementation for novice researchers. Qual Rep. 2008;13(4):544–59.
Rabin BA, Brownson RC, Haire-Joshu D, Kreuter MW, Weaver NL. A glossary for dissemination and implementation research in health. J Public Heal Manag Pract. 2008;14(2):117–23. https://doi.org/10.1097/01.PHH.0000311888.06252.bb.
Hailemariam M, Bustos T, Montgomery B, Barajas R, Evans LB, Drahota A. Evidence-based intervention sustainability strategies : a systematic review. Implement Sci. 2019;6:1–12.
SMC A. Factors associated with sustainability of quality improvement programs after achieving early implementation success . A qualitative case study; 2017. p. 1–9.
Dijkman MAM, Harting J, Van Tol L, Van Der WMF. Sustainability of the good behaviour game in Dutch primary schools; 2015. p. 1–12.
RBM Partinership To End Malaria. Malaria Social and Behavior Change Communication Indicator Reference Guide : Second Edition. 2017.
Abraham C, Sheeran P. The health belief model. In: Conner M, Norman P, editors. Predicting health behaviour: research and practice with social cognition models. 2nd ed. Maidenhead: Open University Press; 2005. p. 28–80.
Berkel C. Directions for the advancement of culturally adapted preventive interventions: local adaptations, engagement, and sustainability Manuel. HHS Public Access. 2020;18(6):640–8.
Wasik BA, Mattera SK, Lloyd KB CM. Intervention dosage in early childhood care and education: It’s complicated: research brief OPRE 2013–15; 2013.
Pluye P, Potvin L, Denis J. Making public health programs last : conceptualizing sustainability. Eval Program Plann. 2004;27(2):121–33. https://doi.org/10.1016/j.evalprogplan.2004.01.001.
Olumide AO, Mcguire C, Calhoun L, Speizer I, Babawarun T, Ojengbede O. Factors promoting sustainability of NURHI programme activities in Ilorin and Kaduna, Nigeria : findings from a qualitative study among health facility staff; 2020. p. 1–11.
Afework EA, Frew AT, Abeya G. Cluster supervision practices in primary school of Jimma Zone. Int J Educ Adm Policy Stud. 2017;9:68–78.
Bopp M, Saunders RP, Lattimore D. The tug-of-war: fidelity versus adaptation throughout the health promotion program life cycle. J Prim Prev. 2013;34:193–207.
Woodbridge MW, Sumi WC, Yu J, Rouspil K, Javitz HS, Seeley JR, et al. Implementation and sustainability of an evidence-based program : lessons learned from the PRISM applied to first step to success. 2015;
Stirman SW, Miller CJ, Toder K, Calloway A. Development of a framework and coding system for modifications and adaptations of evidence-based interventions; 2013. p. 1–12.
Herlitz L, Macintyre H, Osborn T, Bonell C. The sustainability of public health interventions in schools : a systematic review; 2020.
Cowie J, Nicoll A, Dimova ED, Campbell P, Duncan EA. The barriers and facilitators influencing the sustainability of hospital-based interventions : a systematic review, vol. 9; 2020. p. 1–27.
Iwelunmor et al. Toward the sustainability of health interventions implemented in sub-Saharan Africa: a systematic review and conceptual framework. Implement Sci. 2016.11:43.
Domitrovich CE, Bradshaw CP, Poduska JM, Buckley JA, Olin S, Romanelli LH, et al. Maximizing the implementation quality of evidence-based preventive interventions in schools: a conceptual framework Celene. Adv Sch Ment Heal Promot. 2008;1(3):6–28. https://doi.org/10.1080/1754730X.2008.9715730.
Shelton RC, Cooper BR, Stirman SW. The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care. Annual Review of Public Health. 2018;39:55-76.
Acknowledgements
This project was implemented by financial support from USAID/president’s malaria initiative (PMI)/Ethiopia, (Cooperative Agreement Number: AID-663-A-13-0010. We would like to express our heartfelt thanks to USAID/PMI for financial assistance. We would also like to thank Jimma Zone Health and education Departments for facilitating the data collection process and teachers working in intervention schools for their co-operation during data collection. Disclaimer: USAID staff must include, except in circumstances described below about employment status at the time of research and publication, the following disclaimer in publications they author: “The views and opinions expressed in this paper are those of the authors and not necessarily the views and opinions of the USID.
Funding
The research was conducted by financial funding from USAID and Jimma University.
Author information
Authors and Affiliations
Contributions
FA designed the study, collected data, analyzed the data, drafted and reviewed the manuscript. GM designed the study, collected data, analyzed the data, and reviewed the manuscript. MS designed the study, supervised data collection, guided data analysis and critically reviewed the manuscript. LA designed the study, supervised data collection. YK designed the study, supervised data collection, and critically reviewed the manuscript. GA designed the study, supervised data collection. ZB designed the study, supervised data collection, analyzed the data and critically reviewed the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The research was approved by the Institute of Research Board (IRB) of Jimma University before data collection. Permission was obtained from the Jimma Zone Health Department before reaching out the participants. Written informed consent was sought from each participant after explaining the purpose of the study to the participants. All methods were carried out in accordance with relevant guidelines and regulations. Confidentiality and anonymity were assured for study participants during data collection. Data was collected by approaching the participants to where they work and appropriate space to fill the questionnaires.
Consent for publication
Not applicable.
Competing interests
The authors declare that there is no conflict of interest in this work.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Abamecha, F., Midaksa, G., Sudhakar, M. et al. Perceived sustainability of the school-based social and behavior change communication (SBCC) approach on malaria prevention in rural Ethiopia: stakeholders’ perspectives. BMC Public Health 21, 1171 (2021). https://doi.org/10.1186/s12889-021-11216-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12889-021-11216-7