Abstract
Background
A novel strategy to combat malaria was tested using a methodology adapted to a complex setting in the Amazon region and a hard-to-reach, mobile community. The intervention strategy tested was the distribution, after training, of malaria self-management kits to gold miners who cross the Surinamese and Brazilian borders with French Guiana to work illegally in the remote mining sites in the forest of this French overseas entity.
Main text
This article aims at presenting all process and implementation outcomes following the Conceptual Framework of Implementation Fidelity i.e. adherence, including content and exposure, and moderators, comprising participant responsiveness, quality of delivery, facilitation strategies, and context. The information sources are the post-intervention survey, data collected longitudinally during the intervention, a qualitative study, data collected during an outreach mission to a remote gold mining site, supervisory visit reports, in-depth feedback from the project implementers, and videos self-recorded by facilitators based on opened ended questions.
As expected, being part of or close to the study community was an essential condition to enable deliverers, referred to as “facilitators”, to overcome the usual wariness of this gold mining population. Overall, the content of the intervention was in line with what was planned. With an estimated one third of the population reached, exposure was satisfactory considering the challenging context, but improvable by increasing ad hoc off-site distribution according to needs. Participant responsiveness was the main strength of the intervention, but could be enhanced by reducing the duration of the process to get a kit, which could be disincentive in some places. Regarding the quality of delivery, the main issue was the excess of information provided to participants rather than a lack of information, but this was corrected over time. The expected decrease in malaria incidence became a source of reduced interest in the kit. Expanding the scope of facilitators’ responsibilities could be a suitable response. Better articulation with existing malaria management services is recommended to ensure sustainability.
Conclusions
These findings supplement the evaluation outcomes for assessing the relevance of the strategy and provide useful information to perpetuate and transfer it in comparable contexts.
Trial registration
ClinicalTrials.gov. NCT03695770. 10/02/2018 “Retrospectively registered”.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Background
Ineffective programs can be well implemented while useful programs can be poorly implemented [1, 2]. Knowing the degree to which an intervention that has been implemented corresponds to the intervention initially designed can be very helpful when assessing the sustainability, applicability, or transferability of a strategy [3, 4].
In any kind of research, experimental design is considered to be the most rigorous methodology to ensure the highest level of evidence [5,6,7]. In some contexts, however, random allocation of individuals or clusters is not feasible: this may actually be an opportunity in disguise. Indeed, the quest for gold standard methods can overshadow the relevance of a more pragmatic design as well as some of its advantages, such as transferability [3, 8, 9]. Such a context can be found in the Guiana Shield, a part of the Amazon region, and more specifically in French Guiana, a French overseas entity, bordered by Suriname and the Brazilian State of Amapá. The area’s mining potential, inherited from its rich geological history, attracts a highly-mobile and widely-dispersed population, most of whom come from the poorest regions of Brazil. The high risk of exposure to vectors linked to the living and working conditions of these gold miners – long working hours, stagnant water due to alluvial gold mining practices, etc. – is conducive to the spread of malaria, which is endemic in the region, as detailed in the Additional file 1 [10,11,12,13].
Major difficulties in reaching isolated areas and the sensitive transborder context involving an illegal migrant population raised serious methodological challenges [14].
Border malaria has long been a problem, notably in South East Asia (on the borders between Myanmar and Thailand and Cambodia and Thailand, for example), where antimalarial resistance has repeatedly emerged in a particular mix of local circumstances [15,16,17]. Throughout the history of malaria programs, great efforts have been made to target this complex transnational context [17,18,19,20]. Furthermore, certain activities, often illegal (guerrilla warfare, logging, mining), have been important drivers of malaria epidemiology. In South America (in Venezuela and Colombia for instance), malaria has been linked to mining or more largely to extractive activities [10, 21,22,23,24]. The malaria problem on the Guiana Shield is thus specific, but shares certain characteristics with situations found elsewhere in the world.
An innovative research project called Malakit focused on this neglected population which has been identified as a key host and a barrier to the elimination of the disease [25,26,27]. This international collaborative project aimed at evaluating the effectiveness of the preventive distribution of self-diagnosis and self-treatment kits, combined with information and training by facilitators, to gold miners, at resting sites on the borders, to be used when they were unable to rapidly consult a health care provider [26, 28].
The main objective of the project was to increase the proportion of gold miners who correctly take reliable malaria medication, promptly after the onset of the disease, following a positive diagnosis [25, 26, 29,30,31].
The communication of results does not always take into account how interventions were implemented and how context affects implementation and outcomes while it is of major importance for measuring the value of public health strategies [4, 32].
The objective of this article is to detail the solutions that were implemented locally and how the planned intervention unfolded in the midst of a challenging context in order to complement effectiveness outcomes and extract applicability and transferability to other contexts with their own set of interventional constraints [3, 33].
Main text
Evaluation of the effectiveness of the Malakit intervention
Malakit is a research project involving three countries. The sponsor of the research project was the Hospital of Cayenne (French Guiana) which also had a role in the implementation of the intervention. In Suriname, the National Malaria Program and the Foundation for the Advancement of Scientific Research in Suriname (SWOS) were responsible for the investigation and implementation. In Brazil, the institution involved in investigation was Foundation Oswaldo Cruz (Fiocruz) and the non-government organization (NGO), DPAC fronteira was in charge of the implementation [28]. The context, the content of the intervention, the players, and the steps of the project development phase have been described in previous articles [26, 28, 34]. Figures 1 and 2 describe the logic model of the Malakit intervention and its principle. The study population included individuals over the age of 18 and individuals aged 15–17 with parental consent, who go to French Guiana’s illegal gold mining sites to work, or accompany someone who works there: miner, machine owner, cook, housekeeper, canoe operator, driver, hawkers or shopkeepers/vendors, sex workers, etc., whether their activity is itinerant or fixed.
Properly defining the type of research study carried out is useful, since clarity can help avoid duplications, funding inefficiencies, and difficulties in seeking and understanding information encountered by the end-users of research evidence [37]. The Malakit project, by developing an unprecedented approach to malaria management, can be classified as intervention research. A before-after study design was developed using measurable, realistic, and comparable variables. The main evaluation criterion was based on proportion of gold miners who declared good diagnostic and treatment practices, measured cross-sectional surveys before and after the intervention [26, 28]. To complete these indicators, continuous and longitudinal data collection was implemented to assess the correct use of the kit [34]. Between April 2018 and March 2020, 4,766 kits were distributed to 3,733 participants. Six hundred and thirty one of them returned to a distribution site to answer questions about their experience during follow-up visits, among whom 223 used at least one malakit [38]. The main outcomes were analyzed and published independently of the Malakit implementation evaluation [4, 38].
Evaluation of Malakit implementation
The boundaries between intervention and implementation research are not always clear and may closely overlap [37]. Indeed, Malakit could also be considered as an implementation of a test-and treat strategy relying on rapid diagnostic tests (RDT) and artemisinin-based combination therapy (ACTs). In support of this, several implementation research outcomes such as coverage or acceptability were also included in the evaluation from the outset. Therefore, the term of type 2 effectiveness-implementation hybrid trial can be applied to the Malakit study [39,40,41]. No process evaluation plan was elaborated before the launch of the intervention but the need to report on what was delivered and how, as well as on barriers and levers, became evident during the roll-out of the intervention, in order to complement the effectiveness evaluation outcomes and thus improve validity and inform on applicability and transferability.
Data collection and analysis
Quantitative and qualitative data were collected from the studies performed as part of the Malakit project, i.e. pre- and post-intervention surveys, Malakit intervention study, an independent qualitative study, and as part of a medical outreach mission carried out alongside the French army at a remote gold mining site known as Repentir (see Table 1). The qualitative study aimed at exploring: 1) the opinion, perception and responsiveness of participants, facilitators, as well as key actors who are community members not eligible for the intervention, 2) levers and barriers to the use of the “malakit”, 3) the role of the facilitators, 4) contextual elements [42]. Other sources of information were also used to complete the overall picture (see Table 1). Supervisory visits were carried out in the field by project implementers, among whom members of the sponsor team, to observe first and follow-up visits and to hold discussions with facilitators [28]. Seventeen supervisory visits were carried out in Suriname and 15 in Brazil. The total duration of the interventional research was 24 months in Suriname and 18 months in Brazil, between April 2018 and March 2020. In both countries, the first supervisory visit took place within one month after the project launch and the final visit took place one month before the end of the study, i.e. just when it became impossible to travel due to border closings in the context of the Covid-19 pandemic. In Brazil, supervisory observations were conducted on 21 first visits and 10 follow-up visits. In Suriname, 15 first visits and four follow-up visits were reported, although more were actually observed.
Finally, information were extracted from more informal sources i.e. implementer debriefings conducted throughout the project and video self-recorded by facilitators based on a list of questions (Additional file 2).
Conceptual framework used
A modified version of the Conceptual Framework for Implementation Fidelity was chosen retrospectively to present all these outcomes [43]. Therefore, implementation outcomes (“Adherence”) were separated from process outcomes (“Moderators”). Adherence was subcategorized into “Content” and “Dose/Exposure”. However, strictly speaking, adherence with regard to frequency was not assessed, as there was no determined target value regarding the number of training sessions, visits, or kits distributed, due to the lack of knowledge on population size and flows at this time. The moderators presented are “Participant Responsiveness”, which concerned both participants and intervention deliverers as described by Hasson, 2010, “Quality of Delivery”, and “Facilitation Strategies”, but “Intervention Complexity” was not assessed [44]. One element was added, based on a modified model used by Hasson in 2010 to systematically evaluate the implementation fidelity of complex interventions in health and social care, i.e. “Context” [44]. Factors related to the research setting were integrated in this last aspect. The research questions and the sources of the answers are summarized in Table 2.
Ethics
Ethical clearance has been described previously [28, 38]. They were obtained from National Ethics Committee from the countries where the project was implemented, in Brazil—Approval from the Fiocruz Ethics Committee (Opinion Number 2.831.534)—and in Suriname: Approval from the CMWO (Commissie voor Mensgebonden Wetenschappelijk Onderzoek) (Opinion Number VG 25–17)—for the Malakit study, and in Brazil—Approval from the Fiocruz Ethics Committee (Opinion Number 2.560.415)—and in Suriname—Approval from the CMWO (Opinion Number DVG-738)-, for the post-intervention survey.
Findings of the evaluation of adherence
Adherence is defined in implementation science as the extent to which “a program service or intervention is being delivered as it was designed or written” [45].
Content
Human resources
Human resources are the most important elements in most community-based approaches. The workers in this project were referred to as “facilitators” (“mediadores” in Portuguese, “médiateurs” in French). They could not be referred to as “community health workers (CHW)” as they were not active gold miners, were not chosen by the community, and were more accountable to their employer than to the community [46]. Nonetheless, belonging to or being close to the gold mining community and being fluent in Portuguese were fundamental. Having sufficient literacy skills for tablet and smartphone use was a desirable competence. Partners in both countries reported that recruitment of facilitators was difficult due to a lack of eligible candidates. Solutions to address this problem have not yet been identified. Two facilitators were assigned to each of the four border sites (see Fig. 3). In Paramaribo, tasks related to Malakit were added to the duties of the National Malaria Control Program (NMCP) staff, but after repeated failure in the quality of service, the strategy was reviewed and a full-time facilitator was assigned to this site (see Additionnal file 3). Some of the individuals who were hired were not native Portuguese speakers, despite the initial recommendations. Most facilitators had little or no knowledge of malaria and had various occupations, such as Christian pastor or boatman. The extent to which the training was implemented as planned was explained in the article on the setting-up of the project [28].
Details on intervention content
Additional file 3 details the adherence to content and adaptations of the key components of Malakit i.e. inclusion and training as well as kit distribution, replenishment, or re-distribution.
All tools created for training were systematically used, except one poster illustrating the effect of the ACT on malaria over time and the mechanism of resistance (Fig. 4), which was abandoned by some facilitators who found it redundant with the illustration of the treatment displayed on the kit [28].
Dose/exposure
Availability of the intervention
Despite a delay in implementation on the Brazilian side due to regulatory issues related to the 2018 presidential election, the project duration was not shortened thanks to the funds obtained for a six-month extension. Furthermore, the continuous presence of the facilitators at distribution sites was ensured, with the exception of the end-of-year holidays.
While the location of the distribution sites was determined at the beginning of the study, the protocol included the possibility of adapting the strategy according to the mobility of the study population. These ad hoc relocations of the intervention to additional resting sites proved to be very effective in reaching the study population but could not be repeated as often as necessary due to insufficient funding and human resources.
Reach/coverage
The intervention challenge of reaching the population is the same as that of assessing coverage. The findings of the qualitative study performed in 2019 revealed a good knowledge of Malakit, but a probable heterogeneity of project awareness from one site to another [42]. Data collected in a very remote and isolated mining site one year after the start of distributions (Repentir mission in June 2019) showed satisfactory penetration of the intervention. The representativeness of this sample was low (only 25 individuals with an overestimation of women (64% vs. 34% among Malakit participants)) but showed a rate of 28% (95% CI [9.1–46.7]) of the individuals encountered who had been included in the Malakit study and 60%, 95% CI [39.3–80.6]) who had heard about the project.
Finally, reaching more than 3,700 people for a population of approximately 10,000 gold miners in two years is satisfactory, given the challenging context.
Moderators identified
Moderators are factors or mediators which can influence the degree of implementation fidelity [43].
Participants responsiveness
The pre-intervention survey carried out in 2015 revealed that malaria was viewed as the most important health issue in the community by gold miners. The qualitative study carried out in 2019, the year following the launch of the intervention, showed that this perception had not changed and that Malakit was considered the best solution to this health problem by the target population. The ease of use and of carriage of the kit, good contacts with facilitators, and the quality of the training were positive elements put forward. However, some participants pointed out the need to receive reminders with instructions once they were back at gold mining sites [42].
The strong acceptance and enthusiasm of participants were confirmed by the findings from the post-intervention survey and Repentir mission [38]. From the former source, 81.5% (95%CI [77.3–85.8]) of the 320 respondents acknowledged either the importance of the strategy for the population or its public health significance. Only four people expressed a negative opinion, either due to the perception that the medication supplied in the kit was not effective, the lack of usefulness due to the absence of malaria, or the need to self-administer finger pricks. The Repentir mission revealed that 12 people out of 15 who knew about the project had a very good opinion of Malakit. Only one person had a bad opinion and also thought that Coartem® was ineffective. Below are quotes from people interviewed at Repentir:
“It is useful because we can know what disease it is and which treatment to use.”
“It is interesting and useful, my daughter-in-law was able to treat herself” (gold miner who was not a participant).
“It is good, good project” (gold miner who was not a participant but had feedback from participants).
This good acceptance is also reflected by the high level of participation as half of those who knew about the project, were participating (46.1%, 95%CI [40.6–51.6] and 47%, 95%CI [18.1- 75.3] according to the post-intervention survey and Repentir mission results respectively).
The motives for not participating among individuals who had heard about the project were documented for 135 people from the post-intervention survey (Table 3). Not having the opportunity to go to a distribution site was the main reason (40/135, 29.6%). Lack of access to Malakit distribution sites, primarily due to travel costs and time, but also occasionally related to the fear of law enforcement authorities, was also the main obstacle identified in the qualitative study [42]. According to this same source, gold miners acknowledged that the time required for the training and questionnaire could be a disincentive. Facilitators also stressed the importance of making the process before handing out the kit quick, and when asked what could be improved (Additional file 2), three of them mentioned shortening the visits. One suggested reducing the training part by using more videos, and one proposed that questions be removed to shorten follow-up visits [42, 47]. The first visits lasted between 30 and 45 min, but the metadata analysis of monitoring questionnaires revealed that the median time spent on electronic data capture was five minutes, after debriefing with the participant, for both types of visits combined [34]. Reasons for refusing to be part of the study were collected by Malakit facilitators among people who were approached, in other words individuals who had the opportunity to go to a distribution site. The data are not exhaustive, come mainly from a specific site, and mainly from people who had agreed to start the training (Table 3). Lack of time was once again the main barrier that emerged.
Overall, the fear of having to self-administer a finger prick was occasionally expressed, and some facilitators reported efficient strategies to overcome this (see Additional file 3 and Table 3). All the sources of information revealed that the inability to perform a self-test – excluding the fear of needles – and the reluctance to share personal data, which were anticipated as potential barriers, were rarely reported. Facilitators confirmed that distrust was generally overcome and tended to decrease over the course of the project [42].
Facilitators responsiveness
The qualitative study mentioned the perceived importance and relevance of the project from facilitators, and even a pride in doing their work, especially among those who had been gold miners before [42]. Three facilitators reported during supervisory visits a wary attitude among the gold miners, attributed to their accent betraying the fact that they were not Brazilian, but which rapidly dissipated after the project objectives were presented.
The feeling of being useful and part of an innovative project which they believed in was also an important incentive pointed out by the vast majority in their self-shot videos [47]. Three facilitators also reported that what they liked most about their work was acquiring new knowledge. Continuous capacity building is probably crucial to maintaining human resources and sustaining their motivation over time.
Quality of message delivery
Sometimes, less can be more. The shortcoming encountered, mainly at the beginning of the project, was an excess of information or inaccurate information, rather than a lack of information given to participants by facilitators. Adding too much detail may dilute the important information or make it confusing and eventually become detrimental to training. For example, one facilitator described the drug primaquine included in the kit as abortifacient when explaining that it should not be taken by pregnant women, a description that could lead to misuse of the drug for that very purpose. While speaking about risks, instead of only explaining the danger of Coartem® in patients with heart problems, a facilitator also mentioned the risk for Artecom®, the main antimalarial drug found on the black market. This may have undermined the message about avoiding under-the-counter medications. As time went by, the talk was well mastered. The facilitators confirmed that they adjusted the time spent explaining, the stress on specific messages, the number of repetitions, and the vocabulary according to the audience and its availability, as the training was highly interactive.
Overall, facilitators without a health worker background revealed a better ability to tailor the message to the needs of the study population, according to observations in the field.
Facilitation strategies
One principal investigator located in Rio de Janeiro and one coordinator in Oiapoque were responsible for the Brazilian sites. A single person was both coordinator and principal investigator in Suriname. However, these assignments were carried out in addition to their usual work. Due to the distance between the project implementation team in Cayenne and the distribution sites, it was decided that in each country, a supervisor ranking above the facilitators would be hired, to supplement the regular visits of the sponsor team and continuous monitoring of the data collected by the facilitators (see Fig. 3). In the long run, direct interaction between the sponsor team and facilitators in the field on both border rivers proved to be more convenient. Indeed, except for two sites, distance was also an issue for frequent on-site supervisory visits. Non-availability of the supervisors due to lack of time on one border, and difficulties in hiring a permanent supervisor on the other, contributed to poor ongoing training. Nonetheless, the ambiguity of supervisory role of the sponsor team in Cayenne without hierarchical relations was sometimes confusing for facilitators.
To counteract distance issues, facilitators were provided with field reports. The purpose was to improve and homogenize practices by capitalizing on experiences in the field, reiterating important points, and formalizing certain guidelines. This information was provided digitally via an instant messaging group and on paper. Despite efforts to summarize instructions and make them more palatable with the addition of diagrams and pictures, facilitators showed variable interest in these reports. One-to-one direct debriefings, either in person or via instant messaging, had a greater impact. Oral culture seemed to prevail over written culture among facilitators.
Context
Factors influencing reach and participation
Several contextual factors can influence mobility and thus the frequentation of resting sites. The following are the main ones identified: 1) French police operations at mining sites in French Guiana and the presence of the Brazilian army on the Brazilian border; 2) Seasons and periods of the year (for example, greater mobility during end-of-year holidays); 3) Gold mining activity depending on the location of gold veins and rushes following rumors of new discoveries (in Portuguese, fofoca), and indirectly, the presence of armed gangs (facções); 4) Occupation at gold mining site, mobile activity (e.g. traveling vendors, transport providers, and porters) versus non-mobile activity (e.g. gold miners, shop owners, machine owners).
The ability and willingness of potential participants to spend their time on Malakit training was more or less significant depending on the location of the distribution site (see Table 4). At distribution sites where gold miners were just passing through before reaching their final destination (e.g. Albina) and/or where departure by boat to the gold mining sites could be sudden and thus where gold miners were on the lookout (e.g. Vila Brasil), the time required for inclusion was a barrier, since obtaining a malakit was not a priority. On the other hand, participants who lived at the resting site (Antonio do Brinco, Ilha Bela, Oiapoque) and had no “competing activity” showed a much greater engagement in the intervention. Facilitators also reported better availability of participants at temporary distribution points, during one-off missions.
During the project period, the incidence of malaria decreased at the gold mining sites and in the region (decrease partly attributable to the project [38]. This decrease could lead to the perception that malaria no longer exists followed by a diminished interest in obtaining a malakit. Towards the end of the implementation phase, facilitators at one particular site reported several cases of people who felt that the kit was not relevant for them, as they considered that malaria was no longer present at their mining site.
Potential economical moderator
The relatively high market value of the kit itself (more than two grams of gold according to gold miner testimonies i.e. about 85 USD) represented several risks such as resale [48]. Despite close verification of stock flows, the intermittent presence of supervisors in the field made it impossible to ensure that no kits were resold by facilitators.
Influence of the research context
The context of a research is different from a public health intervention as measurement can disturb the object measured. Although the degree of pragmatism in this intervention was high on the pragmatic-explanatory continuum, it was not implemented in fully real-world settings [9]. For example, the instruction given to facilitators not to judge participants for misusing kits (e.g. by sharing them), in order to encourage them to tell the truth about practices, may have led participants to feel that sharing the kit was acceptable. Moreover, the continuous and longitudinal collection of data carried out by the facilitators as part of a research project was more extensive than it would have been if a public health intervention were being monitored. Despite efforts to limit the number of questions and to avoid sensitive topics (e.g. questions were asked on past whereabouts only, not on future destinations), the questionnaires may have been a source of suspicion for a community constantly on their guard due to their illegal and clandestine status. Conversely, the multitude of partners from different countries and the logos displayed on easels and facilitators’ vests were a source of trust for the participants [28].
The difference of diagnostic method between Malakit; i.e. CareStart™ Malaria (Pan) and those provided at malaria clinic in Suriname, i.e. Sd Bioline Malaria Antigen P.f/P.f/P.v® and microscopy, and Brazil, i.e. microscopy, sometimes led to divergent results. Because of the large number of persons tested, mostly asymptomatic, the frequency of such discordant diagnoses seemed high. An investigation using PCR as a gold standard found a false-positive proportion of 1.72%, consistent with an expected false positive rate of 2.4% for a reported specificity of 97.6% and in a low prevalence setting, and a Positive Predictive Value of 40%, consistent with the low PCR prevalence of 5.3% measured during the post-intervention survey [38]. Routine diagnosis was performed on Malakit participants only in case of symptoms or positive Malakit RDT on the Surinamese side and systematically on the Brazilian side. Despite a common procedure to address this problem agreed on among the stakeholders concerned, confusion among participants and decreased confidence in the Malakit RDT or in routine care were reported. Moreover, due to its success, the intervention may have competed with malaria routine care despite the complementarity of the two. A feeling of competition was expressed by some health care workers, which was then dissipated thanks to improved communication.
Discussion on adherence, quality of delivery and its moderators
Based on the observation data, it is possible to assert that the content of the messages and the way they were transmitted complied satisfactorily with what was planned, even if rectifications were necessary at the beginning.
Dane and Schneider suggest [49] that lack of confidence or experience, as well as not being professional – i.e. being a paraprofessional or lay person –, are predictors of poor program integrity in preventive intervention research. Conversely, in a study assessing the fidelity of implementation of malaria care for children by community health workers (CHWs) in Nigeria, adherence to the diagnostic, treatment, and counseling protocol by CHWs was found to be equal or higher to that of the medical staff who served as gold-standard comparators, and was not related to age, level of education, or primary occupation. In the Malakit intervention, previous experience in health care or health mediation did not seem to be an asset – also since, compared to other interventions, no clinical evaluation was performed –, and overconfidence was actually a barrier to compliance with what was planned, to the point where facilitators had to be replaced (see Additional file 3, “Terms and conditions to be included”). This is consistent with WHO’s finding that CHWs can be men or women, young or old, literate or illiterate, as long as they blend into the culture of the community and ensure its acceptance [46].
Ongoing training is a recommended practice, but can be linked to dissatisfaction when format, frequency, quality, etc. are judged inappropriate or insufficient by CHW [50]. Facilitators did not express such discontent, despite many opportunities to do so. The use of mobile technologies in particular was quite well accepted [34]. In low and middle income countries, they are increasingly seen as an opportunity to better train and improve worker performance remotely [51, 52]. This approach, also known as “Mobile Learning for Development”, is the subject of recent studies that concluded that there is a need for further research to better assess and adapt approaches [53, 54]. In Kenya, in a very similar manner to the Malakit intervention, an intervention included a WhatsApp group to strengthen “supervision, professional development and team building”, and also found that quality assurance, information sharing, and the creation of a supportive environment were useful [55]. More broadly, social interaction and peer assessment have been found to be associated with better guideline implementation and clinical practice change [56, 57]. In the present project, the peer-to-peer form of supervision within the WhatsApp group was not observed. Facilitators in the two countries knew each other slightly or not at all, due to the limited number of joint training sessions or meetings (all of them needed a visa to enter French Guiana). That is why they may not have felt comfortable enough to ask questions and share difficulties, and tended instead to share successes. In-person peer supervision, which at one point was considered, can be a way to further foster performance, but could not be implemented.
The geographical distance issues identified here as a main constraint to implementation and monitoring may be encountered in other contexts involving several countries and should be addressed. In addition to instant messaging debriefings, field supervision and refresher training, which are very time-consuming when two days are needed to reach a site, should be assigned to someone dedicated solely to those tasks. This person should actively collaborate in designing and developing training contents and data collection tools with the principal investigators. The development of refresher training tools for facilitators using a participatory approach – as used for participant training tools –, in order to adapt content to their literacy and needs, could also alleviate distance issues.
Constant and long-term efforts to maintain quality are essential to adapt to evolving contexts, including beyond scale-up. Indeed, while resources allocated for research can be sufficient to ensure integrity, for example through continuous in-person and remote supervision, decrease in fidelity is more likely when interventions are adopted and sustained [49]. Further qualitative research is planned during the sustainability phase in Suriname to add and or improve communication tools and ways of delivering messages to enhance quality of delivery.
Discussion on reach/coverage and its moderators
Although coverage was acceptable after two years of intervention, it could have been improved by better allocating funds and resources to adjust to the gold miners’ mobility in a timely manner, especially given the increasing heterogeneity of malaria transmission among gold mining regions. While the penetration of the intervention was very good in a remote gold mining region where traveling to reach a distribution site is costly and time consuming, lack of access remains a barrier to better coverage, as mentioned in the qualitative study and the quantitative results of the post-intervention survey [38, 42].
The excellent appropriateness – defined as “perceived fit of the innovation to address a particular problem” already observed during the feasibility study as well as during participatory development of communication tools, good “adoption” or “uptake” by the study population and finally great acceptability definitely boosted reach [58]. Adjusting the length of training could be a mediator to increase acceptability, especially at certain distribution sites where time is a limiting factor. Furthermore, the findings underline the importance of factors that contribute to the population’s trust in the project, especially with wary communities. Research requirements in particular can negatively impact the community’s perception of the project, which should not be underestimated. Although the strategy was still at the experimental stage, articulation with existing care services should have been further developed to avoid competition being felt instead of complementarity. Finally, diminution of malaria prevalence may imply decrease of participant responsiveness more or less depending on the place of distribution [58]. Maintaining community uptake could be achieved by expanding services offered by facilitators, as seen in Myanmar, where the management of non-malaria febrile illnesses and the referral of severely ill patients complemented “malaria only” CHW prerogatives [59].
Strengths, biases and limitations
While the main defect of the present assessment is the absence of quantitative indicators for content adherence, the main strength is the regularity of supervisory visits throughout the project and not only during specific periods. The distinction between the “core components” and adaptable elements of an intervention can only be discerned through practice and mispractice over time as the intervention is more widely deployed and replicated in other contexts, as explained in the Consolidated Framework of Implementation Research [60]. Since Malakit was an innovative strategy, several choices and adaptations were made during the implementation itself. Thus, the objective of this article was not to create fidelity measures to assess an evidence-based intervention, but to capitalize on this unprecedented field experiment to contribute to future process evaluation or implementation research on the strategy. This is why no proper observation grids were designed to assess adherence to content or quality of delivery and why program differentiation, which is apart from fidelity, was not performed [43].
A workshop bringing together all facilitators and supervisors and led by an external assessor was planned in April 2020 but was cancelled due to the COVID-19 pandemic. The self-recorded videos requested of facilitators to replace their presence at the final meeting of the project were another way to give them a voice. Although this format was not anonymous, which may have inhibited the free expression of opinions, the videos made it possible to confirm or complete information on moderating factors, such as the influence of the length of the training on participation.
One limitation of the post-intervention survey was an over-representation of people frequently traveling to resting sites linked to an overestimation of the coverage. Lack of knowledge on the study population size and flows also made it difficult to assess the estimation of coverage based on distribution figures. The findings of the medical outreach mission in a hard-to-reach gold mining site provided some information on penetration despite the small size of the sample. In both of these quantitative data collections, biases were also over-representation of health-conscious individuals and expected response bias with over-reporting of positive opinion on the project. The qualitative study carried out by an external assessor allowed for increased freedom of expression and to some extent made it possible to alleviate this last bias [38].
Although it is not independent and external, feedback from players who were engaged in the protocol (intervention design and evaluation) and tools development, training, and close field supervision, can constitute in-depth information to complete qualitative and quantitative data collection.
Conclusions
These findings supplement the previously published effectiveness results by reporting on what was actually implemented and the moderating factors of the implementation, thereby strengthening the overall evaluation of the intervention [38]. Satisfactory compliance with what was planned, good responsiveness of the participants and improvements to be done to reach the population are the main points observed. In addition, comparison of the protocol with reality on the ground highlights considerations that will be essential for the sustainability, applicability and transferability of the strategy in other contexts [35, 36, 61].
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Abbreviations
- ACTs:
-
Artemisinin-based combination therapy
- CHW:
-
Community health workers
- CMWO:
-
Commissie voor Mensgebonden Wetenschappelijk Onderzoek
- NGO:
-
Non-government organization
- NMCP:
-
National Malaria Control Program
- RDT:
-
Rapid diagnostic tests
- SWOS:
-
Foundation for the Advancement of Scientific Research in Suriname
References
Blase K. Core Intervention Components: Identifying and Operationalizing What Makes Programs Work. 2013. https://calio.dspacedirect.org/handle/11212/1465. Cited 2020 Sep 2.
Implementation Research: A Synthesis of the Literature [Internet]. http://www.incredibleyears.com/article/implementation-research-a-synthesis-of-the-literature/. Cited 2020 Sep 2.
Cambon L, Minary L, Ridde V, Alla F. Transferability of interventions in health education: a review. BMC Public Health. 2012;12(1):497.
Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;19(350):h1258.
Evaluation designs for adequacy, plausibility and probability of public health programme performance and impact. - PubMed - NCBI [Internet]. [cited 2019 Mar 15]. https://www.ncbi.nlm.nih.gov/pubmed/10195658
Mitchell O. Experimental Research Design. In: The Encyclopedia of Crime & Punishment [Internet]. American Cancer Society; 2015 [cited 2021 May 21]. p. 1–6. https://doi.org/10.1002/9781118519639.wbecpx113
Hwang S, Birken SA, Melvin CL, Rohweder CL, Smith JD. Designs and methods for implementation research: Advancing the mission of the CTSA program. J Clin Transl Sci. 2020;4(3):159–67.
Tosh G, Soares-Weiser K, Adams CE. Pragmatic vs explanatory trials: the Pragmascope tool to help measure differences in protocols of mental health randomized controlled trials. Dialogues Clin Neurosci. 2011;13(2):209–15.
Patsopoulos NA. A pragmatic view on pragmatic trials. Dialogues Clin Neurosci. 2011;13(2):217–24.
Douine M, Lambert Y, Musset L, Hiwat H, Reis Blume L, Marchesini P, et al. Malaria in Gold Miners in the Guianas and the Amazon: Current Knowledge and Challenges (in press). Curr Trop Med Rep. 2020;7:37–47. https://doi.org/10.1007/s40475-020-00202-5.
Heemskerk M, Duijves C. Study on the knowledge, attitudes and practices of malaria and malaria treatment in the small-scale gold mining sector in Suriname. [Internet]. Submitted to the US Agency for International Development by the Systems for Improved Access to Pharmaceuticals and Services (SIAPS) Program.; 2013. http://siapsprogram.org/publication/study-on-the-knowledge-attitudes-and-practices-of-malaria-and-malaria-treatment-in-the-small-scale-gold-mining-sector-in-suriname/
Murta FLG, Marques LLG, Santos APC, Batista TSB, Mendes MO, Silva ED, et al. Perceptions about malaria among Brazilian gold miners in an Amazonian border area: perspectives for malaria elimination strategies. Malar J. 2021;20(1):286.
Musset L, Pelleau S, Girod R, Ardillon V, Carvalho L, Dusfour I, et al. Malaria on the Guiana Shield: a review of the situation in French Guiana. Mem Inst Oswaldo Cruz. 2014;109(5):525–33.
Nacher M, Guerin PJ, Demar-Pierre M, Djossou F, Nosten F, Carme B. Made in Europe: will artemisinin resistance emerge in French Guiana? Malar J. 2013;12:152.
WHO Meeting on the Prevention of the Re-Introduction of Malaria (1966: Washington DC), Organization WH. Prevention of the re-introduction of malaria : report of a WHO meeting [held in Washington, D.C. from 14 to 18 November 1966] [Internet]. World Health Organization; 1967 [cited 2020 Nov 30]. https://apps.who.int/iris/handle/10665/40670
Wangdi K, Gatton ML, Kelly GC, Clements AC. Cross-border malaria: a major obstacle for malaria elimination. Adv Parasitol. 2015;89:79–107.
Guyant P, Corbel V, Guérin PJ, Lautissier A, Nosten F, Boyer S, et al. Past and new challenges for malaria control and elimination: the role of operational research for innovation in designing interventions. Malar J [Internet]. 2015 Jul 17 [cited 2021 Jan 22];14. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4504133/
Pongvongsa T, Ha H, Thanh L, Marchand RP, Nonaka D, Tojo B, et al. Joint malaria surveys lead towards improved cross-border cooperation between Savannakhet province, Laos and Quang Tri province. Vietnam Malar J. 2012;3(11):262.
Gordon A, Vander Meulen RJ, Maglior A. The 2019 Isdell: Flowers Cross Border Malaria Initiative Round Table: community engagement in the context of malaria elimination. Malar J. 2019;18(1):432.
Asia WHORO for S-E. Meeting on cross border collaboration on malaria elimination along the India- Bhutan border. 4–5 Nov 2019, Guwahati, Assam, India. 2020 [cited 2020 Dec 1]; https://apps.who.int/iris/handle/10665/331933
Castellanos A, Chaparro-Narváez P, Morales-Plaza CD, Alzate A, Padilla J, Arévalo M, et al. Malaria in gold-mining areas in Colombia. Mem Inst Oswaldo Cruz. 2016;111(1):59–66.
Aché A, Escorihuela M, Vivas E, Páez E, Miranda L, Matos A, et al. In vivo drug resistance of falciparum malaria in mining areas of Venezuela. Trop Med Int Health. 2002;7(9):737–43.
Lyttleton C. Deviance and resistance: Malaria elimination in the greater Mekong subregion. Soc Sci Med. 2016;150:144–52.
Yan S, Orkis J, Sohail S, Wilson S, Davis T, Storey J. Digging for care-seeking behaviour among gold miners in the Guyana hinterland: a qualitative doer non-doer analysis of social and behavioural motivations for malaria testing and treatment. Malar J. 2020;6:19.
Douine M, Musset L, Corlin F, Pelleau S, Pasquier J, Mutricy L, et al. Prevalence of Plasmodium spp in illegal gold miners in French Guiana in 2015: a hidden but critical malaria reservoir. Malar J. 2016;15:315.
Douine M, Sanna A, Galindo M, Musset L, de Pommier Santi V, Marchesini P, et al. Malakit: an innovative pilot project to self-diagnose and self-treat malaria among illegal gold miners in the Guiana Shield. Malaria J. 2018;17(1):158.
Douine M, Lazrek Y, Blanchet D, Pelleau S, Chanlin R, Corlin F, et al. Predictors of antimalarial self-medication in illegal gold miners in French Guiana: a pathway towards artemisinin resistance. J Antimicrob Chemother. 2018;73(1):231–9.
Galindo MS, Lambert Y, Mutricy L, Garancher L, Bordalo Miller J, Gomes JH, et al. Setting-up a cross-border action-research project to control malaria in remote areas of the Amazon: describing the birth and milestones of a complex international project (Malakit). Malar J. 2021;20(1):216.
Landier J, Parker DM, Thu AM, Carrara VI, Lwin KM, Bonnington CA, et al. The role of early detection and treatment in malaria elimination. Malar J. 2016;15(1):363.
Landier J, Parker DM, Thu AM, Lwin KM, Delmas G, Nosten FH, et al. Effect of generalised access to early diagnosis and treatment and targeted mass drug administration on Plasmodium falciparum malaria in Eastern Myanmar: an observational study of a regional elimination programme. The Lancet. 2018;391(10133):1916–26.
World Health Organization. Guidelines for the treatment of malaria. 3rd ed. 2015.
Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.
Schloemer T, Schröder-Bäck P. Criteria for evaluating transferability of health interventions: a systematic review and thematic synthesis. Implement Sci. 2018;13(1):88.
Tailoring Mobile Data Collection for Intervention Research in a Challenging Context: Development and Implementation in the Malakit Study [Internet]. JMIR Preprints. [cited 2021 May 31]. https://preprints.jmir.org/preprint/29856
Hawkes M, Katsuva JP, Masumbuko CK. Use and limitations of malaria rapid diagnostic testing by community health workers in war-torn Democratic Republic of Congo. Malar J. 2009;8(1):308.
Counihan H, Harvey SA, Sekeseke-Chinyama M, Hamainza B, Banda R, Malambo T, et al. Community health workers use malaria rapid diagnostic tests (RDTs) safely and accurately: results of a longitudinal study in Zambia. Am J Trop Med Hyg. 2012;87(1):57–63.
Remme JHF, Adam T, Becerra-Posada F, D’Arcangues C, Devlin M, Gardner C, et al. Defining Research to Improve Health Systems. PLoS Med [Internet]. 2010 Nov 16 [cited 2021 Apr 22];7(11). https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2993153/
Douine M, Lambert Y, Galindo M, Mutricy L, Sanna A, Peterka C, et al. Self-Diagnosis and Self-Treatment of Malaria in Hard-to-Reach and Mobile Populations of the Amazon: Results of Malakit, a Multicentric Intervention Research Project. In: Towards a Paradigm Shift? [Internet]. Rochester: Social Science Research Network; 2021. (https://papers.ssrn.com/abstract=3850058cited 2021 Jul 1 Report No.: ID 3850058).
Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Republished research: Implementation research: what it is and how to do it: Implementation research is a growing but not well understood field of health research that can contribute to more effective public health and clinical policies and programmes. This article provides a broad definition of implementation research and outlines key principles for how to do it. Br J Sports Med. 2014;48(8):731–6.
Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation Hybrid Designs. Med Care. 2012;50(3):217–26.
Landes SJ, McBain SA, Curran GM. An introduction to effectiveness-implementation hybrid designs. Psychiatry Research. 2019;1(280):112513.
Parent A-A, Galindo MS, Lambert Y, Douine M. Maliqua: A study within Malakit, a project on malaria and gold miners in French Guiana. medRxiv. 2021 May 18 https://doi.org/10.1101/2021.05.16.21257287
Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S. A conceptual framework for implementation fidelity. Implement Sci. 2007;2(1):40.
Hasson H. Systematic evaluation of implementation fidelity of complex interventions in health and social care. Implement Sci. 2010;3(5):67.
Mihalic S. The importance of implementation fidelity. Emotional and Behavioral Disorders in Youth. 2004;4(4):83–105.
Lehmann U, Sanders D. Policy Brief: Community Health Workers: What Do We Know About Them? The State of the Evidence on Programmes, Activities, Costs and Impact on Health Outcomes of Using Community Health Workers. WHO. 2007;1:2.
The facilitators: key people in the Malakit project [Internet]. Malakit. 2020 [cited 2021 Dec 2]. https://www.malakit-project.org/the-facilitators-key-people-in-the-malakit-project/
Gold Price Historical Data | Gold Price History [Internet]. World Gold Council. [cited 2021 Dec 1]. https://www.gold.org/goldhub/data/gold-prices
Dane AV, Schneider BH. Program integrity in primary and early secondary prevention: are implementation effects out of control? Clin Psychol Rev. 1998;18(1):23–45.
O’Donovan J, O’Donovan C, Kuhn I, Sachs SE, Winters N. Ongoing training of community health workers in low-income and middle-income countries: a systematic scoping review of the literature. BMJ Open. 2018;8(4):e021467.
Braun R, Catalani C, Wimbush J, Israelski D. Community Health Workers and Mobile Technology: A Systematic Review of the Literature. PLOS ONE. 2013;8(6):e65772.
Yadav D. Low-Cost Mobile Learning Solutions for Community Health Workers. In: Proceedings of the 26th International Conference on World Wide Web Companion [Internet]. Republic and Canton of Geneva, CHE: International World Wide Web Conferences Steering Committee; 2017 [cited 2021 Jan 22]. p. 729–34. (WWW ’17 Companion). https://doi.org/10.1145/3041021.3053377
Feroz A, Jabeen R, Saleem S. Using mobile phones to improve community health workers performance in low-and-middle-income countries. BMC Public Health. 2020;20(1):49.
Winters N, Langer L, Nduku P, Robson J, O’Donovan J, Maulik P, et al. Using mobile technologies to support the training of community health workers in low-income and middle-income countries: mapping the evidence. BMJ Global Health. 2019;4(4):e001421.
Henry JV, Winters N, Lakati A, Oliver M, Geniets A, Mbae SM, et al. Enhancing the Supervision of Community Health Workers With WhatsApp Mobile Messaging: Qualitative Findings From 2 Low-Resource Settings in Kenya. Glob Health Sci Pract. 2016;4(2):311–25.
Grol R. Personal paper. Beliefs and evidence in changing clinical practice. BMJ. 1997;315(7105):418–21.
Maas MJM, van der Wees PJ, Braam C, Koetsenruijter J, Heerkens YF, van der Vleuten CPM, et al. An Innovative Peer Assessment Approach to Enhance Guideline Adherence in Physical Therapy: Single-Masked Cluster-Randomized Controlled Trial. Physical Therapy. 2015;95(4):600–12.
Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76.
McLean ARD, Wai HP, Thu AM, Khant ZS, Indrasuta C, Ashley EA, et al. Malaria elimination in remote communities requires integration of malaria control activities into general health care: an observational study and interrupted time series analysis in Myanmar. BMC Med. 2018;22(16):183.
Mendel P, Meredith LS, Schoenbaum M, Sherbourne CD, Wells KB. Interventions in Organizational and Community Context: A Framework for Building Evidence on Dissemination and Implementation in Health Services Research. Adm Policy Ment Health. 2008;35(1–2):21–37.
Mukanga D, Babirye R, Peterson S, Pariyo GW, Ojiambo G, Tibenderana JK, et al. Can lay community health workers be trained to use diagnostics to distinguish and treat malaria and pneumonia in children? Lessons from rural Uganda. Trop Med Int Health. 2011;16(10):1234–42.
Acknowledgements
The authors thank all facilitators from the Malakit Project. In Suriname: Breno Otavio Barbosa, Isadora Batista dos Santos, Astrid Huur, Carla Pereira de Paulo, Fernando Silva Rodrigues Barbosa, Nicholas Valente Ferreira. In Brazil: Samanta Braga, Salomao Brito, Alejandro Chavarro, André Da Silva Alancantara, Ronnie Edison and Leonardo Villalba-Bassulto.
Hélène Hilderal, Sam Trinh, Amandine Duclau, Nicolas Vigner and Cécile Longchamps (Hospital of Cayenne).
Funding
The CHC, as sponsor, directly managed most of the project funds. Half of the funding was by the European Regional Development Fund (FEDER) via the Interregional Amazon Cooperation Program (IACP) 2014–2020 (N° Synergy 3949), supplemented with self-funding from the CHC, funds from the French Guiana Health Regional Agency, the European Horizon 2020 Program and contributions in kind from the Surinamese Ministry of Health, as beneficiary of the GF (Global Fund to Fight AIDs, Tuberculosis and Malaria); the Ministry of Health of Brazil; the PAHO/WHO ECC (Pan-American Health Organization/World Health Organisation for Eastern Caribbean Countries); and the French Development Agency (Agence Française de Développement AFD).
The funding bodies have no role in the implementation and analysis of the project.
Author information
Authors and Affiliations
Contributions
MSG, YL, LG, MSM, SV, MN, AA, HH, CP, AS and MD conceived the study and wrote the protocol. MSG, YL, LG, MSM, LM, SV, JBM, JHG, HC and MD implemented the study. MSG, LM, YL and MD performed the analysis. MSG, YL and MD wrote the first draft. All authors read and approved the final manuscript. The authors confirm they had full access to the data in the study and accept responsibility to submit for publication.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The research study obtained all competent ethical approval required according to the respective regulations in Brazil and Suriname. Written consent was obtained from all participants.
Ethical committee of the FUNDACAO OSWALDO CRUZ: CAAE: 89482118.0.0000.5248; Approval No: 2.831.534.
Ethical committee in Suriname for the Malakit study: CMWO. Approval No: VG 25–17.
Ethical committee in Suriname for the post intervention survey (short title: Orpal-2): CMWO. Approval No: DVG 738.
Ethical committee of the Univeristy of Montréal, “Comité d’éthique de la recherche– Société et culture (CER-SC)” for the qualitative study “Malakit Project: a complementary case study”: Project CERSC-2019–083-D.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Galindo, M.S., Lambert, Y., Mutricy, L. et al. Implementation of a novel malaria management strategy based on self-testing and self-treatment in remote areas in the Amazon (Malakit): confronting a-priori assumptions with reality. BMC Public Health 22, 770 (2022). https://doi.org/10.1186/s12889-022-12801-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12889-022-12801-0