Abstract
Background
The conventional IMCI training for healthcare providers is delivered in 11 days, which can be expensive and disruptive to the normal clinical routines of the providers. An equally effective, shorter training course may address these challenges.
Methods
We conducted a quasi-experimental study in two provinces (Sindh and Punjab) of Pakistan. 104 healthcare providers were conveniently selected to receive either the abridged (7-day) or the standard (11-day) training. Knowledge and clinical skills of the participants were assessed before, immediately on conclusion of, and six months after the training.
Results
The improvement in mean knowledge scores of the 7-day and 11-day training groups was 31.6 (95% CI 24.3, 38.8) and 29.4 (95% CI 23.9, 34.9) respectively, p = 0.630 while the improvement in mean clinical skills scores of the 7-day and 11-day training groups was 23.8 (95% CI: 19.3, 28.2) and 23.0 (95% CI 18.9, 27.0) respectively, p = 0.784. The decline in mean knowledge scores six months after the training was − 12.4 (95% CI − 18.5, − 6.4) and − 6.4 (95% CI − 10.5, − 2.3) in the 7-day and 11-day groups respectively, p = 0.094. The decline in mean clinical skills scores six months after the training was − 6.3 (95% CI − 11.3, − 1.3) in the 7-day training group and − 9.1 (95% CI − 11.5, − 6.6) in the 11-day group, p = 0.308.
Conclusion
An abridged IMNCI training is equally effective as the standard training. However, training for certain illnesses may be better delivered by the standard course.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Significance
We wanted to objectively assess the productivity of a short IMNCI course to improve the coverage of IMNCI in the country and reduce cost. We showed that the seven day training is effective.
Introduction
Approximately half of the world’s under-five and neonatal deaths occur in only five countries: India, Nigeria, Ethiopia, the Democratic Republic of Congo and Pakistan (UNICEF, 2019). Although the global under-five and neonatal mortality rates have decreased by more than half since 1990, thousands of childhood deaths still occur in southern Asia and sub-Saharan Africa every day (UNICEF, 2019). A substantial proportion of the decline in childhood mortality was achieved by addressing the two major preventable causes of deaths, pneumonia and diarrhea (Jin et al., 2018). Despite these efforts, both pneumonia and diarrhea still contribute significantly to child mortality (UNICEF, 2019).
To address this global burden, the World Health Organization (WHO) and the United Nations Children’s Fund (UNICEF) developed a strategy called the Integrated Management of Childhood Illness (IMCI). IMCI encompassed a consolidated approach for managing the five most common causes of death in under-five children; pneumonia, diarrhea, measles, malaria and malnutrition (World Health Organization & UNICEF, 1999). Care for newborns younger than 7 days was added to the program in 2003 and the strategy came to be known as IMNCI in many countries (Maternal and Child Survival Program, 2019). Pakistan’s Ministry of Health formally endorsed IMCI in 1998 and it was implemented in the country in 2000 to address the high infant and child mortality rates (World Health Organization Regional Office for the Eastern Mediterranean, 1996).
The effectiveness of IMCI in improving health care workers’ ability to assess and manage the sick child has been well documented in literature (Amaral et al., 2004; Chopra et al., 2005). A systematic review reported that IMCI training and implementation may also cause a reduction in child and infant mortality (Gera et al., 2016). Regardless of the demonstrated advantages of the strategy, its implementation has been met with several challenges, including shortage of trained medical staff, essential drugs, and equipment, weak health systems, and budget allocations (Ahmed et al., 2010; Pradhan et al., 2013; Titaley et al., 2014).
In low-middle income countries, the expense associated with the 11-day IMCI case-management training is a significant problem for scaling up the strategy (Mushi et al., 2011). Additionally, the absence of participating healthcare workers from their clinical obligations leads to disruptions, scarcity of medical staff, and compromised care for the patients. An abridged training has been identified as an alternative to overcome the financial and operational difficulties (Goga & Muhe, 2011). However, before implementing an abridged IMNCI training course, its effectiveness must be evaluated. The objective of this study was to compare the effect of a short 7-day IMNCI training with the standard 11-day training on healthcare providers’ ability to assess and classify illness and take appropriate action according to the IMNCI protocol. We hypothesize that there will be no significant differences in the assessment scores of providers who receive the shorter training and providers who receive the standard duration of training.
Methodology
Study Design and Setting
A quasi-experimental study was carried out from April 2009 to October 2009 in districts Sukkur and Khairpur from Sindh and districts Rawalpindi and Islamabad from Punjab. Two IMNCI training sessions were conducted in each province; a standard WHO 11-day training and an abridged 7-day training that was adapted from the standard course. Blinding of the participants and trainers was not feasible because the same facilitators conducted the training for both groups.
Study Population
Healthcare providers from public sector facilities were nominated by the District Health Officers while those from private facilities were recruited through self-selection after invitation. Providers were eligible to participate in the training if they: (i) worked at first-level health facilities such as hospital outpatient services, health centers, dispensaries, and clinics, (ii) 3 to 4 years of experience in providing clinical care to infants and children, and (iii) did not receive IMNCI in-service training previously. The providers were non-randomly divided into two groups to receive either the 7-day or the 11-day training. The two groups were comparable in terms of cadre (physicians or other healthcare providers) and the health sector they worked in (public or private). The other providers included registered nurses, midwives, health technicians, and lady health visitors (LHVs). LHVs are an important cadre of healthcare workers who provide reproductive and child healthcare at the household and facility levels. They undergo one year of training in midwifery and one year in pediatric and tropical diseases (Ariff et al., 2010). They are stationed at the Basic Health Units, Rural Health Centers, and Tehsil Headquarter Hospitals and provide antenatal, postnatal and immediate newborn care, and facilitate referral to higher centers (Ariff et al., 2010).
IMNCI Case-Management Training
The training was held at two public sector tertiary care hospitals: the Pakistan Institute of Medical Sciences (PIMS) Hospital, Islamabad for the Islamabad and Rawalpindi participants, and the Civil Hospital, Sukkur for the Khairpur and Sukkur participants. Sessions were facilitated by WHO-certified master trainers from the Department of Paediatrics and Child Health at the Aga Khan University. To ensure uniformity and reduce environmental bias, sessions were led by the same team of facilitators for both groups. The training consisted of eight modules that were delivered via classroom activities and hands-on clinical practice sessions as recommended by WHO. The clinical practice sessions were conducted in the outpatient clinics and inpatient wards of the two hospitals. The participants observed and practiced the assessment, classification, and treatment of sick children according to the IMNCI protocol. They were also provided with the IMNCI recording forms to fill their patients’ information.
The same teaching materials, tools, curriculum, and training methodologies were used for both groups. The course was only redesigned and shortened in terms of the time allocated to each classroom activity and clinical practice session. A description of the training and the time spent on each activity in both groups is presented in Supplement 1.
Pre- and Post-Training Assessment
All assessments were conducted at PIMS Hospital, Islamabad and Civil Hospital, Sukkur. Participants’ knowledge and clinical skills were assessed at the beginning and immediately after training. The level of knowledge was measured by administering a written test comprising 25 MCQs. Each correct answer was given a score of two and incorrect answers were marked zero. The questions tested the providers’ knowledge on seven common childhood ailments: possible bacterial infection (PBI), acute respiratory infection (ARI), diarrhea, malaria, ear infection, malnutrition, and anemia, along with breastfeeding problems and counseling.
The clinical skills were assessed in two ways. First, the providers were directly observed in the hospital outpatient and inpatient departments by the facilitators and evaluated according to the IMNCI standard skills observation checklist. Second, the providers were shown 12 video case studies and asked questions on the clinical scenarios presented in the videos for a maximum score of 33. The scenarios covered the seven clinical conditions mentioned above. Participants were expected to appreciate IMNCI signs (for example, sub-costal recessions, stridor, and nasal flaring in respiratory distress, sunken eyes, lethargy, and a slow return to normal after skin pinch in dehydration, edema in malnutrition, and purulent discharge and mastoid swelling in ear infection), count respiratory rate, classify the level of dehydration, nutritional status, ear problem, and respiratory symptoms, and recognize proper attachment and suckling during breastfeeding.
Six months following the IMNCI training, a re-assessment was carried out to evaluate and compare the retention of knowledge and clinical skills between the two groups. The re-assessment was done with the same MCQs and video-based tools that were used at the beginning and end of the training. The facilitators also directly observed the participants’ case-management abilities and their clinical skills.
Outcome Measures
The primary outcomes were the improvement and retention of knowledge and clinical skills of the two groups. Improvement was defined as the difference between the means of the pre-training and immediate post-training assessment scores. Retention was defined as the difference between the means of the post-training and re-assessment scores. The secondary outcomes were the differences in mean scores for each of the childhood illnesses assessed between the two groups.
Sample Size Calculation
Assuming an α error of 5% and power of 80%, a minimum sample size of 40 participants in each group was required to detect a 10% difference in post-training test scores (Kumar et al., 2009).
Data Analysis
Data were analyzed using SPSS version 15. Only the scores of the participants who were re-assessed at 6 months were used for the analysis. The scores were reported as mean percentages with standard deviations. Unpaired t-tests were used to compare the scores between the two groups. A p < 0.05 was considered statistically significant.
Cost Estimation
The total expenses of the training were calculated by including the travel and accommodation costs of the facilitators and the participants, facilitation fees, cost of refreshments, stationery, and teaching materials. Because all training sessions were conducted in public sector hospitals, there were no additional expenses for logistic arrangements.
Ethical Considerations
The study was approved by the Ethics Review Committee of the Aga Khan University and was performed according to the ethical standards of the 1964 Declaration of Helsinki and its later amendments. Verbal informed consent for partaking in the study was obtained from all participants before including them in the study.
Results
A total of 104 healthcare providers participated in the study. 46 (44.2%) providers received the 11-day and 58 (55.8%) received the 7-day training. Their socio-demographic characteristics are shown in Table 1. Of all the participants, 61 were re-assessed 6 months after the initial training, 32 (52.4%) from the 11-day and 29 (47.5%) from the 7-day training groups. Their characteristics are presented in Table 2. The characteristics of the remaining 43 participants who were not re-assessed at 6 months are given in supplement 2. There were several reasons for not re-assessing these participants that included transfer to another healthcare facility, leave of absence, unavailability on scheduled re-assessment days, and refusal to participate.
The 11-day training group had higher scores for knowledge and clinical skills in the pre-training and post-training assessments. In the re-assessment 6 months after training, the 11-day group performed better in the knowledge domain only (Table 3). However, the two groups had no statistically significant differences in the improvement and retention of knowledge and clinical skills (Table 4).
The 11-day group scored higher in the post-training and re-assessment knowledge tests specifically for diarrhea, malaria, ARI, and meningitis. For sore throat and mastoiditis, the 11-day training group performed better in the post-training and re-assessment tests respectively (Table 5).
In the clinical skills assessment, the groups had similar scores for PBI and ARI in both tests. However, the 11-day group had significantly higher scores for questions on malnutrition in both post-training and re-assessment tests. For malaria, the 11-day group performed better in the immediate post-training assessment, while for diarrhea and otitis media, the 11-day group scored higher in the re-assessment only (Table 5).
The average cost of training was approximately US $75.00 per participant per day. This means that a total of US $825.00 was required for each participant to complete the standard 11-day IMNCI training compared to US $525.00 per participant for the 7-day training.
Discussion
This study aimed to evaluate the effectiveness of an abridged IMNCI case-management training in a resource-limited country and to compare it with the standard 11-day training. The results of the study showed that while the two groups differed at baseline in their level of knowledge and their clinical skills proficiency, there were no statistically significant differences in the improvement and retention of knowledge and skills between the two groups. In contrast, a systematic review concluded that the standard IMCI training was more effective than its shorter versions, though the extent of this difference may be small (Rowe et al., 2012). Additionally, the lack of first-tier study designs directly comparing short and standard courses in literature was found to be a major limitation to definitively declaring the standard training as the superior option. However, since then, other studies have shown shorter courses to be as effective as the standard course. A study from Afghanistan showed that healthcare workers receiving a 7-day training performed equally well as workers that received the 11-day training (Mayhew et al., 2015). Another study demonstrated that nurses trained for 6 days in Rwanda had lower odds of incorrectly classifying fever and treating pneumonia than nurses trained for 11 days (Harerimana et al., 2014). India, from the onset, implemented a revised 8-days version of the WHO recommended 11-day course (Ingle & Malhotra, 2007). In 2012, a cluster-randomized trial demonstrated a decline in the infant mortality rate and the neonatal mortality rate for children born at home after the execution of the country’s 8-day version of the IMCI strategy (Bhandari et al., 2012). Moreover, two studies in India compared the outcomes of a further shortened interrupted 5-day training with the country’s standard 8-day training in primary healthcare workers. They demonstrated that the increase in assessment scores after training and the subsequent decline 3 years later were not statistically different between the two groups (Kumar et al., 2009; Venkatachalam et al., 2011).
We also found that the two groups did not perform consistently when the scores were evaluated for each individual illness. The overall knowledge scores for general health, PBI, eye infection, otitis media, and counseling were similar in both groups. Similarly, the clinical skills scores for PBI and ARI did not differ statistically both in the post-training and re-assessment tests. This indicates that the two training sessions were equally effective. However, the 11-day group scored higher on questions about sore throat, diarrhea, malaria, ARI, and meningitis in the post-training and re-assessment evaluations. We also observed that the 11-day group had higher scores in the clinical skills assessments for malnutrition, diarrhea, and otitis media at re-assessment. This finding may suggest that improving competency in the IMNCI approach for certain diseases may require additional time and attention during the training. Therefore, any measures for shortening the training should take this factor into consideration.
The standard training was considerably more costly, representing a 57% increase in expenses over the abridged training. The surplus funds can be reallocated to train more providers or for supervisory visits for previously trained providers. This reallocation can further improve the quality of care and sustain the quality of skills (Pariyo et al., 2005), as lack of long term supervision has been identified as an important obstacle to the proper implementation of IMCI (Reñosa et al., 2020).
The findings of the current study add to the existing literature where few studies have directly compared two training sessions of different lengths. To our knowledge, this is the first study in Pakistan that has developed, administered, and evaluated the effectiveness of an abridged IMNCI training module. The study also re-assesses the participants at 6 months to provide a more comprehensive picture of the effectiveness of the two training courses.
The study however had some limitations. First, it was carried out in 3 districts of Pakistan, so the findings may not be generalized. Second, the two groups participating in the study were not randomized. Nonetheless, a conscious effort was made to match the participants as much as possible.
Conclusion
The improvement and retention of knowledge and clinical skills of healthcare providers receiving an abridged 7-day training are equivalent to providers receiving the standard 11-day training. However, knowledge and clinical skills for some illness may require increased allocated time. Additionally, the abridged training incurs fewer upfront costs than the standard training. Our study provides information about the effectiveness of scaling up an abridged IMNCI training program across the country to improve child health.
Key Points
-
The 7-day IMCI training is just as effective in improving and retaining clinical knowledge and skills as the 11-day training
-
The 7-day training is more feasible due to lower cost
-
However, proficiency in certain disease management was higher in the 11-day course, so more time may be required for training healthcare providers on management of these illnesses.
References
Ahmed, H. M., Mitchell, M., & Hedt, B. (2010). National implementation of Integrated Management of Childhood Illness (IMCI): Policy constraints and strategies. Health Policy, 96(2), 128–133. https://doi.org/10.1016/j.healthpol.2010.01.013
Amaral, J., Gouws, E., Bryce, J., Leite, A. J., Cunha, A. L., & Victora, C. G. (2004). Effect of Integrated Management of Childhood Illness (IMCI) on health worker performance in Northeast-Brazil. Cadernos De Saúde Pública, 20(Suppl 2), S209-219. https://doi.org/10.1590/s0102-311x2004000800016
Ariff, S., Soofi, S. B., Sadiq, K., Feroze, A. B., Khan, S., Jafarey, S. N., & Bhutta, Z. A. (2010). Evaluation of health workforce competence in maternal and neonatal issues in public health sector of Pakistan: An assessment of their training needs. BMC Health Services Research, 10(1), 1–9.
Bhandari, N., Mazumder, S., Taneja, S., Sommerfelt, H., Strand, T. A., & Group I. E. S. (2012). Effect of implementation of Integrated Management of Neonatal and Childhood Illness (IMNCI) programme on neonatal and infant mortality: Cluster randomised controlled trial. BMJ, 344, e1634. https://doi.org/10.1136/bmj.e1634
Chopra, M., Patel, S., Cloete, K., Sanders, D., & Peterson, S. (2005). Effect of an IMCI intervention on quality of care across four districts in Cape Town, South Africa. Archives of Disease in Childhood, 90(4), 397–401. https://doi.org/10.1136/adc.2004.059147
Gera, T., Shah, D., Garner, P., Richardson, M., & Sachdev, H. S. (2016). Integrated Management of Childhood Illness (IMCI) strategy for children under five. Cochrane Database System Review. https://doi.org/10.1002/14651858.CD010123.pub2
Goga, A. E., & Muhe, L. M. (2011). Global challenges with scale-up of the integrated management of childhood illness strategy: Results of a multi-country survey. BMC Public Health, 11, 503. https://doi.org/10.1186/1471-2458-11-503
Harerimana, J. M., Nyirazinyoye, L., Ahoranayezu, J. B., Bikorimana, F., Hedt-Gauthier, B. L., Muldoon, K. A., & Ntaganira, J. (2014). Effect of shortened Integrated Management of Childhood Illness training on classification and treatment of under-five children seeking care in Rwanda. Risk Management Health Policy, 7, 99–104. https://doi.org/10.2147/RMHP.S56520
Ingle, G., & Malhotra, C. (2007). Integrated management of neonatal and childhood illness: An overview. Indian Journal of Community Medicine, 32(2), 108–110. https://doi.org/10.4103/0970-0218.35646
Jin, Y., Mankadi, P. M., Rigotti, J. I., & Cha, S. (2018). Cause-specific child mortality performance and contributions to all-cause child mortality, and number of child lives saved during the Millennium Development Goals era: A country-level analysis. Global Health Action, 11(1), 1546095.
Kumar, D., Aggarwal, A. K., & Kumar, R. (2009). The effect of interrupted 5-day training on Integrated Management of Neonatal and Childhood Illness on the knowledge and skills of primary health care workers. Health Policy and Planning, 24(2), 94–100. https://doi.org/10.1093/heapol/czn051
Maternal and Child Survival Program. (2019). Review of newborn health content in Integrated Management of Newborn and Childhood Illnesses and integrated community case management training materials and job aids in seven maternal and child survival program countries.
Mayhew, M., Ickx, P., Newbrander, W., Stanekzai, H., & Alawi, S. A. (2015). Long and short Integrated Management of Childhood Illness (IMCI) training courses in Afghanistan: A cross-sectional cohort comparison of post-course knowledge and performance. International Journal of Health Policy and Management, 4(3), 143–152. https://doi.org/10.15171/ijhpm.2015.17
Mushi, H. P., Mullei, K., Macha, J., Wafula, F., Borghi, J., Goodman, C., & Gilson, L. (2011). The challenges of achieving high training coverage for IMCI: Case studies from Kenya and Tanzania. Health Policy and Planning, 26(5), 395–404. https://doi.org/10.1093/heapol/czq068
Pariyo, G., Gouws, E., Bryce, J., & Burnham, G. (2005). Improving facility-based care for sick children in Uganda: Training is not enough. Health Policy and Planning, 20(supplement SI), i58-i68.
Pradhan, N. A., Rizvi, N., Sami, N., & Gul, X. (2013). Insight into implementation of facility-based integrated management of childhood illness strategy in a rural district of Sindh, Pakistan. Global Health Action, 6, 20086. https://doi.org/10.3402/gha.v6i0.20086
Reñosa, M. D., Dalglish, S., Bärnighausen, K., & McMahon, S. (2020). Key challenges of health care workers in implementing the Integrated Management of Childhood Illnesses (IMCI) program: A scoping review. Global Health Action, 13(1), 1732669. https://doi.org/10.1080/16549716.2020.1732669
Rowe, A. K., Rowe, S. Y., Holloway, K. A., Ivanovska, V., Muhe, L., & Lambrechts, T. (2012). Does shortening the training on Integrated Management of Childhood Illness guidelines reduce its effectiveness? A systematic review. Health Policy and Planning, 27(3), 179–193. https://doi.org/10.1093/heapol/czr033
Titaley, C. R., Jusril, H., Ariawan, I., Soeharno, N., Setiawan, T., & Weber, M. W. (2014). Challenges to the implementation of the Integrated Management of Childhood Illness (IMCI) at community health centres in West Java Province, Indonesia. WHO South East Asia Journal of Public Health, 3(2), 161–170. https://doi.org/10.4103/2224-3151.206732
UNICEF. (2019). Levels and trends in child mortality: report 2019. Estimates developed by the UN Interagency Group for Child Mortality Estimation. New York, USA.
Venkatachalam, J., Kumar, D., Gupta, M., & Aggarwal, A. K. (2011). Knowledge and skills of primary health care workers trained on integrated management of neonatal and childhood illness: Follow-up assessment 3 years after the training. Indian Journal of Public Health, 55(4), 298–302. https://doi.org/10.4103/0019-557X.92410
World Health Organization, & UNICEF. (1999). Improving child health. IMCI: The Integrated Approach
World Health Organization Regional Office for the Eastern Mediterranean. (1996). Implementation of IMCI in Pakistan. Retrieved April 13, 2020, from http://www.emro.who.int/child-health/strategy-implementation/implementation-of-imci-in-pakistan.html.
Acknowledgements
We thank all the providers who participated in the training and the facilitators who led the sessions. We also thank the Pakistan Institute of Medical Sciences (PIMS) Hospital and the Civil Hospital, Sukkur for providing logistic arrangements for the training.
Funding
This study was funded by John Snow Inc, via a grant from by the US Agency for International Development (USAID; Award Number: 36098-01, Cooperative agreement number 391-A-00-05-01037-00).
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Ariff, S., Sadiq, K., Jiwani, U. et al. Evaluation the Effectiveness of Abridged IMNCI (7-Day) Course v Standard (11-Day) Course in Pakistan. Matern Child Health J 26, 530–536 (2022). https://doi.org/10.1007/s10995-021-03276-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10995-021-03276-3