Background

Despite considerable government efforts in recent years, Nepal continues to have huge social and geographic inequalities in child health. Nepal currently ranks 110th on the United Nations Development Programme’s Gender Inequality Index [1], and caste and ethnicity continue to be major determinants of poverty, education and health outcomes [2,3,4,5]. There are significant inequalities in access to and utilisation of basic health services between urban and rural areas, as well as between lowland, hill and mountain zones [2, 3, 5,6,7]. This presents a significant challenge for Nepal in terms of promoting social and economic development, meeting the Sustainable Development Goals to end preventable deaths of newborns and children under 5 years of age, and achieving universal health coverage.

Although work with the support of the World Health Organisation (WHO) on implementing electronic health management and information system (HMIS) is ongoing, one major shortcoming of current health data in Nepal is that individual patient-level data is not available at the government level: only aggregated data are reported from health facilities to the relevant provincial government. In large part, this is because health facilities, especially those in rural areas where infrastructure and capacity are lacking, continue to rely on paper-based health records which are never digitised. Consequently, individual patient records cannot easily be investigated for health outcome correlations with gender, ethnicity and caste [7]. For the same reason, there is a significant data gap that prevents monitoring and evaluation of the practices of frontline health workers, such as the extent to which they comply with treatment guidelines [7, 8].

Previous research investigating inequalities in health-seeking behaviour, diagnosis and treatment in Nepal has, as a result, been based upon either health-seeking behaviours self-reported via household surveys [9, 10] or data from Nepal’s Demographic Health Survey [11,12,13,14,15,16,17], and has not (to our knowledge) previously taken advantage of facility-level data. It has tended to focus on adult patients, in particular on maternal health services [9, 14, 16, 18] and the management of hypertension [13, 15]. That literature provides ample reason to believe that direct or indirect discrimination based on gender, caste, geography and other factors including level of education and household income have significant impacts on healthcare utilisation, and also on the quality of care received when visiting a health facility [11, 12, 15, 17, 19]. Research has shown, for example, that health services commonly fail to reach low castes, ethnic minorities, people living in remote areas, and other marginalized populations [20].

Health care utilization by under-5s, the focus of this study, depends on the health-seeking behaviors of parents and caregivers. As seen in studies elsewhere in South Asia, parents and caregivers do not always adequately seek health care services for childhood illness for a variety of reasons, including a preference for traditional healers [21, 22], low levels of education[23], and living long distances from a health center [21, 23]. Health-seeking patterns for children have also been found to be highly gendered in developing countries [24, 25]. Resultant delays in care-seeking can make illness more severe, or in some cases mean that the child does not receive treatment at all. Significant disparities have been found according to class, caste, ethnicity, and literacy in an assessment of health utilization and health service provision done by a health improvement program in Nepal [26].

Enhanced evidence on how inequalities affect health status, health service utilisation, and treatment provided, and the extent to which current health worker practices either mitigate or reinforce those inequalities, is highly pertinent for academic, policy and practice audiences. A good understanding of the impacts of inequality on health-seeking behaviours and healthcare will allow for the co-production of better policy and practice recommendations. This study sought to explore how age, sex, ethnicity and caste of young children affect: (1) their health-seeking behaviours and utilisation of health services; and (2) the treatment that they receive at health centres, with a particular focus on diagnosis and prescribing practices. A secondary objective of the study was to examine the utility of health data that is routinely collected by rural health centres.

Methods

The study was carried out by a team of researchers from the University of Sheffield in partnership with a Nepali non-governmental organisation (NGO), PHASE Nepal, which works in remote Himalayan communities to support health, education and livelihoods. We conducted a retrospective analysis of cross-sectional health data that is routinely recorded by rural health centres.

Setting

The data for this project comes from information recorded and stored as paper records at 23 health centres supported (or previously supported) by PHASE Nepal. The funding for the project (from the GCRF NGO Secondary Data Initiative) was specifically intended to support the systematisation and analysis of data held by NGOs that had not previously been available for analysis by researchers. As such, the project’s data sampling included data from the 23 government health posts that were being supported (or had recently been supported) by PHASE Nepal.

PHASE Nepal specialises in working in some of the most remote regions of the country, where government services are weak and other NGO support is limited or entirely absent. The 23 health centres involved in the study are spread across 5 Districts, all of which are in the Hill or Mountain zones of Nepal; Bajura, Humla and Mugu in the Far West of the country; and the central districts of Gorkha and Sindhupalchok. The three districts in the Far West are very remote with limited road access, services, and amenities. Wealth quintiles and literacy rates vary significantly between the two regions. About half of the population in the Far West lives below the poverty line. The Far West region has complex socio-economic structures and there is widespread gender- and caste-based discrimination. The central region is more varied, being home to various ethnic communities including Newar, Tamang, and Brahmins as well as different religions, including Hinduism, Buddhism and Islam. Levels of gender- and caste-based discrimination vary widely between different communities. All district headquarters in the central region have road connectivity, but geographical isolation, vulnerable roads and a lack of bridges across many rivers are nevertheless major challenges in the central region.

Data collection

Research Assistants visited each of these centres to collect the data. The paper records were either digitally photographed and transported on secure electronic media to the PHASE Nepal office in the Kathmandu valley, or the record books themselves were taken to the PHASE Nepal office, photocopied, and returned to the health centres. All records were stored securely at the PHASE Nepal offices, as per the project’s Data Management Plan.

Description of data

The record books utilised in this study record individual patient contacts for children under 5 years of age. The format of the record books follows the WHO (Nepal) guidance on Community-Based Integrated Management of Neonatal and Childhood Illness (IMNCI).

The data captured on the forms include the following information: a unique identifier, date of visit, child’s sex, age, ethnicity/caste, weight, temperature, symptoms of general danger signs (GDS), symptoms of acute respiratory infection (ARI) (including respiratory rate), diarrhoea and dehydration symptoms, symptoms for fever and ear infections, mid upper arm circumference (MUAC) measurement, assessment of nutritional status, classification for one major diagnosis, medicine prescribed (name of medicine), follow up plan, and condition of child on the date of follow up.

There were two main versions of the register books in use across the 23 health centres: Integrated Management of Childhood Illness (IMCI) and IMNCI. The two versions of the register books were broadly similar, although there was some variation in the precise format of the forms (e.g. slight differences in the questions or slight differences in the answer options provided in different registers). There were separate forms for children from age two to 59 months, and children below two months of age. The differences in questions and answer choices in each type of register are displayed in Supplementary Fig. 1. The data digitisation tool was designed to ensure that the data entered from the slightly different books adhered to a common format, with no loss or amendment of data. In addition, detailed guidelines were devised by the research team to guide data input and analysis, to ensure that where the form formats differed, they were consistently and accurately mapped onto the data digitisation tool.

Digitisation of data

A team of 12 trained Data Entry Assistants entered the data from the images of the paper records into a bespoke data digitisation tool (using KoBo Toolbox [27]), which was designed by members of the project team. At this stage, all data were pseudonymised and referred to only by a code number: direct identifiers (such as names and addresses, as well as any other information that could lead to the identification of an individual patient) were not entered into the database.

Data quality checks

A number of measures were taken to ensure a high standard of data quality. Point-of-entry validation was enforced by checks carried out by the digitisation tool during data entry to ensure mandatory fields were completed, and to prevent entry of invalid data. Data entry verification was conducted by reviewing a sample (5%) of entered records against the original digital image and any data entry errors were noted and corrected. If consistent errors were identified, this was investigated and all potentially affected records were checked and, where necessary, corrected. Post-entry validation consisted of checks of the data which had already been entered against a set of pre-defined rules to identify potentially invalid, out-of-range, inconsistent or missing data. Where data was not compliant with the validation rules, the discrepancies were highlighted and subsequently reviewed and resolved.

Participants and excluded data

The IMNCI register books were identified from the sampled health facilities, dated from 2068/05/07 BS (24 August 2011) to 2077/08/12 BS (27 November 2020). Records were collected from 23 rural health posts included in the study. Registers should only be completed for children up to five years of age (< 60 months); in the event a child’s age was declared as equal to or greater than 60 months, or the age value was missing, the record was excluded from the analysis. For the main analysis we also excluded children whose ages were declared as under 2 months, as we wanted to focus the research on those aged 2 to 59 months. Where the child’s sex was not recorded in the register, the sex was inferred based on the child’s first name where possible, otherwise it was left as missing. As a sensitivity analysis, we examined the impact of leaving all the undeclared sexes as missing.

Health seeking behaviour and service utilisation

To assess health seeking behaviour and utilisation of health services, we analysed the number of days the child had symptoms before visiting the health facility for one of the four conditions of interest: acute respiratory infection, diarrhoea, fever, and ear infection. We initially intended to also investigate whether the child attended the health centre for a follow-up; however, as the Master Registration Number field was not used consistently, it became impossible to track follow-up cases with a lack of data linkage for patients between different clinic attendees.

Assessment of diagnostic accuracy and appropriateness of care

We assessed the diagnostic accuracy for pneumonia recorded by health workers by comparing their diagnoses with our retrospective diagnosis using the IMNCI case definition for pneumonia based on the presenting symptoms. We then assessed the appropriateness of treatment for pneumonia by comparing the recorded treatment provided by health workers to children whom they diagnosed as having pneumonia with the IMNCI treatment guidelines.

Statistical methods

Descriptive statistics were summarised using count (percentage) and median with Inter-Quartile Range (IQR). The most appropriate hypothesis test was performed to explore unadjusted associations depending on the variable types and distributions (indicated in the footnote of Table 1). To account for the impact of confounding variables, multivariable linear regression, with robust standard errors to produce more conservative estimates, was used to assess the number of symptom days a child had ARI, diarrhoea or fever before consultation (ear infection was not modelled due to small numbers). The main predictors of age, sex, ethnicity and district were included in the multivariable model regardless of their univariable significance; the remaining predictors (temperature, whether child was referred to clinic, GDS, ARI, diarrhoea, ear infection and fever) were only included in the multivariable model if their univariable significance was p < 0.20. Multivariable logistic regression was used to investigate the relationship between demographics and whether the appropriate pneumonia diagnosis and subsequent antibiotic prescription had been provided or not.

Table 1 Median time from symptom onset to attendance at a health centre for young children (age 2–59 months) with ARI, Diarrhoea, Fever and Ear Infection

All regression models were analysed as random-effects taking account for the potential clustering of the health facility. In addition to this, multiple imputation (MI) using chained equations was used to impute missing values in all the predictors of interest, with blocks of ten imputations in each regression model, as the primary analysis. Multicollinearity was assessed using the variance inflation factor, with scores higher than 10 investigated further. Specific pair-wise interactions with gender and other factors were investigated in the regression models. As a sensitivity analysis, we also repeated all the regression analyses using only complete case analysis; all sensitivity analyses are presented as supplementary tables.

All inferential analysis is presented with two-sided p-values, where p < 0.05 was considered statistically significant, and with 95% confidence intervals. Analyses were performed in Stata version 15.0 [28]. The statistical analysis plan was not pre-registered, therefore all analyses should be considered explanatory.

Results

There were a total of 33,860 child patient records retrieved from a total of 116 IMNCI register books from the 23 rural health posts. Of this total, 643 (1.9%) child patient records from IMNCI forms for children below the age of 2 months were excluded from the analysis. 33,217 records were for children aged 2 to 59 months. 274 (0.8%) records had a recorded age equal to or greater than 60 months, 1,957 (5.9%) records had missing or unclear age recorded and 256 (0.8%) records had patient age stated as below 2 months recorded in the 2 to 59 months register; these were all excluded from the analysis. Therefore, 30,730 records were taken forward for analysis (Fig. 1).

The median age of children was 18 months (IQR = 10, 32 months) (Table 2). There were more attendances recorded for male children than female children (55.7% vs. 44.3%). In terms of ethnic groups, the highest proportion of attendances was for children with Janajati ethnicity (34.9%), followed by Brahmin/Chhetri (32.7%). Madhesi and Muslim children comprised only 0.7% combined, which would be expected given the location of the health centres and the geographical distribution of Madhesi and Muslim population groups, who are mainly concentrated in the Terai (lowland areas) that were not part of this study.

Table 2 Overall demographics for all records collected, all frequency and percentage unless otherwise stated

42% of children were recorded as having fever, 37% with diarrhoea, and 34% with respiratory symptoms. Less than 7% of children were recorded as having an ear infection, while 2.1% had General Danger Signs (GDS).

Fig. 1
figure 1

Flow diagram illustrating the number of records identified, and those carried forward for analysis, with reason for exclusion noted

Days of illness prior to presentation at a health centre

The time interval between onset of symptoms and attendance at a health centre for children with ARI was lowest in Gorkha District with a median of 2 days (IQR = 2, 3) (Table 1). There were significant differences in time to attendance between the five districts for ARI, diarrhoea and fever with longer delays for Bajura, Mugu and Humla (in the Far West) compared to the other central districts. Janajati children were more likely to attend the health post sooner than children from other ethnic groups for all conditions with the exception of ear infections (p < 0.001). There were no significant differences between a child’s sex and duration of symptoms prior to attendance for each condition.

The records from the years 2068 BS (2011/12 AD) (n = 43), 2069 BS (2012/13 AD) (n = 9), and 2077 BS (2020/21 AD) (n = 77) were removed from the regression modelling due to convergence issues. The unadjusted and adjusted regression results for the number of days a child had ARI, diarrhoea or fever before visiting a health post are presented in Tables 3, 4 and 5 respectively. For ARI, only the Janajati ethnic group was significant in the unadjusted model (p < 0.001) compared to Dalit children, while male Janajati and Brahmin/Chherti children with ARI waited on average more than half a day less than females (interaction coef=-0.55, p = 0.025 and coef=-0.73, p = 0.001 respectively) (Table 3). Children with ARI from Humla in the Far West visited the health post on average one day later than those from Gorkha (1.05, 95%CI: 0.44, 1.65).

Table 3 Univariable and multivariable linear regression of number of ARIs day using multiple imputation analysis
Table 4 Univariable and multivariable linear regression of number of diarrhoea days using multiple imputation analysis
Table 5 Univariable and multivariable linear regression of number of fever days using multiple imputation analysis

The difference in time taken to seek help for diarrhoea in those from the Far West (Humla and Mugu) was significant in both the unadjusted and adjusted models (both p < 0.001), and a strong, albeit non-significant, association for Bajura district (also in the Far West) (p = 0.061), Table 4. Children with diarrhoea in Mugu and Humla waited on average 2 days longer to visit the health post (1.86, 95% CI: 1.47, 2.25 and 1.79, 95%CI: 1.12, 2.46 respectively) than those in Gorkha.

District, and ARI were significantly associated with time delay to presentation for fever in the adjusted model (both p ≤ 0.02, Table 5) while there was a non-significant, but associative interaction for male children from Mugu to attend sooner than females (p = 0.08). Children with fever from Humla (1.53, 95% CI: 0.83, 2.24), Mugu (0.88, 95% CI: 0.57, 1.19) and Bajura (0.59, 95% CI: 0.25, 0.93) waited significantly longer than those from Gorkha.

As mentioned previously, due to issues with accuracy of data completion for follow-up, it was not possible to formally analyse this part of the information. The main reasons were that children were infrequently allocated a Master Registration Number (MRN), akin to a unique ID for that child, and even when they were, there were issues of accuracy (sometimes the same number appeared for two different children of different sexes). We have included the information we could from the registers in Supplementary Table 1.

Correct diagnosis and treatment of pneumonia

For the children for whom we were able to retrospectively diagnose pneumonia from their presenting symptoms, 22.0% had no pneumonia; 62.9% had pneumonia and 15.0% had severe pneumonia (based on IMNCI guidelines). However, among all children whose pneumonia was diagnosed by the health worker, 65.3% had no pneumonia, 34.0% had pneumonia and 0.7% had severe pneumonia. The accuracy of pneumonia diagnoses by the health worker could only be analysed for 2,548 children due to missing data in variables necessary to assess the diagnosis of pneumonia retrospectively from the records. Pneumonia was not correctly diagnosed in 30% of children. Children from the Madhesi and Dalit ethnic group were less likely to have a correct diagnosis of pneumonia (36.4% and 66.3% respectively). Male children were significantly more likely to be correctly diagnosed for pneumonia (73.3% vs. 67%).

Of the 2,663 children who were recorded as having severe pneumonia or pneumonia by the health worker, over 60% were not provided correct treatment in line with the IMNCI guidelines (Table 6).

Table 6 Pneumonia correctly diagnosed and correct treatment provided by health worker

Children in the Janajati group had the lowest proportion of correct treatment whereas the highest proportion receiving correct treatment was seen for Dalit children (34.1% vs. 41%). This excludes Madhesi and Muslim children that were not included in the subsequent regression analysis due to the small numbers.

Janajati children had twice the odds of a correct pneumonia diagnosis compared to Dalit children (Odds Ratio (OR) = 2.06, 95%CI: 1.16, 3.67) after adjusting for background factors, while children with higher body temperatures also had 19% higher odds (OR = 1.19, 95%CI: 1.01, 1.41) (Table 7). Males had significantly higher odds of a correct diagnosis than females (OR = 1.59, 95%CI: 1.27, 1.2.01). Males from “other” ethnicities had 49% lower odds of a correct diagnosis compared to females (OR = 0.51, 95%CI: 0.30, 0.85).

Table 7 Unadjusted and adjusted logistic regression results of correct diagnosis of pneumonia vs. not (reference) and correct treatment of pneumonia vs. not (reference) using multiple imputation analysis

Associations with correct treatment of pneumonia (given they had been diagnosed) were not so plentiful, with no significant difference in ethnicity, sex or age (all p > 0.3). The main significant relationship was if the child had been referred, with 4 times the odds (OR = 3.98, 95%CI: 2.23, 7.10) and a tendency for male children in the Mugu district having lower odds of a correct treatment compared to females, although not statistically significant (OR = 0.37, 95%CI: 0.12, 1.09).

Multicollinearity was not evident in any of the regression models, with all VIF < 10.

Sensitivity analyses

The complete case regression models (Supplementary Tables 2–5) produced similar conclusions to the multiple imputation models, although the MI regression models frequently included more variables in the final multivariable model. Excluding all the 828 children who did have a sex declared as missing from the analysis only subtly changed the estimates and did not impact any conclusions.

Discussion

In this large secondary analysis of healthcare records of children under 5 in Nepal, we have highlighted that there are some significant differences between health seeking behaviours and particular demographics such as District, ethnicity, and in some cases age. In addition, there appeared to be some more clear differences in achieving a successful diagnosis of pneumonia based on the child’s ethnicity, sex and District even after accounting for background factors; however, these differences were not as apparent when examining subsequent treatment for pneumonia.

It is not surprising that inequalities in health and healthcare amongst under-5 children exist in remote rural areas of Nepal as this mirrors similar experience from around the world [29]. The determinants are manifold and have been previously described [30], including key factors such as the accessibility [31] and availability of services [32]. One proposed solution has been the provision of care closer to home that may help address the accessibility issue [33]. However, our study highlights that proximity of services is not enough as even with village-level health posts there remain significant differences in patient health seeking behaviour as well as quality of care provision. Alarmingly, there were high percentages of misdiagnosis of pneumonia and suboptimal treatment subsequently. Ethnic differences were observed with children from the Dalit ethnic group having low ratios for correct diagnosis of pneumonia. Paradoxically, they were more likely to receive correct treatment than the other ethnic groups. Reasons for this are not clear from our data and could be the focus of valuable future research. There was some difference observed in accuracy of diagnosis but not treatment for pneumonia by sex, while the child’s age was not associated with the correct diagnosis or treatment of pneumonia.

Comparisons to wider literature

As reported elsewhere [34], we found delays in health seeking were associated with district, with patients in less-developed districts in the Far West presenting later than those in the relatively more developed districts in the central region of the country. Likewise, there were greater delays seen for older children than younger children. There were also greater delays in seeking treatment seen for lower caste ethnic groups, which mirrors previously reported lower service utilisation rates for maternal healthcare in Nepal [35, 36]. Part of the explanation for this may be cultural but socio-economic barriers such as poverty cannot be discounted.

The WHO put forward in 2006 the Treat, Train, Retain strategy to address the skills and health workforce shortages in low-income countries [37]. A central pillar of this strategy is task shifting some of the health work to less specialised community health workers. However, the low accuracy of diagnosis and correct treatment of pneumonia even by trained community-level health workers found in our study puts this approach in doubt. Indeed, the figures were not much better compared to reported rates of disease recognition by caregivers [38]. Suboptimal care is likely to lead to poorer health outcomes and undermine efforts to improve child mortality rates in developing countries such as Nepal. Similar issues have been reported elsewhere [39]. This highlights the need for greater efforts, through training and supportive supervision, to improve the clinical performance of frontline community health workers [40].

The other notable finding was that correct diagnoses for pneumonia tended to be made in the presence of a fever. This could reflect the challenge of diagnosing pneumonia based on subtler and more subjective symptoms than fever. This again highlights a training need for frontline staff to better recognise respiratory infections that may not present with a febrile illness.

We also note that disease recognition by health workers showed a two-fold difference between the lowest caste and higher caste patient groups. This cannot be explained by economic or physical access factors. Similarly, there was a gender disparity with more correct diagnoses of pneumonia in males than females. The reasons for both of these observations are not clear and warrant further study.

What the study adds

Our study demonstrates that there is utility in further and regular analysis of secondary data from primary care settings, including in low- and middle-income countries. The absence of electronic health information systems in rural Nepali health centres inhibits such analysis, with the collection and digitisation of paper-based records being a time-consuming and resource-intensive task. In addition, the analysis of this data is highly dependent on the availability of clinical records that in turn rely on the diligence of health workers recording patient consultations. This data can help inform and guide local service delivery, as well as audit clinical practice as part of service improvement initiatives. However, in keeping with routinely collected clinical data, there will be limitations in terms of accuracy, completeness and timeliness of the data. Some of the limitations are set out below.

Limitations

There was no consistent tracking of individual patients between visits to a health centre (although there is a field on the form for MRN number, this is often not used - or used inaccurately) so the same children could have visited the health post more than once, yet appear in the data as if they are separate patients. This limitation also meant we could not ascertain the outcomes of consultations beyond prescribing/onward referral. There was also no way to ascertain whether what was recorded by staff was accurately recorded and a true reflection of the clinical picture for the patients attending the clinics.

The determinants of health seeking behaviours, as reflected in the existing literature discussed in the Background section, are multifactorial, and are affected by many things on which the dataset provided no insights, including parents’ level of education; household income; class; and cultural/religious beliefs. Age, sex, ethnicity, and caste are not the only factors influencing these outcomes.

There may also be other confounding factors on the ‘supply side’ that we could not control for and/or that we were not aware of such as staff turnover or potential contaminating effects of local training and supervision that may have taken place. In addition, the study only included data from government health posts that are supported by (or have previously been supported by) PHASE Nepal. Findings may differ in the case of health posts that have not received support from PHASE Nepal, or that have received support from other NGOs.

In our assessment of the diagnostic accuracy of acute respiratory infections, we are making a presumption that the syndromic approach espoused in the IMNCI guidelines is accurate. However, it is recognised that not all febrile illnesses will be due to infections and that there are a wide range of diagnostic possibilities in young children with febrile illnesses.

What are the implications?

One key insight emerging from our study is the need for good quality monitoring of healthcare activity as part of quality assurance. This is difficult currently based on existing paper records that are not collated or interrogated, and in which it is not possible to reliably track individual children and study follow-up behaviour or health outcomes. Switching from a paper-based record to digital record system may help address these issues, as well as containing fewer recording errors that can occur compared to handwritten records. We have previously demonstrated that it is possible to introduce basic electronic patient record systems even in low-income country settings like Nepal [41].

Our study confirms that there are geographical and socio-demographic inequalities in health-seeking behaviour as well as care provision in rural areas. We identify an important need to raise awareness amongst parents of danger symptoms and signs, especially in certain districts and ethnic groups where awareness levels may be low, so that ill children attend health facilities sooner. We also observed that health workers seem to respond more to some symptoms such as illnesses where there is fever present. They may consequently not appreciate fully serious illnesses where there is no fever. Further training may be needed focused on non-febrile illnesses that may be life-threatening conditions. We also observed a gender bias to health seeking behaviour, with greater delay seen for female children. Therefore, further public education on gender equality remains important.

Conclusion

The causes of continuing health inequalities in Nepal, and in other low and middle-income countries, are multi-faceted and complex – and relate to a great extent to the social and economic determinants. Nevertheless, demonstrating how differences in geography, sex, ethnicity and caste affect health seeking behaviours and the quality of diagnosis and treatment received following presentation to a health facility is an important step in more fully understanding (and subsequently remedying) inequalities in health service utilisation and quality. The findings of this study identify a range of observed inequalities that can be followed up through detailed qualitative research. The inability to carry out such analysis on an ongoing, routine basis as a result of the absence of electronic record keeping represents an obstacle to identifying and further investigating such inequalities.