Abstract
Background
Infectious diarrhea can lead to a considerable global disease burden. Thus, the accurate prediction of an infectious diarrhea epidemic is crucial for public health authorities. This study was aimed at developing an optimal random forest (RF) model, considering meteorological factors used to predict an incidence of infectious diarrhea in Jiangsu Province, China.
Methods
An RF model was developed and compared with classical autoregressive integrated moving average (ARIMA)/X models. Morbidity and meteorological data from 2012 to 2016 were used to construct the models and the data from 2017 were used for testing.
Results
The RF model considered atmospheric pressure, precipitation, relative humidity, and their lagged terms, as well as 1–4 week lag morbidity and time variable as the predictors. Meanwhile, a univariate model ARIMA (1,0,1)(1,0,0)52 (AIC = − 575.92, BIC = − 558.14) and a multivariable model ARIMAX (1,0,1)(1,0,0)52 with 0–1 week lag precipitation (AIC = − 578.58, BIC = − 578.13) were developed as benchmarks. The RF model outperformed the ARIMA/X models with a mean absolute percentage error (MAPE) of approximately 20%. The performance of the ARIMAX model was comparable to that of the ARIMA model with a MAPE reaching approximately 30%.
Conclusions
The RF model fitted the dynamic nature of an infectious diarrhea epidemic well and delivered an ideal prediction accuracy. It comprehensively combined the synchronous and lagged effects of meteorological factors; it also integrated the autocorrelation and seasonality of the morbidity. The RF model can be used to predict the epidemic level and has a high potential for practical implementation.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Background
Infectious diarrhea is one of the major causes of morbidity and mortality in infants and younger populations. It is a major global public health issue, particularly in developing countries [1]. In 2015, diarrheal diseases led to an estimated 688 million illnesses and 499,000 deaths among children under the age of 5 [2]. Over the past decade, morbidity has also increased in various regions in China [3]. Thus, an accurate forecast of infectious diarrhea based on predictive models is crucial for public health authorities to clearly understand its epidemic characteristics, track seasonal updates in advance, and select the main response actions such as the surveillance of disease and deployment of emergency supplies [4].
The autoregressive integrated moving average (ARIMA) model has been widely used as classical method for diarrhea incidence prediction, however, it has some limitations at the same time [4,5,6,7]. For example, Yang et al. [4] used the ARIMA model without climate terms in an early warning systems for diarrhea but achieved a poor fit. Several studies have reported that meteorological factors are associated with diarrhea and can be used to predict its incidence [8, 9]. Yan et al. [7] developed a multivariable ARIMA (ARIMAX) model considering temperature and rainfall but only achieved high short-term predictive accuracy, possibly because the ARIMAX model assumed linear relationships between the independent and dependent variables. However, meteorological factors have been reported to be non-linearly associated with the infectious diarrhea epidemic [9, 10].
The RF model is a new regression method and can address the limitations of ARIMA/X models in the prediction of diarrhea incidence [11,12,13,14]. It can effectively extract non-linear relationships from data. The RF model uses independent variables to create classification and regression trees (CARTs), wherein each constituent tree is trained on a potentially non-linear regression space. The RF model may achieve predictive stability in terms of the actual instable morbidity. Using the RF model, the training set for each tree is randomly selected from the data, and the final predicted value is the average of all CART outputs. RF model has been widely used for infectious-disease prediction such as West Nile virus infection and Bovine viral diarrhea [12, 13]. Notably, Michael et al. [14] reported that an RF model has advantages over the ARIMA model in predicting avian influenza H5N1 outbreaks. However, no studies have used an RF model to predict the incidence of infectious diarrhea .
This study was aimed at developing an optimal RF model for predicting infectious diarrhea epidemics with meteorological factors in Jiangsu Province, China. Meanwhile, the performance of the RF model was compared with those of the ARIMA/X models. The model can be used to develop an early warning system for infectious diarrhea to facilitate preventive strategies in a more effective manner.
Methods
Study area
Jiangsu Province, located along the eastern-coast of China (latitude 30°45′-35°20′N and longitude 116°18′-121°57′E), has an area of 102,600 km2 and a population of approximately 80 million. It has a typical temperate subtropical monsoon climate with mild temperature, moderate rainfall and a distinct four-season pattern.
Data sources
In China, infectious diarrhea (excluding cholera, dysentery, typhoid and paratyphoid) is an intestinal infectious disease with diarrhea and/or vomiting as the main symptom. It has been listed as a legal Class C infectious disease [3]. An infectious diarrhea case, clinically diagnosed or etiologically confirmed by any hospital or healthcare institution throughout the country, must be reported timely and directly to the National Notifiable Disease Surveillance System (NNDSS) [15] (http://www.cdpc.chinacdc.cn). In this study, the weekly numbers of infectious diarrhea cases in Jiangsu Province during 2012–2017 were downloaded from the NNDSS, including both clinically diagnosed and etiologically confirmed cases.
The demographic data were collected from the Jiangsu provincial statistics department. The weekly meteorological factors were calculated based on the daily data obtained from the Jiangsu Meteorological Service Center. The data included atmospheric pressure, mean temperature, maximum temperature, minimum temperature, precipitation, relative humidity and sunshine duration.
ARIMA/X model
ARIMA model, namely the Box−Jenkins model, has been widely used for time series analysis [16]. The seasonal ARIMA, that incorporates seasonal variation based on ARIMA model, performs better in the presence of clear seasonal patterns [17, 18]. It is denoted as ARIMA(p,d,q)(P,D,Q)s, where p, d and q indicate the orders of general auto-regression (AR), differencing and moving average (MA) terms; P, D and Q are the orders of seasonal AR, differencing and MA terms, respectively; and s is the seasonal periodicity (s = 52 weeks in this study) [18].
The fitting of the ARIMA model involves the following three essential steps:
First, an augmented Dickey−Fuller test is conducted to detect whether the original time series is stationary (statistical properties such as the mean and variance are all constant over time). If not, a logarithmic transformation or difference is adopted to achieve stability.
Second, ARIMA models are established for a stationary time series, and the model with the minimum Akaike information criterion (AIC) and Bayesian information criterion (BIC) values is considered the optimal model. The model parameters are then estimated using the conditional least squares method.
Third, to verify the adequacy of the ARIMA model, a Box−Ljung test is conducted to check whether the residual series is a white noise sequence. A white noise sequence is a purely random time series without an autocorrelation, and useful information cannot be extracted from the sequence for model fitting. If not, the model must be reestablished. Finally, a prospective prediction is conducted using the optimal model.
Based on the optimal ARIMA model, a multivariate ARIMA model including meteorological factors as external regressors [19] is further developed, and is referred to as the ARIMAX model.
In this study, the ARIMA/X models were used as references to evaluate the performance of the RF model. A cross-correlation analysis was used to identify the lagged associations (1–4 week lag [20, 21]) between the meteorological factors and the incidence of infectious diarrhea.
RF model
RF model is an ensemble machine learning method proposed by Breiman [11]. It creates multiple CARTs, wherein each tree is trained on a bootstrap sample of the original training data using a randomly selected subset of input variables, and taking the average outputs of the CARTs as the final prediction. One of its most important features is the calculation of the variable importance, which measures the association between a given variable and the accuracy of the prediction, based on the percentage of increase in the mean square-error (%IncMSE).
The RF model fitting consists of four essential steps [14]:
First, a bootstrap sampling method is used to randomly select sample units from the original training data to create multiple CARTs.
Second, the bootstrap sampling method is used again to select the candidate variables for each CART. In this study, the related meteorological variables were chosen as the predictors. Meanwhile, the 1–4 week lag morbidity and time variable were incorporated into the RF model to consider the effects of autocorrelation and seasonality of the dependent variable, respectively.
Third, the average outputs from all CARTs are calculated as the final predictive value.
Fourth, the importance of each variable is assessed based on the reduction in accuracy.
Model evaluation
Three models were fitted during this study, namely an RF model with meteorological factors, a univariate ARIMA model and a multivariate ARIMAX model. The data subset for the period of 2012–2016 was used as the training set to fit the models, and data from 2017 were used as the test set to evaluate the forecasting accuracy. The root mean square error (RMSE) and mean absolute percentage error (MAPE) were selected to evaluate the performance of each model; they were calculated as follows:
where n is the number of real data or predicted values, yt is the real data, and \( {\hat{y}}_t \) is the predicted value.
Statistics analysis
All analyses were conducted in R (version3.5.1). A seasonal decomposition was conducted to elucidate the temporal pattern of infectious diarrhea. The RF model was fitted using the “randomForest” package, and the ARIMA/X models were fitted using the “Forecast” package.
Results
General description
A total of 102,020 cases were detected during 2012–2017 in Jiangsu Province, China, reaching an annual average incidence of 21.40 per 100,000. As shown in Fig. 1, the incidence exhibited an increasing long-term trend during these 6 years. Moreover, a distinct seasonality was exhibited, i.e., two incidence peaks were observed during each year: namely higher winter peak from December to February and a lower summer peak from July to September. The descriptive statistics for the meteorological factors were summarized in Table 1.
Correlation analysis
As presented in Table 2, the atmospheric pressure and precipitation were significantly associated with 0–2 week and 0–3 week lag morbidity, respectively. Meanwhile, the relative humidity was related to the synchronous morbidity (rs = − 0.13, P = 0.02). The temperature variables and sunshine duration were not correlated with the incidence.
Model fitting
ARIMA/X model
The original time series of the incidence of infectious diarrhea was stationary (Dickey−Fuller = −4.26, P < 0.01). Univariate ARIMA models were developed. The best-fitting ARIMA model was determined to be ARIMA (1,0,1)(1,0,0)52, with a minimum AIC = − 575.92 and a minimum BIC = − 558.14. The Ljung−Box test results suggested that the residual series of the model was a white noise sequence (χ2 = 0.01, P = 0.93).
Next, related meteorological factors were added as covariates into the optimal ARIMA model to establish the multivariate ARIMAX models. Finally, ARIMAX (1,0,1)(1,1,0)52 with 0–1 week lag precipitation was identified as the optimal ARIMAX model, with a minimum AIC of − 578.58 and a minimum BIC of − 578.13 (Ljung−Box test: χ2 = 0.00548, P = 0.10).
RF model.
An RF model was constructed using atmospheric pressure, precipitation and their lagged terms, relative humidity, 1–4 week lag morbidity and time variable as predictors. Figure 2 indicated that the lag dependent terms were the most imperative among all the applied predictors. The atmospheric pressure and its lagged terms were the most vital meteorological factors, followed by a lag in precipitation.
Prediction performance comparison
Table 3 compared the RF and ARIMA/X models, the predictive outputs of which were reported in Fig. 3. The RF model with meteorological factors outperformed the ARIMA/X models in both model fitting and prospective stages in terms of RMSE and MAPE. The values predicted by the RF model matched the actual values very well, with a MAPE of approximately 20%. The performance of the ARIMAX model was comparable to that of the ARIMA model with a high MAPE of approximately 30%.
Discussion
The incidence of infectious diarrhea in Jiangsu Province exhibited a long-term gradual growth trend. Mathematical prediction models are urgently required to reinforce integrated management to monitor, control and prevent infectious diarrhea. We constructed an RF model with meteorological factors, which delivered a good accuracy in predicting the incidence of infectious diarrhea with a MAPE of approximately 20%. It can relatively estimate the seasonal fluctuation of this disease well. The model may be used as an important tool by public health authorities.
The RF model is more suitable than the ARIMA/X method for predicting an infectious diarrhea epidemic within the study region. The performance of the ARIMAX model was comparable to that of the ARIMA model, which suggested that the introduction of meteorological factors did not significantly optimize the prediction accuracy of the ARIMA model. This finding was consistent with the findings of other previous studies [3,4,5]. The RF model provided a meaningfully better fit to the data in terms of RMSE and MAPE. Compared with the ARIMA/X models, the prediction error of the RF model decreased by approximately 50 and 30% in the training and testing sets, respectively. This is because the RF model can better fit non-linear relationships. Moreover, compared with the ARIMAX model, the RF model is not influenced by the multicollinearity, mainly because of the random selection of variables for each tree in the RF [11]. The meteorological factors and their lagged terms were incorporated into the models when they significantly correlated with the morbidity. All of them exhibited a certain degree of importance, which suggested that the RF model comprehensively combined the climatic variables and their lagged effects. In particular, the models partly underestimated the incidence of infectious diarrhea in 2017. This is primarily due to the sharp increase in morbidity in 2017, which indicated that the potential influencing factors might have changed over a 52-week period, such as increase in the number of outbreaks, or changes in the pathogen spectrum [22, 23]. In addition to meteorological factors, some other variables should be considered to better optimize the prediction accuracy of the RF model.
Atmospheric pressure, precipitation, and relative humidity were all correlated with the incidence of infectious diarrhea in Jiangsu Province with 0–2 week, 0 week and 0–3 week lag, respectively. However, Tao et al. [20] reported that the atmospheric pressure and relative humidity were related to the 0–1 week lag diarrhea morbidity in Lanzhou city (northwest China). The relative humidity was related to 4-week lag in the incidence of diarrhea in Beijing city (north China) [21]. This difference may be due to the regional differences in pathogen composition and climatic conditions. Furthermore, the meteorological factors significantly contributed to the forecasting ability of the RF model, with atmospheric pressure as the main contributor. Potential mechanisms can include the influencing pathogen survival and air barrier. A high atmospheric pressure may be conducive to the survival of infectious diarrhea causing microorganisms, such as the rotavirus, in the environment [24]. A high atmospheric pressure can hinder the airflow and serve as a barrier to the spreading of airborne pathogens thereby increasing their concentration at a smaller scale, which may lead to more diarrhea infection [25]. The precipitation had a moderate importance in the RF model, particularly the 3-week lag effect. This implied that the precipitation during the previous 3 weeks may influence the morbidity and can thus be used in its prediction. The relative humidity was identified as the least important factor. The relative humidity in Jiangsu Province exhibited a narrow variation at the weekly level, and did not fit well with the morbidity. These findings may help future studies in analyzing the specific relationship between the climate and infectious diarrhea.
Notably, the prediction performance is likely to vary in different climatic regions. The generalizability of the RF model for the incidence of infectious diarrhea in Jiangsu Province to other regions might not be straightforward. However, the use of the RF model incorporating meteorological factors in the detection and prediction of infectious diarrhea may provide an opportunity for reallocating healthcare resources more efficiently in other regions. In addition, considering the autocorrelation and clear seasonality of infectious diarrhea, the 0–4 week lag morbidity and time variable were incorporated into the RF model and were more important than the meteorological factors in improving the prediction accuracy of the RF model. These strategies should be used as a reference when fitting similar RF models.
This study had a few limitations. First, some mild cases may use home therapies, and cases with atypical symptoms may be misdiagnosed, therefore, the reported data may underestimate the level of morbidity. Second, only meteorological factors were considered to improve the prediction ability. Other factors associated with infectious diarrhea may also be used as good predictors and should be studied further. Third, similar to other machine learning methods such as artificial neural networks, the RF model cannot explain the specific non-linear relationship between meteorological factors and the disease.
Conclusions
The RF model with meteorological factors demonstrated a satisfactory prediction accuracy and can be used to predict the epidemic level, demonstrating its potential and practical applicability. The autocorrelation and seasonal variation of the dependent variables are crucial for the prediction model. In addition, the synchronous effects of meteorological factors and their cumulative effects over a period of time were combined to improve the model. Future studies should be conducted to explore an RF model with meteorological and other variables for the development of a useful tool for predicting other major infectious diseases.
Availability of data and materials
The datasets used in this study are available from the corresponding author on reasonable request.
Abbreviations
- ARIMA:
-
Autoregressive integrated moving average
- RF:
-
Random forest
- MAPE:
-
Mean absolute percentage
- CART:
-
classification and regression tree
- AR:
-
Auto-regression
- MA:
-
Moving average
- AIC:
-
Akaike information criterion
- BIC:
-
Bayesian information criterion
- RMSE:
-
Root mean square error
References
GBD 2015 Disease and Injury Incidence and Prevalence Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990–2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet. 2016;388(10053):1545–602.
GBD 2015 Mortality and Causes of Death Collaborators. Global, regional, and national life expectancy, all-cause mortality, and cause-specific mortality for 249 causes of death, 1980–2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet. 2016;388(10053):1459–544.
Zhang P, Zhang J. Surveillance on other infectious diarrheal diseases in China from 2014 to 2015. Chin J Epidemiol 2017;38(4):424–430.(in Chinese).
Yang E, Park HW, Choi YH, Kim J, Munkhdalai L, Musa I, et al. A simulation-based study on the comparison of statistical and time series forecasting methods for early detection of infectious disease outbreaks. Int J Environ Res Public Health. 2018;15(5):966.
Zhang Y, Bi P, Hiller JE, Sun Y, Ryan P. Climate variations and bacillary dysentery in northern and southern cities of China. J Inf Secur. 2007;55(2):194–200.
Gao L, Zhang Y, Ding G, Liu Q, Zhou M, Li X, et al. Meteorological variables and bacillary dysentery cases in Changsha City. China Am J Trop Med Hyg. 2014;90(4):697–704.
Yan L, Wang H, Zhang X, Li MY, He J. Impact of meteorological factors on the incidence of bacillary dysentery in Beijing, China: a time series analysis (1970-2012). PLoS One. 2017;12(8):e0182937.
Chou WC, Wu JL, Wang YC, Huang H, Sung FC, Chuang CY. Modeling the impact of climate variability on diarrhea-associated diseases in Taiwan (1996-2007). Sci Total Environ. 2010;409(1):43–51.
Phung D, Huang C, Rutherford S, Chu C, Wang X, Nguyen M, et al. Association between climate factors and diarrhea in a Mekong Delta area. Int J Biometeorol. 2015;59(9):1321–31.
Li Z, Wang L, Sun W, Hou X, Yang H, Sun L, et al. Identifying high-risk areas of bacillary dysentery and associated meteorological factors in Wuhan. China Sci Rep. 2013;3(1):3239.
Breiman L. Random Forest. Berkeley: University of California; 2001.
Keyel AC, Elison Timm O, Backenson PB, Prussing C, Quinones S, McDonough KA, et al. Seasonal temperatures and hydrological conditions improve the prediction of West Nile virus infection rates in Culex mosquitoes and human case counts in New York and Connecticut. PLoS One. 2019;14(6):e0217854.
Machado G, Mendoza MR, Corbellini LG. What variables are important in predicting bovine viral diarrhea virus? A random forest approach. Vet Res. 2015;24(1):46–85.
Kane MJ, Price N, Scotch M, Rabinowitz P. Comparison of ARIMA and random Forest time series models for prediction of avian influenza H5N1 outbreaks. BMC Bioinformatics. 2014;15(1):276.
Wang L, Wang Y, Jin S, Wu Z, Chin DP, Koplan JP, et al. Emergence and control of infectious diseases in China. Lancet. 2008;372(9649):1598–605.
Box G, Jenkins G, Reinsel G. Time series analysis: forecasting and control. Hoboken. New Jersey: John Wiley & Sons; 2008.
Xu Q, Li R, Liu Y, Luo C, Xu A, Xue F, et al. Forecasting the incidence of mumps in Zibo City based on a SARIMA model. Int J Environ Res Public Health. 2017;14(18):925.
Tian CW, Wang H, Luo XM. Time-series modelling and forecasting of hand, foot and mouth disease cases in China from 2008 to 2018. Epidemiol Infect. 2019;147(1):28.
Zhang Y, Bi P, Hiller JE. Meteorological variables and malaria in a Chinese temperate city: a twenty-year time-series data analysis. Environ Int. 2010;36(5):439–45.
Tao Y, Liu ZM, Mi SQ, Song J, Qiang L. Effects of meteorological factors on other types of infectious diarrhea. J Lanzhou Univ: Nat Sci. 2015;51(5):646–51 (in Chinese).
Wang J, Xu MM, Mo YZ, Pan XC. Correlation between meteorological factors and infectious diarrhea in a district of Beijing. J Environ Health. 2013;30(11):991–5 (in Chinese).
Fu JG, Shi C, Xu C, Lin Q, Zhang J, Yi QH, et al. Outbreaks of acute gastroenteritis associated with a re-emerging GII.P16-GII.2 norovirus in the spring of 2017 in Jiangsu, China. PLoS One. 2017;12(12):e0186090.
Ma T, Zhang M, Hong L, Wang X, Dai WJ, Wu ZW, et al. Outbreak investigation of acute gastroenteritis associated with GII.P7-GII.6 norovirus in a primary school of Nanjing in 2017. Mod Pre Med. 2018;45(22):4188–91 (in Chinese).
Chan MC, Mok HY, Lee TC, Nelson EA, Leung TF, Tam WW, et al. Rotavirus activity and meteorological variations in an Asian subtropical city, Hong Kong, 1995-2009. J Med Virol. 2013;85(11):2026–33.
Wang H, Di B, Zhang T, Lu Y, Chen C, Wang D, et al. Association of meteorological factors with infectious diarrhea incidence in Guangzhou, southern China: a time-series study (2006-2017). Sci Total Environ. 2019;672(2019):7–15.
Acknowledgements
We gratefully acknowledge Jiangsu Meteorological Service Center for supplying the daily meteorological data.
Funding
This work was supported by Jiangsu Provincial Major Science & Technology Demonstration Project (No. BE2017749); Jiangsu Provincial natural science foundation (No. BK20151595); Jiangsu Provincial Medical Youth Talent (No. QNRC2016542); Key Medical Discipline of Epidemiology (No. ZDXK A2016008) and National Major S&T Projects (No.2018ZX10714–002). The funders had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Author information
Authors and Affiliations
Contributions
XYF, WDL,JA and CJB designed the study. MH, YW, YYS, WQS prepared and processed the initial data, XYF, WDL and CJB analyzed the data and drafted the manuscript. CJB revised the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study was approved by the Ethics Committee at Jiangsu Provincial Center for Disease Control and Prevention, China. As the incidence was statistical summary data, it was not necessary to obtain informed consent.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Fang, X., Liu, W., Ai, J. et al. Forecasting incidence of infectious diarrhea using random forest in Jiangsu Province, China. BMC Infect Dis 20, 222 (2020). https://doi.org/10.1186/s12879-020-4930-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12879-020-4930-2