Abstract
Accurate prediction of adverse cardiac events for the emergency department (ED) chest pain patients is essential in risk stratification due to the current ambiguity in diagnosing acute coronary syndrome. While most current practices rely on human decision by measuring clinical vital signs, computerized solutions are gaining popularity. We have previously proposed an ensemble-based scoring system (ESS). In this paper, we aim to extend the ESS system using extreme learning machine (ELM), a fast learning algorithm for neural networks. We recruited patients from the ED of Singapore General Hospital, and extracted features such as heart rate variability, 12-lead ECG parameters, and vital signs. We also proposed a novel algorithm called ESS-ELM to predict adverse cardiac events. Different from the original ESS algorithm, ESS-ELM uses the under-sampling technique only in model training. Our proposed method was compared to the original ESS algorithm and several clinical scores in predicting patient outcome. With a cohort of 797 recruited patients, we demonstrated that ESS-ELM outperformed the original ESS algorithm and three established clinical scores, namely HEART, TIMI, and GRACE, in terms of receiver operating characteristic analysis. Furthermore, we have investigated the impact of hidden node number and ensemble size on the predictive performance. ELM has demonstrated the flexibility in its integration with the ESS algorithm. Experiments showed the value of ESS-ELM in prediction of adverse cardiac events. Future works may include the use of new ELM-based learning methods and further validation with a new cohort of patients.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Bhuiya FA, Pitts SR, McCaig LF. 2010. Emergency department visits for chest pain and abdominal pain: United States, 1999-2008, NCHS Data Brief.
Lindsell CJ, Anantharaman V, Diercks D, Han J, Hoekstra JW, Hollander JE, Kirk JD, Lim SH, Peacock WF, Tiffany B, Wilke EK, Gibler WB, Jr, CVP. The internet tracking registry of acute coronary syndromes (i*trACS): a multicenter registry of patients with suspicion of acute coronary syndromes reported using the standardized reporting guidelines for emergency department chest pain studies. Ann. Emerg. Med. 2006;48:666–677.
Ong MEH, Goh K, Fook-Chong S, Haaland B, Wai KL, Koh ZX, Shahidah N, Lin Z. Heart rate variability risk score for prediction of acute cardiac complications in ED patients with chest pain. Am. J. Emerg. Med. 2013;31:1201–1207.
Heldeweg MLA, Liu N, Koh ZX, Fook-Chong S, Lye WK, Harms M, Ong MEH. A novel cardiovascular risk stratification model incorporating ECG and heart rate variability for patients presenting to the emergency department with chest pain. Crit Care 2016;20(1):179.
Six A, Backus B, Kelder J. Chest pain in the emergency room: value of the HEART score. Neth Heart J 2008;16(6):191–196.
Backus B, Six A, Kelder J, Bosschaert MAR, Mast E, Mosterd A, Veldkamp R, Wardeh A, Tio R, Braam R, Monnink SHJ, Van Tooren R, Mast T, Van den Akker F, Cramer MJM, Poldervaart J, Hoes A, Doevendans P. A prospective validation of the HEART score for chest pain patients at the emergency department. Int J Cardiol 2013;168(3):2153–2158.
Six A, Cullen L, Backus B, Greenslade J, Parsonage W, Aldous S, Doevendans PA, Than M. The HEART score for the assessment of patients with chest pain in the emergency department: a multinational validation study. Crit Pathw Cardiol 2013;12(3):121–126.
Antman E, Cohen M, Bernink P, McCabe C, Horacek T, Papuchis G, Mautner B, Corbalan R, Radley D, Braunwald E. The TIMI risk score for unstable angina/non-ST elevation MI - a method for prognostication and therapeutic decision making. JAMA 2000;284(7):835–842.
Granger CB, Goldberg RJ, Dabbous O, Pieper KS, Eagle KA, Cannon CP, Van De Werf F, Avezum A, Goodman SG, Flather MD, Fox KA. Predictors of hospital mortality in the global registry of acute coronary events. Arch Intern Med 2003;163(19):2345–2353.
Liu N, Koh ZX, Chua EC, Tan LM, Lin Z, Mirza B, Ong MEH. Risk scoring for prediction of acute cardiac complications from imbalanced clinical data. IEEE J Biomed Health Inform 2014;18(6):1894–1902.
Liu N, Koh ZX, Goh J, Lin Z, Haaland B, Ting BP, Ong MEH. Prediction of adverse cardiac events in emergency department patients with chest pain using machine learning for variable selection. BMC Med Inform Decis Mak 2014;14:75.
Liu N, Lee MAB, Ho AFW, Haaland B, Fook-Chong S, Koh ZX, Pek PP, Chua EC-P, Ting BP, Lin Z, Ong MEH. Risk stratification for prediction of adverse coronary events in emergency department chest pain patients with a machine learning score compared with the timi score. Int J Cardiol 2014;177(3):1095–1097.
Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. SMOTE: synthetic minority over-sampling technique. J Artif Intell Res 2002;16(1):321–357.
Huang G-B, Wang D, Lan Y. Extreme learning machines: a survey. Int J Mach Learn Cybern 2011;2:107–122.
Rong H-J, Ong YS, Tan AH, Zhu Z. A fast pruned-extreme learning machine for classification problem. Neurocomputing 2008;72:359–366.
Miche Y, Sorjamaa A, Bas P, Simula O, Jutten C, Lendasse A. OP-ELM: optimally pruned extreme learning machine. IEEE Trans Neural Netw 2010;21:158–162.
Liu N, Wang H. Evolutionary extreme learning machine and its application to image analysis. J Signal Process Syst 2013;73:1–9.
Luo J, Vong C-M, Wong P-K. Sparse bayesian extreme learning machine for multi-classification. IEEE Trans Neural Netw Learn Syst 2014;25(4):836–843.
Liu N, Wang H. Ensemble based extreme learning machine. IEEE Signal Process Lett 2010;17:754–757.
Cao J, Chen T, Fan J. Landmark recognition with compact BoW histogram and ensemble ELM. Multimed Tools Appl 2016;75(5):2839–2857.
Wong PK, Gao XH, Wong KI, Vong CM. An analytical study on reasoning of extreme learning machine for classification from its inductive bias. Cogn Comput 2016;8(4):746–756.
Vong C-M, Ip W-F, Chiu C-C, Wong P-K. Imbalanced learning for air pollution by meta-cognitive online sequential extreme learning machine. Cogn Comput 2015;7(3):381–391.
Vong C-M, Ip W-F, Wong P-K, Chiu C-C. Predicting minority class for suspended particulate matters level by extreme learning machine. Neurocomputing 2014;128:136–144.
Rong H-J, bin Huang G, Liang Y-Q. Fuzzy extreme learning machine for a class of fuzzy inference systems. Int J Uncertain Fuzz 2013;21:51–61.
Rong H-J, Huang G-B, Sundararajan N, Saratchandran P. Online sequential fuzzy extreme learning machine for function approximation and classification problems. IEEE Trans Syst Man, Cybern B, Cybern 2009;39(4):1067–1072.
Peng X, Lin P, Zhang T, Wang J. Extreme learning machine-based classification of ADHD using brain structural MRI data. PLOS ONE 2013;8:e79476.
Liu N, Cao J, Koh ZX, Pek PP, Ong MEH. 2014. Risk stratification with extreme learning machine: A retrospective study on emergency department patients, Mathematical Problems in Engineering, vol. 2014, pp. Article ID 248 938, 6 pages.
Kim J, Shin HS, Shin K, Lee M. Robust algorithm for arrhythmia classification in ECG using extreme learning machine. Biomed Eng Online 2009;8:31:1–12.
Cao J, Zhang K, Luo M, Yin C, Lai X. Extreme learning machine and adaptive sparse representation for image classification. Neural Netw 2016;81:91–102.
Cao J, Hao J, Lai X, Vong C-M, Luo M. Ensemble extreme learning machine and sparse representation classification algorithm. J Franklin Inst 2016;353:4526–4541.
Zhang R, Huang G-B, Sundararajan N, Saratchandran P. Multicategory classification using extreme learning machine for microarray gene expression cancer diagnosis. IEEE/ACM Trans Comput Biol Bioinform 2007;4:485–495.
Lu H-J, An C-L, Zheng E-H, Lu Y. Dissimilarity based ensemble of extreme learning machine for gene expression data classification. Neurocomputing 2014;128:22–30.
Cao J, Wang W, Wang J, Wang R. Excavation equipment recognition based on novel acoustic statistical features. IEEE Trans Cybern 2016;(99):1–13.
Wong PK, Zhong J, Yang Z, Vong CM. Sparse bayesian extreme learning committee machine for engine simultaneous fault diagnosis. Neurocomputing 2016;174:331–343.
Niskanen J-P, Tarvainen MP, Ranta-Aho PO, Karjalainen PA. Software for advanced HRV analysis. Comput Methods Programs Biomed 2004;76(1):73–81.
Levick JR. An introduction to cardiovascular physiology: Butterworth-Heinemann; 2013.
Task Force of the European Society of Cardiology the North American Society of Pacing Electrophysiology, Heart rate variability: Standards of measurement, physiological interpretation, and clinical use. Circulation 1996;93:1043–1065.
Brennan M, Palaniswami M, Kamen P. Do existing measures of poincare plot geometry reflect nonlinear features of heart rate variability? IEEE Trans Biomed Eng 2001;48(11):1342–1347.
Pincus S. Approximate entropy (ApEn) as a complexity measure. Chaos 1995;5(1):110–117.
Richman JS, Moorman JR. Physiological time-series analysis using approximate entropy and sample entropy. Am J Physiol Heart Circ Physiol 2000;278(6):H2039–H2049.
Hsin H-T, Yang C-Y, Yeih D-F, Shieh J-S, Li, A-H. The detrended fluctuation analysis of acute-phase heart-rate variability in acute coronary syndromes - a pilot study. Int J Cardiol 2010;140(2):252–255.
Tulppo MP, Kiviniemi AM, Hautala AJ, Kallio M, Seppänen T, Mäkikallio TH, Huikuri HV. Physiological background of the loss of fractal heart rate dynamics. Circulation 2005;112(3):314–319.
Tapanainen JM, Thomsen PE, Køber, L, Torp-Pedersen C, Mäkikallio, TH, Still AM, Lindgren KS, Huikuri HV. Fractal analysis of heart rate variability and mortality after an acute myocardial infarction. Am J Cardiol 2002;90(4):347–352.
Penzel T, Kantelhardt JW, Grote L, Peter JH, Bunde, A. Comparison of detrended fluctuation analysis and spectral analysis for heart rate variability in sleep and sleep apnea. IEEE Trans Biomed Eng 2003;50(10):1143–1151.
Huang G-B, Zhou H, Ding X, Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern B Cybern 2012;42:513–529.
Huang G-B, Zhu Q-Y, Siew CK. Extreme learning machine: theory and applications. Neurocomputing 2006;70:489–501.
Serre D. Matrices: Theory and applications. New York: Springer; 2002.
He H, Garcia EA. Learning from imbalanced data. IEEE Trans Knowl Data Eng 2009;21:1263–1284.
Han J, Kamber M. Data Mining: Concepts and Techniques: Morgan Kaufmann; 2006.
Polikar R. Ensemble based systems in decision making. IEEE Circ Syst Mag 2006;6:21–45.
Acknowledgments
We would like to thank all contributions made from doctors, nurses, and researchers from the Department of Emergency Medicine, Singapore General Hospital.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Funding
This study was supported by Singapore National Health Innovation Centre (NHIC) Innovation to Develop Grant (NHIC-I2D-1409014) and SingHealth Foundation Grant (SHF/FG543P/2013).
Conflict of Interests
Nan Liu and Marcus Eng Hock Ong have a patent filing that is related to this study (System and method of determining a risk score for triage, Application Number: US 13/791,764). Zhiping Lin and Marcus Eng Hock Ong have a similar patent filing related to this study (Method of predicting acute cardiopulmonary events and survivability of a patient, Application Number: US 13/047,348). Zhiping Lin and Marcus Eng Hock Ong also have a licensing agreement with ZOLL Medical Corporation for the above patented technology. There are no further patents, products in development or marketed products to declare. All the other authors do not have either commercial or personal associations or any sources of support that might pose a conflict of interest in the subject matter or materials discussed in this manuscript.
Ethical approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. The study was approved by SingHealth’s Centralized Institutional Review Board (CIRB, Ref: 2014/584/C) with waiver of patient consent.
Informed consent
Informed consent was waived in the ethical approval.
Rights and permissions
About this article
Cite this article
Liu, N., Sakamoto, J.T., Cao, J. et al. Ensemble-Based Risk Scoring with Extreme Learning Machine for Prediction of Adverse Cardiac Events. Cogn Comput 9, 545–554 (2017). https://doi.org/10.1007/s12559-017-9455-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12559-017-9455-7