Skip to main content
SpringerLink
Log in

Amelioration of multitudinous classifiers performance with hyper-parameters tuning in elephant search optimization for cardiac arrhythmias detection

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Detecting cardiac abnormalities promptly is critical for preventing unexpected and premature fatalities. In this research, four types of cardiac arrhythmias such as Ventricular Tachycardia, Premature Ventricular Contraction, Normal Sinus Rhythm and Supraventricular Tachycardia are detected from the amassed Physiobank MIT-BIH cardiac arrhythmia database. Dimensionality reduction techniques like Stochastic Neighbour Embedding (SNE), Neighbourhood Preserving Embedding, Linear Local Tangent Space Alignment and Gaussian Process Latent Variable Model are used to reduce the dimension of the ECG signals. The appropriate features of dimensionally reduced ECG signals are selected by the Elephant Search Optimization (ESO) technique. Finally, classification is performed using the relevant classifiers, such as Support Vector Machine, Adaboost, Modest Adaboost based on Ridge Regression (Modest Adaboost.RR), Extreme Gradient Boost (XGboost) and Naïve Bayes (NBC) classifiers. Multiple classifiers without and with ESO feature selection for different cardiac cases have an average classification accuracy of 62.23% and 73.61%, respectively. These multiple classifiers are defined by a set of control parameters known as hyper-parameters, which must be tuned in order to achieve optimal results. Experts have developed many approaches for detecting cardiac arrhythmias, but these multiple classifiers do not always perform well when the usual parameters for machine learning classification models are employed. In this paper, various classifiers are used in conjunction with the Stochastic Gradient Descent (SGD), Particle Swarm Optimization (PSO) and Bayesian Tree-structured Parzen Estimator (BTPE) to enhance the cardiac arrhythmia classification accuracy via hyper-parameter tuning. Multiple classifiers with SGD, PSO and BTPE hyper-parameters tuning techniques for various cardiac cases have an average classification accuracy of 80.13%, 90.67% and 94.96%, respectively. The Classifier’s performance is analysed based on metrics like Classification Accuracy, F1 score, Error Rate, Matthew’s correlation coefficient, Jaccard Index and Cohen’s Kappa Coefficient with and without ESO features selection method and hyper-parameters tuning techniques. The analysis utilizes the MATLAB R2014a software for result evaluation. The results show that the SNE-ESO approach, along with the XGboost-BTPE, achieved the highest classification accuracy of 99.89% for detecting {Ventricular Tachycardia}-{Normal Sinus Rhythm} cases. In terms of classification benchmarks, the results exhibit that the BTPE hyper-parameter tuning technique surpasses the SGD and PSO techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Algorithm 1
Algorithm 2
Algorithm 3
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Data availability

Datasets are available at: https://archive.physionet.org/cgi-bin/atm/ATM.

References

  1. Sahoo S, Kanungo B, Behera S, Sabut S (2017) Multiresolution wavelet transform based feature extraction and ECG classification to detect cardiac abnormalities. Measurement 108:55–66

    Article  Google Scholar 

  2. Huffman MD, Prabhakaran D (2010) Heart failure: epidemiology and prevention in India. Natl Med J India 23(5):283–288

    Google Scholar 

  3. Mehra R (2007) Global public health problem of sudden cardiac death. J Electrocardiol 40(6):S118–S122

    Article  Google Scholar 

  4. Goldberger, A. L., Goldberger, Z. D., & Shvilkin, A (2017) Clinical electrocardiography: a simplified approach e-book. Elsevier Health Sciences.

  5. Elhaj FA, Salim N, Harris AR, Swee TT, Ahmed T (2016) Arrhythmia recognition and classification using combined linear and nonlinear features of ECG signals. Comput Methods Programs Biomed 127:52–63

    Article  Google Scholar 

  6. Wang JS, Chiang WC, Hsu YL, Yang YTC (2013) ECG arrhythmia classification using a probabilistic neural network with a feature reduction method. Neurocomputing 116:38–45

    Article  Google Scholar 

  7. Hammad M, Maher A, Wang K, Jiang F, Amrani M (2018) Detection of abnormal heart conditions based on characteristics of ECG signals. Measurement 125:634–644

    Article  Google Scholar 

  8. Silipo R, Marchesi C (1998) Artificial neural networks for automatic ECG analysis. IEEE Trans Signal Process 46(5):1417–1425. https://doi.org/10.1109/78.668803

    Article  Google Scholar 

  9. Papaloukas C, Fotiadis DI, Likas A, Michalis LK (2002) An ischemia detection method based on artificial neural networks. Artif Intell Med 24(2):167–178

    Article  Google Scholar 

  10. Tayel, M. B., & El-Bouridy, M. E (2006) ECG images classification using feature extraction based on wavelet transformation and neural network. In: ICGST, International Conference on AIML.

  11. Gothwal H, Kedawat S, Kumar R (2011) Cardiac arrhythmias detection in an ECG beat signal using fast fourier transform and artificial neural network. J Biomed Sci Eng 4(04):289–296. https://doi.org/10.4236/jbise.2011.44039

    Article  Google Scholar 

  12. Arif, M., Malagore, I. A., & Afsar, F. A (2010) Automatic detection and localization of myocardial infarction using back propagation neural networks. In: 2010 4th International Conference on Bioinformatics and Biomedical Engineering, pp. 1–4, IEEE, doi: https://doi.org/10.1109/ICBBE.2010.5514664.

  13. Afsar, F. A., Akram, M. U., Arif, M., & Khurshid, J (2008) A pruned fuzzy k-nearest neighbor classifier with application to electrocardiogram based cardiac arrhytmia recognition. In: 2008 IEEE International Multitopic Conference, pp. 143–148, IEEE, doi: https://doi.org/10.1109/INMIC.2008.4777725.

  14. Zhao, Q., & Zhang, L (2005) ECG feature extraction and classification using wavelet transform and support vector machines. In: 2005 International Conference on Neural Networks and Brain, vol. 2, pp. 1089–1092, IEEE, doi: https://doi.org/10.1109/ICNNB.2005.1614807.

  15. Song MH, Lee J, Cho SP, Lee KJ, Yoo SK (2005) Support vector machine based arrhythmia classification using reduced features. Int J Control Autom Syst 3(4):571–579

    Google Scholar 

  16. Zhu, Z., Liu, W., Yao, Y., Chen, X., Sun, Y., & Xu, L (2019) AdaBoost based ECG signal quality evaluation. In 2019 Computing in Cardiology (CinC), pp. 1–4, IEEE, doi: https://doi.org/10.23919/CinC49843.2019.9005515.

  17. Xia H, Garcia GA, Bains J, Wortham DC, Zhao X (2012) Matrix of regularity for improving the quality of ECGs. Physiol Meas 33(9):1535–1548

    Article  Google Scholar 

  18. Batra A, Jawa V (1975) Classification of arrhythmia using conjunction of machine learning algorithms and ECG diagnostic criteria. Train J 1:1–7

    Google Scholar 

  19. Verma AR, Gupta B, Bhandari C (2020) A comparative study of ECG beats variability classification based on different machine learning algorithms. Augmented Human Res 5(1):1–8

    Article  Google Scholar 

  20. Zhang, B., Wen, J., & Ren, H (2020) A Classification Method of Arrhythmia Based on Adaboost Algorithm. In: Journal of Physics: Conference Series, vol. 1682, no. 1, pp. 012060, IOP Publishing.

  21. Barstuğan M, Ceylan R (2020) The effect of dictionary learning on weight update of AdaBoost and ECG classification. J King Saud Univ-Comput Inform Sci 32(10):1149–1157

    Google Scholar 

  22. Hannun AY, Rajpurkar P, Haghpanahi M, Tison GH, Bourn C, Turakhia MP, Ng AY (2019) Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network. Nat Med 25(1):65–69

    Article  Google Scholar 

  23. Jangra M, Dhull SK, Singh KK (2020) ECG arrhythmia classification using modified visual geometry group network (mVGGNet). J Intell Fuzzy Syst 38(3):3151–3165

    Article  Google Scholar 

  24. Chen YM, Chen YJ, Tsai YK, Ho WH, Tsai JT (2021) Classification of human electrocardiograms by multi-layer convolutional neural network and hyperparameter optimization. J Intell Fuzzy Syst 40(4):7883–7891

    Article  Google Scholar 

  25. Karpinski, M., Khoma, V., Dudvkevych, V., Khoma, Y., & Sabodashko, D (2018) Autoencoder neural networks for outlier correction in ECG-based biometric identification. In: 2018 IEEE 4th international symposium on wireless systems within the international conferences on intelligent data acquisition and advanced computing systems (IDAACS-SWS), pp. 210–215, IEEE, doi: https://doi.org/10.1109/IDAACS-SWS.2018.8525836.

  26. Elola A, Aramendi E, Irusta U, Picón A, Alonso E, Owens P, Idris A (2019) Deep neural networks for ECG-based pulse detection during out-of-hospital cardiac arrest. Entropy 21(3):305

    Article  MathSciNet  Google Scholar 

  27. Gopika, P., Sowmya, V., Gopalakrishnan, E. A., & Soman, K. P (2020) Transferable approach for cardiac disease classification using deep learning. In Deep learning techniques for biomedical and health informatics, pp. 285–303, Academic Press.

  28. Ahamed, M. A., Hasan, K. A., Monowar, K. F., Mashnoor, N., & Hossain, M. A (2020) ECG heartbeat classification using ensemble of efficient machine learning approaches on imbalanced datasets. In: 2020 2nd International Conference on Advanced Information and Communication Technology (ICAICT), pp. 140–145, IEEE, doi: https://doi.org/10.1109/ICAICT51780.2020.9333534.

  29. Ukil A, Marin L, Mukhopadhyay SC, Jara AJ (2022) AFSense-ECG: atrial fibrillation condition sensing from single lead electrocardiogram (ECG) signals. IEEE Sens J. https://doi.org/10.1109/JSEN.2022.3162691

    Article  Google Scholar 

  30. Fki, Zeineb and Ammar, Boudour & Ayed, Mounir Ben (2021) Towards automated optimisation of residual convolutional neural networks for electrocardiogram classification. arXiv, doi: https://doi.org/10.48550/ARXIV.2112.06024

  31. Li H, Lin Z, An Z, Zuo S, Zhu W, Zhang Z, García JDP (2022) Automatic electrocardiogram detection and classification using bidirectional long short-term memory network improved by Bayesian optimization. Biomed Signal Process Control 73:103424

    Article  Google Scholar 

  32. Yadav SS, Jadhav SM (2021) Detection of common risk factors for diagnosis of cardiac arrhythmia using machine learning algorithm. Expert Syst Appl 163:113807

    Article  Google Scholar 

  33. Wu Q, Sun Y, Yan H, Wu X (2020) Ecg signal classification with binarized convolutional neural network. Comput Biol Med 121:103800

    Article  Google Scholar 

  34. Karoui, H., Hamza, S., Ayed, Y.B. (2023). Detection of Heart Diseases Using CNN-LSTM. In: Abraham, A., Hong, TP., Kotecha, K., Ma, K., Manghirmalani Mishra, P., Gandhi, N. (eds) Hybrid Intelligent Systems. HIS 2022. Lecture Notes in Networks and Systems, vol 647. Springer, Cham. https://doi.org/10.1007/978-3-031-27409-1_45

  35. Rai HM, Trivedi A, Shukla S (2013) ECG signal processing for abnormalities detection using multi-resolution wavelet transform and Artificial Neural Network classifier. Measurement 46(9):3238–3246

    Article  Google Scholar 

  36. Chen S, Hua W, Li Z, Li J, Gao X (2017) Heartbeat classification using projected and dynamic features of ECG signal. Biomed Signal Process Control 31:165–173

    Article  Google Scholar 

  37. Goldberger, A. L., Amaral, L. A., Glass, L., Hausdorff, J. M., Ivanov, P. C., Mark, R. G., & Stanley, H. E. (2000). PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation, vol. 101, no. 23, pp. e215-e220.

  38. Greenwald, S. D. (1986). The development and analysis of a ventricular fibrillation detector. Doctoral dissertation, Massachusetts Institute of Technology.

  39. Greenwald, S. D., Patil, R. S., & Mark, R. G. (1990). Improved detection and classification of arrhythmias in noise-corrupted electrocardiograms using contextual information. Ph.D. thesis, HarvardMIT Division of Health Sciences and Technology.

  40. Hinton GE, Roweis S (2002) Stochastic neighbor embedding. Adv Neural Inf Process Syst 15:833–840

    Google Scholar 

  41. Van der Maaten, L. J. P (2007) An introduction to dimensionality reduction using matlab. Report, 1201. 62.

  42. He, X., Cai, D., Yan, S., & Zhang, H. J (2005) Neighborhood preserving embedding. In: Tenth IEEE International Conference on Computer Vision (ICCV'05), vol. 2, pp. 1208–1213, IEEE, doi: https://doi.org/10.1109/ICCV.2005.167.

  43. Zhang T, Yang J, Zhao D, Ge X (2007) Linear local tangent space alignment and application to face recognition. Neurocomputing 70(7–9):1547–1553

    Article  Google Scholar 

  44. Gunawardena, S. R. A., He, F., Sarrigiannis, P., & Blackburn, D. J (2020) Nonlinear classification of eeg recordings from patients with alzheimer’s disease using gaussian process latent variable model. medRxiv, https://doi.org/10.1101/2020.05.07.20093922;

  45. Gao, X., Wang, X., Tao, D., & Li, X (2010) Supervised Gaussian process latent variable model for dimensionality reduction. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), vol. 41, no. 2, pp. 425–434.

  46. Lawrence N (2003) Gaussian process latent variable models for visualisation of high dimensional data. Adv Neural Inf Process Syst 16:329–336

    Google Scholar 

  47. Deb, S., Fong, S., & Tian, Z (2015) Elephant search algorithm for optimization problems. In: 2015 Tenth International Conference on Digital Information Management (ICDIM), pp. 249–255, IEEE, doi: https://doi.org/10.1109/ICDIM.2015.7381893.

  48. Strumberger, I., Bacanin, N., Tomic, S., Beko, M., & Tuba, M (2017) Static drone placement by elephant herding optimization algorithm. In: 2017 25th Telecommunication Forum (TELFOR), pp. 1–4, IEEE, doi: https://doi.org/10.1109/TELFOR.2017.8249469.

  49. Mirowski, P. W., LeCun, Y., Madhavan, D., & Kuzniecky, R (2008) Comparing SVM and convolutional networks for epileptic seizure prediction from intracranial EEG. In 2008 IEEE workshop on machine learning for signal processing, pp. 244–249, IEEE, doi: https://doi.org/10.1109/MLSP.2008.4685487.

  50. Prabhakar SK, Lee SW (2020) An integrated approach for ovarian cancer classification with the application of stochastic optimization. IEEE access 8:127866–127882. https://doi.org/10.1109/ACCESS.2020.3006154

    Article  Google Scholar 

  51. Harikumar R, Balasubramani M (2011) Fpga synthesis of soft decision tree (sdt) for classification of epilepsy risk levels from fuzzy based classifier using eeg signals. Int J Soft Comput Eng 1(4):206–211

    Google Scholar 

  52. Prabhakar SK, Rajaguru H (2017) Adaboost classifier with dimensionality reduction techniques for epilepsy classification from EEG. International conference on biomedical and health informatics. Springer, Singapore, pp 185–189

    Google Scholar 

  53. Rajaguru, H., & Prabhakar, S. K (2017) Analysis of adaboost classifier from compressed EEG features for epilepsy detection. In: 2017 International Conference on Computing Methodologies and Communication (ICCMC), pp. 981–984, IEEE, doi: https://doi.org/10.1109/ICCMC.2017.8282614.

  54. Piepho HP (2009) Ridge regression and extensions for genomewide selection in maize. Crop Sci 49(4):1165–1176

    Article  Google Scholar 

  55. Vezhnevets A, Vezhnevets V (2005) Modest AdaBoost-teaching AdaBoost to generalize better. In Graphicon 12(5):987–997

    Google Scholar 

  56. Manju, B. R., & Nair, A. R (2019) Classification of cardiac arrhythmia of 12 lead ECG using combination of SMOTEENN, XGBoost and machine learning algorithms. In: 2019 9th International Symposium on Embedded Computing and System Design (ISED), pp. 1–7, IEEE, doi: https://doi.org/10.1109/ISED48680.2019.9096244.

  57. Shi H, Wang H, Huang Y, Zhao L, Qin C, Liu C (2019) A hierarchical method based on weighted extreme gradient boosting in ECG heartbeat classification. Comput Methods Programs Biomed 171:1–10

    Article  Google Scholar 

  58. Karthick, G., & Harikumar, R (2017) Comparative performance analysis of Naive Bayes and SVM classifier for oral X-ray images. In: 2017 4th International Conference on Electronics and Communication Systems (ICECS), pp. 88–92, IEEE, doi: https://doi.org/10.1109/ECS.2017.8067843.

  59. Prabhakar SK, Lee SW (2020) Transformation based tri-level feature selection approach using wavelets and swarm computing for prostate cancer classification. IEEE Access 8:127462–127476. https://doi.org/10.1109/ACCESS.2020.3006197

    Article  Google Scholar 

  60. Prabhakar SK, Rajaguru H, Lee SW (2019) Metaheuristic-based dimensionality reduction and classification analysis of PPG signals for interpreting cardiovascular disease. IEEE Access 7:165181–165206. https://doi.org/10.1109/ACCESS.2019.2950220

    Article  Google Scholar 

  61. Elgeldawi, E., Sayed, A., Galal, A. R., & Zaki, A. M (2021) Hyperparameter Tuning for Machine Learning Algorithms Used for Arabic Sentiment Analysis. In Informatics, vol. 8, no. 4, pp. 79, Multidisciplinary Digital Publishing Institute.

  62. LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324. https://doi.org/10.1109/5.726791

    Article  Google Scholar 

  63. Bengio Y (2000) Gradient-based optimization of hyperparameters. Neural Comput 12(8):1889–1900

    Article  MathSciNet  Google Scholar 

  64. Lancewicki, T., & Kopru, S (2020) Automatic and Simultaneous Adjustment of Learning Rate and Momentum for Stochastic Gradient-based Optimization Methods. In: ICASSP 2020–2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 3127–3131, IEEE, doi: https://doi.org/10.1109/ICASSP40776.2020.9053316.

  65. Li, Y., & Zhang, Y (2020) Hyper-parameter estimation method with particle swarm optimization. arXiv preprint arXiv:2011.11944.

  66. Jain, N. K., Nangia, U., & Jain, J (2018) A review of particle swarm optimization. Journal of The Institution of Engineers (India): Series B, vol. 99, no. 4, pp. 407–411.

  67. Wang, Y., & Ni, X. S (2019) A XGBoost risk model via feature selection and Bayesian hyper-parameter optimization. arXiv preprint arXiv:1901.08433.

  68. Yu, T., & Zhu, H (2020) Hyper-parameter optimization: A review of algorithms and applications. arXiv preprint arXiv:2003.05689.

  69. Sannasi Chakravarthy SR, Rajaguru H (2021) A novel improved crow-search algorithm to classify the severity in digital mammograms. Int J Imaging Syst Technol 31(2):921–954

    Article  Google Scholar 

  70. Sannasi Chakravarthy SR, Rajaguru H (2020) Detection and classification of microcalcification from digital mammograms with firefly algorithm, extreme learning machine and non-linear regression models: A comparison. Int J Imaging Syst Technol 30(1):126–146

    Article  Google Scholar 

  71. Das A, Acharya UR, Panda SS, Sabut S (2019) Deep learning based liver cancer detection using watershed transform and Gaussian mixture model techniques. Cogn Syst Res 54:165–175

    Article  Google Scholar 

  72. Raghu S, Sriraam N, Temel Y, Rao SV, Hegde AS, Kubben PL (2019) Performance evaluation of DWT based sigmoid entropy in time and frequency domains for automated detection of epileptic seizures using SVM classifier. Comput Biol Med 110:127–143

    Article  Google Scholar 

  73. Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Measur 20(1):37–46

    Article  Google Scholar 

  74. Rajesh KN, Dhuli R (2018) Classification of imbalanced ECG beats using re-sampling techniques and AdaBoost ensemble classifier. Biomed Signal Process Control 41:242–254

    Article  Google Scholar 

  75. Karpagachelvi S, Arthanari M, Sivakumar M (2011) Classification of ECG signals using extreme learning machine. Comput Inform Sci 4:42–52

    Article  Google Scholar 

  76. Sadiq AT, Shukr NH (2013) Classification of cardiac arrhythmia using ID3 classifier based on wavelet transform. Iraqi J Sci 54(4):1167–1175

    Google Scholar 

  77. Das MK, Ari S (2014) ECG beats classification using mixture of features. Int Scholarly Res Notices 2014:1–12

    Google Scholar 

  78. Korürek M, Doğan B (2010) ECG beat classification using particle swarm optimization and radial basis function neural network. Expert Syst Appl 37(12):7563–7569

    Article  Google Scholar 

  79. Joshi, N. P., & Topannavar, P. S (2014) Support vector machine based heartbeat classification. In Proc. of 4th IRF Int. Conf, pp. 140–144.

  80. De Chazal P, O’Dwyer M, Reilly RB (2004) Automatic classification of heartbeats using ECG morphology and heartbeat interval features. IEEE Trans Biomed Eng 51(7):1196–1206

    Article  Google Scholar 

  81. Kamath C (2011) ECG beat classification using features extracted from Teager energy functions in time and frequency domains. IET Signal Proc 5(6):575–581

    Article  MathSciNet  Google Scholar 

Download references

Funding

Not applicable.

Author information

Authors and Affiliations

  1. Bannari Amman Institute of Technology, Sathyamangalam, Tamilnadu, 638 401, India

    Gowri Shankar Manivannan, C. Ganesh Babu & Harikumar Rajaguru

Authors
  1. Gowri Shankar Manivannan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. C. Ganesh Babu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Harikumar Rajaguru
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

GSM helped in investigation, methodology, conceptualization, data curation, formal analysis, validation, writing original draft, writing—review & editing. CGB helped in supervision & review. HR was involved in supervision, review & editing.

Corresponding author

Correspondence to Gowri Shankar Manivannan.

Ethics declarations

Conflict of interest

No conflict of interest exists in the submission of this manuscript.

Ethical approval

Not applicable.

Consent to participate

Not applicable.

Consent for publication

All the authors listed have approved the manuscript for the publication.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Manivannan, G.S., Babu, C.G. & Rajaguru, H. Amelioration of multitudinous classifiers performance with hyper-parameters tuning in elephant search optimization for cardiac arrhythmias detection. J Supercomput (2024). https://doi.org/10.1007/s11227-024-06036-6

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11227-024-06036-6

Keywords

Search

Navigation