Skip to main content
SpringerLink
Log in

Strength of ensemble learning in automatic sleep stages classification using single-channel EEG and ECG signals

  • Original Article
  • Published:
Medical & Biological Engineering & Computing Aims and scope Submit manuscript

Abstract

Healthy sleep plays an essential role in human daily life. Classification of sleep stages is a crucial tool for assisting physicians in diagnosing and treating sleep disorders. In this study, a strong ensemble learning model is proposed to enhance the ability of classification models in accurate sleep staging, particularly in multi-class classification. We asserted that high-accuracy sleep classification is achievable using only single-channel electroencephalogram (EEG) and electrocardiogram (ECG) by combining their best-extractable features in the time and frequency domains we recommended. More importantly, the superiority of the recommended method, which is the simultaneous use of stacking and bagging, over conventional machine learning classifiers in sleep staging was demonstrated, using the MIT-BIH Polysomnographic and Sleep-EDF expanded databases. Finally, K-fold cross-validation was used to fairly estimate these models. The best mean test accuracy rates for distinguishing between two classes of “sleep vs. wake,” “rapid vs. non-rapid eye movement,” and “deep vs. light sleep,” were obtained 99.93%, 99.64%, and 99.69%, respectively. Furthermore, our proposed method achieved accuracies of 97.14%, 95.18%, 92.7%, and 85.64% for separating three, four, five, and six sleep classes, respectively. Compared to recent studies, our method outperforms other sleep stage classification schemes, especially in multi-class staging.

Graphical abstract

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Prucnal M, Polak AG (2017) Effect of feature extraction on automatic sleep stage classification by artificial neural network. Metrol Meas Syst 24(2)

  2. Léger D, Poursain B, Neubauer D, Uchiyama M (2008) An international survey of sleeping problems in the general population. Curr Med Res Opin 24(1):307–317

    Article  PubMed  Google Scholar 

  3. Rechtschaffen A (1968) A manual for standardized terminology, techniques and scoring system for sleep stages in human subjects. Brain Inform Service

  4. Faust O, Razaghi H, Barika R, Ciaccio EJ, Acharya UR (2019) A review of automated sleep stage scoring based on physiological signals for the new millennia. Comput Methods Programs Biomed 176:81–91

    Article  PubMed  Google Scholar 

  5. Collop NA (2002) Scoring variability between polysomnography technologists in different sleep laboratories. Sleep Med 3(1):43–47

    Article  PubMed  Google Scholar 

  6. Zhu G, Li Y, Wen P (2014) Analysis and classification of sleep stages based on difference visibility graphs from a single-channel EEG signal. IEEE J Biomed Health Inform 18(6):1813–1821

    Article  PubMed  Google Scholar 

  7. Loomis AL, Harvey EN, Hobart GA (1937) Cerebral states during sleep, as studied by human brain potentials. J Exp Psychol 21(2):127

    Article  Google Scholar 

  8. Koley B, Dey D (2012) An ensemble system for automatic sleep stage classification using single channel EEG signal. Comput Biol Med 42(12):1186–1195

    Article  CAS  PubMed  Google Scholar 

  9. Supriya S, Siuly S, Wang H, Zhang Y (2018) EEG sleep stages analysis and classification based on weighed complex network features. IEEE Trans Emerg Topics Comput Intell 5(2):236–246

    Article  Google Scholar 

  10. Ichimaru Y, Moody G (1999) Development of the polysomnographic database on CD-ROM. Psychiatry Clin Neurosci 53(2):175–177

    Article  CAS  PubMed  Google Scholar 

  11. Jiang D, Lu Y-N, Yu M, Yuanyuan W (2019) Robust sleep stage classification with single-channel EEG signals using multimodal decomposition and HMM-based refinement. Expert Syst Appl 121:188–203

    Article  Google Scholar 

  12. Zhang J, Yao R, Ge W, Gao J (2020) Orthogonal convolutional neural networks for automatic sleep stage classification based on single-channel EEG. Comput Methods Programs Biomed 183:105089

    Article  PubMed  Google Scholar 

  13. Bhusal A, Alsadoon A, Prasad P, Alsalami N, Rashid TA (2022) Deep learning for sleep stages classification: modified rectified linear unit activation function and modified orthogonal weight initialisation. Multimed Tools Appl 81(7):9855–9874

    Article  Google Scholar 

  14. Yu S, Chen X, Wang B, Wang X (2012) Automatic sleep stage classification based on ECG and EEG features for day time short nap evaluation. In: Proceedings of the 10th world congress on intelligent control and automation, IEEE, pp. 4974–4977

  15. Shaffer F, J. P, (2017) Ginsberg, an overview of heart rate variability metrics and norms. Front Public Health 258

  16. Zhao R, Xia Y, Wang Q (2021) Dual-modal and multi-scale deep neural networks for sleep staging using EEG and ECG signals. Biomed Signal Process Control 66:102455

    Article  Google Scholar 

  17. Bakshi UA, Bakshi MV (2020) Electrical technology. Technical Publications

  18. Utomo OK, Surantha N, Isa SM, Soewito B (2019) Automatic sleep stage classification using weighted ELM and PSO on imbalanced data from single lead ECG. Procedia Comput Sci 157:321–328

    Article  Google Scholar 

  19. Werth J, Radha M, Andriessen P, Aarts RM, Long X (2020) Deep learning approach for ECG-based automatic sleep state classification in preterm infants. Biomed Signal Process Control 56:101663

    Article  Google Scholar 

  20. Wang W, Qin D, Fang Y, Zhou C, Zheng Y (2023) Automatic multi-class sleep staging method based on novel hybrid features. J Electr Eng Technol 1–14

  21. Mathunjwa BM, Lin Y-T, Lin C-H, Abbod MF, Sadrawi M, Shieh J-S (2023) Automatic IHR-based sleep stage detection using features of residual neural network. Biomed Signal Process Control 85:105070

    Article  Google Scholar 

  22. Moeynoi P, Kitjaidure Y (2017) Dimension reduction based on canonical correlation analysis technique to classify sleep stages of sleep apnea disorder using EEG and ECG signals. In: 2017 14th International conference on electrical engineering/electronics, computer, telecommunications and information technology (ECTI-CON), IEEE, pp. 455–458

  23. Tripathy R, Acharya UR (2018) Use of features from RR-time series and EEG signals for automated classification of sleep stages in deep neural network framework. Biocybern Biomed Eng 38(4):890–902

    Article  Google Scholar 

  24. Tăutan A-M, Rossi AC, de Francisco R, Ionescu B (2020) Automatic sleep stage detection: a study on the influence of various PSG input signals. In: 2020 42nd annual international conference of the IEEE engineering in medicine & biology society (EMBC). IEEE, 5330–5334

  25. Association AP et al (1995) Association, ap diagnostic and statistical manual of mental disorders. Arlington, VA, US

  26. Kemp B, Zwinderman AH, Tuk B, Kamphuisen HA, Oberye JJ (2000) Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG. IEEE Trans Biomed Eng 47(9):1185–1194

    Article  CAS  PubMed  Google Scholar 

  27. Wei R, Zhang X, Wang J, Dang X (2018) The research of sleep staging based on single-lead electrocardiogram and deep neural network. Biomed Eng Lett 8(1):87–93

    Article  PubMed  Google Scholar 

  28. Seiffert C, Khoshgoftaar TM, Van Hulse J, Napolitano A (2009) RUSBoost: a hybrid approach to alleviating class imbalance. IEEE Trans Syst Man Cybern-Part A: Syst Hum 40(1):185–197

    Article  Google Scholar 

  29. Hsu Y-L, Yang Y-T, Wang J-S, Hsu C-Y (2013) Automatic sleep stage recurrent neural classifier using energy features of EEG signals. Neurocomputing 104:105–114

    Article  Google Scholar 

  30. Electrophysiology TF (1996) Heart rate variability: standards of measurement, physiological interpretation, and clinical use. Circulation 93(5):1043–1065

    Article  Google Scholar 

  31. Pan J, Tompkins WJ (1985) A real-time QRS detection algorithm. IEEE Trans Biomed Eng 3:230–236

    Article  Google Scholar 

  32. Varon C, Caicedo A, Testelmans D, Buyse B, Van Huffel S (2015) A novel algorithm for the automatic detection of sleep apnea from single-lead ECG. IEEE Trans Biomed Eng 62(9):2269–2278

    Article  PubMed  Google Scholar 

  33. Zarei A, Asl BM (2020) Automatic classification of apnea and normal subjects using new features extracted from HRV and ECG-derived respiration signals. Biomed Signal Process Control 59:101927

    Article  Google Scholar 

  34. Surantha N, Lesmana TF, Isa SM (2021) Sleep stage classification using extreme learning machine and particle swarm optimization for healthcare big data. J Big Data 8(1):1–17

    Article  Google Scholar 

  35. Nayana B, Geethanjali P (2017) Analysis of statistical time-domain features effectiveness in identification of bearing faults from vibration signal. IEEE Sens J 17(17):5618–5625

    Article  ADS  Google Scholar 

  36. Zhang Y, Wang B, Jing J, Zhang J, Zou J, Nakamura M (2017) A comparison study on multidomain EEG features for sleep stage classification. Comput Intell Neurosci 2017

  37. Al Ghayab HR, Li Y, Siuly S, Abdulla S (2019) A feature extraction technique based on tunable q-factor wavelet transform for brain signal classification. J Neurosci Methods 312:43–52

    Article  PubMed  Google Scholar 

  38. Oh S-H, Lee Y-R, Kim H-N (2014) A novel EEG feature extraction method using Hjorth parameter, International Journal of Electronics and Electrical. Engineering 2(2):106–110

    Google Scholar 

  39. Shannon CE (1948) A mathematical theory of communication. Bell Syst Tech J 27(3):379–423

    Article  MathSciNet  Google Scholar 

  40. Han J, Dong F, Xu Y (2009) Entropy feature extraction on flow pattern of gas/liquid two-phase flow based on cross-section measurement. 147(1):012041

  41. Pincus SM (1991) Approximate entropy as a measure of system complexity. Proc Natl Acad Sci 88(6):2297–2301

    Article  ADS  MathSciNet  CAS  PubMed  PubMed Central  Google Scholar 

  42. Kosko B (1986) Fuzzy entropy and conditioning. 1njorm

  43. Richman JS, Moorman JR (2000) Physiological time-series analysis using approximate entropy and sample entropy. Am J Physiol Heart Circ Physiol

  44. Theodoridis S, Koutroumbas K (2006) Pattern recognition. Elsevier

  45. Cutler A, Cutler D, Stevens J (2012) Random forests. Ensemble machine learning. In: Ensemble Machine Learning, pp. 157–175

  46. Zhao D, Wang Y, Wang Q, Wang X (2019) Comparative analysis of different characteristics of automatic sleep stages. Comput Methods Programs Biomed 175:53–72

    Article  PubMed  Google Scholar 

  47. Alaa T et al (2018) Classification assessment methods. Applied Computing and Informatics, Sciencedirect

    Google Scholar 

  48. Powers DM (2020) Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation. ArXiv:2010.16061

  49. Li Q, Li Q, Liu C, Shashikumar SP, Nemati S, Clifford GD (2018) Deep learning in the cross-time frequency domain for sleep staging from a single-lead electrocardiogram. Physiol Meas 39(12):124005

    Article  PubMed  PubMed Central  Google Scholar 

  50. Yücelbaş Ş, Yücelbaş C, Tezel G, Özşen S, Yosunkaya Ş (2018) Automatic sleep staging based on SVD, VMD, HHT and morphological features of single-lead ECG signal. Expert Syst Appl 102:193–206

    Article  Google Scholar 

  51. Qu W, Wang Z, Hong H, Chi Z, Feng DD, Grunstein R, Gordon C (2020) A residual based attention model for EEG based sleep staging. IEEE J Biomed Health Inform 24(10):2833–2843

    Article  PubMed  Google Scholar 

  52. Fiorillo L, Favaro P, Faraci FD (2021) Deepsleepnet-lite: a simplified automatic sleep stage scoring model with uncertainty estimates. IEEE Trans Neural Syst Rehabilitation Eng 29:2076–2085

    Article  Google Scholar 

  53. Zhou D, Wang J, Hu G, Zhang J, Li F, Yan R, Kettunen L, Chang Z, Xu Q, Cong F (2022) Singlechannelnet: a model for automatic sleep stage classification with raw single-channel EEG. Biomed Signal Process Control 75:103592

    Article  Google Scholar 

  54. Kong G, Li C, Peng H, Han Z, Qiao H (2023) EEG-based sleep stage classification via neural architecture search. IEEE Trans Neural Syst Rehabil Eng 31:1075–1085

    Article  Google Scholar 

  55. Iber C, Redline S, Gilpin AMK, Quan SF, Zhang L, Gottlieb DJ, Rapoport D, Resnick HE, Sanders M, Smith P (2004) Polysomnography performed in the unattended home versus the attended laboratory setting-sleep heart health study methodology. Sleep 27(3):536–540

    Article  PubMed  Google Scholar 

  56. Mikkelsen KB, Tabar YR, Toft HO, Hemmsen MC, Rank ML, Kidmose P (2022) Self-applied ear-EEG for sleep monitoring at home. In 2022 44th annual international conference of the IEEE engineering in medicine & biology society (EMBC). IEEE, 3135–3138

  57. Rajbhandary PL, Nallathambi G, Selvaraj N, Tran T, Colliou O (2022) ECG signal quality assessments of a small bipolar single-lead wearable patch sensor. Cardiovasc Eng Technol 13(5):783–796

    Article  PubMed  PubMed Central  Google Scholar 

  58. Krakovská A, Mezeiová K (2011) Automatic sleep scoring: a search for an optimal combination of measures. Artif Intell Med 53(1):25–33

Download references

Funding

This research was supported by the Cognitive Sciences and Technologies Council of Iran.

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, Tarbiat Modares University, Tehran, Iran

    Samandokht Rashidi & Babak Mohammadzadeh Asl

Authors
  1. Samandokht Rashidi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Babak Mohammadzadeh Asl
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Babak Mohammadzadeh Asl.

Ethics declarations

Conflict of interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rashidi, S., Asl, B.M. Strength of ensemble learning in automatic sleep stages classification using single-channel EEG and ECG signals. Med Biol Eng Comput 62, 997–1015 (2024). https://doi.org/10.1007/s11517-023-02980-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11517-023-02980-2

Keywords

Search

Navigation