Abstract
Purpose
Cardiotocography (CTG), which measures uterine contraction (UC) and fetal heart rate (FHR), is a crucial tool for assessing fetal health during pregnancy. However, traditional computerized cardiotocography (cCTG) approaches have non-negligible calibration errors in feature extraction and heavily rely on the expertise and prior experience to define diagnostic features from CTG or FHR signals. Although previous works have studied deep learning methods for extracting CTG or FHR features, these methods still neglect the clinical information of pregnant women.
Methods
In this paper, we proposed a multimodal deep learning architecture (MMDLA) for intelligent antepartum fetal monitoring that is capable of performing automatic CTG feature extraction, fusion with clinical data and classification. The multimodal feature fusion was achieved by concatenating high-level CTG features, which were extracted from preprocessed CTG signals via a convolution neural network (CNN) with six convolution layers and five fully connected layers, and the clinical data of pregnant women. Eventually, light gradient boosting machine (LGBM) was implemented as fetal status assessment classifier. The effectiveness of MMDLA was evaluated using a dataset of 16,355 cases, each of which includes FHR signal, UC signal and pertinent clinical data like maternal age and gestational age.
Results
With an accuracy of 90.77% and an area under the curve (AUC) value of 0.9201, the multimodal features performed admirably. The data imbalance issue was also effectively resolved by the LGBM classifier, with a normal-F1 value of 0.9376 and an abnormal-F1 value of 0.8223.
Conclusion
In summary, the proposed MMDLA is conducive to the realization of intelligent antepartum fetal monitoring.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Al-Yousif S, Jaenul A, Al-Dayyeni W, Alamoodi A, Saleh AH. Distributed under creative commons cc-by 4.0 open access a systematic review of automated pre-processing, feature extraction and classification of cardiotocography. J Comput Sci Technol. 2021. https://doi.org/10.7717/peerj-cs.452
Georgieva A, Abry P, Chudáček V, Djurić PM, Frasch MG, Kok R, Lear CA, Lemmens SN, Nunes I, Papageorghiou AT, et al. Computer-based intrapartum fetal monitoring and beyond: a review of the 2nd workshop on signal processing and monitoring in labor (October 2017, Oxford, UK). Acta Obstet Gynecol Scand. 2019;98(9):1207–17.
Kahankova R, Martinek R, Jaros R, Behbehani K, Behar JA. A review of signal processing techniques for non-invasive fetal electrocardiography. IEEE Rev Biomed Eng. 2019;13:51–73.
Behar J.A, Weiner Z, Warrick P. Special session on computational fetal monitoring. In: 2019 Computing in cardiology (CinC), 2019;1–4 . https://doi.org/10.23919/CinC49843.2019.9005927.
Pereira S, Ingram C, Gupta N, Singh M, Chandraharan E. Recognising fetal compromise in the cardiograph during the antenatal period: pearls and pitfalls. Asian J Med Health. 2020. https://doi.org/10.9734/AJMAH/2020/v18i930238.
Ibrahim HA, Elgzar WT, Saied E. The effect of different positions during non-stress test on maternal hemodynamic parameters, satisfaction, and fetal cardiotocographic patterns. Afr J Reprod Health. 2021;25(1):81–9.
Saleem S, Naqvi S.S, Manzoor T, Saeed A, Rehman N.U, Mirza J A strategy for classification of ‘vaginal vs. cesarean section’ delivery: bivariate empirical mode decomposition of cardiotocographic recordings. Front Physiol. 2019;10:246.
Zeng R, Lu Y.S, Long S, Wang C, Murphy L. Cardiotocography signal abnormality classification using time-frequency features and ensemble cost-sensitive svm classifier. Comput Biol Med. 2021;130:104218.
Thippa RG, Praveen K, Lakshmanna K, Kaluri R, Baker T. Analysis of dimensionality reduction techniques on big data. IEEE Access 2020;8:54776–54788.
Fei Y, Huang X, Chen Q, Chen J, Wei H. Automatic classification of antepartum cardiotocography using fuzzy clustering and adaptive neuro-fuzzy inference system. In: 2020 IEEE international conference on bioinformatics and biomedicine (BIBM); 2020.
Hruban L, Spilka J, Chudacek V, Janku P. Agreement on intrapartum recordings between expert-obstetricians. J Eval Clin Pract. 2015;21(4):694–702.
Romano M, Bifulco P, Ruffo M, Improta G, Cesarelli M. Software for computerised analysis of cardiotocographic traces. Comput Methods Programs Biomed. 2016;124(C):121–37.
Fergus P, Chalmers C, Montanez C.C, Reilly D, Pineles B. Modelling segmented cardiotocography time-series signals using one-dimensional convolutional neural networks for the early detection of abnormal birth outcomes. IEEE Trans Emerg Top Comput Intell. 2020;5(6):882–92.
Zhao Z, Deng Y, Zhang Y, Zhang Y, Zhang X, Shao L. DeepFHR: intelligent prediction of fetal Acidemia using fetal heart rate signals based on convolutional neural network. BMC Med Inform Decis Mak. 2019;19:286.
Cmert Z, Kocamaz AF. Fetal hypoxia detection based on deep convolutional neural network with transfer learning approach. Cham: Springer; 2018.
Ma’Sum MA, Intan P, Jatmiko W, Krisnadhi AA, Suarjaya I. Improving deep learning classifier for fetus hypoxia detection in cardiotocography signal. In: 2019 International workshop on big data and information security (IWBIS); 2019.
Haijing, Tg, Taoyi, Wang, Mengke, Li, Xu, Yang: The design and implementation of cardiotocography signals classification algorithm based on neural network. Comput Math Methods Med. 2018. https://doi.org/10.1155/2018/8568617.
Yavuz P, Taze M, Salihoglu O. The effect of adolescent and advanced-age pregnancies on maternal and early neonatal clinical data. J Maternal Fetal Neonatal Med. 2022;35(25):7399–405.
Ferguson KK, Sammallahti S, Rosen E, Dries MVD, Jaddoe VWV. Fetal growth trajectories among small for gestational age babies and child neurodevelopment. Epidemiology. 2021;32(5):664–671.
Ni X, Wang H, Shaolan LV, Xiong M. An ensemble classification model based on imbalanced data for aviation safety; 2021.
Xu Z, So DR, Dai AM. MUFASA: multimodal fusion architecture search for electronic health records; 2021. https://arxiv.org/abs/2102.02340.
Zhang Y, Sheng M, Liu X, Wang R, Lin W, Ren P, Wang X, Zhao E, Song W. A heterogeneous multi-modal medical data fusion framework supporting hybrid data exploration. Health Inf Sci Syst. 2022;10(1):1–11.
Jha M, Gupta R, Saxena R. A framework for in-vivo human brain tumor detection using image augmentation and hybrid features. Health Inf Sci Syst. 2022;10(1):1–12.
Menegotto AB, Becker CDL, Cazella SC. Computer-aided diagnosis of hepatocellular carcinoma fusing imaging and structured health data. Health Inf Sci Syst. 2021;9(1):1–11.
Zhong M, Yi H, Lai F, Liu M, Zeng R, Kang X, Xiao Y, Rong J, Wang H, Bai J. CTGNet: automatic analysis of fetal heart rate from cardiotocograph using artificial intelligence. Maternal Fetal Med. 2022. https://doi.org/10.1097/FM9.0000000000000147.
Petrozziello A, Redman CW, Papageorghiou AT, Jordanov I, Georgieva A. Multimodal convolutional neural networks to detect fetal compromise during labor and delivery. IEEE Access. 2019;7:112026–36.
Improta G, Ricciardi C, Amato F, D’Addio G, Romano M. Efficacy of machine learning in predicting the kind of delivery by cardiotocography. In: XV Mediterranean conference on medical and biological engineering and computing—MEDICON 2020;2019. p. 793–800.
Chen Y, Guo A, Chen Q, Quan B, Hao Z. Intelligent classification of antepartum cardiotocography model based on deep forest. Biomed Signal Process Control. 2021;67(2): 102555.
Pini N, Lucchini M, Esposito G, Tagliaferri S, Signorini MG. A machine learning approach to monitor the emergence of late intrauterine growth restriction. Front Artif Intell. 2021;4: 622616.
Xie B. X. Kong, Duan T. Gynecology and obstetrics, 9th edn. Beijing: People’s Health Publishing House; 2018. p. 54–56.
Gao W, Lu Y. Fetal heart baseline extraction and classification based on deep learning. In: 2019 International conference on information technology and computer application (ITCA); 2019.
Cömert Z, Şengür A, Budak Ü, Kocamaz AF. Prediction of intrapartum fetal hypoxia considering feature selection algorithms and machine learning models. Health Inf Sci Syst. 2019;7(1):17.
Acknowledgements
This work is supported by Natural Science Foundation of China Nos. 61976052 and 71804031, and Medical Scientific Research Foundation of Guangdong Province No. A2019428.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Cao, Z., Wang, G., Xu, L. et al. Intelligent antepartum fetal monitoring via deep learning and fusion of cardiotocographic signals and clinical data. Health Inf Sci Syst 11, 16 (2023). https://doi.org/10.1007/s13755-023-00219-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s13755-023-00219-w