Abstract
Cardiac image synthesis and analysis are pivotal in modern healthcare for accurate diagnosis and treatment of cardiovascular conditions. This study introduces a pioneering approach—hybrid GAN with semantic resonance—for the generation and analysis of synthetic cardiac images. Drawing from a diverse dataset encompassing local and global views, acquired through various modalities like MRI, CT, and echocardiography, the critical need for both accuracy and clinical relevance in cardiac image synthesis is addressed. In the architectural setup, a hybrid GAN is defined, comprising both local and global components. The local generator excels in capturing intricate details, while the global generator contextualizes the overall cardiac structure. A fundamental innovation lies in the incorporation of pre-trained CNN classifiers specialized in recognizing cardiac pathologies, anatomical structures, and clinical features. These classifiers provide conditional guidance to the generators, ensuring that the synthesized images align semantically with clinical expectations. The training phase employs a pioneering approach, integrating real-time feedback from the classifiers to steer the image synthesis process. The generators, discriminators, and classifiers are optimized, with a dual emphasis on adversarial loss for authenticity and classification loss for diagnostic significance. The accuracy obtained by the proposed approach is 98.96%. Further, the SSIM and PSNR values attained by the proposed approach are 0.955 and 45.23, which is higher than the existing approaches like GAN, CNN, VAE, DenseNet, VGG19, DeepCardiac, Pix2Pix GAN and Cycle-GAN, respectively. Validation on an independent test dataset underscores the generalization capabilities of the proposed hybrid GAN. Furthermore, post-processing techniques refine the generated images, elevating their clinical relevance. Results visualization presents the prowess of the proposed approach, providing a holistic view of local and global perspectives within synthetic images.
Similar content being viewed by others
Availability of data and material
The data that support the findings of this study are available from the corresponding author upon reasonable request.
References
Kwon JM, Kim KH, Jeon KH, Lee SY, Park J, Oh BH (2020) Artificial intelligence algorithm for predicting cardiac arrest using electrocardiography. Scand J Trauma, Resuscitation Emerg Med 28:1–10
Grogan M, Lopez-Jimenez F, Cohen-Shelly M, Dispenzieri A, Attia ZI, Abou Ezzedine OF, Lin G, Kapa S, Borgeson DD, Friedman PA, Murphree DH Jr (2021) Artificial intelligence–enhanced electrocardiogram for the early detection of cardiac amyloidosis. Mayo Clin Proc 96(11):2768–2778
Rath A, Mishra D, Panda G (2021) LSTM-based cardiovascular disease detection using ECG signal. Cognitive informatics and soft computing: proceeding of CISC 2020. Springer, Singapore, pp 133–142
Colin GC, Pouleur AC, Gerber BL, Poncelet PA, De Meester C, D’Hondt AM, Vlassenbroek A, Houard L, Gevenois PA, Ghaye B (2020) Pulmonary hypertension detection by computed tomography pulmonary transit time in heart failure with reduced ejection fraction. Eur Heart J Cardiovasc Imaging 21(11):1291–1298
Mishra S, Kass DA (2021) Cellular and molecular pathobiology of heart failure with preserved ejection fraction. Nat Rev Cardiol 18(6):400–423
Mansour A, Fuhrman JD, Ammar FE, Loggini A, Davis J, Lazaridis C, Kramer C, Goldenberg FD, Giger ML (2022) Machine learning for early detection of hypoxic-ischemic brain injury after cardiac arrest. Neurocrit Care 36:974–982
Elming MB, Hammer-Hansen S, Voges I, Nyktari E, Raja AA, Svendsen JH, Pehrson S, Signorovitch J, Køber L, Prasad SK, Thune JJ (2020) Myocardial fibrosis and the effect of primary prophylactic defibrillator implantation in patients with non-ischemic systolic heart failure—DANISH-MRI. Am Heart J 221:165–176
Olsen CR, Mentz RJ, Anstrom KJ, Page D, Patel PA (2020) Clinical applications of machine learning in the diagnosis, classification, and prediction of heart failure. Am Heart J 229:1–17
Chae M, Gil HW, Cho NJ, Lee H (2022) Machine learning-based cardiac arrest prediction for early warning system. Mathematics 10(12):2049
Kumar Y, Koul A, Sisodia PS, Shafi J, Kavita V, Gheisari M, Davoodi MB (2021) Heart failure detection using quantum-enhanced machine learning and traditional machine learning techniques for internet of artificially intelligent medical things. Wirel Commun Mobile Comput 17(2021):1–6
Al Khalil Y, Amirrajab S, Lorenz C, Weese J, Pluim J, Breeuwer M (2023) Reducing segmentation failures in cardiac MRI via late feature fusion and GAN-based augmentation. Comput Biol Med 161:106973
Pandya S, Gadekallu TR, Reddy PK, Wang W, Alazab M (2022) InfusedHeart: a novel knowledge-infused learning framework for diagnosis of cardiovascular events. IEEE Trans Comput Soc Syst 1–10
Acs B, Rantalainen M, Hartman J (2020) Artificial intelligence as the next step towards precision pathology. J Intern Med 288(1):62–81
Baral S, Alsadoon A, Prasad PWC, Al Aloussi S, Alsadoon OH (2021) A novel solution of using deep learning for early prediction cardiac arrest in Sepsis patient: enhanced bidirectional long short-term memory (LSTM). Multimed Tools Appl 80:32639–32664
Savorgnan F, Crouthamel DI, Heroy A, Santerre J, Acosta S (2022) Quantification of electrocardiogram instability prior to cardiac arrest in patients with single-ventricle physiology. J Electrocardiol 73:29–33
Tani H, Tohyama S (2022) Human engineered heart tissue models for disease modeling and drug discovery. Front Cell Dev Biol 10:855763
Kuznetsov VV, Moskalenko VA, Zolotykh NY (2020) Electrocardiogram generation and feature extraction using a variational autoencoder. arXiv preprint arXiv:2002.00254
Rustam F, Ishaq A, Munir K, Almutairi M, Aslam N, Ashraf I (2022) Incorporating CNN features for optimizing performance of ensemble classifier for cardiovascular disease prediction. Diagnostics 12(6):1474
Jahmunah V, Ng EYK, San TR, Acharya UR (2021) Automated detection of coronary artery disease, myocardial infarction and congestive heart failure using GaborCNN model with ECG signals. Comput Biol Med 134:104457
Ishaq A, Sadiq S, Umer M, Ullah S, Mirjalili S, Rupapara V, Nappi M (2021) Improving the prediction of heart failure patients’ survival using SMOTE and effective data mining techniques. IEEE access 9:39707–39716
Le MT, Vo MT, Pham NT, Dao SV (2021) Predicting heart failure using a wrapper-based feature selection. Indones J Electr Eng Comput Sci 21(3):1530–1539
Abdellatif A, Abdellatef H, Kanesan J, Chow CO, Chuah JH, Gheni HM (2022) An effective heart disease detection and severity level classification model using machine learning and hyperparameter optimization methods. IEEE Access 10:79974–79985
Krishnan VG, Saradhi DM, Kumar DS, Dhanalakshmi G, Pushpa P, Vijayaraja DV (2023) Hybrid optimization based feature selection with densenet model for heart disease prediction. Int J Electric Electron Res 11(2):253–261
Apostolopoulos ID, Papathanasiou ND, Papandrianos N, Papageorgiou E, Apostolopoulos DJ (2023) Innovative attention-based explainable feature-fusion VGG19 network for characterising myocardial perfusion imaging SPECT polar maps in patients with suspected coronary artery disease. Appl Sci 13(15):8839
Jimenez-Perez G, Acosta J, Alcaine A, Camara O (2021) Generalizing electrocardiogram delineation--Training convolutional neural networks with synthetic data augmentation. arXiv preprint arXiv:2111.12996
Kaspal R, Alsadoon A, Prasad PWC, Al-Saiyd NA, Nguyen TQV, Pham DTH (2021) A novel approach for early prediction of sudden cardiac death (SCD) using hybrid deep learning. Multimedia Tools Appl 80:8063–8090
https://www.creatis.insa-lyon.fr/Challenge/acdc/databases.html
Ahmad A, Hussain HK, Tanveer H, Kiruthiga T, Gupta K (2023) The intelligent heart rate monitoring model for survivability prediction of cardiac arrest patients using deep cardiac learning model. In: International conference on intelligent systems for communication, IoT and security (ICISCoIS). IEEE, 376–381
Aljohani A, Alharbe N (2022) Generating synthetic images for healthcare with novel deep pix2pix gan. Electronics 11(21):3470
Zhang H, Li H, Dillman JR, Parikh NA, He L (2022) Multi-contrast MRI image synthesis using switchable cycle-consistent generative adversarial networks. Diagnostics 12(4):816
Funding
Not applicable.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Consent to participate
Not applicable.
Consent for publication
Not applicable.
Human and animal rights
This article does not contain any studies with human or animal subjects performed by any of the authors.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Gurusubramani, S., Latha, B. Enhancing cardiac diagnostics through semantic-driven image synthesis: a hybrid GAN approach. Neural Comput & Applic 36, 8181–8197 (2024). https://doi.org/10.1007/s00521-024-09452-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-024-09452-0