Abstract
Coronavirus disease 2019 (COVID-19) is an infectious disease that has spread globally, disrupting the health care system and claiming millions of lives worldwide. Because of the high number of Covid-19 infections, it has been challenging for medical professionals to manage this crisis. Estimating the Covid-19 percentage can help medical staff categorize patients by severity and prioritize accordingly. With this approach, the intensive care unit (ICU) can free up resuscitation beds for the critical cases and provide other treatments for less severe cases to efficiently manage the healthcare system during a crisis. In this paper, we present a transformer-based method to estimate covid-19 infection percentage for monitoring the evolution of the patient state from computed tomography scans (CT-scans). We used a particular Transformer architecture called Swin Transformer as a backbone network to extract the feature from the CT slice and pass it through multi-layer perceptron (MLP) to obtain covid-19 infection percentage. We evaluated our approach on the covid-19 infection percentage estimation challenge dataset, annotated by two expert radiologists. The experimental results show that the proposed method achieves promising performance with a mean absolute error (MAE) of 4.5042, Pearson correlation coefficient (PC) of 0.9490, root mean square error (RMSE) of 8.0964 on the given Val set leaderboard and a MAE of 3.5569, PC of 0.8547 and RMSE of 7.5102 on the given Test set Leaderboard. These promising results demonstrate the high potential of Swin Transformer architecture for this image regression task of covid-19 infection percentage estimation from CT-scans. The source code of this project can be found at: https://github.com/suman560/Covid-19-infection-percentage-estimation.
Keywords
- COVID-19
- Deep learning
- CT-scan
- Transformers
This is a preview of subscription content, access via your institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Abhishek, T.: Tez: a simple PyTorch trainer. https://github.com/abhishekkrthakur/tez
Bougourzi, F., Contino, R., Distante, C., Taleb-Ahmed, A.: CNR-IEMN: a deep learning based approach to recognise Covid-19 from CT-scan. In: 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2021, pp. 8568–8572. IEEE (2021)
Bougourzi, F., Contino, R., Distante, C., Taleb-Ahmed, A.: Recognition of Covid-19 from CT scans using two-stage deep-learning-based approach: CNR-IEMN. Sensors 21(17), 5878 (2021)
Bougourzi, F., Distante, C., Ouafi, A., Dornaika, F., Hadid, A., Taleb-Ahmed, A.: Per-Covid-19: a benchmark dataset for Covid-19 percentage estimation from CT-scans. J. Imaging 7(9), 189 (2021)
Buslaev, A., Iglovikov, V.I., Khvedchenya, E., Parinov, A., Druzhinin, M., Kalinin, A.A.: Albumentations: fast and flexible image augmentations. Information 11(2) (2020). https://doi.org/10.3390/info11020125. https://www.mdpi.com/2078-2489/11/2/125
Dosovitskiy, A., et al.: An image is worth 16x16 words: transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)
Fan, D.P., et al.: Inf-Net: automatic Covid-19 lung infection segmentation from CT images. IEEE Trans. Med. Imaging 39(8), 2626–2637 (2020)
Goceri, E., Goceri, N.: Deep learning in medical image analysis: recent advances and future trends (2017)
Jalaber, C., Lapotre, T., Morcet-Delattre, T., Ribet, F., Jouneau, S., Lederlin, M.: Chest CT in Covid-19 pneumonia: a review of current knowledge. Diagn. Interv. Imaging 101(7–8), 431–437 (2020)
Kucirka, L.M., Lauer, S.A., Laeyendecker, O., Boon, D., Lessler, J.: Variation in false-negative rate of reverse transcriptase polymerase chain reaction-based SARS-CoV-2 tests by time since exposure. Ann. Intern. Med. 173(4), 262–267 (2020)
Lacerda, P., Barros, B., Albuquerque, C., Conci, A.: Hyperparameter optimization for Covid-19 pneumonia diagnosis based on chest CT. Sensors 21(6), 2174 (2021)
Lassau, N., et al.: Integrating deep learning CT-scan model, biological and clinical variables to predict severity of Covid-19 patients. Nat. Commun. 12(1), 1–11 (2021)
Lei, J., Li, J., Li, X., Qi, X.: CT imaging of the 2019 novel coronavirus (2019-nCoV) pneumonia. Radiology 295(1), 18 (2020)
Litjens, G.: A survey on deep learning in medical image analysis. Med. Image Anal. 42, 60–88 (2017)
Liu, Z., et al.: Swin transformer: hierarchical vision transformer using shifted windows. arXiv preprint arXiv:2103.14030 (2021)
Paszke, A., et al.: PyTorch: an imperative style, high-performance deep learning library. Adv. Neural. Inf. Process. Syst. 32, 8026–8037 (2019)
Stefano, A., Comelli, A.: Customized efficient neural network for Covid-19 infected region identification in CT images. J. Imaging 7(8), 131 (2021)
Vaishya, R., Javaid, M., Khan, I.H., Haleem, A.: Artificial intelligence (AI) applications for Covid-19 pandemic. Diab. Metab. Syndr. Clin. Res. Rev. 14(4), 337–339 (2020)
Vantaggiato, E., Paladini, E., Bougourzi, F., Distante, C., Hadid, A., Taleb-Ahmed, A.: Covid-19 recognition using ensemble-CNNs in two new chest X-ray databases. Sensors 21(5), 1742 (2021)
Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, pp. 5998–6008 (2017)
Voulodimos, A., Doulamis, N., Doulamis, A., Protopapadakis, E.: Deep learning for computer vision: a brief review. Comput. Intell. Neurosci. 2018, 1–14 (2018)
Voulodimos, A., Protopapadakis, E., Katsamenis, I., Doulamis, A., Doulamis, N.: A few-shot U-Net deep learning model for Covid-19 infected area segmentation in CT images. Sensors 21(6), 2215 (2021)
Wang, G., et al.: A deep-learning pipeline for the diagnosis and discrimination of viral, non-viral and Covid-19 pneumonia from chest X-ray images. Nat. Biomed. Eng. 5(6), 509–521 (2021)
Wang, L., Lin, Z.Q., Wong, A.: Covid-Net: a tailored deep convolutional neural network design for detection of Covid-19 cases from chest X-ray images. Sci. Rep. 10(1), 1–12 (2020)
Wang, X., et al.: A weakly-supervised framework for Covid-19 classification and lesion localization from chest CT. IEEE Trans. Med. Imaging 39(8), 2615–2625 (2020)
Wightman, R.: PyTorch image models (2019). https://doi.org/10.5281/zenodo.4414861. https://github.com/rwightman/pytorch-image-models
Zhao, X., et al.: D2A U-Net: automatic segmentation of Covid-19 lesions from CT slices with dilated convolution and dual attention mechanism. arXiv preprint arXiv:2102.05210 (2021)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Chaudhary, S., Yang, W., Qiang, Y. (2022). Swin Transformer for COVID-19 Infection Percentage Estimation from CT-Scans. In: Mazzeo, P.L., Frontoni, E., Sclaroff, S., Distante, C. (eds) Image Analysis and Processing. ICIAP 2022 Workshops. ICIAP 2022. Lecture Notes in Computer Science, vol 13374. Springer, Cham. https://doi.org/10.1007/978-3-031-13324-4_44
Download citation
DOI: https://doi.org/10.1007/978-3-031-13324-4_44
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-13323-7
Online ISBN: 978-3-031-13324-4
eBook Packages: Computer ScienceComputer Science (R0)