Skip to main content

Swin Transformer for COVID-19 Infection Percentage Estimation from CT-Scans

  • 788 Accesses

Part of the Lecture Notes in Computer Science book series (LNCS,volume 13374)


Coronavirus disease 2019 (COVID-19) is an infectious disease that has spread globally, disrupting the health care system and claiming millions of lives worldwide. Because of the high number of Covid-19 infections, it has been challenging for medical professionals to manage this crisis. Estimating the Covid-19 percentage can help medical staff categorize patients by severity and prioritize accordingly. With this approach, the intensive care unit (ICU) can free up resuscitation beds for the critical cases and provide other treatments for less severe cases to efficiently manage the healthcare system during a crisis. In this paper, we present a transformer-based method to estimate covid-19 infection percentage for monitoring the evolution of the patient state from computed tomography scans (CT-scans). We used a particular Transformer architecture called Swin Transformer as a backbone network to extract the feature from the CT slice and pass it through multi-layer perceptron (MLP) to obtain covid-19 infection percentage. We evaluated our approach on the covid-19 infection percentage estimation challenge dataset, annotated by two expert radiologists. The experimental results show that the proposed method achieves promising performance with a mean absolute error (MAE) of 4.5042, Pearson correlation coefficient (PC) of 0.9490, root mean square error (RMSE) of 8.0964 on the given Val set leaderboard and a MAE of 3.5569, PC of 0.8547 and RMSE of 7.5102 on the given Test set Leaderboard. These promising results demonstrate the high potential of Swin Transformer architecture for this image regression task of covid-19 infection percentage estimation from CT-scans. The source code of this project can be found at:


  • COVID-19
  • Deep learning
  • CT-scan
  • Transformers

This is a preview of subscription content, access via your institution.

Buying options

USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD   79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions


  1. Abhishek, T.: Tez: a simple PyTorch trainer.

  2. Bougourzi, F., Contino, R., Distante, C., Taleb-Ahmed, A.: CNR-IEMN: a deep learning based approach to recognise Covid-19 from CT-scan. In: 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2021, pp. 8568–8572. IEEE (2021)

    Google Scholar 

  3. Bougourzi, F., Contino, R., Distante, C., Taleb-Ahmed, A.: Recognition of Covid-19 from CT scans using two-stage deep-learning-based approach: CNR-IEMN. Sensors 21(17), 5878 (2021)

    CrossRef  Google Scholar 

  4. Bougourzi, F., Distante, C., Ouafi, A., Dornaika, F., Hadid, A., Taleb-Ahmed, A.: Per-Covid-19: a benchmark dataset for Covid-19 percentage estimation from CT-scans. J. Imaging 7(9), 189 (2021)

    CrossRef  Google Scholar 

  5. Buslaev, A., Iglovikov, V.I., Khvedchenya, E., Parinov, A., Druzhinin, M., Kalinin, A.A.: Albumentations: fast and flexible image augmentations. Information 11(2) (2020).

  6. Dosovitskiy, A., et al.: An image is worth 16x16 words: transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)

  7. Fan, D.P., et al.: Inf-Net: automatic Covid-19 lung infection segmentation from CT images. IEEE Trans. Med. Imaging 39(8), 2626–2637 (2020)

    CrossRef  Google Scholar 

  8. Goceri, E., Goceri, N.: Deep learning in medical image analysis: recent advances and future trends (2017)

    Google Scholar 

  9. Jalaber, C., Lapotre, T., Morcet-Delattre, T., Ribet, F., Jouneau, S., Lederlin, M.: Chest CT in Covid-19 pneumonia: a review of current knowledge. Diagn. Interv. Imaging 101(7–8), 431–437 (2020)

    CrossRef  Google Scholar 

  10. Kucirka, L.M., Lauer, S.A., Laeyendecker, O., Boon, D., Lessler, J.: Variation in false-negative rate of reverse transcriptase polymerase chain reaction-based SARS-CoV-2 tests by time since exposure. Ann. Intern. Med. 173(4), 262–267 (2020)

    CrossRef  Google Scholar 

  11. Lacerda, P., Barros, B., Albuquerque, C., Conci, A.: Hyperparameter optimization for Covid-19 pneumonia diagnosis based on chest CT. Sensors 21(6), 2174 (2021)

    CrossRef  Google Scholar 

  12. Lassau, N., et al.: Integrating deep learning CT-scan model, biological and clinical variables to predict severity of Covid-19 patients. Nat. Commun. 12(1), 1–11 (2021)

    CrossRef  Google Scholar 

  13. Lei, J., Li, J., Li, X., Qi, X.: CT imaging of the 2019 novel coronavirus (2019-nCoV) pneumonia. Radiology 295(1), 18 (2020)

    CrossRef  Google Scholar 

  14. Litjens, G.: A survey on deep learning in medical image analysis. Med. Image Anal. 42, 60–88 (2017)

    CrossRef  Google Scholar 

  15. Liu, Z., et al.: Swin transformer: hierarchical vision transformer using shifted windows. arXiv preprint arXiv:2103.14030 (2021)

  16. Paszke, A., et al.: PyTorch: an imperative style, high-performance deep learning library. Adv. Neural. Inf. Process. Syst. 32, 8026–8037 (2019)

    Google Scholar 

  17. Stefano, A., Comelli, A.: Customized efficient neural network for Covid-19 infected region identification in CT images. J. Imaging 7(8), 131 (2021)

    CrossRef  Google Scholar 

  18. Vaishya, R., Javaid, M., Khan, I.H., Haleem, A.: Artificial intelligence (AI) applications for Covid-19 pandemic. Diab. Metab. Syndr. Clin. Res. Rev. 14(4), 337–339 (2020)

    Google Scholar 

  19. Vantaggiato, E., Paladini, E., Bougourzi, F., Distante, C., Hadid, A., Taleb-Ahmed, A.: Covid-19 recognition using ensemble-CNNs in two new chest X-ray databases. Sensors 21(5), 1742 (2021)

    CrossRef  Google Scholar 

  20. Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, pp. 5998–6008 (2017)

    Google Scholar 

  21. Voulodimos, A., Doulamis, N., Doulamis, A., Protopapadakis, E.: Deep learning for computer vision: a brief review. Comput. Intell. Neurosci. 2018, 1–14 (2018)

    Google Scholar 

  22. Voulodimos, A., Protopapadakis, E., Katsamenis, I., Doulamis, A., Doulamis, N.: A few-shot U-Net deep learning model for Covid-19 infected area segmentation in CT images. Sensors 21(6), 2215 (2021)

    CrossRef  Google Scholar 

  23. Wang, G., et al.: A deep-learning pipeline for the diagnosis and discrimination of viral, non-viral and Covid-19 pneumonia from chest X-ray images. Nat. Biomed. Eng. 5(6), 509–521 (2021)

    CrossRef  Google Scholar 

  24. Wang, L., Lin, Z.Q., Wong, A.: Covid-Net: a tailored deep convolutional neural network design for detection of Covid-19 cases from chest X-ray images. Sci. Rep. 10(1), 1–12 (2020)

    Google Scholar 

  25. Wang, X., et al.: A weakly-supervised framework for Covid-19 classification and lesion localization from chest CT. IEEE Trans. Med. Imaging 39(8), 2615–2625 (2020)

    CrossRef  Google Scholar 

  26. Wightman, R.: PyTorch image models (2019).

  27. Zhao, X., et al.: D2A U-Net: automatic segmentation of Covid-19 lesions from CT slices with dilated convolution and dual attention mechanism. arXiv preprint arXiv:2102.05210 (2021)

Download references

Author information

Authors and Affiliations


Corresponding author

Correspondence to Suman Chaudhary .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chaudhary, S., Yang, W., Qiang, Y. (2022). Swin Transformer for COVID-19 Infection Percentage Estimation from CT-Scans. In: Mazzeo, P.L., Frontoni, E., Sclaroff, S., Distante, C. (eds) Image Analysis and Processing. ICIAP 2022 Workshops. ICIAP 2022. Lecture Notes in Computer Science, vol 13374. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-13323-7

  • Online ISBN: 978-3-031-13324-4

  • eBook Packages: Computer ScienceComputer Science (R0)