Skip to main content

Swin UNETR for Tumor and Lymph Node Segmentation Using 3D PET/CT Imaging: A Transfer Learning Approach

  • Conference paper
  • First Online:
Head and Neck Tumor Segmentation and Outcome Prediction (HECKTOR 2022)

Abstract

Delineation of Gross Tumor Volume (GTV) is essential for the treatment of cancer with radiotherapy. GTV contouring is a time-consuming specialized manual task performed by radiation oncologists. Deep Learning (DL) algorithms have shown potential in creating automatic segmentations, reducing delineation time and inter-observer variation. The aim of this work was to create automatic segmentations of primary tumors (GTVp) and pathological lymph nodes (GTVn) in oropharyngeal cancer patients using DL. The organizers of the HECKTOR 2022 challenge provided 3D Computed Tomography (CT) and Positron Emission Tomography (PET) scans with ground-truth GTV segmentations acquired from nine different centers. Bounding box cropping was applied to obtain an anatomic based region of interest. We used the Swin UNETR model in combination with transfer learning. The Swin UNETR encoder weights were initialized by pre-trained weights of a self-supervised Swin UNETR model. An average Dice score of 0.656 was achieved on a test set of 359 patients from the HECKTOR 2022 challenge. Code is available at: https://github.com/HC94/swin_unetr_hecktor_2022.

Aicrowd Group Name: RT_UMCG

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://docs.monai.io/en/stable/transforms.html.

References

  1. Andrearczyk, V., et al.: Overview of the HECKTOR challenge at MICCAI 2022: automatic head and neck tumor segmentation and outcome prediction in PET/CT. In: Andrearczyk, V., Oreiller, V., Hatt, M., Depeursinge, A. (eds.) HECKTOR 2022. LNCS, vol. 13626, pp. 1–30. Springer, Cham (2023)

    Google Scholar 

  2. De Biase, A., et al.: Skip-SCSE multi-scale attention and co-learning method for oropharyngeal tumor segmentation on multi-modal PET-CT images. In: Andrearczyk, V., et al. (eds.) HECKTOR 2021. LNCS, vol. 13209, pp. 109–120. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-98253-9_10

    Chapter  Google Scholar 

  3. Andrearczyk, V., Oreiller, V., Depeursinge, A.: Oropharynx detection in PET-CT for tumor segmentation. In: Irish Machine Vision and Image Processing (2020)

    Google Scholar 

  4. Hatamizadeh, A., et al.: Swin UNETR: swin transformers for semantic segmentation of brain tumors in MRI images (2022). https://doi.org/10.48550/arXiv.2201.01266

  5. Loshchilov, I., et al.: Decoupled weight decay regularization (2017). https://doi.org/10.48550/arXiv.1711.05101

  6. Loshchilov, I., et al.: SGDR: stochastic gradient descent with warm restarts (2016). https://doi.org/10.48550/arXiv.1608.03983

  7. Oreiller, V., et al.: Head and neck tumor segmentation in PET/CT: the HECKTOR challenge. Med. Image Anal. 77, 102336 (2022)

    Google Scholar 

  8. Parkin, D.M., et al.: Global cancer statistics, 2002. CA Cancer J. Clin. 55(2), 74–108 (2005)

    Article  Google Scholar 

  9. Lievens, Y.: Provision and use of radiotherapy in Europe. Mol. Oncol. 14(7), 1461–1469 (2020). https://doi.org/10.1002/1878-0261.12690

    Article  Google Scholar 

  10. Tang, Y., et al.: Self-supervised pre-training of swin transformers for 3D medical image analysis (2021). https://doi.org/10.48550/arXiv.2111.14791

Download references

Acknowledgements

We thank the Center for Information Technology of the University of Groningen for their support and for providing access to the Peregrine high performance computing cluster.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Hung Chu , Luis Ricardo De la O Arévalo , Wei Tang , Baoqiang Ma , Yan Li , Alessia De Biase , Stefan Both , Johannes Albertus Langendijk , Peter van Ooijen , Nanna Maria Sijtsema or Lisanne V. van Dijk .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chu, H. et al. (2023). Swin UNETR for Tumor and Lymph Node Segmentation Using 3D PET/CT Imaging: A Transfer Learning Approach. In: Andrearczyk, V., Oreiller, V., Hatt, M., Depeursinge, A. (eds) Head and Neck Tumor Segmentation and Outcome Prediction. HECKTOR 2022. Lecture Notes in Computer Science, vol 13626. Springer, Cham. https://doi.org/10.1007/978-3-031-27420-6_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-27420-6_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-27419-0

  • Online ISBN: 978-3-031-27420-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics