Skip to main content

Incorporating Isodose Lines and Gradient Information via Multi-task Learning for Dose Prediction in Radiotherapy

  • Conference paper
  • First Online:
Medical Image Computing and Computer Assisted Intervention – MICCAI 2021 (MICCAI 2021)

Abstract

Radiation therapy has been widely used in the treatment of cancer. However, a high-quality radiotherapy plan often requires dosimetrists to tweak repeatedly in a trial-and-error manner based on experience, causing it quite time-consuming and subjective. In this paper, we present a multi-task dose prediction (MTDP) network to automatically predict the dose distribution from computer tomography (CT) image. Specifically, the MTDP network consists of three highly-related tasks: a main dose prediction task for generating fine-grained dose value for each pixel, an auxiliary isodose lines prediction task for providing coarse-grained dose range for each pixel, and an auxiliary gradient prediction task for capturing subtle gradient information such as radiation patterns and edges of the dose distribution map, to obtain a more accurate and robust dose distribution map. The three related tasks are integrated via a shared encoder, following the multi-task learning strategy. To strengthen the correlations of different tasks, we also introduce two additional constraints, i.e., isodose consistency loss and gradient consistency loss, to enforce the match between the dose distribution features produced by the two auxiliary tasks and the main task. The experiments conducted on an in-house dataset with 110 rectum cancer patients have demonstrated the effectiveness and superiority of our method compared with the state-of-the-art methods. Code is available at https://github.com/DeepMedLab/MTDP-network.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Murakami, Y., et al.: Possibility of chest wall dose reduction using volumetric-modulated arc therapy (VMAT) in radiation-induced rib fracture cases: comparison with stereotactic body radiation therapy (SBRT). J. Radiat. Res. 59(3), 327–332 (2018)

    Article  Google Scholar 

  2. Nelms, B.E., et al.: Variation in external beam treatment plan quality: an inter-institutional study of planners and planning systems. Pract. Radiat. Oncol. 2(4), 296–305 (2012)

    Article  Google Scholar 

  3. Ronneberger, O., Fischer, P., Brox, T.: U-net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III, pp. 234–241. Springer International Publishing, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28

    Chapter  Google Scholar 

  4. Nguyen, D., et al.: Dose prediction with U-net: a feasibility study for predicting dose distributions from contours using deep learning on prostate IMRT patients. arXiv preprint arXiv:1709.09233 (2017)

  5. Nguyen, D., et al.: A feasibility study for predicting optimal radiation therapy dose distributions of prostate cancer patients from patient anatomy using deep learning. Sci. Rep. 9(1), 1–10 (2019)

    Google Scholar 

  6. Kearney, V., et al.: DoseNet: a volumetric dose prediction algorithm using 3D fully-convolutional neural networks. Phys. Med. Biol. 63(23), 235022 (2018)

    Article  Google Scholar 

  7. Song, Y., et al.: Dose prediction using a deep neural network for accelerated planning of rectal cancer radiotherapy. Radiother. Oncol. 149, 111–116 (2020)

    Article  Google Scholar 

  8. Mahmood, R., et al.: Automated treatment planning in radiation therapy using generative adversarial networks. In: Machine Learning for Healthcare Conference. PMLR (2018)

    Google Scholar 

  9. Cao, C., et al.: Adaptive multi-organ loss based generative adversarial network for automatic dose prediction in radiotherapy. In: IEEE 18th International Symposium on Biomedical Imaging. IEEE (2021)

    Google Scholar 

  10. Nguyen, D., et al.: 3D radiotherapy dose prediction on head and neck cancer patients with a hierarchically densely connected U-net deep learning architecture. Phys. Med. Biol. 64(6), 065020 (2019)

    Article  Google Scholar 

  11. Murakami, Y., et al.: Fully automated dose prediction using generative adversarial networks in prostate cancer patients. PLoS ONE 15(5), e0232697 (2020)

    Article  Google Scholar 

  12. Babier, A., et al.: Knowledge‐based automated planning with three‐dimensional generative adversarial networks. Med. Phys. 47(2), 297–306 (2020)

    Article  Google Scholar 

  13. Barragán-Montero, A.M., et al.: Three-dimensional dose prediction for lung IMRT patients with deep neural networks: robust learning from heterogeneous beam configurations. Med. Phys. 46(8), 3679–3691 (2019)

    Article  Google Scholar 

  14. He, K., et al.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016)

    Google Scholar 

  15. Chen, L.-C., et al.: Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11211, pp. 833–851. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01234-2_49

    Chapter  Google Scholar 

  16. Zhang, H., et al.: Self-attention generative adversarial networks. In: International Conference on Machine Learning. PMLR (2019)

    Google Scholar 

  17. Paddick, I.: A simple scoring ratio to index the conformity of radiosurgical treatment plans: technical note. J. Neurosur. 93(supplement_3), 219–222 (2000)

    Article  Google Scholar 

  18. Helal, A., Abbas, O.: Homogeneity index: effective tool for evaluation of 3DCRT. Pan Arab J. Oncol. 8(2), 20–24 (2015)

    Google Scholar 

  19. Graham, M.V., et al.: Clinical dose–volume histogram analysis for pneumonitis after 3D treatment for non-small cell lung cancer (NSCLC). Int. J. Radiat. Oncol. Biol. Phys. 45(2), 323–329 (1999)

    Article  Google Scholar 

Download references

Acknowledgments

This work is supported by National Natural Science Foundation of China (NSFC 62071314) and Sichuan Science and Technology Program (2021YFG0326, 2020YFG0079).

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Tan, S. et al. (2021). Incorporating Isodose Lines and Gradient Information via Multi-task Learning for Dose Prediction in Radiotherapy. In: de Bruijne, M., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2021. MICCAI 2021. Lecture Notes in Computer Science(), vol 12907. Springer, Cham. https://doi.org/10.1007/978-3-030-87234-2_71

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-87234-2_71

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-87233-5

  • Online ISBN: 978-3-030-87234-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics