Temporal Prediction of Respiratory Motion Using a Trained Ensemble of Forecasting Methods

  • Xiaoran Chen
  • Christine Tanner
  • Orçun Göksel
  • Gábor Székely
  • Valeria De LucaEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9805)


Respiratory motion is a limiting factor during cancer therapy. Although image tracking can facilitate compensation for this motion, system latencies will still reduce the accuracy of tracking-based treatments. We propose a novel approach for temporal prediction of the motion of anatomical targets in the liver, observed from ultrasound sequences. The method is based on an ensemble of six prediction models, including neural networks, which are trained on motion traces and images. Using leave-one-subject-out validation on 24 liver ultrasound 2D sequences from the Challenge on Liver Ultrasound Tracking, the best performance was achieved by the linear regression-based ensemble of all methods with an accuracy of 1.49 (2.39) mm for a latency of 300 (600) ms.


Image-guided therapy Temporal prediction Respiratory motion Neural networks Regression 


  1. 1.
    Cleveland, W.S., Devlin, S.J.: Locally weighted regression: an approach to regression analysis by local fitting. J. Am. Stat. Assoc. 83(403), 596 (1988)CrossRefzbMATHGoogle Scholar
  2. 2.
    De Luca, V., Benz, T., Kondo, S., König, L., Lübke, D., Rothlübbers, S., Somphone, O., Allaire, S., Bell, M.L., Chung, D., et al.: The 2014 liver ultrasound tracking benchmark. PMB 60(14), 5571 (2015)Google Scholar
  3. 3.
    De Luca, V., Tschannen, M., Székely, G., Tanner, C.: A learning-based approach for fast and robust vessel tracking in long ultrasound sequences. In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds.) MICCAI 2013, Part I. LNCS, vol. 8149, pp. 518–525. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  4. 4.
    He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: surpassing human-level performance on ImageNet classification. In: IEEE ICCV, p. 1026 (2015)Google Scholar
  5. 5.
    Isakkson, M., Jaiden, J., Murphy, M.: On using an adaptive neural network to predict lung tumor motion during respiration for radiotherapy applications. Med. Phys. 32(12), 3801 (2005)CrossRefGoogle Scholar
  6. 6.
    Kakar, M., Nyström, H., Aarup, L.R., Nøttrup, T.J., Olsen, D.R.: Respiratory motion prediction by using the adaptive neuro fuzzy inference system (ANFIS). PMB 50(19), 4721 (2005)Google Scholar
  7. 7.
    Keall, P.J., Mageras, G.S., Balter, J.M., Emery, R.S., Forster, K.M., Jiang, S.B., Kapatoes, J.M., Low, D.A., Murphy, M.J., Murray, B.R., et al.: The management of respiratory motion in radiation oncology report of AAPM Task Group 76. Med. Phys. 33(10), 3874 (2006)CrossRefGoogle Scholar
  8. 8.
    Krauss, A., Nill, S., Oelfke, U.: The comparative performance of four respiratory motion predictors for real-time tumour tracking. PMB 56(16), 5303 (2011)Google Scholar
  9. 9.
    Lee, S.J., Motai, Y.: Review: prediction of respiratory motion. Prediction and Classification of Respiratory Motion, pp. 7–37. Springer, Heidelberg (2014)CrossRefGoogle Scholar
  10. 10.
    Makhinya, M., Goksel, O.: Motion tracking in 2D ultrasound using vessel models and robust optic-flow. In: Proceedings of MICCAI CLUST, p. 20 (2015)Google Scholar
  11. 11.
    O’Shea, T., Bamber, J., Fontanarosa, D., van der Meer, S., Verhaegen, F., Harris, E.: Review of ultrasound image guidance in external beam radiotherapy part II: intra-fraction motion management and novel applications. PMB 61(8), R90 (2016)Google Scholar
  12. 12.
    Poulsen, P.R., Cho, B., Sawant, A., Ruan, D., Keall, P.J.: Detailed analysis of latencies in image-based dynamic MLC tracking. Med. Phys. 37(9), 4998 (2010)CrossRefGoogle Scholar
  13. 13.
    Putra, D., Haas, O.C., Mills, J.A., Burnham, K.J.: A multiple model approach to respiratory motion prediction for real-time IGRT. PMB 53, 1651 (2008)Google Scholar
  14. 14.
    Ruan, D.: Kernel density estimation-based real-time prediction for respiratory motion. PMB 55(5), 1311 (2010)Google Scholar
  15. 15.
    Sharp, G.C., Jiang, S.B., Shimizu, S., Shirato, H.: Prediction of respiratory tumour motion for real-time image-guided radiotherapy. PMB 49(3), 425 (2004)Google Scholar
  16. 16.
    Tanner, C., Eppenhof, K., Gelderblom, J., Szekely, G.: Decision fusion for temporal prediction of respiratory liver motion. In: IEEE ISBI, p. 698. IEEE (2014)Google Scholar
  17. 17.
    Teo, P., Bruce, N., Pistorius, S.: Application and parametric studies of a sliding window neural network for respiratory motion predictions of lung cancer patients. In: Jaffray, D.A. (ed.) World Congress on Medical Physics and Biomedical Engineering. IFMBE Proceedings, vol. 51, pp. 595–598. Springer, Switzerland (2015)Google Scholar
  18. 18.
    Tieleman, T., Hinton, G.: Lecture 6.5-rmsprop: divide the gradient by a running average of its recent magnitude. COURSERA: Neural Netw. Mach. Learn. 4, 2 (2012)Google Scholar
  19. 19.
    Vedam, S., Keall, P., Docef, A., Todor, D., Kini, V., Mohan, R.: Predicting respiratory motion for four-dimensional radiotherapy. Med. Phys. 31(8), 2274 (2004)CrossRefGoogle Scholar
  20. 20.
    Verma, P.S., Wu, H., Langer, M.P., Das, I.J., Sandison, G.: Survey: real-time tumor motion prediction for image-guided radiation treatment. Comput. Sci. Eng. 13(5), 24 (2011)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Xiaoran Chen
    • 1
  • Christine Tanner
    • 1
  • Orçun Göksel
    • 1
  • Gábor Székely
    • 1
  • Valeria De Luca
    • 1
    Email author
  1. 1.Computer Vision Lab, ETH ZurichZurichSwitzerland

Personalised recommendations