Skip to main content

Regression Forests for Efficient Anatomy Detection and Localization in CT Studies

  • Conference paper
Medical Computer Vision. Recognition Techniques and Applications in Medical Imaging (MCV 2010)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 6533))

Included in the following conference series:


This paper proposes multi-class random regression forests as an algorithm for the efficient, automatic detection and localization of anatomical structures within three-dimensional CT scans.

Regression forests are similar to the more popular classification forests, but trained to predict continuous outputs. We introduce a new, continuous parametrization of the anatomy localization task which is effectively addressed by regression forests. This is shown to be a more natural approach than classification.

A single pass of our probabilistic algorithm enables the direct mapping from voxels to organ location and size; with training focusing on maximizing the confidence of output predictions. As a by-product, our method produces salient anatomical landmarks; i.e. automatically selected “anchor” regions which help localize organs of interest with high confidence. Quantitative validation is performed on a database of 100 highly variable CT scans. Localization errors are shown to be lower (and more stable) than those from global affine registration approaches. The regressor’s parallelism and the simplicity of its context-rich visual features yield typical runtimes of only 1s. Applications include semantic visual navigation, image tagging for retrieval, and initializing organ-specific processing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others


  1. Breiman, L.: Random forests. Technical Report TR567, UC Berkeley (1999)

    Google Scholar 

  2. Zhou, S.K., Zhou, J., Comaniciu, D.: A boosting regression approach to medical anatomy detection. In: IEEE CVPR, pp. 1–8 (2007)

    Google Scholar 

  3. Fenchel, M., Thesen, S., Schilling, A.: Automatic labeling of anatomical structures in MR fastView images using a statistical atlas. In: Metaxas, D., Axel, L., Fichtinger, G., Székely, G. (eds.) MICCAI 2008, Part I. LNCS, vol. 5241, pp. 576–584. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  4. Hardle, W.: Applied non-parametric regression. Cambridge University Press, Cambridge (1990)

    Book  MATH  Google Scholar 

  5. Zhou, S., Georgescu, B., Zhou, X., Comaniciu, D.: Image-based regression using boosting method. In: ICCV (2005)

    Google Scholar 

  6. Friedman, J.: Greedy function approximation: A gradient boosting machine. The Annals of Statistics 2(28) (2001)

    Google Scholar 

  7. Vapnik, V.: The nature of statistical learning theory. Springer, Heidelberg (2000)

    Book  MATH  Google Scholar 

  8. Yin, P., Criminisi, A., Essa, I., Winn, J.: Tree-based classifiers for bilayer video segmentation. In: CVPR (2007)

    Google Scholar 

  9. Montillo, A., Ling, H.: Age regression from faces using random forests. In: ICIP (2009)

    Google Scholar 

  10. Gall, J., Lempitsky, V.: Class-specific Hough forest for object detection. In: IEEE CVPR, Miami (2009)

    Google Scholar 

  11. Zhan, Y., Zhou, X.S., Peng, Z., Krishnan, A.: Active scheduling of organ detection and segmentation in whole-body medical images. In: Metaxas, D., Axel, L., Fichtinger, G., Székely, G. (eds.) MICCAI 2008, Part I. LNCS, vol. 5241, pp. 313–321. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  12. Torralba, A., Murphy, K.P., Freeman, W.T.: Sharing visual features for multiclass and multiview object detection. IEEE Trans. PAMI (2007)

    Google Scholar 

  13. Seifert, S., Barbu, A., Zhou, S.K., Liu, D., Feulner, J., Huber, M., Sühling, M., Cavallaro, A., Comaniciu, D.: Hierarchical parsing and semantic navigation of full body CT data. In: Pluim, J.P.W., Dawant, B.M. (eds.) SPIE (2009)

    Google Scholar 

  14. Criminisi, A., Shotton, J., Bucciarelli, S.: Decision forests with long-range spatial context for organ localization in CT volumes. In: MICCAI Workshop on Probabilistic Models for Medical Image Analysis (2009)

    Google Scholar 

  15. Shimizu, A., Ohno, R., Ikegami, T., Kobatake, H.: Multi-organ segmentation in three-dimensional abdominal CT images. Int. J. CARS 1 (2006)

    Google Scholar 

  16. Yao, C., Wada, T., Shimizu, A., Kobatake, H., Nawano, S.: Simultaneous location detection of multi-organ by atlas-guided eigen-organ method in volumetric medical images. Int. J. CARS 1 (2006)

    Google Scholar 

  17. Isgum, I., Staring, M., Rutten, A., Prokop, M., Viergever, M.A., van Ginneken, B.: Multi-atlas-based segmentation with local decision fusion—application to cardiac and aortic segmentation in ct scans. IEEE Trans. Medical Imaging 28(7) (2009)

    Google Scholar 

  18. Breiman, L., Friedman, J., Stone, C.J., Olshen, R.A.: Classification and Regression Trees. Chapman and Hall/CRC (1984)

    Google Scholar 

  19. Shotton, J., Winn, J., Rother, C., Criminisi, A.: Textonboost for image understanding: Multi-class object recognition and segmentation by jointly modeling texture, layout, and context. In: IJCV (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations


Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Criminisi, A., Shotton, J., Robertson, D., Konukoglu, E. (2011). Regression Forests for Efficient Anatomy Detection and Localization in CT Studies. In: Menze, B., Langs, G., Tu, Z., Criminisi, A. (eds) Medical Computer Vision. Recognition Techniques and Applications in Medical Imaging. MCV 2010. Lecture Notes in Computer Science, vol 6533. Springer, Berlin, Heidelberg.

Download citation

  • DOI:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-18420-8

  • Online ISBN: 978-3-642-18421-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics