Fast Anatomical Structure Localization Using Top-Down Image Patch Regression

  • René Donner
  • Bjoern H. Menze
  • Horst Bischof
  • Georg Langs
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7766)


Fully automatic localization of anatomical structures in 2D and 3D radiological data sets is important in both computer aided diagnosis, and the rapid automatic processing of large amounts of data. We present a simple, accurate and fast approach with low computational complexity to find anatomical landmarks, based on a multi-scale regression codebook of informative image patches and encoded landmark contexts.

From a set of annotated training volumes the method captures the appearance of landmarks over several scales together with relative positions of neighboring landmarks and a spatial distribution model. During multi-scale search in a target volume, starting from the coarsest level, each landmark model predicts all landmark positions it has encoded, with the median of all predictions yielding the final prediction for each scale.

We present results on two challenging data sets (hand radiographs and hand CTs), where our method achieves comparable accuracy to the state of the art with substantially improved run-time.


Anatomical structure localization nearest neighbor regression image patch codebooks 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bergtholdt, M., Kappes, J., Schmidt, S., Schnörr, C.: A Study of Parts-Based Object Class Detection Using Complete Graphs. IJCV 87(1-2), 93–117 (2010)CrossRefGoogle Scholar
  2. 2.
    Cootes, T.F., Taylor, C.J., Cooper, D.H., Graha, J.: Active Shape Models - Their Training and Application. CVIU 61(1), 38–59 (1995)Google Scholar
  3. 3.
    Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active Appearance Models. TPAMI 23(6), 681–685 (2001)CrossRefGoogle Scholar
  4. 4.
    Cremers, D., Rousson, M., Deriche, R.: A Review of Statistical Approaches to Level Set Segmentation: Integrating Color, Texture, Motion and Shape. IJCV 72(2), 195–215 (2007)CrossRefGoogle Scholar
  5. 5.
    Criminisi, A., Shotton, J., Robertson, D., Konukoglu, E.: Regression forests for efficient anatomy detection and localization in ct studies. In: Medical Computer Vision 2010: Recognition Techniques and Applications in Medical Imaging, MICCAI Workshop (2010)Google Scholar
  6. 6.
    Criminisi, A., Shotton, J., Bucciarelli, S.: Decision Forests with Long-Range Spatial Context for Organ Localization in CT Volumes. In: Proc. of MICCAI Workshop on Probabilistic Models for Medical Image Analysis, MICCAI-PMMIA (2009)Google Scholar
  7. 7.
    Doi, K.: Computer-aided diagnosis in medical imaging: Historical review, current status and future potential. Computerized Medical Imaging and Graphics 31, 198–211 (2007)CrossRefGoogle Scholar
  8. 8.
    Donner, R., Birngruber, E., Steiner, H., Bischof, H., Langs, G.: Localization of 3D Anatomical Structures Using Random Forests and Discrete Optimization. In: Proc. MICCAI Workshop on Medical Computer Vision (2010)Google Scholar
  9. 9.
    Donner, R., Menze, B.H., Bischof, H., Langs, G.: Global Localization of 3D Anatomical Structures by Pre-filtered Hough Forests and Discrete Optimization. Medical Image Analysis (accepted, 2013)Google Scholar
  10. 10.
    Kelm, B.M., Zhou, S.K., Suehling, M., Zheng, Y., Wels, M., Comaniciu, D.: Detection of 3D Spinal Geometry Using Iterated Marginal Space Learning. In: Proc. MICCAI Workshop on Medical Computer Vision (2010)Google Scholar
  11. 11.
    Montillo, A., Shotton, J., Winn, J., Iglesias, J.E., Metaxas, D., Criminisi, A.: Entangled Decision Forests and Their Application for Semantic Segmentation of CT Images. In: Székely, G., Hahn, H.K. (eds.) IPMI 2011. LNCS, vol. 6801, pp. 184–196. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  12. 12.
    Pauly, O., Glocker, B., Criminisi, A., Mateus, D., Möller, A.M., Nekolla, S., Navab, N.: Fast Multiple Organ Detection and Localization in Whole-Body MR Dixon Sequences. In: Fichtinger, G., Martel, A., Peters, T. (eds.) MICCAI 2011, Part III. LNCS, vol. 6893, pp. 239–247. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  13. 13.
    Seifert, S., Barbu, A., Zhou, S., Liu, D., Feulner, J., Huber, M., Suehling, M., Cavallaro, A., Comaniciu, D.: Hierarchical Parsing and Semantic Navigation of Full Body CT Data. In: SPIE Medical Imaging (2009)Google Scholar
  14. 14.
    Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moorea, R., Kipman, A., Blake, A.: Real-Time Human Pose Recognition in Parts from a Single Depth Image. In: Proc. CVPR (2011)Google Scholar
  15. 15.
    Zheng, Y., Georgescu, B., Comaniciu, D.: Marginal Space Learning for Efficient Detection of 2D/3D Anatomical Structures in Medical Images. In: Prince, J.L., Pham, D.L., Myers, K.J. (eds.) IPMI 2009. LNCS, vol. 5636, pp. 411–422. Springer, Heidelberg (2009)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • René Donner
    • 1
    • 2
  • Bjoern H. Menze
    • 3
    • 4
    • 5
  • Horst Bischof
    • 2
  • Georg Langs
    • 1
    • 3
  1. 1.Computational Image Analysis and Radiology Lab, Department of RadiologyMedical University ViennaAustria
  2. 2.Institute for Computer Graphics and VisionGraz University of TechnologyAustria
  3. 3.CSAILMITCambridgeUSA
  4. 4.Asclepios ProjectINRIA Sophia-AntipolisFrance
  5. 5.Computer Vision LaboratoryETH ZurichSwitzerland

Personalised recommendations