Skip to main content

Context-Aware Anatomical Landmark Detection: Application to Deformable Model Initialization in Prostate CT Images

  • Conference paper
Machine Learning in Medical Imaging (MLMI 2014)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 8679))

Included in the following conference series:


Anatomical landmark detection plays an important role in medical image analysis, e.g., for landmark-guided image registration, and deformable model initialization. Among various existing methods, regression-based landmark detection method has recently drawn much attention due to its robustness and efficiency. In this method, a regression model is often trained for each landmark to predict the location of this landmark from any image voxel based on local patch appearance, e.g., also the 3D displacement vector from any image voxel to this landmark. During the application stage, the predicted displacement vectors from all image voxels form a displacement field, which is then utilized for final landmark detection with a regression voting process. Accordingly, the quality of predicted displacement field largely determines the accuracy of final landmark detection. However, the displacement fields predicted by previous methods are often spatially inconsistent 1) within each displacement field of same landmark and 2) also across the displacement fields of all different landmarks, thus limiting the final landmark detection accuracy. The main reason is that for each landmark, the 3D displacement of each image voxel is predicted independently, and also for all different landmarks their displacement fields are estimated independently. To address these issues, we propose a two-layer regression model for context-aware landmark detection. Specifically, the first layer is designed to separately provide the initial displacement fields for different landmarks, and the second layer is designed to refine them jointly by using the context features extracted from results of the first layer to impose spatial consistency 1) within the displacement field of each landmark and 2) across the displacement fields of all different landmarks. Experimental results on a CT prostate dataset show that our proposed method significantly outperforms the traditional classification-based and regression-based methods in both landmark detection and deformable model initialization.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others


  1. Johnson, H.J., Christensen, G.E.: Consistent landmark and intensity-based image registration. IEEE TMI 21(5), 450–461 (2002)

    Google Scholar 

  2. Zhang, S., Zhan, Y., Dewan, M., et al.: Towards robust and effective shape modeling: Sparse shape composition. Med. Imag. Anal. 16(1), 265–277 (2012)

    Article  Google Scholar 

  3. Zheng, Y., Barbu, A., Georgescu, B., Scheuering, M., Comaniciu, D.: Four-Chamber Heart Modeling and Automatic Segmentation for 3-D Cardiac CT Volumes Using Marginal Space Learning and Steerable Features. IEEE TMI 27(11), 1668–1681 (2008)

    Google Scholar 

  4. Viola, P., Jones, M.J.: Robust Real-Time Face Detection. IJCV 57(2), 137–154 (2004)

    Article  Google Scholar 

  5. Cheng, E., Chen, J., Yang, J., et al.: Automatic Dent-landmark detection in 3-D CBCT dental volumes. In: EMBC 2011, pp. 6204–6207 (2011)

    Google Scholar 

  6. Zhan, Y., et al.: Robust Automatic Knee MR Slice Positioning Through Redundant and Hierarchical Anatomy Detection. IEEE TMI 30(12), 2087–2100 (2011)

    Google Scholar 

  7. Criminisi, A., Shotton, J., Robertson, D., Konukoglu, E.: Regression Forests for Efficient Anatomy Detection and Localization in CT Studies. In: Menze, B., Langs, G., Tu, Z., Criminisi, A. (eds.) MICCAI 2010. LNCS, vol. 6533, pp. 106–117. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  8. Cootes, T.F., Ionita, M.C., Lindner, C., Sauer, P.: Robust and Accurate Shape Model Fitting Using Random Forest Regression Voting. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VII. LNCS, vol. 7578, pp. 278–291. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  9. Tu, Z., Bai, X.: Auto-Context and Its Application to High-Level Vision Tasks and 3D Brain Image Segmentation. IEEE PAMI 32(10), 1744–1757 (2010)

    Article  Google Scholar 

  10. Coup, P., et al.: Patch-based segmentation using expert priors: Application to hippocampus and ventricle segmentation. NeuroImage 54(2), 940–954 (2010)

    Article  Google Scholar 

  11. Rousson, M., Khamene, A., Diallo, M., Celi, J.C., Sauer, F.: Constrained Surface Evolutions for Prostate and Bladder Segmentation in CT Images. In: Liu, Y., Jiang, T.-Z., Zhang, C. (eds.) CVBIA 2005. LNCS, vol. 3765, pp. 251–260. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  12. Lay, N., Birkbeck, N., Zhang, J., Zhou, S.K.: Rapid Multi-organ Segmentation Using Context Integration and Discriminative Models. In: Gee, J.C., Joshi, S., Pohl, K.M., Wells, W.M., Zöllei, L. (eds.) IPMI 2013. LNCS, vol. 7917, pp. 450–462. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  13. Lu, C., Zheng, Y., Birkbeck, N., Zhang, J., Kohlberger, T., Tietjen, C., Boettger, T., Duncan, J.S., Zhou, S.K.: Precise Segmentation of Multiple Organs in CT Volumes Using Learning-Based Approach and Information Theory. In: Ayache, N., Delingette, H., Golland, P., Mori, K. (eds.) MICCAI 2012, Part II. LNCS, vol. 7511, pp. 462–469. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations


Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Gao, Y., Shen, D. (2014). Context-Aware Anatomical Landmark Detection: Application to Deformable Model Initialization in Prostate CT Images. In: Wu, G., Zhang, D., Zhou, L. (eds) Machine Learning in Medical Imaging. MLMI 2014. Lecture Notes in Computer Science, vol 8679. Springer, Cham.

Download citation

  • DOI:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-10580-2

  • Online ISBN: 978-3-319-10581-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics