Skip to main content

Multi-atlas Context Forests for Knee MR Image Segmentation

  • Conference paper
  • First Online:
Machine Learning in Medical Imaging (MLMI 2015)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 9352))

Included in the following conference series:


It is important, yet a challenging procedure, to segment bones and cartilages from knee MR images. In this paper, we propose multi-atlas context forests to first segment bones and then segment cartilages. Specifically, for both the bone and cartilage segmentations, we iteratively train sets of random forests, based on training atlas images, to classify the individual voxels. The random forests rely on (1) the appearance features directly computed from images and also (2) the context features associated with tentative segmentation results, generated by the previous layer of random forest in the iterative framework. To extract context features, multiple atlases (with expert segmentation) are first registered, with the tentative segmentation result of the subject under consideration. Then, the spatial priors of anatomical labels of registered atlases are computed and used to calculate context features of the subject. Note that these multi-atlas context features will be iteratively refined based on the (updated) tentative segmentation result of the subject. As better segmentation result leads to more accurate registration between multiple atlases and the subject, context features will become increasingly more useful for the training of subsequent random forests in the iterative framework. As validated by experiments on the SKI10 dataset, our proposed method can achieve high segmentation accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others


  1. Mody, G.M., Brooks, P.M.: Improving Musculoskeletal Health: Global Issues. Best Practice and Research Clinical Rheumatology. 26, 237–249 (2012)

    Article  Google Scholar 

  2. Eckstein, F., Cicuttini, F., Raynauld, J.P., Waterton, J.C., Peterfy, C.: Magnetic Resonance Imaging (MRI) of Articular Cartilage in Knee Osteoarthritis (OA): Morphological Assessment. Osteoarthritis and Cartilage 14, 46–75 (2006)

    Article  Google Scholar 

  3. Heimann, T., Meinzer, H.P.: Statistical Shape Models for 3D Medical Image Segmentation: a Review. Medical Image Analysis 13, 543–563 (2009)

    Article  Google Scholar 

  4. Fripp, J., Crozier, S., Warfield, S.K., Ourselin, S.: Automatic Segmentation and Quantitative Analysis of the Articular Cartilages from Magnetic Resonance Images of the Knee. IEEE Transactions on Medical Imaging 29, 55–64 (2010)

    Article  Google Scholar 

  5. Wang, Q., Wu, D., Lu, L., Liu, M., Boyer, K.L., Zhou, S.K.: Semantic Context Forests for Learning-based Knee Cartilage Segmentation in 3D MR Images. Medical Computer Vision Large Data in Medical Imaging, pp. 105–115 (2014)

    Google Scholar 

  6. Vincent, G., Wolstenholme, C., Scott, I., Bowes, M.: Fully Automatic Segmentation of the Knee Joint Using Active Appearance Models. Medical Image Analysis for the Clinic: A Grand Challenge, 224–230 (2010)

    Google Scholar 

  7. Folkesson, J., Dam, E.B., Olsen, O.F., Pettersen, P.C., Christiansen, C.: Segmenting Articular Cartilage Automatically Using a Voxel Classification Approach. IEEE Transactions on Medical Imaging, 106–115 (2007)

    Google Scholar 

  8. Koo, S., Hargreaves, B., Andriacchi, T., Gold, G.: Automatic segmentation of articular cartilage from MRI: a multi-contrast and multi-dimensional approach. In: Proc. Intl. Soc. Mag. Reson. Med., p. 2546 (2008)

    Google Scholar 

  9. Breiman, L.: Random Forests. Springer (2001)

    Google Scholar 

  10. Wang, L., Gao, Y., Shi, F., Li, G., Gilmore, J.H., Lin, W., Shen, D.: LINKS: Learning-based Multi-source IntegratioN FrameworK for Segmentation of Infant Brain Images. Neuroimage 108, 160–172 (2015)

    Article  Google Scholar 

  11. Tu, Z., Bai, X.: Auto-context and Its Application to High-level Vision Tasks and 3D Brain Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 1744–1757 (2010)

    Article  Google Scholar 

  12. Vercauteren, T., Pennec, X., Perchant, A., Ayache, N.: Diffeomorphic Demons: Efficient Non-parametric Image Registration. NeuroImage 45, S61–S72 (2009)

    Article  Google Scholar 

  13. Shan, L., Zach, C., Charles, C., Niethammer, M.: Automatic Atlas-based Three-label Cartilage Segmentation from MR Images. Medical Image Analysis 18, 1233–1246 (2014)

    Article  Google Scholar 

  14. Heimann, T., Morrison, B.J., Styner, M.A., Niethammer, M., Warfield, S.: Segmentation of knee images: a grand challenge. In: MICCAI Workshop on Medical Image Analysis for the Clinic, pp. 207–214 (2010)

    Google Scholar 

  15. Zhang, K., Lu, W., Marziliano, P.: Automatic Knee Cartilage Segmentation from Multi-contrast MR Images Using Support Vector Machine Classification with Spatial Dependencies. Magnetic Resonance Imaging 31, 1731–1743 (2013)

    Article  Google Scholar 

  16. Jenkinson, M., Beckmann, C.F., Behrens, T.E., Woolrich, M.W., Smith, S.M.: FSL. NeuroImage 62, 782–790 (2012)

    Article  Google Scholar 

  17. Lee, S., Shim, H., Park, S.H., Yun, I.D., Lee, S.U.: Learning local shape and appearance for segmentation of knee cartilage in 3D MRI. In: Proceedings of the 4th Medical Image Analysis for the Clinic—A Grand Challenge Workshop (2010)

    Google Scholar 

  18. Shan, L., Charles, C., Niethammer, M.: Automatic atlas-based three-label cartilage segmentation from MR Knee Images. In: IEEE Workshop on Mathematical Methods in Biomedical Image Analysis, pp. 241–246 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations


Corresponding author

Correspondence to Dinggang Shen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Liu, Q., Wang, Q., Zhang, L., Gao, Y., Shen, D. (2015). Multi-atlas Context Forests for Knee MR Image Segmentation. In: Zhou, L., Wang, L., Wang, Q., Shi, Y. (eds) Machine Learning in Medical Imaging. MLMI 2015. Lecture Notes in Computer Science(), vol 9352. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-24887-5

  • Online ISBN: 978-3-319-24888-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics