Multi-atlas Context Forests for Knee MR Image Segmentation

  • Qin Liu
  • Qian Wang
  • Lichi Zhang
  • Yaozong Gao
  • Dinggang Shen
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9352)


It is important, yet a challenging procedure, to segment bones and cartilages from knee MR images. In this paper, we propose multi-atlas context forests to first segment bones and then segment cartilages. Specifically, for both the bone and cartilage segmentations, we iteratively train sets of random forests, based on training atlas images, to classify the individual voxels. The random forests rely on (1) the appearance features directly computed from images and also (2) the context features associated with tentative segmentation results, generated by the previous layer of random forest in the iterative framework. To extract context features, multiple atlases (with expert segmentation) are first registered, with the tentative segmentation result of the subject under consideration. Then, the spatial priors of anatomical labels of registered atlases are computed and used to calculate context features of the subject. Note that these multi-atlas context features will be iteratively refined based on the (updated) tentative segmentation result of the subject. As better segmentation result leads to more accurate registration between multiple atlases and the subject, context features will become increasingly more useful for the training of subsequent random forests in the iterative framework. As validated by experiments on the SKI10 dataset, our proposed method can achieve high segmentation accuracy.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Mody, G.M., Brooks, P.M.: Improving Musculoskeletal Health: Global Issues. Best Practice and Research Clinical Rheumatology. 26, 237–249 (2012)CrossRefGoogle Scholar
  2. 2.
    Eckstein, F., Cicuttini, F., Raynauld, J.P., Waterton, J.C., Peterfy, C.: Magnetic Resonance Imaging (MRI) of Articular Cartilage in Knee Osteoarthritis (OA): Morphological Assessment. Osteoarthritis and Cartilage 14, 46–75 (2006)CrossRefGoogle Scholar
  3. 3.
    Heimann, T., Meinzer, H.P.: Statistical Shape Models for 3D Medical Image Segmentation: a Review. Medical Image Analysis 13, 543–563 (2009)CrossRefGoogle Scholar
  4. 4.
    Fripp, J., Crozier, S., Warfield, S.K., Ourselin, S.: Automatic Segmentation and Quantitative Analysis of the Articular Cartilages from Magnetic Resonance Images of the Knee. IEEE Transactions on Medical Imaging 29, 55–64 (2010)CrossRefGoogle Scholar
  5. 5.
    Wang, Q., Wu, D., Lu, L., Liu, M., Boyer, K.L., Zhou, S.K.: Semantic Context Forests for Learning-based Knee Cartilage Segmentation in 3D MR Images. Medical Computer Vision Large Data in Medical Imaging, pp. 105–115 (2014)CrossRefGoogle Scholar
  6. 6.
    Vincent, G., Wolstenholme, C., Scott, I., Bowes, M.: Fully Automatic Segmentation of the Knee Joint Using Active Appearance Models. Medical Image Analysis for the Clinic: A Grand Challenge, 224–230 (2010)Google Scholar
  7. 7.
    Folkesson, J., Dam, E.B., Olsen, O.F., Pettersen, P.C., Christiansen, C.: Segmenting Articular Cartilage Automatically Using a Voxel Classification Approach. IEEE Transactions on Medical Imaging, 106–115 (2007)CrossRefGoogle Scholar
  8. 8.
    Koo, S., Hargreaves, B., Andriacchi, T., Gold, G.: Automatic segmentation of articular cartilage from MRI: a multi-contrast and multi-dimensional approach. In: Proc. Intl. Soc. Mag. Reson. Med., p. 2546 (2008)Google Scholar
  9. 9.
    Breiman, L.: Random Forests. Springer (2001)Google Scholar
  10. 10.
    Wang, L., Gao, Y., Shi, F., Li, G., Gilmore, J.H., Lin, W., Shen, D.: LINKS: Learning-based Multi-source IntegratioN FrameworK for Segmentation of Infant Brain Images. Neuroimage 108, 160–172 (2015)CrossRefGoogle Scholar
  11. 11.
    Tu, Z., Bai, X.: Auto-context and Its Application to High-level Vision Tasks and 3D Brain Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 1744–1757 (2010)CrossRefGoogle Scholar
  12. 12.
    Vercauteren, T., Pennec, X., Perchant, A., Ayache, N.: Diffeomorphic Demons: Efficient Non-parametric Image Registration. NeuroImage 45, S61–S72 (2009)CrossRefGoogle Scholar
  13. 13.
    Shan, L., Zach, C., Charles, C., Niethammer, M.: Automatic Atlas-based Three-label Cartilage Segmentation from MR Images. Medical Image Analysis 18, 1233–1246 (2014)CrossRefGoogle Scholar
  14. 14.
    Heimann, T., Morrison, B.J., Styner, M.A., Niethammer, M., Warfield, S.: Segmentation of knee images: a grand challenge. In: MICCAI Workshop on Medical Image Analysis for the Clinic, pp. 207–214 (2010)Google Scholar
  15. 15.
    Zhang, K., Lu, W., Marziliano, P.: Automatic Knee Cartilage Segmentation from Multi-contrast MR Images Using Support Vector Machine Classification with Spatial Dependencies. Magnetic Resonance Imaging 31, 1731–1743 (2013)CrossRefGoogle Scholar
  16. 16.
    Jenkinson, M., Beckmann, C.F., Behrens, T.E., Woolrich, M.W., Smith, S.M.: FSL. NeuroImage 62, 782–790 (2012)CrossRefGoogle Scholar
  17. 17.
    Lee, S., Shim, H., Park, S.H., Yun, I.D., Lee, S.U.: Learning local shape and appearance for segmentation of knee cartilage in 3D MRI. In: Proceedings of the 4th Medical Image Analysis for the Clinic—A Grand Challenge Workshop (2010)Google Scholar
  18. 18.
    Shan, L., Charles, C., Niethammer, M.: Automatic atlas-based three-label cartilage segmentation from MR Knee Images. In: IEEE Workshop on Mathematical Methods in Biomedical Image Analysis, pp. 241–246 (2010)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 2.5 International License (, which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

Authors and Affiliations

  • Qin Liu
    • 1
  • Qian Wang
    • 1
  • Lichi Zhang
    • 1
  • Yaozong Gao
    • 2
    • 3
  • Dinggang Shen
    • 3
  1. 1.Med-X Research Institute, School of Biomedical EngineeringShanghai Jiao Tong UniversityShanghaiChina
  2. 2.Department of Computer ScienceUniversity of North Carolina at Chapel HillChapel HillUSA
  3. 3.Department of Radiology and BRICUniversity of North Carolina at Chapel HillChapel HillUSA

Personalised recommendations