Reliability Guided Forward and Backward Patch-Based Method for Multi-atlas Segmentation

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9467)


Label fusion is an important step in multi-atlas based segmentation. It uses label propagation from multiple atlases to predict final label. However, most of the current label fusion methods consider each voxel equally and independently during the procedure of label fusion. In general, voxels which are misclassified are at the edge of ROIs, meanwhile the voxels labeled correctly with high reliability are far from the edge of ROIs. In light of this, we propose a novel framework for multi-atlas based image segmentation by using voxels of the target image with high reliability to guide the labeling procedure of other voxels with low reliability to afford more accurate label fusion. Specifically, we first measure the corresponding labeling reliability for each voxel based on traditional label fusion result, i.e., nonlocal mean weighted voting methods. In the second step, we use the voxels with high reliability to guide the label fusion process, at the same time we consider the location relationship of different voxels. We propagate not only labels from atlases, but also labels from the neighboring voxels with high reliability on the target. Meanwhile, an alternative method is supplied, we utilize the backward nonlocal mean patch-based method for reliability estimation. We compare our method with nonlocal mean patch-based method. In experiments, we apply all methods in the NIREP dataset to 32 regions of interest segmentation. Experimental results show our method can improve the performance of the nonlocal mean patch-based method.


Patch-based Methods (PBM) Multi-atlas Segmentation Label Fusion Reliable Labeling Target Image 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



We thank the reviewers for their helpful comments. This study was supported by the National Natural Science Foundation of China (61422204; 61473149); Jiangsu Natural Science Foundation for Young Scholar (BK20130034).


  1. 1.
    Heckemann, R.A., Hajnal, J.V., Aljabar, P., et al.: Automatic anatomical brain MRI segmentation combining label propagation and decision fusion. NeuroImage 33(1), 115–126 (2006)CrossRefGoogle Scholar
  2. 2.
    Artaechevarria, X., Munoz-Barrutia, A., Ortiz-de-Solorzano, C.: Combination strategies in multi-atlas image segmentation: application to brain MR data. IEEE Trans. Med. Imag. 28(8), 1266–1277 (2009)CrossRefGoogle Scholar
  3. 3.
    Coupe, P., Manjon, J.V., Fonov, V., Pruessner, J.: Patch-based segmentation using expert priors: application to hippocampus and ventricle segmentation. Neuroimage 54, 940–954 (2011)CrossRefGoogle Scholar
  4. 4.
    Rousseau, F., Habas, P.A., Studholme, C.A.: Supervised patch-based approach for human brain labeling. IEEE Trans. Med. Imag. 30(10), 1852–1862 (2011)CrossRefGoogle Scholar
  5. 5.
    Zhang, D., Wu, G., Guo, Q., Shen, D.: Sparse patch-based label fusion for multi-atlas segmentation. In: Yap, P.-T., Liu, T., Shen, D., Westin, C.-F., Shen, L. (eds.) MBIA 2012. LNCS, vol. 7509, pp. 94–102. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  6. 6.
    Tong, T., Wolz, R., Hajnal, J.V., et al.: Segmentation of brain MR images via sparse patch representation. In: MICCAI Workshop on Sparsity Techniques in Medical Imaging (2012)Google Scholar
  7. 7.
    Lotjonen, J.M.P., Wolz, R., Koikkalainen, J.R., et al.: Fast and robust multi-atlas segmentation of brain magnetic resonance images. Neuroimage 49(3), 2352–2365 (2010)CrossRefGoogle Scholar
  8. 8.
    Aljabar, P., Heckemann, R.A., Hammers, A., et al.: Multi-atlas based segmentation of brain images: atlas selection and its effect on accuracy. Neuroimage 46(3), 726–738 (2009)CrossRefGoogle Scholar
  9. 9.
    Sanroma, G., Wu, G., Gao, Y., Shen, D.: Learning to rank atlases for multiple-atlas segmentation. IEEE Trans. Med. Imag. 33(11), 2210 (2014)CrossRefGoogle Scholar
  10. 10.
    Wu, G., Wang, Q., Zhang, D., et al.: A generative probability model of joint label fusion for multi-atlas based brain segmentation. Med. Image Anal. 18(6), 881–890 (2014)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Wu, G., Kim, M., Sanroma, G., et al.: Hierarchical multi-atlas label fusion with multi-scale feature representation and label-specific patch partition. NeuroImage 106, 34–46 (2015)CrossRefGoogle Scholar
  12. 12.
    Tong, T., Wolz, R., Coupe, P., et al.: Segmentation of MR images via discriminative dictionary learning and sparse coding: Application to hippocampus labeling. NeuroImage 76(1), 11–23 (2013)CrossRefGoogle Scholar
  13. 13.
    Wang, H., Suh, J.W., Das, S.R., et al.: Multi-atlas segmentation with joint label fusion. Trans. Pattern Anal. Mach. Intell. 35(3), 611–623 (2013)CrossRefGoogle Scholar
  14. 14.
    Langerak, T.R., van der Heide, U.A., Kotte, A.N., Viergever, M.A., van Vulpen, M., Pluim, J.P.: Label fusion in atlas-based segmentation using a selective and iterative method for performance level estimation (SIMPLE). IEEE Trans. Med. Imag. 29, 2000–2008 (2010)CrossRefGoogle Scholar
  15. 15.
    Shen, D., Wu, G., Jia, H., Zhang, D.: Confidence-guided sequential label fusion for multi-atlas based segmentation. In: Fichtinger, G., Martel, A., Peters, T. (eds.) MICCAI 2011, Part III. LNCS, vol. 6893, pp. 643–650. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  16. 16.
    Grabowski, T.J., Bruss, J., Pirwani, I.A., Damasio, H., Vannier, M.W., Allen, J.S., Christensen, G.E., Kuhl, J.G., Geng, X.: Introduction to the non-rigid image registration evaluation project (NIREP). In: Pluim, J.P., Likar, B., Gerritsen, F.A. (eds.) WBIR 2006. LNCS, vol. 4057, pp. 128–135. Springer, Heidelberg (2006)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringNanjing University of Aeronautics and AstronauticsNanjingChina

Personalised recommendations