Learning-Based Shape Model Matching: Training Accurate Models with Minimal Manual Input

  • Claudia Lindner
  • Jessie Thomson
  • The arcOGEN Consortium
  • Tim F. Cootes
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9351)


Recent work has shown that statistical model-based methods lead to accurate and robust results when applied to the segmentation of bone shapes from radiographs. To achieve good performance, model-based matching systems require large numbers of annotations, which can be very time-consuming to obtain. Non-rigid registration can be applied to unlabelled images to obtain correspondences from which models can be built. However, such models are rarely as effective as those built from careful manual annotations, and the accuracy of the registration is hard to measure. In this paper, we show that small numbers of manually annotated points can be used to guide the registration, leading to significant improvements in performance of the resulting model matching system, and achieving results close to those of a model built from dense manual annotations. Placing such sparse points manually is much less time-consuming than a full dense annotation, allowing good models to be built for new bone shapes more quickly than before. We describe detailed experiments on varying the number of sparse points, and demonstrate that manually annotating fewer than 30% of the points is sufficient to create robust and accurate models for segmenting hip and knee bones in radiographs. The proposed method includes a very effective and novel way of estimating registration accuracy in the absence of ground truth.


Random Forest regression-voting bone segmentation radiographs statistical shape models machine learning 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Baker, S., Matthews, I., Schneider, J.: Automatic construction of active appearance models as an image coding problem. IEEE TPAMI 26(10), 1380–1384 (2004)CrossRefGoogle Scholar
  2. 2.
    Chen, C., Xie, W., Franke, J., Grutzner, P., Nolte, L.P., Zheng, G.: Automatic X-ray landmark detection and shape segmentation via data-driven joint estimation of image displacements. Medical Image Analysis 18(3), 487–499 (2014)CrossRefGoogle Scholar
  3. 3.
    Cootes, T., Twining, C., Petrovic, V., Babalola, K., Taylor, C.: Computing accurate correspondences across groups of images. IEEE TPAMI 32(11), 1994–2005 (2010)CrossRefGoogle Scholar
  4. 4.
    Donner, R., Menze, B.H., Bischof, H., Langs, G.: Fast anatomical structure localization using top-down image patch regression. In: Menze, B.H., Langs, G., Lu, L., Montillo, A., Tu, Z., Criminisi, A. (eds.) MCV 2012. LNCS, vol. 7766, pp. 133–141. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  5. 5.
    Frangi, A.F., Rueckert, D., Schnabel, J.A., Niessen, W.J.: Automatic 3D ASM construction via atlas-based landmarking and volumetric elastic registration. In: Insana, M.F., Leahy, R.M. (eds.) IPMI 2001. LNCS, vol. 2082, pp. 78–91. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  6. 6.
    Langs, G., Donner, R., Peloschek, P., Bischof, H.: Robust autonomous model learning from 2D and 3D data sets. In: Ayache, N., Ourselin, S., Maeder, A. (eds.) MICCAI 2007, Part I. LNCS, vol. 4791, pp. 968–976. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  7. 7.
    Lindner, C., Bromiley, P., Ionita, M., Cootes, T.: Robust and Accurate Shape Model Matching using Random Forest Regression-Voting. IEEE TPAMI (2014).
  8. 8.
    Lindner, C., Thiagarajah, S., Wilkinson, M., The arcOGEN Consortium, Wallis, G., Cootes, T.: Fully Automatic Segmentation of the Proximal Femur Using Random Forest Regression Voting. IEEE TMI 32(8), 1462–1472 (2013)Google Scholar
  9. 9.
    Lindner, C., Thiagarajah, S., Wilkinson, J.M., arcOGEN Consortium, Wallis, G.A., Cootes, T.F.: Accurate bone segmentation in 2D radiographs using fully automatic shape model matching based on regression-voting. In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds.) MICCAI 2013, Part II. LNCS, vol. 8150, pp. 181–189. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  10. 10.
    Sotiras, A., Davatzikos, C., Paragios, N.: Deformable Medical Image Registration: A Survey. IEEE TMI 32(7), 1153–1190 (2013)Google Scholar
  11. 11.
    Zhang, P., Adeshina, S.A., Cootes, T.F.: Automatic learning sparse correspondences for initialising groupwise registration. In: Jiang, T., Navab, N., Pluim, J.P.W., Viergever, M.A. (eds.) MICCAI 2010, Part II. LNCS, vol. 6362, pp. 635–642. Springer, Heidelberg (2010)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Claudia Lindner
    • 1
  • Jessie Thomson
    • 1
  • The arcOGEN Consortium
    • 1
  • Tim F. Cootes
    • 1
  1. 1.Centre for Imaging SciencesUniversity of ManchesterManchesterU.K.

Personalised recommendations