ShapeForest: Building Constrained Statistical Shape Models with Decision Trees

  • Saša Grbić
  • Joshua K. Y. Swee
  • Razvan Ionasec
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8691)


Constrained local models (CLM) are frequently used to locate points on deformable objects. They usually consist of feature response images, defining the local update of object points and a shape prior used to regularize the final shape. Due to the complex shape variation within an object class this is a challenging problem. However in many segmentation tasks a simpler object representation is available in form of sparse landmarks which can be reliably detected from images. In this work we propose ShapeForest, a novel shape representation which is able to model complex shape variation, preserves local shape information and incorporates prior knowledge during shape space inference. Based on a sparse landmark representation associated with each shape the ShapeForest, trained using decision trees and geometric features, selects a subset of relevant shapes to construct an instance specific parametric shape model. Hereby the ShapeForest learns the association between the geometric features and shape variability. During testing, based on the estimated sparse landmark representation a constrained shape space is constructed and used for shape initialization and regularization during the iterative shape refinement within the CLM framework. We demonstrate the effectiveness of our approach on a set of medical segmentation problems where our database contains complex morphological and pathological variations of several anatomical structures.


Shape Model Shape Space Active Contour Model Reconstruction Accuracy Active Appearance Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Breiman, L.: Random forests. Machine Learning 45(1), 5–32 (2001)CrossRefzbMATHGoogle Scholar
  2. 2.
    Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models-their training and application. Computer Vision and Image Understanding 61(1), 38–59 (1995)CrossRefGoogle Scholar
  3. 3.
    Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(6), 681–685 (2001)CrossRefGoogle Scholar
  4. 4.
    Cootes, T.F., Taylor, C.J.: A mixture model for representing shape variation. Image and Vision Computing 17(8), 567–573 (1999)CrossRefGoogle Scholar
  5. 5.
    Criminisi, A., Robertson, D., Konukoglu, E., Shotton, J., Pathak, S., White, S., Siddiqui, K.: Regression forests for efficient anatomy detection and localization in computed tomography scans. Medical Image Analysis (2013)Google Scholar
  6. 6.
    Cristinacce, D., Cootes, T.: Automatic feature localisation with constrained local models. Pattern Recognition 41(10), 3054–3067 (2008)CrossRefzbMATHGoogle Scholar
  7. 7.
    Davatzikos, C., Tao, X., Shen, D.: Hierarchical active shape models, using the wavelet transform. IEEE Transactions on Medical Imaging 22(3), 414–423 (2003)CrossRefGoogle Scholar
  8. 8.
    Etyngier, P., Segonne, F., Keriven, R.: Shape priors using manifold learning techniques. In: IEEE 11th International Conference on Computer Vision, ICCV 2007, pp. 1–8. IEEE (2007)Google Scholar
  9. 9.
    Felzenszwalb, P.F., Huttenlocher, D.P.: Pictorial structures for object recognition. International Journal of Computer Vision 61(1), 55–79 (2005)CrossRefGoogle Scholar
  10. 10.
    Gall, J., Lempitsky, V.: Class-specific hough forests for object detection. In: Decision Forests for Computer Vision and Medical Image Analysis, pp. 143–157. Springer (2013)Google Scholar
  11. 11.
    Georgescu, B., Zhou, X.S., Comaniciu, D., Gupta, A.: Database-guided segmentation of anatomical structures with complex appearance. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 2, pp. 429–436. IEEE (2005)Google Scholar
  12. 12.
    Grbic, S., Ionasec, R., Vitanovski, D., Voigt, I., Wang, Y., Georgescu, B., Comaniciu, D.: Complete valvular heart apparatus model from 4d cardiac ct. Medical Image Analysis 16(5), 1003–1014 (2012)CrossRefGoogle Scholar
  13. 13.
    Kass, M., Witkin, A., Terzopoulos, D.: Snakes: Active contour models. International Journal of Computer Vision 1(4), 321–331 (1988)CrossRefGoogle Scholar
  14. 14.
    Rodola, E., Bulo, S.R., Windheuser, T., Vestner, M., Cremers, D.: Dense non-rigid shape correspondence using random forests (2014)Google Scholar
  15. 15.
    Saragih, J., Goecke, R.: A nonlinear discriminative approach to aam fitting. In: IEEE 11th International Conference on Computer Vision, ICCV 2007, pp. 1–8. IEEE (2007)Google Scholar
  16. 16.
    Saragih, J.M., Lucey, S., Cohn, J.F.: Deformable model fitting with a mixture of local experts. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 2248–2255. IEEE (2009)Google Scholar
  17. 17.
    Sjostrand, K., Rostrup, E., Ryberg, C., Larsen, R., Studholme, C., Baezner, H., Ferro, J., Fazekas, F., Pantoni, L., Inzitari, D., et al.: Sparse decomposition and modeling of anatomical shape variation. IEEE Transactions on Medical Imaging 26(12), 1625–1635 (2007)CrossRefGoogle Scholar
  18. 18.
    Yang, L., Georgescu, B., Zheng, Y., Meer, P., Comaniciu, D.: 3d ultrasound tracking of the left ventricle using one-step forward prediction and data fusion of collaborative trackers. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–8. IEEE (2008)Google Scholar
  19. 19.
    Zhang, S., Zhan, Y., Dewan, M., Huang, J., Metaxas, D.N., Zhou, X.S.: Sparse shape composition: A new framework for shape prior modeling. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1025–1032. IEEE (2011)Google Scholar
  20. 20.
    Zheng, Y., Georgescu, B., Ling, H., Zhou, S.K., Scheuering, M., Comaniciu, D.: Constrained marginal space learning for efficient 3d anatomical structure detection in medical images. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 194–201. IEEE (2009)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Saša Grbić
    • 1
  • Joshua K. Y. Swee
    • 1
  • Razvan Ionasec
    • 1
  1. 1.Corporate TechnologySiemens CorporationPrincetonUSA

Personalised recommendations