Joint Co-segmentation and Registration of 3D Ultrasound Images

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7917)


Contrast-enhanced ultrasound (CEUS) allows a visualization of the vascularization and complements the anatomical information provided by conventional ultrasound (US). However, these images are inherently subject to noise and shadows, which hinders standard segmentation algorithms. In this paper, we propose to use simultaneously the different information coming from 3D US and CEUS images to address the problem of kidney segmentation. To that end, we introduce a generic framework for joint co-segmentation and registration that seeks objects having the same shape in several images. From this framework, we derive both an ellipsoid co-detection and a model-based co-segmentation algorithm. These methods rely on voxel-classification maps that we estimate using random forests in a structured way. This yields a fast and fully automated pipeline, in which an ellipsoid is first estimated to locate the kidney in both US and CEUS volumes and then deformed to segment it accurately. The proposed method outperforms state-of-the-art results (by dividing the kidney volume error by two) on a clinically representative database of 64 images.


co-segmentation registration kidney random forests ultrasound contrast-enhanced ultrasound 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Albrecht, T., et al.: Guidelines for the use of contrast agents in ultrasound. Ultraschall Med. 25(4), 249–256 (2004)CrossRefGoogle Scholar
  2. 2.
    Breiman, L.: Random forests. Machine Learning 45(1), 5–32 (2001)zbMATHCrossRefGoogle Scholar
  3. 3.
    Chan, T.F., Vese, L.A.: Active contours without edges. IEEE TIP 10(2), 266–277 (2001)zbMATHGoogle Scholar
  4. 4.
    Glocker, B., Pauly, O., Konukoglu, E., Criminisi, A.: Joint classification-regression forests for spatially structured multi-object segmentation. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part IV. LNCS, vol. 7575, pp. 870–881. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  5. 5.
    Han, D., Bayouth, J., Song, Q., Taurani, A., Sonka, M., Buatti, J., Wu, X.: Globally optimal tumor segmentation in PET-CT images: A graph-based co-segmentation method. In: Székely, G., Hahn, H.K. (eds.) IPMI 2011. LNCS, vol. 6801, pp. 245–256. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  6. 6.
    Kontschieder, P., Bulò, S.R., Criminisi, A., Kohli, P., Pelillo, M., Bischof, H.: Context-sensitive decision forests for object detection. In: Proceedings of NIPS, pp. 440–448 (2012)Google Scholar
  7. 7.
    Lu, C., Duncan, J.S.: A coupled segmentation and registration framework for medical image analysis using robust point matching and active shape model. In: IEEE Workshop on MMBIA, pp. 129–136 (2012)Google Scholar
  8. 8.
    Martin-Fernandez, M., Alberola-Lopez, C.: An approach for contour detection of human kidneys from ultrasound images using Markov random fields and active contours. MedIA 9(1), 1–23 (2005)Google Scholar
  9. 9.
    Montillo, A., Shotton, J., Winn, J., Iglesias, J.E., Metaxas, D., Criminisi, A.: Entangled decision forests and their application for semantic segmentation of CT images. In: Székely, G., Hahn, H.K. (eds.) IPMI 2011. LNCS, vol. 6801, pp. 184–196. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  10. 10.
    Mory, B., Somphone, O., Prevost, R., Ardon, R.: Real-time 3D image segmentation by user-constrained template deformation. In: Ayache, N., Delingette, H., Golland, P., Mori, K. (eds.) MICCAI 2012, Part I. LNCS, vol. 7510, pp. 561–568. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  11. 11.
    Payet, N., Todorovic, S.: 2-Random Forest Random Field. In: Proceedings of NIPS 2010 (2010)Google Scholar
  12. 12.
    Pohl, K.M., Fisher, J., Grimson, W.E.L., Kikinis, R., Wells, W.M.: A Bayesian model for joint segmentation and registration. NeuroImage 31(1), 228–239 (2006)CrossRefGoogle Scholar
  13. 13.
    Prevost, R., Mory, B., Correas, J.-M., Cohen, L.D., Ardon, R.: Kidney detection and real-time segmentation in 3D contrast-enhanced ultrasound images. In: Proceedings of IEEE ISBI, pp. 1559–1562 (2012)Google Scholar
  14. 14.
    Saddi, K., Chefd’hotel, C., Rousson, M., Cheriet, F.: Region-based segmentation via non-rigid template matching. In: Proceedings of ICCV, pp. 1–7 (2007)Google Scholar
  15. 15.
    Tu, Z., Bai, X.: Auto-context and its application to high-level vision tasks and 3D brain image segmentation. IEEE TPAMI 32(10), 1744–1757 (2010)CrossRefGoogle Scholar
  16. 16.
    Vicente, S., Kolmogorov, V., Rother, C.: Cosegmentation revisited: Models and optimization. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part II. LNCS, vol. 6312, pp. 465–479. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  17. 17.
    Wang, F., Vemuri, B.C.: Simultaneous registration and segmentation of anatomical structures from brain MRI. In: Duncan, J.S., Gerig, G. (eds.) MICCAI 2005. LNCS, vol. 3749, pp. 17–25. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  18. 18.
    Wyatt, P.P., Noble, J.A.: MAP MRF joint segmentation and registration. In: Dohi, T., Kikinis, R. (eds.) MICCAI 2002, Part I. LNCS, vol. 2488, pp. 580–587. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  19. 19.
    Yezzi, A., Zöllei, L., Kapur, T.: A variational framework for integrating segmentation and registration through active contours. MedIA 7(2), 171–185 (2003)Google Scholar
  20. 20.
    Zikic, D., Glocker, B., Konukoglu, E., Criminisi, A., Demiralp, C., Shotton, J., Thomas, O.M., Das, T., Jena, R., Price, S.J.: Decision Forests for Tissue-Specific Segmentation of High-Grade Gliomas in Multi-channel MR. In: Ayache, N., Delingette, H., Golland, P., Mori, K. (eds.) MICCAI 2012, Part III. LNCS, vol. 7512, pp. 369–376. Springer, Heidelberg (2012)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  1. 1.Philips Research MedisysSuresnesFrance
  2. 2.CEREMADE UMR 7534Universite Paris DauphineParisFrance
  3. 3.Adult Radiology DepartmentNecker HospitalParisFrance

Personalised recommendations