A Hybrid Framework for Image Segmentation Using Probabilistic Integration of Heterogeneous Constraints

  • Rui Huang
  • Vladimir Pavlovic
  • Dimitris N. Metaxas
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3765)


In this paper we present a new framework for image segmentation using probabilistic multinets. We apply this framework to integration of region-based and contour-based segmentation constraints. A graphical model is constructed to represent the relationship of the observed image pixels, the region labels and the underlying object contour. We then formulate the problem of image segmentation as the one of joint region-contour inference and learning in the graphical model. The joint inference problem is solved approximately in a band area around the estimated contour. Parameters of the model are learned on-line. The fully probabilistic nature of the model allows us to study the utility of different inference methods and schedules. Experimental results show that our new hybrid method outperforms methods that use homogeneous constraints.


Image Segmentation Inference Method Deformable Model Active Contour Model Region Label 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Geman, S., Geman, D.: Stochastic Relaxation, Gibbs Distributions and the Bayesian Restoration of Images. In: IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 6(6) (1984)Google Scholar
  2. 2.
    Besag, J.E.: On the Statistical Analysis of Dirty Pictures. Journal of the Royal Statistical Society B 48(3) (1986)Google Scholar
  3. 3.
    Marroquin, J., Mitter, S., Poggio, T.: Probabilistic Solution of Ill-posed Problems in Computational Vision. Journal of American Statistical Association 82(397) (1987)Google Scholar
  4. 4.
    Freeman, W.T., Pasztor, E.C., Carmichael, O.T.: Learning Low-Level Vision. International Journal of Computer Vision 40(1) (2000)Google Scholar
  5. 5.
    Boykov, Y.Y., Jolly, M.P.: Interactive Graph Cuts for Optimal Boundary & Region Segmentation of Objects in N-D Images. In: Proceedings of ICCV (2001)Google Scholar
  6. 6.
    Kass, M., Witkin, A., Terzopoulos, D.: Snakes: Active contour models. International Journal of Computer Vision 1(4) (1987)Google Scholar
  7. 7.
    Cohen, L.D.: On Active Contour Models and Balloons. Computer Vision, Graphics, and Image Processing: Image Understanding 53(2) (1991)Google Scholar
  8. 8.
    McInerney, T., Terzopoulos, D.: Topologically Adaptable Snakes. In: Proceedings of ICCV (1995)Google Scholar
  9. 9.
    Xu, C., Prince, J.L.: Gradient Vector Flow: A New External Force for Snakes. In: Proceedings of CVPR (1997)Google Scholar
  10. 10.
    Geiger, D., Heckerman, D.: Knowledge representation and inference in similarity networks and Bayesian multinets. Artificial Intelligence 82, 45–74 (1996)CrossRefMathSciNetGoogle Scholar
  11. 11.
    Zhang, Y., Brady, M., Smith, S.: Segmentation of Brain MR Images Through a Hidden Markov Random Field Model and the Expectation-Maximization Algorithm. IEEE Transaction on Medical Imaging 20(1) (2001)Google Scholar
  12. 12.
    Grenander, U., Miller, M.: Representations of Knowledge in Complex Systems. Journal of the Royal Statistical Society B 56(4) (1994)Google Scholar
  13. 13.
    Zhu, S.C., Yuille, A.L.: Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation. IEEE Transaction on Pattern Analysis and Machine Intelligence 18(9) (1996)Google Scholar
  14. 14.
    Chen, T., Metaxas, D.N.: Image Segmentation Based on the Integration of Markov Random Fields and Deformable Models. In: Delp, S.L., DiGoia, A.M., Jaramaz, B. (eds.) MICCAI 2000. LNCS, vol. 1935, pp. 256–265. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  15. 15.
    Huang, R., Pavlovic, V., Metaxas, D.N.: A Graphical Model Framework for Coupling MRFs and Deformable Models. In: Proceedings of CVPR (2004)Google Scholar
  16. 16.
    Chen, Y., Rui, Y., Huang, T.S.: JPDAF Based HMM for Real-Time Contour Tracking. In: Proceedings of CVPR (2001)Google Scholar
  17. 17.
    Pearl, J.: Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann Publishers, San Francisco (1988)Google Scholar
  18. 18.
    Weiss, Y.: Belief Propagation and Revision in Networks with Loops. Technical Report MIT A.I. Memo 1616 (1998)Google Scholar
  19. 19.
    Kschischang, F.R., Frey, B.J., Loeliger, H.-A.: Factor Graphs and the Sum-Product Algorithm. IEEE Transactions on Information Theory 47(2) (2001)Google Scholar
  20. 20.
    Yedidia, J.S., Freeman, W.T., Weiss, Y.: Understanding Belief Propagation and Its Generalizations. In: IJCAI 2001 Distinguished Lecture track (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Rui Huang
    • 1
  • Vladimir Pavlovic
    • 1
  • Dimitris N. Metaxas
    • 1
  1. 1.Deptartment of Computer ScienceRutgers UniversityPiscatawayUSA

Personalised recommendations