Skip to main content

Energy Partitions and Image Segmentation

Abstract

We address the issue of low-level segmentation for real-valued images. The proposed approach relies on the formulation of the problem in terms of an energy partition of the image domain. In this framework, an energy is defined by measuring a pseudo-metric distance to a source point. Thus, the choice of an energy and a set of sources determines a tessellation of the domain. Each energy acts on the image at a different level of analysis; through the study of two types of energies, two stages of the segmentation process are addressed. The first energy considered, the path variation, belongs to the class of energies determined by minimal paths. Its application as a pre-segmentation method is proposed. In the second part, where the energy is induced by a ultrametric, the construction of hierarchical representations of the image is discussed.

This is a preview of subscription content, access via your institution.

References

  1. P.A. Arbeláez and L.D. Cohen, “The extrema edges,” in Proc. Scale-Space'03.Skye, UK, 2003, pp. 180–195.

  2. P.A. Arbeláez and L.D. Cohen, “Path variation and image segmentation,” in Proc. EMMCVPR'03, Lisbon, Protugal, 2003, pp. 246–260.

  3. F. Aurenhammer and R. Klein, Handbook of Computational Geometry, Chapt. 5: Voronoi Diagrams, Elsevier Science Publishing, 2000, pp. 201–290.

  4. J. Beaulieu and M. Goldberg, “Hierarchy in picture segmen-tation: A stepwise optimization approach,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 11, No. 2, pp. 150–163, 1989.

    Google Scholar 

  5. J.P. Benzécri, L'Analyse des Données. Tome I: La Taxinomie, 4th edition, Dunod: Paris, 1984.

    Google Scholar 

  6. S. Beucher and F. Meyer, Mathematical Morphology in Image Processing, Chapt. 12: The Morphological Approach to Segmentation: The Watershed Transformation, Marcel Dekker, 1992, pp. 433–481.

  7. C.R. Brice and C.L. Fenema, “Scene analysis using regions,” Artificial Intelligence, Vol. 1, pp. 205–226, 1970.

    Google Scholar 

  8. L.D. Cohen and R. Kimmel, “Global minimum for active contour models: A minimal path approach,” International Journal of Computer Vision, Vol. 24, No. 1, pp. 57–78, 1997.

    Google Scholar 

  9. L.D. Cohen, L. Vinet, P. Sander, and A. Gagalowicz, “Hierar-chical region based stereo matching,” in Proc. IEEE Conference on Computer Vision and Pattern Recognition, 1989.

  10. L.D. Cohen, “Multiple contour finding and perceptual grouping using minimal paths,” Journal of Mathematical Imaging and Vision, Vol. 14, No. 3, pp. 225–236, 2001.

    Google Scholar 

  11. T. Deschamps and L.D. Cohen, “Fast extraction of minimal paths in 3D images and applications to virtual endoscopy,” Medical Image Analysis, Vol. 5, No. 4, pp. 281–299, 2001.

    Google Scholar 

  12. E.W. Dijkstra, “A Note on two problems in connection with graphs,” Numerische Mathemetic, Vol. 1, pp. 269–271, 1959.

    Google Scholar 

  13. L. Garrido, P. Salembier, and D. Garcia, “Extensive operators in partition lattices for image sequence analysis,” Signal Process-ing, Vol. 66, No. 2, pp. 157–180, 1998. Special Issue on Video Sequence Segmentation.

    Google Scholar 

  14. M. Grimaud, “New measure of contrast: Dynamics,” in Image Algebra and Morphological Processing III, San Diego, USA, 1992.

  15. M. Gromov, Metric Structures for Riemannian and Non-Riemannian Spaces, Birkhauser: Boston, 1999.

    Google Scholar 

  16. E. Hewitt and K. Stromberg, Real and Abstract Analysis, Springer Verlag, 1969.

  17. S.L. Horowitz and T. Pavlidis, “Picture segmentation by a directed split-and-merge procedure,” in Proceedings of the Second International Joint Conference on Pattern Recognition, 1974, pp. 424–433.

  18. C. Jordan, “Sur la Série de Fourier,” Comptes Rendus de l'Académie des Sciences. Série Mathématique., Vol. 92, No. 5, pp. 228–230, 1881.

    Google Scholar 

  19. J. L. Kelley, General Topology, Springer, 1975.

  20. R. Kimmel and A.M. Bruckstein, “Global shape from shad-ing,” Computer Vision and Image Understanding, Vol. 62, No. 3, pp. 360–369, 1995.

    Google Scholar 

  21. R. Kimmel, N. Kiryati, and A.M. Bruckstein, “Distance maps and weighted distance transforms,” Journal of Mathematical Imaging and Vision, Vol. 6, pp. 223–233, 1996. Special Issue on Topology and Geometry in Computer Vision.

    Google Scholar 

  22. G. Koepfler, C. Lopez, and J.M. Morel, “A multiscale algorithm for image segmentation by variational method,” SIAM Journal on Numerical Analysis, Vol. 31, No. 1, pp. 282–299, 1994.

    Google Scholar 

  23. A.S. Kronrod, “On Functions of two variables,” Uspehi Mathematical Sciences, Vol. 5, No. 35, (In Russian), 1950.

  24. R. Kruse and A. Ryba, Data Structures and Program Design in C ++. Prentice Hall: New York, 1999.

    Google Scholar 

  25. R. Malladi and J. Sethian, “A unified approach to noise removal, image-enhancement, and shape recovery,” IEEE Transactions on Image Processing, Vol. 5, No. 11, pp. 1554–1568, 1996.

    Google Scholar 

  26. P. Maragos and M.A. Butt, “Curve evolution, differential morphology and distance transforms applied to multiscale and eikonal problems,” Fundamenta Informaticae, Vol. 41, pp. 91–129, 2000.

    Google Scholar 

  27. D. Marr, Vision, Freeman: San Francisco, 1982.

    Google Scholar 

  28. D. Martin, C. Fowlkes, D. Tal, and J. Malik, “A database of hu-man segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics,” in: Proc. ICCV'01, Vol. II. Vancouver, Canada, 2001, pp. 416–423.

    Google Scholar 

  29. F. Meyer, A. Oliveras, P. Salembier, and C. Vachier, “Morphological tools for segmentation: Connected filters and watersheds,” Annals of Telecommunications, Vol. 52, No. 7/8, pp. 367–379, 1997.

    Google Scholar 

  30. F. Meyer, “Morphological segmentation on a neighborhood graph,” Acta Stereologica, Vol. 16, No. 3, pp. 175–182, 1997.

    Google Scholar 

  31. F. Meyer, “Hierarchies of partitions and morphological segmentation,” in: Scale Space and Morphology in Computer Vision, M. Kerckhove (ed.), 2001, pp. 161–182.

  32. A. Montanvert, P. Meer, and A. Rosenfeld, “Hierarchical im-age analysis using irregular tessellations,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 13, No. 4, pp. 307–316, 1991.

    Google Scholar 

  33. P. Nacken, “Image segmentation by connectivity preserving re-linking in hierarchical graph structures,” PR, Vol. 28, No. 6, pp. 907–920, 1995.

    Google Scholar 

  34. I.P. Natansson, Theory of Functions of a Real Variable.New York: Frederick Ungar Publishing, 1964.

    Google Scholar 

  35. A. Okabe, B. Boots, K. Sugihara, and S.N. Chiu, Spatial Tesselations: Concepts and Applications of Voronoi Diagrams, 2nd edition, Wiley, 2002.

  36. S. Osher and L. Rudin, “Feature-oriented image enhancement using shock filters,” NumAnal, Vol. 27, No. 4, pp. 919–940, 1990.

    Google Scholar 

  37. L. Rudin, S. Osher, and E. Fatemi, “Nonlinear total variation based noise removal algorithms,” Physica D, Vol. 60, pp. 259–268, 1992.

    Google Scholar 

  38. J. Serra and P. Salembier, “Connected operators and pyramids,” in: Image Algebra and Mathematical Morphology, SPIE (Ed.), Vol. 2030. San Diego CA., 1993, pp. 65–76.

  39. J.A. Sethian, Level Set Methods and Fast Marching Methods, 2nd edition Cambridge University Press: Cambridge, UK, 1999.

    Google Scholar 

  40. C. Vachier, “Extraction de caractéristiques, segmentation d'Image et morphologie mathématique,” Ph.D. thesis, Ecole des Mines de Paris, 1995.

  41. T. Vlachos and A.G. Constantinides, “Graph-theoretical approach to colour picture segmentation and contour classification,” in: IEE Proc. Vision, Image and Sig. Proc., Vol. 140, pp. 36–45, 1993.

    Google Scholar 

  42. W. Yu, J. Fritts, and F. Sun, “A hierarchical image segmentation algorithm,” in: Proc. ICME'02, 2002, pp. 221–224.

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Arbeláez, P.A., Cohen, L.D. Energy Partitions and Image Segmentation. Journal of Mathematical Imaging and Vision 20, 43–57 (2004). https://doi.org/10.1023/B:JMIV.0000011318.77653.44

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:JMIV.0000011318.77653.44

  • segmentation
  • distance transform
  • path variation
  • ultrametrics
  • extrema mosaic
  • mathematical morphology
  • image enhancement