Attribute Operators for Color Images: Image Segmentation Improved by the Use of Unsupervised Segmentation Evaluation Methods

  • Sérgio Sousa Filho
  • Franklin César Flores
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10225)


Attribute openings and thinnings are morphological connected operators that remove structures from images according to a given criterion. These operators were successfully extended from binary to grayscale images, but such extension to color images is not straightforward. This paper proposes color attribute operators by a combination of color gradients and thresholding decomposition. In this approach, not only structural criteria may be applied, but also criteria based on color features and statistics. This work proposes, in a segmentation framework, two criteria based on unsupervised segmentation evaluation for improvement of color segmentation. Segmentation using our operators performed better than two state-of-the-art methods in 80% of the experiments done using 300 images.


Attribute filter Image segmentation Thresholding decomposition Color processing 



First author would like to thank Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq), Brazil, for the master scholarship. Second author would like to thank Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq), Brazil, for the post-doctoral scholarship.


  1. 1.
    Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Süsstrunk, S.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2011)CrossRefGoogle Scholar
  2. 2.
    Aptoula, E., Lefevre, S.: A comparative study on multivariate mathematical morphology. Pattern Recogn. 40(11), 2914–2929 (2007)CrossRefzbMATHGoogle Scholar
  3. 3.
    Beucher, S., Meyer, F.: The Morphological Approach to Segmentation: The Watershed Transformation (chap. 12). In: Mathematical Morphology in Image Processing, pp. 433–481. Marcel Dekker (1992)Google Scholar
  4. 4.
    Boroujerdi, A.S., Breuß, M., Burgeth, B., Kleefeld, A.: PDE-based color morphology using matrix fields. In: Aujol, J.-F., Nikolova, M., Papadakis, N. (eds.) SSVM 2015. LNCS, vol. 9087, pp. 461–473. Springer, Cham (2015). doi: 10.1007/978-3-319-18461-6_37 Google Scholar
  5. 5.
    Borsotti, M., Campadelli, P., Schettini, R.: Quantitative evaluation of color image segmentation results. Pattern Recogn. Lett. 19, 741–747 (1998)CrossRefzbMATHGoogle Scholar
  6. 6.
    Breen, E.J., Jones, R.: Attribute openings. Thinnings Granulometries 64(3), 377–389 (1996)Google Scholar
  7. 7.
    Burgeth, B., Kleefeld, A.: Morphology for color images via Loewner order for matrix fields. In: Hendriks, C.L.L., Borgefors, G., Strand, R. (eds.) ISMM 2013. LNCS, vol. 7883, pp. 243–254. Springer, Heidelberg (2013). doi: 10.1007/978-3-642-38294-9_21 CrossRefGoogle Scholar
  8. 8.
    Burgeth, B., Kleefeld, A.: An approach to color-morphology based on Einstein addition and Loewner order. Pattern Recogn. Lett. 47, 29–39 (2014)CrossRefGoogle Scholar
  9. 9.
    Burgeth, B., Kleefeld, A.: Order based morphology for color images via matrix fields. In: Westin, C.-F., Vilanova, A., Burgeth, B. (eds.) Visualization and Processing of Tensors and Higher Order Descriptors for Multi-Valued Data. MV, pp. 75–95. Springer, Heidelberg (2014). doi: 10.1007/978-3-642-54301-2_4 Google Scholar
  10. 10.
    Busin, L., Vandenbroucke, N., Ludovic, L.: Color spaces and image segmentation. Advances in Imaging and Electron Physics 151, 65–168 (2008)CrossRefGoogle Scholar
  11. 11.
    Dougherty, E.R., Lotufo, R.A.: Hands-on Morphological Image Processing, vol. 71. SPIE Optical Engineering Press, Washington (2003)CrossRefGoogle Scholar
  12. 12.
    Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. Wiley, Hoboken (2001)zbMATHGoogle Scholar
  13. 13.
    Evans, A.N., Liu, X.U.: A morphological gradient approach to color edge detection. IEEE Trans. Image Process. 15(6), 1454–1463 (2006)CrossRefGoogle Scholar
  14. 14.
    Flores, F.C., Evans, A.N.: Attribute operators for color images: the use of entropy from local color information to image compression (2017, submitted)Google Scholar
  15. 15.
    Flores, F.C., Polidório, A.M., Lotufo, R.A.: The weighted gradient: a color image gradient applied to morphological segmentation. J. Braz. Comput. Soc. 11(3), 53–63 (2006)CrossRefGoogle Scholar
  16. 16.
    van de Gronde, J.J., Roerdink, J.B.T.M.: Group-invariant frames for colour morphology. In: Hendriks, C.L.L., Borgefors, G., Strand, R. (eds.) ISMM 2013. LNCS, vol. 7883, pp. 267–278. Springer, Heidelberg (2013). doi: 10.1007/978-3-642-38294-9_23 CrossRefGoogle Scholar
  17. 17.
    Hanbury, A., Serra, J.: Mathematical morphology in the HLS colour space. In: BMVC, pp. 1–10 (2001)Google Scholar
  18. 18.
    Hanbury, A., Serra, J.: Mathematical morphology in the cielab space. Image Anal. Ster. 21(3), 201–206 (2002)MathSciNetCrossRefGoogle Scholar
  19. 19.
    Haralick, R.M., Shapiro, L.G.: Image segmentation techniques. Comput. Vis. Graph. Image Process. 29(1), 100–132 (1985)CrossRefGoogle Scholar
  20. 20.
    Heijmans, H.J.A.M.: Introduction to connected operators. In: Dougherty, E.R., Astola, J.T. (eds.) Nonlinear Filters for Image Processing, pp. 207–235. SPIE-The International Society for Optical Engineering, Bellingham (1999)Google Scholar
  21. 21.
    Lambert, P., Chanussot, J.: Extending mathematical morphology to color image processing. In: Proceedings CGIP 2000 (2000)Google Scholar
  22. 22.
    Liu, J., Yang, Y.H., Member, S.: Multiresolution color image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 16(7), 689–700 (1994)CrossRefGoogle Scholar
  23. 23.
    Lucchese, L., Mitra, S.K.: Color image segmentation: a state-of-the-art survey. Proc. Indian Natl. Sci. Acad. (INSA-A) 67(2), 207–221 (2001). Delhi, IndianGoogle Scholar
  24. 24.
    Martin, D., Fowlkes, C., Tal, D., Malik, J.: A Database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings of 8th International Conference Computer Vision. vol. 2, pp. 416–423, July 2001Google Scholar
  25. 25.
    Meyer, F.: From connected operators to levelings. In: Heijmans, H., Roerdink, J. (eds.) Proceedings of ISMM 1998 Mathematical Morphology and its Applications to Image and Signal Processing, pp. 191–198. Kluwer Academic Publishers (1998)Google Scholar
  26. 26.
    Meyer, F.: Hierarchies of partitions and morphological segmentation. In: Kerckhove, M. (ed.) Scale-Space 2001. LNCS, vol. 2106, pp. 161–182. Springer, Heidelberg (2001). doi: 10.1007/3-540-47778-0_14 CrossRefGoogle Scholar
  27. 27.
    Najman, L., Talbot, H. (eds.): Mathematical Morphology: From Theory to Applications. Wiley, Hoboken (2013)Google Scholar
  28. 28.
    Ou, L.C., Luo, M.R.: A colour harmony model for two-colour combinations. Color Res. Appl. 31(3), 191–204 (2006)CrossRefGoogle Scholar
  29. 29.
    Rittner, L., Flores, F.C., Lotufo, R.A.: A tensorial framework for color images. Pattern Recogn. Lett. 31(4), 277–296 (2010)CrossRefGoogle Scholar
  30. 30.
    Ruzon, M.A., Tomasi, C.: Edge, junction, and corner detection using color distributions. IEEE Trans. Pattern Anal. Mach. Intell. 23(11), 1281–1295 (2001)CrossRefGoogle Scholar
  31. 31.
    Serra, J., Vincent, L.: An overview of morphological filtering. Circuits Syst. Signal Process. 11(1), 47–108 (1992)MathSciNetCrossRefzbMATHGoogle Scholar
  32. 32.
    Vachier, C.: Extraction de caractéristiques, segmentation d’image et morphologie mathématique. Ph.D. thesis, Ecole des Mines de Paris (1995)Google Scholar
  33. 33.
    Vachier, C., Meyer, F.: Extinction value: a new measurement of persistence. In: Proceedings of 1995 IEEE Workshop on Nonlinear Signal and Image Processing. vol. I, pp. 254–257. IEEE (1995)Google Scholar
  34. 34.
    Vincent, L.: Grayscale area openings and closings, their efficient implementation and applications. In: First Workshop on Mathematical Morphology and its Applications to Signal Processing, pp. 22–27 (1993)Google Scholar
  35. 35.
    van der Walt, S., Schönberger, J.L., Nunez-Iglesias, J., Boulogne, F., Warner, J.D., Yager, N., Gouillart, E., Yu, T.: the scikit-image contributors: scikit-image: image processing in Python. PeerJ 2, e453 (2014)CrossRefGoogle Scholar
  36. 36.
    Zhang, H., Fritts, J.E., Goldman, S.A.: An entropy-based objective evaluation method for image segmentation. In: Storage and Retrieval Methods and Applications for Multimedia 2004. vol. 5307, pp. 38–49, December 2003Google Scholar
  37. 37.
    Zhang, H., Fritts, J.E., Goldman, S.A.: Image segmentation evaluation: a survey of unsupervised methods. Comput. Vis. Image Underst. 110(2), 260–280 (2008)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Department of InformaticsState University of MaringáMaringáBrazil

Personalised recommendations