Color Image Segmentation Through Unsupervised Gaussian Mixture Models

  • Antonio Peñalver
  • Francisco Escolano
  • Juan M. Sáez
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4140)


In this paper we introduce a novelty EM based algorithm for Gaussian Mixture Models with an unknown number of components. Although the EM (Expectation-Maximization) algorithm yields the maximum likelihood solution it has many problems: (i) it requires a careful initialization of the parameters; (ii) the optimal number of kernels in the mixture may be unknown beforehand. We propose a criterion based on the entropy of the pdf (probability density function) associated to each kernel to measure the quality of a given mixture model, and a modification of the classical EM algorithm to find the optimal number of kernels in the mixture. We apply our algorithm to the unsupervised color image segmentation problem.


Image Segmentation Gaussian Mixture Model Reversible Jump Reversible Jump Markov Chain Monte Carlo Color Image Segmentation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Arandjelovic, O., Cipolla, R.: Incremental learning of temporary-coherent Gaussian mixture models. In: British Machine Vision Conference. British Machine Vision Association, BMVA (2005)Google Scholar
  2. 2.
    Beirlant, E., Dudewicz, E., Gyorfi, L., Van der Meulen, E.: Nonparametric entropy estimation. International Journal on Mathematical and Statistical Sciences 6(1), 17–39 (1996)Google Scholar
  3. 3.
    Clark, E., Quinn, A.: A data-driven bayesian sampling scheme for unsupervised image segmentation. In: Proceedings of ICASSP 1999 (1999)Google Scholar
  4. 4.
    Cover, T., Thomas, J.: Elements of Information Theory. J. Wiley and Sons, Chichester (1991)MATHCrossRefGoogle Scholar
  5. 5.
    Dellaportas, P., Papageorgiou, I.: Multivariate mixtures of normals with unknown number of components. Statistics and Computing (to appear)Google Scholar
  6. 6.
    Dempster, A., Laird, N., Rubin, D.: Maximum likelihood estimation from incomplete data via the em algorithm. Journal of The Royal Statistical Society B 39(1), 1–38 (1977)MATHMathSciNetGoogle Scholar
  7. 7.
    Figueiredo, M.A.T., Jain, A.K.: Unsupervised selection and estimation of finite mixture models. In: Proceedings of the International Conference on Pattern Recognition, ICPR 2000, Barcelona (2000)Google Scholar
  8. 8.
    Figueiredo, M.A.T., Leitao, J.M.N., Jain, A.K.: On fitting mixture models. In: Hancock, E.R., Pelillo, M. (eds.) EMMCVPR 1999. LNCS, vol. 1654, pp. 54–69. Springer, Heidelberg (1999)CrossRefGoogle Scholar
  9. 9.
    Hornegger, J., Niemann, H.: A novel probabilistic model for object recognition and pose estimation. Pattern Recognition Artif. Intell. 15(2), 241–253 (2001)CrossRefGoogle Scholar
  10. 10.
    Li, S.Z.: Markov random field modeling in computer vision. Springer, London (1995)Google Scholar
  11. 11.
    Mardia, K.V.: Measures of multivariate skewness and kurtosis with applications. Biometrika 57(3), 519–530 (1970)MATHCrossRefMathSciNetGoogle Scholar
  12. 12.
    Parzen, E.: On estimation of a probability density function and mode. Annals of Mathematical Statistics 33(1), 1065–1076 (1962)MATHCrossRefMathSciNetGoogle Scholar
  13. 13.
    Redner, R.A., Walker, H.F.: Mixture densities, maximum likelihood, and the em algorithm. SIAM Review 26(2), 195–239 (1984)MATHCrossRefMathSciNetGoogle Scholar
  14. 14.
    Richardson, S., Green, P.J.: On bayesian analysis of mixtures with unknown number of components (with discussion). Journal of the Royal Statistical Society B 59(1), 731–792 (1997)MATHCrossRefMathSciNetGoogle Scholar
  15. 15.
    Rissanen, J.: Stochastic complexity in statistical inquiry. World Scientific, Singapore (1989)MATHGoogle Scholar
  16. 16.
    Shannon, C.: A mathematical theory of comunication. The Bell System Technical Journal 27(1), 379–423 (1948)MATHMathSciNetGoogle Scholar
  17. 17.
    Tu, Z., Zhu, S.C., Shum, H.Y.: Image segmentation by data driven markov chain montecarlo. In: Proceedings of ICCV 2001 (2001)Google Scholar
  18. 18.
    Tu, Z.W., Zhu, S.C.: Image segmentation by datadriven markov chain monte carlo. IEEE Trans. Pattern Anal. Mach. Intell 24(1), 657–673 (2002)Google Scholar
  19. 19.
    Ueda, N., Nakano, R., Ghahramani, Z., Hinton, G.E.: Smem algorithm for mixture models. Neural Computation 12(1), 2109–2128 (2000)CrossRefGoogle Scholar
  20. 20.
    Viola, P., Schraudolph, N.N., Sejnowski, T.J.: Empirical entropy manipulation for real-world problems. Adv. in Neural Infor. Proces. Systems 8(1) (1996)Google Scholar
  21. 21.
    Viola, P., Wells-III, W.M.: Alignment by maximization of mutual information. In: 5th Intern. Conf. on Computer Vision. IEEE, Los Alamitos (1995)Google Scholar
  22. 22.
    Vlassis, N., Likas, A.: A kurtosis-based dynamic approach to gaussian mixture modeling. IEEE Trans. Systems, Man, and Cybernetics 29(4), 393–399 (1999)CrossRefGoogle Scholar
  23. 23.
    Vlassis, N., Likas, A.: A greedy em algorithm for gaussian mixture learning. Neural Processing Letters 15(1), 77–87 (2002)MATHCrossRefGoogle Scholar
  24. 24.
    Vlassis, N., Likas, A., Krose, B.: A multivariate kurtosis-based dynamic approach to gaussian mixture modeling. Inteligent Autonomous Systems Tech. Report (2000)Google Scholar
  25. 25.
    Zhang, Z., Chan, K.L., Wu, Y., Chen, C.: Learning a multivariate gaussian mixture models with the reversible jump mcmc algorithm. Statistics and Computing 14(1), 343–355 (2004)CrossRefMathSciNetGoogle Scholar
  26. 26.
    Zhang, Z., Chen, C., Sun, J., Chan, K.L.: Em algorithms for gaussian mixtures with split-and-merge operation. Pattern Recognition 36(1), 1973–1983 (2003)MATHCrossRefGoogle Scholar
  27. 27.
    Zhu, S.C., Zhang, R., Tu, Z.: Integrating bottom-up for object recognition by data driven markov chain montecarlo. In: CVPR. IEEE, Los Alamitos (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Antonio Peñalver
    • 1
  • Francisco Escolano
    • 1
  • Juan M. Sáez
    • 1
  1. 1.Robot Vision GroupAlicante UniversitySpain

Personalised recommendations