A New Approach for High-Dimensional Unsupervised Learning: Applications to Image Restoration

  • Nizar Bouguila
  • Djemel Ziou
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3776)


This paper proposes an unsupervised algorithm for learning a high-dimensional finite generalized Dirichlet mixture model. The generalized Dirichlet distribution offers high flexibility and ease of use. We propose a hybrid stochastic expectation maximization algorithm (HSEM) to estimate the parameters of the generalized Dirichlet mixture. The performance of our method is tested by applying it to the problems of image restoration.


Image Restoration Dirichlet Distribution Finite Mixture Model Local Quadratic Convergence Generalize Dirichlet Distribution 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Aeberhard, S., Coomans, D., De Vel, O.: Comparative Analysis of Statistical Pattern Recognition Methods in High Dimensional Settings. Pattern Recognition 27(8), 1065–1077 (1994)CrossRefGoogle Scholar
  2. 2.
    Bouguila, N., Ziou, D., Vaillancourt, J.: Unsupervised Learning of a Finite Mixture Model Based on the Dirichlet Distribution and its Application. IEEE Transactions on Image Processing 13(11), 1533–1543 (2004)CrossRefGoogle Scholar
  3. 3.
    Connor, R.J., Mosimann, J.E.: Concepts of Independence for Proportions With A Generalization of The Dirichlet Distribution. American Statistical Association Journal 64, 194–206 (1969)zbMATHCrossRefMathSciNetGoogle Scholar
  4. 4.
    McLachlan, G.J., Krishnan, T.: The EM Algorithm and Extensions. Wiley-Interscience, New York (1997)zbMATHGoogle Scholar
  5. 5.
    Frigui, H., Krishnapuram, R.: A Robust Competitive Clustering Algorithm With Applications in Computer Vision. IEEE Transactions on PAMI 21(5), 450–465 (1999)Google Scholar
  6. 6.
    McLachlan, G.J., Peel, D.: Finite Mixture Models. Wiley, New York (2000)zbMATHCrossRefGoogle Scholar
  7. 7.
    Celeux, G., Diebolt, J.: A Stochastic Approximation Type EM Algorithm for the Mixture Problem. Stochastics and Stochastics Reports 41, 119–134 (1992)zbMATHMathSciNetGoogle Scholar
  8. 8.
    Popat, K., Picard, R.W.: Cluster-Based Probability model and its Application to Image and Texture Processing. IEEE Transactions on Image Processing 6(2), 268–284 (1997)CrossRefGoogle Scholar
  9. 9.
    Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE Transactions on Image Processing 13(4), 600–612 (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Nizar Bouguila
    • 1
  • Djemel Ziou
    • 1
  1. 1.Département d’Informatique, Faculté des SciencesUniversité de SherbrookeSherbrookeCanada

Personalised recommendations