NEC: A Hierarchical Agglomerative Clustering Based on Fisher and Negentropy Information

  • Angelo Ciaramella
  • Giuseppe Longo
  • Antonino Staiano
  • Roberto Tagliaferri
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3931)


In this paper a hierarchical agglomerative clustering is introduced. A hierarchy of two unsupervised clustering algorithms is considered. The first algorithm is based on a competitive Neural Network or on a Probabilistic Principal Surfaces approach and the second one on an agglomerative clustering based on both Fisher and Negentropy information. Different definitions of Negentropy information are used and some tests on complex synthetic data are presented.


Independent Component Analysis Hierarchical Agglomerative Cluster Latent Variable Model Agglomerative Cluster Differential Entropy 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bishop, C.M.: Neural Networks for Pattern Recognition. Oxford University Press, Oxford (1995)MATHGoogle Scholar
  2. 2.
    Chang, K., Ghosh, J.: A unified Model for Probabilistic Principal Surfaces. IEEE Transactions on pattern Analysis nd Machine Intelligence 23(1)Google Scholar
  3. 3.
    Cook, D., Buja, A., Cabrera, J.: Projection Pursuit Indexes Based on Orthonormal Function Expansions. Journal of Computational and Graphical Statistics 2(3), 225–250 (1993)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. John Wiley & Sons Inc., Chichester (2001)MATHGoogle Scholar
  5. 5.
    Hyvärinen, A., Karhunen, J., Oja, E.: Independent Component Analysis. John Wiley & Sons, Chichester (2001)CrossRefGoogle Scholar
  6. 6.
    Hyvärinen, A.: New Approximations of Differential Entropy for Independent Component Analysis and Projection Pursuit. In: Advences in Neural Information Processing Systems, vol. 10, pp. 273–279. MIT Press, Cambridge (1998)Google Scholar
  7. 7.
    Jenssen, R., Eltoft, T., Principe, J.C.: Information Theoretic Clustering: A Unifying Review of Three Recent Algorithms. In: Proceedings of the 6th Nordic Signal Processing Symposium - NORSIG 2004, Espoo, Finland, June 9-11(2004)Google Scholar
  8. 8.
    de M. Martins, A., Neto, A.D.D., de Melo, J.D., Costa, J.A.F.: Clustering Using Neural Networks and Kullback-leibler Divergency. In: International Joint Conference on Neural Networks - IJCNN 2004, pp. 1–6 (2004)Google Scholar
  9. 9.
    Staiano, A., De Vinco, L., Ciaramella, A., Raiconi, G., Tagliaferri, R., Longo, G., Miele, G., Amato, R., Del Mondo, C., Donalek, C., Mangano, G., Di Bernardo, D.: Probabilistic Principal Surfaces for Yeast Gene Microarray Data-Mining. In: ICDM 2004 - Fourth IEEE International Conference on Data Mining, Brighton (UK), pp. 202–209 (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Angelo Ciaramella
    • 1
  • Giuseppe Longo
    • 2
  • Antonino Staiano
    • 1
  • Roberto Tagliaferri
    • 1
  1. 1.Department of Mathematics and Computer ScienceUniversity of SalernoFisciano, Salerno
  2. 2.Dipartimento di Scienze FisicheUniversity of Naples, Polo delle Scienze e della TecnologiaNapoliItaly

Personalised recommendations