AUDyC Neural Network using a new Gaussian Densities Merge Mechanism
In the context of evolutionary data classification, dynamical modeling techniques are useful to continuously learn clusters models. Dedicated to on-line clustering, the AUDyC (Auto-adaptive and Dynamical Clustering) algorithm is an unsupervised neural network with auto-adaptive abilities in nonstationary environment. These particular abilities are based on specific learning rules that are developed into three stages: “Classification”, “Evaluation” and “Fusion”. In this paper, we propose a new densities merge mechanism to improve the “Fusion” stage in order to avoid some local optima drawbacks of Gaussian fitting. The novelty of our approach is to use an ambiguity rule of fuzzy modelling with new merge acceptance criteria. Our approach can be generalized to any type of fuzzy classification method using Gaussian models. Some experiments are presented to show the efficiency of our approach to circumvent to AUDyC NN local optima problems.
KeywordsGaussian Density Finite Mixture Model Fuzzy Classification Local Optimum Problem Dynamical Classification
Unable to display preview. Download preview PDF.
- Eltoft T. (1998) A new Neural Network for Cluster-Detection-and-Labeling. IEEE Trans. NN, 9(5): 1021–1035.Google Scholar
- Lecoeuche, S., Lurette C. (2003) Auto-adaptive and Dynamical Clustering Neural Network. ICANN03: 350–358.Google Scholar
- McLachlan G. J., Peel D. (2000) Finite Mixture Models. Eds Wiley, ISBN 0-471-00626-2Google Scholar
- Lecoeuche, S., Lurette C. (2004) New supervision architecture based on on line modelization of non stationary data, Neural Computing and Applications, To be published.Google Scholar
- Mouchaweh S. (2003) Conception d’un système de diagnostic adaptatif et prédictif basè sur la méthode Fuzzy Pattern Matching pour la surveillance en ligne des systèmes évolutifs, PhD Univ RCA FranceGoogle Scholar
- Shaohua, K., Shellappa, R. (2004) Kullback-Leibler Distance between Two Gaussian Densities in Reproducing Kernel Hilbert Space. Chicago DC, ISIT Google Scholar
- P. M. Kelly (1994). An Algorithm for Merge Hyper-ellipsoidal Clusters. Los Alamos National Laboratory.Google Scholar