Hybrid Optimization Method Applied to Adaptive Splitting and Selection Algorithm
The paper presents an approach to train combined classifiers based on feature space splitting and selection of the best classifier ensemble to each subspace of feature space. The learning method uses a hybrid algorithm that combines a Genetic Algorithm and Cross Entropy Method. The proposed approach was evaluated on the basis of the comprehensive computer experiments run on balanced and imbalanced datasets, and compared with Cluster and Selection algorithm, improving the results obtained by this technique.
KeywordsGenetic algorithms Cross entropy Classification Machine learning Classifier ensemble Hybrid optimization
Pedro Lopez-Garcia, Enrique Onieva and Asier Perallos’ work was supported by TIMON Project (Enhanced real time services for an optimized multimodal mobility relying on cooperative networks and open data). This project has received funding from the European Unions Horizon 2020 research and innovation programme under grant agreement No. 636220. Also, Michal Wozniak’s work was supported by the Polish National Science Centre under the grant no. DEC-2013/09/B/ST6/02264 and by EC under FP7, Coordination and Support Action, Grant Agreement Number 316097, ENGINE - European Research Centre of Network Intelligence for Innovation Enhancement (http://engine.pwr.wroc.pl/). All computer experiments were carried out using computer equipment sponsored by ENGINE project.
- 11.Krogh, A., Vedelsby, J.: Neural network ensembles, cross validation, and active learning. Adv. Neural Inf. Process. Syst. 7, 231–238 (1995)Google Scholar
- 12.L.I. Kuncheva. Clustering-and-selection model for classifier combination. In: Fourth International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies, Proceedings. vol. 1, pp. 185–188 (2000)Google Scholar
- 17.Rastrigin, L.A., Erenstein, R.H.: Method of Collective Recognition. Energoizdat, Moscow (1981)Google Scholar