Abstract
This paper present an enhanced approach for ensemble multi classifier of Artificial Neural Networks (ANN). The motivation of this study is to enhance the ANN capability and performance using reconstructed heterogeneous if the homogenous classifiers are deployed. The clusters set are partitioned into two sets of cluster; clusters of a same class and clusters of multi class which both of them were using different partition techniques. Each partitions represented by an independent classifier of highly correlated patterns from different classes. Each set of clusters are compared and the final decision is voted by using majority voting. The approach is tested on benchmark large dataset and small dataset. The results show that the proposed approach achieved almost near to 99% of accuracy which is better classification than the existing approach.
This is a preview of subscription content, log in via an institution to check access.
References
Bottou, L.: Large-scale machine learning with stochastic gradient descent. In: Lechevallier, Y., Saporta, G. (eds.) 19th International Conference on Computational Statistics, pp. 177–186. Physica-Verlag HD, Paris (2010)
Vijayalakshmi, M., Devi, M.R.: A survey of different issues of different clustering algorithms used in large data sets. Int. J. Adv. Res. Comput. Sci. Softw. Eng. 3, 137–141 (2012)
Wen, Y.-M., Wang, Y.-N., Liu, W.-H.: Using parallel partitioning strategy to create diversity for ensemble learning. In: 2nd IEEE International Conference on Computer Science and Information Technology, ICCSIT 2009, Beijing, pp. 585–589 (2009)
Seiffertt, J., Wunsch. D.C.: Back propagation on time scales. In: Unified Computational Intelligence for Complex Systems, vol. 6, pp. 77–89. Springer, Heidelberg (2010)
Parvin, H., Minaei, B., Alizadeh, H., Beigi, A.: A novel classifier ensemble method based on class weightening in huge dataset. In: Liu, D., Zhang, H., Polycarpou, M., Alippi, C., He, H. (eds.) ISNN 2011. LNCS, vol. 6676, pp. 144–150. Springer, Heidelberg (2011). doi:10.1007/978-3-642-21090-7_17
Jing, Y., Xiaoqin, Z., Shuiming, Z., Shengli, W.: Effective neural network ensemble approach for improving generalization performance. IEEE Trans. Neural Netw. Learn. Syst. 24, 878–887 (2013)
Ciresan, D.C., Meier, U., Gambardella, L.M., Schmidhuber, J.: Deep big simple neural nets excel on handwritten digit recognition. Neural Comput. 22, 3207–3220 (2010)
Bishop, C.M.: Neural Networks for Pattern Recognition. Clarendon, Oxford (1995)
Yao, Y.: On complexity issues of online learning algorithms. IEEE Trans. Inf. Theory 56, 6470–6481 (2010)
Windeatt, T.: Accuracy diversity and ensemble MLP classifier design. IEEE Trans. Neural Netw. 17, 1194–1211 (2006)
Sospedra, J.T.: Ensembles of artificial neural networks: analysis and development of design methods. Ph.D. doctoral dissertation, Department of Computer Science and Engineering, Universitat Jaume I, Castellon (2011)
Peng, K., Obradovic, Z., Vucetic, S.: Towards efficient learning of neural network ensembles from arbitrarily large datasets. In: ECAI, p. 623 (2004)
Wang, S., Yao, X.: Relationships between diversity of classification ensembles and single-class performance measures. IEEE Trans. Knowl. Data Eng. 25, 206–219 (2013)
Fernández, C., Valle, C., Saravia, F., Allende, H.: Behavior analysis of neural network ensemble algorithm on a virtual machine cluster. Neural Comput. Appl. 21, 535–542 (2012)
Polikar, R.: Ensemble based systems in decision making. IEEE Circ. Syst. Mag. 6, 21–45 (2006)
Acknowledgments
This work supported by Fundamental Research Grant Scheme under Malaysia Ministry of Higher Education (MOHE) and Center of Research and Innovation Management of Universiti Sultan Zainal Abidin, Terengganu, Malaysia.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Mohamad, M., Makhtar, M., Rahman, M.N.A. (2017). The Reconstructed Heterogeneity to Enhance Ensemble Neural Network for Large Data. In: Herawan, T., Ghazali, R., Nawi, N.M., Deris, M.M. (eds) Recent Advances on Soft Computing and Data Mining. SCDM 2016. Advances in Intelligent Systems and Computing, vol 549. Springer, Cham. https://doi.org/10.1007/978-3-319-51281-5_45
Download citation
DOI: https://doi.org/10.1007/978-3-319-51281-5_45
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-51279-2
Online ISBN: 978-3-319-51281-5
eBook Packages: EngineeringEngineering (R0)