Abstract
Learning problems for Neural Networks (NNs) has widely been explored from last two decades. Population based algorithms become more focus by researchers because of its nature behavior processing with optimal solution. The population-based algorithms are Ant Colony Optimization (ACO), Artificial Bee Colony (ABC), and recently Hybrid Ant Bee Colony (HABC) Algorithms produced easy way for training NNs. These social based techniques mostly used for finding optimal weight values and over trapping local minima in NNs learning. Typically, NNs trained by a traditional and recognized algorithm called Backpropagation (BP) has difficulties such as trapping in local minima, slow convergence or might fail sometimes. In this research, the new method named Global Hybrid Ant Bee Colony (GHABC) algorithm used to train NNs to recover the BP gaps. The simulation result of a hybrid algorithm evaluates with ordinary ABC, Levenberg-Marquardt (LM) training algorithms. From the investigated results, the proposed GHABC algorithm did get better the learning efficiency for NNs using Boolean Function classification task.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Romano, M., et al.: Artificial neural network for tsunami forecasting. Journal of Asian Earth Sciences 36, 29–37 (2009)
Ghazali, R., Hussain, A.J., Liatsis, P.: Dynamic Ridge Polynomial Neural Network: Forecasting the univariate non-stationary and stationary trading signals. Expert Systems with Applications 38(4), 3765–3776 (2011)
Rumelhart, D.E., McClelland, J.L., The PDP Research Group: Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1, 2. MIT Press, Cambridge (1986)
Osamu, F.: Statistical estimation of the number of hidden units for feedforward neural networks. Neural Networks 11(5), 851–859 (1998)
Shokri, A., Hatami, T., et al.: Near critical carbon dioxide extraction of Anise (Pimpinella Anisum L.) seed: Mathematical and artificial neural network modeling. The Journal of Supercritical Fluids 58(1), 49–57 (2011)
Thwin, M.M.T., Quah, T.-S.: Application of neural networks for software quality prediction using object-oriented metrics. Journal of Systems and Software 76(2), 147–156 (2005)
Iyoda, E., Nobuhara, H., Hirota, K.: A solution for the n-bit parity problem using a single translated multiplicative neuron. Neural Processing Letters 18, 233–238 (2003)
Stork, D., Allen, J.: How to solve the n-bit parity problem with two hidden units. Neural Networks 5, 923–926 (1992)
Wilamowski, B., Hunter, D.: Solving parity-n problems with feedforward neural network. In: Proc. of the Int. Joint Conf. on Neural Networks (IJCNN 2003), Portland, Oregon, vol. I, pp. 2546–2551. IEEE Computer Society Press, Los Alamitos (2003)
Liu, D., Hohil, M., Smith, S.: N-bit parity neural networks: new solutions based on linear programming. Neurocomputing 48, 477–488 (2002)
Ilonen, J., Kamarainen, J.-K., et al.: Differential Evolution Training Algorithm for Feed-Forward Neural Networks. Neural Processing Letters 17(1), 93–105 (2003)
Bonabeau, E., Dorigo, M., Theraulaz, G.: Swarm Intelligence: From Natural to Artificial Systems. Oxford University Press, NY (1999)
Mendes, R., Cortez, P., Rocha, M., Neves, J.: Particle swarm for feedforward neural network training. In: Proceedings of the International Joint Conference on Neural Networks, vol. 2, pp. 1895–1899 (2002)
Shah, H., Ghazali, R., Nawi, N.M.: Hybrid Bee Ant Colony Algorithm (HBAC) for Classification and Prediction Mission. In: 2nd World IT Conference Turkey (Presented in Turkey, Procedia Computer Science Journal) (2011)
Shah, H., Ghazali, R.: Prediction of Earthquake Magnitude by an Improved ABC-MLP, DESE, UAE (Presented in UAE, DESE 2011, to be published soon in IEEE) (2011)
Shah, H., Ghazali, R., Nawi, N.M.: Hybrid Ant Bee Colony Algorithm for Volcano Temperature Prediction. In: Chowdhry, B.S., Shaikh, F.K., Hussain, D.M.A., Uqaili, M.A. (eds.) IMTIC 2012. CCIS, vol. 281, pp. 453–465. Springer, Heidelberg (2012)
Gori, M., Tesi, A.: On the problem of local minima in back-propagation. IEEE Trans. Pattern Anal. Mach. Intell. 14(1), 76–86 (1992)
Yao, X.: Evolutionary artificial neural networks. International Journal of Neural Systems 4(3), 203–222 (1993)
Fahlman, S.: An empirical study of learning speed in back-propagation networks, Technical Report CMU-CS-88-162, Carnegie Mellon University, Pittsburgh, PA 15213 (September 1988)
Hornik, K., Stinchcombe, M., White, H.: Multilayer feedforward networks are universal approximators. Neural Networks 2(5), 359–366 (1989)
Rosenblatt, F.: A Probabilistic Model for Information Storage and Organization in the Brain. Cornell Aeronautical Laboratory 65, 386–408 (1958)
Dorigo, M., Di Caro, G., Corne, D., Dorigo, M., Glover, F.: The ant colony optimization meta-heuristic. New Ideas in Optimization, 11–32 (1999)
Karaboga, D., Akay, B., Ozturk, C.: Artificial Bee Colony (ABC) Optimization Algorithm for Training Feed-Forward Neural Networks. In: Torra, V., Narukawa, Y., Yoshida, Y. (eds.) MDAI 2007. LNCS (LNAI), vol. 4617, pp. 318–329. Springer, Heidelberg (2007)
Ozturk, C., Karaboga, D.: Hybrid Artificial Bee Colony algorithm for neural network training. In: 2011 IEEE Congress on Evolutionary Computation, CEC (2011)
Peng, G., Wenming, C., et al.: Global artificial bee colony search algorithm for numerical function optimization. In: 2011 Seventh International Conference on Natural Computation, ICNC (2011)
Shah, H., Ghazali, R., Nawi, N.M.: Using Artificial Bee Colony Algorithm for MLP Training on Earthquake Time Series Data Prediction. Journal of Computing 3(6), 135–142 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Shah, H., Ghazali, R., Nawi, N.M., Deris, M.M. (2012). Global Hybrid Ant Bee Colony Algorithm for Training Artificial Neural Networks. In: Murgante, B., et al. Computational Science and Its Applications – ICCSA 2012. ICCSA 2012. Lecture Notes in Computer Science, vol 7333. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31125-3_7
Download citation
DOI: https://doi.org/10.1007/978-3-642-31125-3_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-31124-6
Online ISBN: 978-3-642-31125-3
eBook Packages: Computer ScienceComputer Science (R0)