Abstract
Classification is achieved through the categorisation of objects into predefined categories or classes, where the categories or classes are created based on a similar set of attributes of the object. This is referred to as supervised learning. Numerous methodologies have been formulated by researchers in order to solve classification problems effectively. These methodologies exhibit an uncomplicated structure and fast training, and are based on artificial intelligence, such as the probabilistic neural network (PNN). In this study, techniques to improve the accurateness of the PNN in solving classification problems have been analysed with the help of the water cycle algorithm (WCA), which is a population-based metaheuristic that imitates the water cycle in the real world. In the recommended solution, near-optimal solutions are created in order to regulate the arbitrary parameter selection of the PNN. In this study, it has also been suggested that the enhanced WCA (E-WCA) can be used to attain a balance between exploitation and exploration, so that premature conjunction and immobility of the population can be avoided. With the help of 11 standard benchmark datasets, the recommended solutions were verified. The results of the experiment substantiated that the WCA and E-WCA are capable of improving the weight parameters of the PNN, thereby imparting improved performance with respect to convergence speed and classification accuracy, compared with the initial PNN classifier.
Similar content being viewed by others
References
Andreopoulou, Z., Koliouska, C., Zopounidis, C.: Multicriteria and Clustering: Classification Techniques in Agrifood and Environment. Springer, Cham (2017)
Johnston, K.B., Oluseyi, H.M.: Generation of a supervised classification algorithm for time-series variable stars with an application to the LINEAR dataset. N. Astron. 52, 35–47 (2017)
Zhang, G.P.: Neural networks for classification: a survey. Trans. Syst. Man. Cybern. C 30, 451–462 (2002)
Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Mach. Learn. 29, 131–163 (1997)
Lee, Y.J., Mangasarian, O.L.: SSVM: a smooth support vector machine for classification. Comput. Optim. Appl. 20, 5–22 (2001)
Wai-Ho, A., Chan, K.C.C.: Classification with degree of membership: a fuzzy approach. In: Presented at the Proceedings in International Conference on Data Mining, California, USA, 2001
Han, J.K., Kamber, M.: Data Mining: Concepts and Techniques. Morgan Kaufmann Publishers, Inc., San Francisco (2008)
Alshareef, A.M., Bakar, A.A., Hamdan, A.R., Abdullah, S.M.S., Alweshah, M.: A case-based reasoning approach for pattern detection in Malaysia rainfall data. Int. J. Big Data Intell. 2, 285–302 (2015)
Alweshah, M., Rashaideh, H., Hammouri, A.I., Tayyeb, H., Ababneh, M.: Solving time series classification problems using support vector machine and neural network. Int. J. Data Anal. Tech. Strateg. 9(3), 237–247 (2017)
Alweshah, M., Omar, A., Alzubi, J., Alaqeel, S.: Solving attribute reduction problem using wrapper genetic programming. Int. J. Comput. Sci. Netw. Secur. 16, 77–84 (2016)
Wang, L., Wu, C.: A combination of models for financial crisis prediction: integrating probabilistic neural network with back-propagation based on adaptive boosting. Int. J.Comput. Intell. Syst. 10, 507–520 (2017)
Alweshah, M.: Construction biogeography-based optimization algorithm for solving classification problems. In: Neural Computing and Applications, pp. 1–10. Springer, Cham (2018)
Zeinali, Y., Story, B.A.: Competitive probabilistic neural network. Integr. Comput. Aided Eng. 24, 105–118 (2017)
Specht, D.F.: Probabilistic neural networks. Neural Netw. 3, 109–118 (1990)
Hernández-Lobato, J.M., Adams, R.: Probabilistic backpropagation for scalable learning of Bayesian neural networks. In: ICML, 2015, pp. 1861–1869.
Melhem, L.B., Azmi, M.S., Muda, A.K., Bani-Melhim, N.J., Alweshah, M.: Text line segmentation of Al-Quran pages using binary representation. Adv. Sci. Lett. 23, 11498–11502 (2017)
Kevric, J., Jukic, S., Subasi, A.: An effective combining classifier approach using tree algorithms for network intrusion detection. Neural Comput. Appl. 1, 1–8 (2016)
Schaffer, J.D., Whitley, D., Eshelman, L.J.: Combinations of genetic algorithms and neural networks: a survey of the state of the art. In: Combinations of Genetic Algorithms and Neural Networks, COGANN-92, 1992, pp. 1–37.
Whitley, D., Starkweather, T., Bogart, C.: Genetic algorithms and neural networks: optimizing connections and connectivity. Parallel Comput. 14, 347–361 (1990)
Sebt, M., Afshar, M., Alipouri, Y.: Hybridization of genetic algorithm and fully informed particle swarm for solving the multi-mode resource-constrained project scheduling problem. Eng. Optim. 49, 513–530 (2017)
Kumar, S., Singh, M.P.: Pattern recall analysis of the Hopfield neural network with a genetic algorithm. Comput. Math. Appl. 60, 1049–1057 (2010)
Singh, S., Bhambri, P., Gill, J.: Time series based temperature prediction using back propagation with genetic algorithm technique. Int. J. Comput. Sci. Issues 8, 28–32 (2011)
Singh, S., Gill, J.: Temporal weather prediction using back propagation based genetic algorithm technique. Int. J. Intell. Syst. Appl. 6, 55–61 (2014)
Huang, H.-X., Li, J.-C., Xiao, C.-L.: A proposed iteration optimization approach integrating backpropagation neural network with genetic algorithm. Expert Syst. Appl. 42, 146–155 (2015)
Chanda, S., Gupta, S., Pratihar, D.K.: A combined neural network and genetic algorithm based approach for optimally designed femoral implant having improved primary stability. Appl. Soft Comput. 38, 296–307 (2016)
Will, A.L.E.: Improvement of a hybrid evolutionary model of genetic algorithms and artificial neural networks. Bol. Técn. 54, 777–780 (2017)
Dragoi, E.-N., Curteanu, S., Leon, F., Galaction, A.-I., Cascaval, D.: Modeling of oxygen mass transfer in the presence of oxygen-vectors using neural networks developed by differential evolution algorithm. Eng. Appl. Artif. Intell. 24, 1214–1226 (2011)
Saleh, A.Y., Shamsuddin, S.M., Hamed, H.N.A.: A hybrid differential evolution algorithm for parameter tuning of evolving spiking neural network. Int. J. Comput. Vis. Robot. 7, 20–34 (2017)
Desell, T., Clachar, S., Higgins, J., Wild, B.: Evolving deep recurrent neural networks using ant colony optimization. In: European Conference on Evolutionary Computation in Combinatorial Optimization, 2015, pp. 86–98
Mavrovouniotis, M., Yang, S.: Training neural networks with ant colony optimization algorithms for pattern classification. Soft Comput. 19, 1511–1522 (2015)
Geng, Y., Zhang, L., Sun, Y., Zhang, Y., Yang, N., Wu, J.: Research on ant colony algorithm optimization neural network weights blind equalization algorithm. Int. J. Secur. Appl. 10, 95–104 (2016)
Lie, F., Kuo, H.-F.: Constructing freeform source through the combination of neural network and binary ant colony optimization. In: SPIE Advanced Lithography, 2017, pp. 101471M–101471M-9
Bin, Z.Y., Zhong, L.L., Ming, Z.Y.: Notice of Retraction Study on network flow prediction model based on particle swarm optimization algorithm and RBF neural network. In: 2010 3rd IEEE International Conference on Computer Science and Information Technology (ICCSIT), 2010, pp. 302–306
Yaghini, M., Khoshraftar, M.M., Fallahi, M.: A hybrid algorithm for artificial neural network training. Eng. Appl. Artif. Intell. 26, 293–301 (2013)
Taormina, R., Chau, K.-W.: Neural network river forecasting with multi-objective fully informed particle swarm optimization. J. Hydroinform. 17, 99–113 (2015)
Gordan, B., Armaghani, D.J., Hajihassani, M., Monjezi, M.: Prediction of seismic slope stability through combination of particle swarm optimization and neural network. Eng. Comput. 32, 85–97 (2016)
Ozturk, C., Karaboga, D.: Hybrid artificial bee colony algorithm for neural network training. In: 2011 IEEE Congress of Evolutionary Computation (CEC), 2011, pp. 84–88
Anuar, S., Selamat, A., Sallehuddin, R.: Hybrid artificial neural network with artificial bee colony algorithm for crime classification. In: Computational Intelligence in Information Systems, pp. 31–40. Springer, Cham (2015)
Ebrahimi, E., Monjezi, M., Khalesi, M.R., Armaghani, D.J.: Prediction and optimization of back-break and rock fragmentation using an artificial neural network and a bee colony algorithm. Bull. Eng. Geol. Environ. 75, 27–36 (2016)
Subramaniam, S., Radhakrishnan, M.: Neural network with bee colony optimization for MRI brain cancer image classification. Int. Arab J. Inf. Technol. 13, 118–124 (2016)
Cruz, D.P.F., Maia, R.D., da Silva, L.A., de Castro, L.N.: BeeRBF: a bee-inspired data clustering approach to design RBF neural network classifiers. Neurocomputing 172, 427–437 (2016)
Jafrasteh, B., Fathianpour, N.: A hybrid simultaneous perturbation artificial bee colony and back-propagation algorithm for training a local linear radial basis neural network on ore grade estimation. Neurocomputing 235, 217–227 (2017)
Ahmed, M.H., Hasan, S., Ali, A.: Learning enhancement of radial basis function neural network with harmony search algorithm. Int. J. Adv. Soft Comput. Appl. 7, 78–103 (2015)
Saleh, A.Y., Shamsuddin, S.M., Hamed, H.N.A.: Multi-objective differential evolution of evolving spiking neural networks for classification problems. In: IFIP International Conference on Artificial Intelligence Applications and Innovations, 2015, pp. 351–368
Yadav, N., Ngo, T.T., Yadav, A., Kim, J.H.: Numerical solution of boundary value problems using artificial neural networks and harmony search. In: International Conference on Harmony Search Algorithm, 2017, pp. 112–118
Kawam, A.A., Mansour, N.: Metaheuristic optimization algorithms for training artificial neural networks. Int. J. Comput. Inf. Technol. 1, 156–161 (2012)
Nawi, N.M., Khan, A., Rehman, M., Chiroma, H., Herawan, T.: Weight optimization in recurrent neural networks with hybrid metaheuristic Cuckoo search techniques for data classification. Math. Probl. Eng. 1, 1–12 (2015)
Yasar, M.: Optimization of reservoir operation using cuckoo search algorithm: example of Adiguzel Dam, Denizli, Turkey. Math. Probl. Eng. 1, 1–7 (2016)
Alweshah, M.: Firefly algorithm with artificial neural network for time series problems. Res. J. Appl. Sci. Eng. Technol. 7, 3978–3982 (2014)
Alweshah, M., Abdullah, S.: Hybridizing firefly algorithms with a probabilistic neural network for solving classification problems. Appl. Soft Comput. 35, 513–524 (2015)
Alweshah, M., Hammouri, A.I., Tedmori, S.: Biogeography-based optimisation for data classification problems. Int. J. Data Min. Model. Manag. 9, 142–162 (2017)
Eskandar, H., Sadollah, A., Bahreininejad, A., Hamdi, M.: Water cycle algorithm—a novel metaheuristic optimization method for solving constrained engineering optimization problems. Comput. Struct. 110, 151–166 (2012)
Eskandar, H., Sadollah, A., Bahreininejad, A.: Weight optimization of truss structures using water cycle algorithm. Int. J. Optim. Civ. Eng. 3, 115–129 (2013)
Haddad, O.B., Moravej, M., Loáiciga, H.A.: Application of the water cycle algorithm to the optimal operation of reservoir systems. J. Irrig. Drain. Eng. 141, 401–406 (2014)
Jabbar, A., Zainudin, S.: Water cycle algorithm for attribute reduction problems in rough set theory. J. Theor. Appl. Inf. Technol. 61, 107–117 (2014)
Sadollah, A., Eskandar, H., Kim, J.H.: Water cycle algorithm for solving constrained multi-objective optimization problems. Appl. Soft Comput. 27, 279–298 (2015)
Sadollah, A., Eskandar, H., Bahreininejad, A., Kim, J.H.: Water cycle algorithm with evaporation rate for solving constrained and unconstrained optimization problems. Appl. Soft Comput. 30, 58–71 (2015)
Sadollah, A., Eskandar, H., Bahreininejad, A., Kim, J.H.: Water cycle algorithm for solving multi-objective optimization problems. Soft Comput. 19, 2587–2603 (2015)
Sarvi, M., Avanaki, I.N.: An optimized fuzzy logic controller by water cycle algorithm for power management of stand-alone hybrid green power generation. Energy Convers. Manag. 106, 118–126 (2015)
El-Hameed, M.A., El-Fergany, A.A.: Water cycle algorithm-based load frequency controller for interconnected power systems comprising non-linearity. IET Gener. Transm. Distrib. 10, 3950–3961 (2016)
Khalilpourazari, S., Mohammadi, M.: Optimization of closed-loop supply chain network design: a water cycle algorithm approach. In: 2016 12th International Conference on Industrial Engineering (ICIE), 2016, pp. 41–45
Sadollah, A., Eskandar, H., Lee, H.M., Yoo, D.G., Kim, J.H.: Water cycle algorithm: a detailed standard code. SoftwareX 5, 37–43 (2016)
Heidari, A.A., Abbaspour, R.A., Jordehi, A.R.: An efficient chaotic water cycle algorithm for optimization tasks. Neural Comput. Appl. 28, 57–85 (2017)
Méndez, E., Castillo, O., Soria, J., Sadollah, A.: Fuzzy dynamic adaptation of parameters in the water cycle algorithm. In: Nature-Inspired Design of Hybrid Intelligent Systems, pp. 297–311. Springer, Cham (2017)
Moradi, M., Sadollah, A., Eskandar, H., Eskandar, H.: The application of water cycle algorithm to portfolio selection. Econ. Res. Ekon. Istraž. 30, 1–23 (2017)
Pahnehkolaei, S.M.A., Alfi, A., Sadollah, A., Kim, J.H.: Gradient-based Water Cycle Algorithm with evaporation rate applied to chaos suppression. Appl. Soft Comput. 53, 420–440 (2017)
Pham, H.N.A., Triantaphyllou, E.: The impact of overfitting and overgeneralization on the classification accuracy in data mining. In: Soft Computing for Knowledge Discovery and Data Mining, pp. 391–431. Springer, New York (2008)
Sokolova, M., Lapalme, G.: A systematic analysis of performance measures for classification tasks. Inf. Process. Manag. 45, 427–437 (2009)
Gorunescu, F.: Data Mining: Concepts, Models and Techniques. Springer, Berlin (2011)
Rutkowski, L., Cpalka, K.: Flexible neuro-fuzzy systems. Neural Netw. 14, 554–574 (2003)
Zarndt, F.: A comprehensive case study: an examination of machine learning and connectionist algorithms. PhD, Department of Computer Science, Brigham Young University (1995)
Ene, M.: Neural network-based approach to discriminate healthy people from those with Parkinson’s disease. Ann. Univ. Craiova Math. Comput. Sci. Ser. 35, 112–116 (2008)
Kurgan, L.A., Cios, K.J., Tadeusiewicz, R., Ogiela, M., Goodenday, L.S.: Knowledge discovery approach to automated cardiac SPECT diagnosis. Artif. Intell. Med. 23, 149–169 (2001)
Pham, H.N.A., Triantaphyllou, E.: A meta-heuristic approach for improving the accuracy in some classification algorithms. Comput. Oper. Res. 38, 174–189 (2011)
Salar, H., Farrokhi, F.: Improving genetic algorithm performance in multi-classification using simplex method. In: Presented at the First International Conference on Integrated Intelligent Computing (ICIIC), 2010
Pham, H.N.A., Triantaphyllou, E.: The impact of overfitting and overgeneralization on the classification accuracy in data mining. In: Soft Computing for Knowledge Discovery and Data Mining, pp. 391–431. Springer, New York (2008)
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Alweshah, M., Al-Sendah, M., Dorgham, O.M. et al. Improved water cycle algorithm with probabilistic neural network to solve classification problems. Cluster Comput 23, 2703–2718 (2020). https://doi.org/10.1007/s10586-019-03038-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10586-019-03038-5