Abstract
Probabilistic neural network (PNN) is a single-pass feed-forward neural network with the capability of providing nonlinear decision boundaries. In this work, we propose the modifications to the existing PNN approach. Contributions are threefold: First, symmetric Laplace distribution has been used instead of Gaussian distribution in the pattern layer of the PNN approach. Second, a new weight coefficients’ estimation method has been introduced between the pattern and summation layers of PNN. Third, a novel convex fitness function has been designed for the bat algorithm to obtain an optimal smoothing parameter vector. The designed fitness function maintains a balance between the sensitivity and specificity values. The performance of the proposed algorithm “bat algorithm-based weighted Laplacian probabilistic neural network” is compared with that of conventional PNN, weighted PNN, extreme learning method, optimal pruned extreme learning machine and K-nearest neighbor. Experimental evaluation is carried out on eleven benchmark data sets using different performance measures such as accuracy, sensitivity, specificity and Youden’s index. The comparative performance evaluation of the proposed model has been made with the PNN, and other standard algorithms outperform the compared approaches in terms of classification accuracy. Friedman test is used for statistical evaluation of the proposed approach.
Similar content being viewed by others
References
Zhang GP (2000) Neural networks for classification: a survey. IEEE Trans Syst Man Cybern Part C (Appl Rev) 30(4):451–462
Chen FC (1989) Back-propagation neural network for nonlinear self-tuning adaptive control. In: International symposium on intelligent control. IEEE, pp 274–279
Dutta M, Chatterjee A, Rakshit A (2006) Intelligent phase correction in automatic digital ac bridges by resilient backpropagation neural network. Measurement 39(10):884–891
Haykin SS (2009) Neural networks and learning machines. Pearson Upper Saddle River, Hoboken
Huang G-B, Zhu Q-Y, Siew C-K (2004) Extreme learning machine: a new learning scheme of feedforward neural networks. In: International joint conference on neural networks (IJCNN), vol 2. IEEE, pp 985–990
Specht Donald F (1990) Probabilistic neural networks. Neural Netw 3(1):109–118
Mao KZ, Tan K-C, Ser W (2000) Probabilistic neural-network structure determination for pattern classification. IEEE Trans Neural Netw 11(4):1009–1016
Nanjundappan D et al (2016) Hybrid weighted probabilistic neural network and biogeography based optimization for dynamic economic dispatch of integrated multiple-fuel and wind power plants. Int J Electr Power Energy Syst 77:385–394
Song T, Jamshidi M, Lee RR, Huang M (2005) A novel weighted probabilistic neural network for MR image segmentation. In: International conference on systems, man and cybernetics, vol 3. IEEE, pp 2501–2506
Ross SM (2009) Probability and statistics for engineers and scientists. Elsevier, Amsterdam
Kotz S, Kozubowski T, Podgorski K (2012) The Laplace distribution and generalizations: a revisit with applications to communications, economics, engineering, and finance. Springer, Berlin
Draper NR, Smith H (2014) Applied regression analysis, vol 326. Wiley, Hoboken
Song W, Yao W, Xing Y (2014) Robust mixture regression model fitting by Laplace distribution. Comput Stat Data Anal 71:128–137
Rasheed HA, Nadia JA, Al-Baldawi THK (2014) Some Bayes’ estimators for Laplace distribution under different loss functions. J Babylon Univ 22:975–983
Burrascano P (1991) Learning vector quantization for the probabilistic neural network. IEEE Trans Neural Netw 2(4):458–461
Yi J-H, Wang J, Wang G-G (2016) Improved probabilistic neural networks with self-adaptive strategies for transformer fault diagnosis problem. Adv Mech Eng 8(1):1–13
Montana D (1992) A weighted probabilistic neural network. In: Advances in neural information processing systems, pp 1110–1117
Song T, Gasparovic C, Andreasen N, Bockholt J, Jamshidi M, Lee RR, Huang M (2006) A hybrid tissue segmentation approach for brain MR images. Med Biol Eng Comput 44(3):242–249
Ramakrishnan S, El Emary IMM (2009) Comparative study between traditional and modified probabilistic neural networks. Telecommun Syst 40(1–2):67–74
Kusy M, Kowalski PA (2018) Weighted probabilistic neural network. Inf Sci 430:65–76
Yang ZR, Chen S (1998) Robust maximum likelihood training of heteroscedastic probabilistic neural networks. Neural Netw 11(4):739–747
Georgiou VL, Alevizos PD, Vrahatis MN (2008) Novel approaches to probabilistic neural networks through bagging and evolutionary estimating of prior probabilities. Neural Process Lett 27(2):153–162
Wolpert DH, Macready WG et al (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82
Georgiou VL, Malefaki SN, Alevizos PD, Vrahatis MN (2006) Evolutionary bayesian probabilistic neural networks. In: International conference on numerical analysis and applied mathematics (ICNAAM). Wiley, pp 393–396
Yang X-S (2010) A new metaheuristic bat-inspired algorithm. In: González JR, Pelta DA, Cruz C, Terrazas G, Krasnogor N (eds) Nature inspired cooperative strategies for optimization (NICSO 2010). Studies in computational intelligence, vol 284. Springer, Berlin, pp 65–74
Huang G-Q, Zhao W-J, Qiu-Qin L (2013) Bat algorithm with global convergence for solving large-scale optimization problem. Jisuanji Yingyong Yanjiu 30(5):1323–1328
Dua D, Graff C (2019) UCI machine learning repository. http://archive.ics.uci.edu/ml. University of California, School of Information and Computer Science, Irvine, CA
Miche Y, Sorjamaa A, Bas P, Simula O, Jutten C, Lendasse A (2010) OP-ELM: optimally pruned extreme learning machine. IEEE Trans Neural Netw 21(1):158–162
Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297
Kohonen T (1995) Learning vector quantization. In: Self-organizing maps. Springer series in information sciences, vol 30. Springer, Berlin, Heidelberg
Park J, Sandberg IW (1991) Universal approximation using radial-basis-function networks. Neural Comput 3(2):246–257
Specht DF (1990) Probabilistic neural networks and the polynomial adaline as complementary techniques for classification. IEEE Trans Neural Netw 1(1):111–121
Jain A, Nandakumar K, Ross A (2005) Score normalization in multimodal biometric systems. Pattern Recognit 38(12):2270–2285
Sokolova M, Lapalme G (2009) A systematic analysis of performance measures for classification tasks. Inf Process Manag 45(4):427–437
Youden WJ (1950) Index for rating diagnostic tests. Cancer 3(1):32–35
Yang H, Yang Z (2012) An improved grey neural network model with GA optimization. In: Fifth international conference on intelligent computation technology and automation (ICICTA). IEEE, pp 72–75
Kohavi R et al (1995) A study of cross-validation and bootstrap for accuracy estimation and model selection. IJCAI 14:1137–1145
Peterson LE (2009) K-nearest neighbor. Scholarpedia 4(2):1883
Royston JP (1983) Some techniques for assessing multivarate normality based on the Shapiro-Wilk W. Appl Stat 32(2):121–133
Henze N, Zirkler B (1990) A class of invariant consistent tests for multivariate normality. Commun Stat Theory Methods 19(10):3595–3617
Kundu D (2005) Discriminating between normal and Laplace distributions. In: Advances in ranking and selection, multiple comparisons, and reliability. Springer, pp 65–79
Acknowledgements
The authors are thankful to Prof. Gopal Mugeraya, Director of National Institute of Technology Goa, for providing required help and support. Also we would like to thank DST SERB for providing computational facilities [File Number: YSS/2015/001636].
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Naik, S.M., Jagannath, R.P.K. & Kuppili, V. Bat algorithm-based weighted Laplacian probabilistic neural network. Neural Comput & Applic 32, 1157–1171 (2020). https://doi.org/10.1007/s00521-019-04475-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-019-04475-4