An Improved PSO Based Back Propagation Learning-MLP (IPSO-BP-MLP) for Classification

  • D. P. Kanungo
  • Bighnaraj Naik
  • Janmenjoy Nayak
  • Sarada Baboo
  • H. S. Behera
Conference paper
Part of the Smart Innovation, Systems and Technologies book series (SIST, volume 31)


Although PSO has been successfully used in much application, the issues of trapping in local optimum and premature convergence can be avoided by using improved version of PSO (IPSO) by introducing new parameter called inertia weight. The IPSO is based on the global search properties of the traditional PSO and focuses on the suitable balance of the investigation and exploitation of the particles in the swarm for effective solution. During IPSO iterations, with increase in possible generations, the search space is decreased. Motivated from successful use of IPSO in many applications, in this paper, it is an attempt to design a MLP classifier with a hybrid back propagation learning based on IPSO. The proposed method has been tested using benchmark dataset from UCI machine learning repository and performances are compared with MLP, GA based MLP and PSO based MLP.


Data mining Classification Improved particle swarm optimization Particle swarm optimization Multilayer perceptron Back propagation learning 


  1. 1.
    Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of the 1995 IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948 (1995)Google Scholar
  2. 2.
    Kennedy, J., Eberhart, R.: Swarm Intelligence Morgan Kaufmann, 3rd edn. Academic Press, New Delhi (2001)Google Scholar
  3. 3.
    Yang, E., Erdogan, A.T., Arslan, T., Barton, N.: An improved particle swarm optimization algorithm for power-efficient wireless sensor networks. In: 2007 ECSIS Symposium on Bio-inspired, Learning, and Intelligent Systems for Security. (2007). doi  10.1109/BLISS.2007.19
  4. 4.
    Zhixia, Z., Caiwu, L.: Application of the improved particle swarm optimizer to vehicle routing and scheduling problems. In: Proceedings of 2007 IEEE International Conference on Grey Systems and Intelligent Services, Nanjing, pp. 1150–1152, 18–20 Nov 2007Google Scholar
  5. 5.
    Wu, X., Qie, Z., Zhang, Z.Z.H.: Application of Improved PSO to optimization of gravity dam and sluice gate *. In: Proceedings of the 7th World Congress on Intelligent Control and Automation, Chongqing, pp. 6178–6182, 25–27 June 2008Google Scholar
  6. 6.
    Tang, X., Pang, Y., Chang, W., Li, Y.: Improved PSO-based S curve controller for motion control of underwater vehicle. In: Proceedings of the 7th World Congress on Intelligent Control and Automation, Chongqing, pp. 6949–6954, 25–27 June 2008Google Scholar
  7. 7.
    Chen, Q., Guo, W., Li, C.: An improved PSO algorithm to optimize BP neural network. In: 2009 5th International Conference on Natural Computation, pp. 351–360 (2009)Google Scholar
  8. 8.
    Park, J.-B., Jeong, Y.-W., Shin, J.-R., Lee, K.Y.: An improved particle swarm optimization for nonconvex economic dispatch problems. IEEE Trans. Power Syst. 25(1), 156–166 (2010)CrossRefGoogle Scholar
  9. 9.
    Ran, M., Duan, H., Gao, X., Mao, Z. : Improved particle swarm optimization approach to path planning of amphibious mouse robot. In: 2011 6th IEEE Conference on Industrial Electronics and Applications, pp. 1146–1149 (2011). doi:978-1-4244-8756-1Google Scholar
  10. 10.
    Chew, K.S., Zarrabi, K.: Non-contact displacements measurement using an improved particle swarm optimization based digital speckle correlation method. In: 2011 International Conference on Pattern Analysis and Intelligent Robotics, Putrajaya, pp. 53–58, 28–29 June 2011Google Scholar
  11. 11.
    Ishaque, K., Salam, Z., Amjad, M., Mekhilef, S. : An improved particle swarm optimization (PSO)–based MPPT for PV with reduced steady-state oscillation. IEEE Trans. Power Electron. 27(8), 3627–3638 (2012)Google Scholar
  12. 12.
    Qais, M., AbdulWahid, Z.: A New Method for Improving Particle Swarm Optimization Algorithm (TriPSO). doi: 978-1-4673-5814-9Google Scholar
  13. 13.
    Geng, Q., Zhao, Z.: A Kind of Route Planning Method for UAV Based on Improved PSO Algorithm. doi: 978-1-4673-5534-6Google Scholar
  14. 14.
    Shakiba, R., Najafipour, M., Salehi, M.E.: An Improved PSO-Based Path Planning Algorithm For Humanoid Soccer Playing Robots. doi: 978-1-4673-6315-0Google Scholar
  15. 15.
    Yanqiu, L., Zheng, W., Dayu, Z., Yinghui, L., He, W.: Improved particle swarm optimization applied in calibrating a three-axis measuring system. In: Control Conference (CCC). 2013 32nd Chinese, pp. 3120–3123, IEEE (2013)Google Scholar
  16. 16.
    Qu, Z., Li, Q., Yue, L.: Improved particle swarm optimization for constrained optimization. In: 2013 International Conference on Information Technology and Applications, pp. 244–247 (2013)Google Scholar
  17. 17.
    Barani, M.J., Ayubi, P., Hadi, R.M.: Improved Particle Swarm Optimization Based on Chaotic Cellular Automata. doi: 978-1-4799-3351-8Google Scholar
  18. 18.
    Naik, B., Nayak, J., Behera, H.S.: A Novel FLANN with a hybrid PSO and GA based gradient descent learning for classification. In: Proceedings of the 3rd International Conference on Front of Intelligent Computing (FICTA). Advances in Intelligent Systems and Computing, vol. 1(327), pp. 745–754 (2014). doi:  10.1007/978-3-319-11933-5_84
  19. 19.
    Yue-bo, M.: ZouJian-hua, GanXu-sheng, ZhaoLiang: research on WNN aerodynamic modeling from flight data based on improved PSO algorithm. Neurocomputing 83, 212–221 (2012)CrossRefGoogle Scholar
  20. 20.
    Yang, J.M., Kao, C.Y.: A robust evolutionary algorithm for training neural networks. Neural Comput. Appl. 10, 214–230 (2001)CrossRefMATHGoogle Scholar
  21. 21.
    Hamedi, M., et al.: Comparison of multilayer perceptron and radial basis function neural networks for EMG-based facial gesture recognition. In: The 8th International Conference on Robotic, Vision, Signal Processing and Power Applications, Springer, Singapore (2014)Google Scholar
  22. 22.
    Ndiaye, A., et al.: Development of a multilayer perceptron (MLP) based neural network controller for grid connected photovoltaic system. Int. J. Phys. Sci. 9(3), 41–47 (2014)CrossRefGoogle Scholar
  23. 23.
    Roy, M., et al.: Ensemble of multilayer perceptrons for change detection in remotely sensed images. Geosci. Remote Sens. Lett. 49–53 IEEE 11.1, New York (2014)Google Scholar
  24. 24.
    Hassanien, A.E., et al.: MRI breast cancer diagnosis hybrid approach using adaptive ant-based segmentation and multilayer perceptron neural networks classifier. Appl. Softw Comput. 14, 62–71 (2014)CrossRefGoogle Scholar
  25. 25.
    Aydin, K., Kisi, O.: Damage detection in Timoshenko beam structures by multilayer perceptron and radial basis function networks. Neural Comput. Appl. 24(3-4), 583–597 (2014)CrossRefGoogle Scholar
  26. 26.
    Velo, R., López, P., Maseda, F.: Wind speed estimation using multilayer perceptron. Energy Convers. Manag. 81, 1–9 (2014)CrossRefGoogle Scholar
  27. 27.
    Lee, S., Choeh, J.Y.: Predicting the helpfulness of online reviews using multilayer perceptron neural networks. Expert Syst. Appl. 41(6), 3041–3046 (2014)CrossRefGoogle Scholar
  28. 28.
    Azim, S., Aggarwal, S.: Hybrid model for data imputation: using fuzzy c means and multi layer perceptron. In: IEEE Advance Computing Conference (IACC), pp. 1281–1285 (2014)Google Scholar
  29. 29.
    Chaudhuri, S., Goswami, S., Middey, A.: Medium-range forecast of cyclogenesis over North Indian Ocean with multilayer perceptron model using satellite data. Nat. Hazards 70(1), 173–193 (2014)CrossRefGoogle Scholar
  30. 30.
    Bache, K., Lichman, M.: UCI Machine Learning Repository. []. Irvine. CA: University of California, School of Information and Computer Science (2013)

Copyright information

© Springer India 2015

Authors and Affiliations

  • D. P. Kanungo
    • 1
  • Bighnaraj Naik
    • 1
  • Janmenjoy Nayak
    • 1
  • Sarada Baboo
    • 2
  • H. S. Behera
    • 1
  1. 1.Department of Computer Science Engineering and Information TechnologyVeer Surendra Sai University of TechnologyBurla, SambalpurIndia
  2. 2.Department of Computer Science and ApplicationSambalpur UniversityBurla, SambalpurIndia

Personalised recommendations