A Hybrid PSO-FSVM Model and Its Application to Imbalanced Classification of Mammograms

  • Hussein Samma
  • Chee Peng Lim
  • Umi Kalthum Ngah
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7802)


In this work, a hybrid model comprising Particle Swarm Optimization (PSO) and the Fuzzy Support Vector Machine (FSVM) for tackling imbalanced classification problems is proposed. A PSO algorithm, guided by the G-mean measure, is used to optimize the FSVM parameters in imbalanced classification problems. The hybrid PSO-FSVM model is evaluated using a mammogram mass classification problem. The experimental results are analyzed and compared with those from other methods. The outcomes positively demonstrate that the proposed PSO-FSVM model is able to achieve comparable, if not better, results for imbalanced data classification problems.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Vegard, E., Jonathan, V., Keith, P.: Enhancing network based intrusion detection for imbalanced data. Int. J. Know.-Based Intell. Eng. Syst. 12, 357–367 (2008)Google Scholar
  2. 2.
    Mazurowski, M.A., Habas, P.A., Zurada, J.M., Lo, J.Y., Baker, J.A., Tourassi, G.D.: Training neural network classifiers for medical decision making: The effects of imbalanced datasets on classification performance. Neural Networks 21, 427–436 (2008)CrossRefGoogle Scholar
  3. 3.
    Chen, K., Lim, C., Lai, W.: Application of a Neural Fuzzy System with Rule Extraction to Fault Detection and Diagnosis. Journal of Intelligent Manufacturing 16, 679–691 (2005)CrossRefGoogle Scholar
  4. 4.
    Eric, W.M.L., Lee, Y.Y., Lim, C.P., Tang, C.Y.: Application of a noisy data classification technique to determine the occurrence of flashover in compartment fires. Adv. Eng. Inform. 20, 213–222 (2006)CrossRefGoogle Scholar
  5. 5.
    Goh, W.Y., Lim, C.P., Peh, K.K., Subari, K.: Application of a Recurrent Neural Network to Prediction of Drug Dissolution Profiles. Neural Computing & Applications 10, 311–317 (2002)MATHCrossRefGoogle Scholar
  6. 6.
    Chee-Peng, L., Jenn-Hwai, L., Mei-Ming, K.: A Hybrid Neural Network System for Pattern Classification Tasks with Missing Features. IEEE Trans. Pattern Anal. Mach. Intell. 27, 648–653 (2005)CrossRefGoogle Scholar
  7. 7.
    Hua Tan, K., Peng Lim, C., Platts, K., Shen Koay, H.: An intelligent decision support system for manufacturing technology investments. International Journal of Production Economics 104, 179–190 (2006)CrossRefGoogle Scholar
  8. 8.
    Chee Peng, L., Harrison, R.F.: Online pattern classification with multiple neural network systems: an experimental study. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 33, 235–247 (2003)CrossRefGoogle Scholar
  9. 9.
    Lim, C.P., Quek, S.S., Peh, K.K.: Prediction of drug release profiles using an intelligent learning system: an experimental study in transdermal iontophoresis. Journal of Pharmaceutical and Biomedical Analysis 31, 159–168 (2003)CrossRefGoogle Scholar
  10. 10.
    Hsu, C.-C., Wang, K.-S., Chang, S.-H.: Bayesian decision theory for support vector machines: Imbalance measurement and feature optimization. Expert Systems with Applications 38, 4698–4704 (2011)CrossRefGoogle Scholar
  11. 11.
    Liu, Y., An, A., Huang, X.: Boosting Prediction Accuracy on Imbalanced Datasets with SVM Ensembles. In: Ng, W.-K., Kitsuregawa, M., Li, J., Chang, K. (eds.) PAKDD 2006. LNCS (LNAI), vol. 3918, pp. 107–118. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  12. 12.
    Liu, Y., Yu, X., Huang, J.X., An, A.: Combining integrated sampling with SVM ensembles for learning from imbalanced datasets. Information Processing & Management 47, 617–631 (2011)CrossRefGoogle Scholar
  13. 13.
    Veropoulos, K., Campbell, C., Cristianini, N.: Controlling the Sensitivity of Support Vector Machines. In: the International Joint Conference on AI, pp. 55–60 (1999)Google Scholar
  14. 14.
    Kang, P., Cho, S.: EUS SVMs: Ensemble of Under-Sampled SVMs for Data Imbalance Problems. In: King, I., Wang, J., Chan, L.-W., Wang, D. (eds.) ICONIP 2006. LNCS, vol. 4232, pp. 837–846. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  15. 15.
    Batuwita, R., Palade, V.: FSVM-CIL: Fuzzy Support Vector Machines for Class Imbalance Learning. IEEE Transactions on Fuzzy Systems 18, 558–571 (2010)CrossRefGoogle Scholar
  16. 16.
    Wu, G., Chang, E.Y.: KBA: kernel boundary alignment considering imbalanced data distribution. IEEE Transactions on Knowledge and Data Engineering 17, 786–795 (2005)CrossRefGoogle Scholar
  17. 17.
    Zhao, Z., Zhong, P., Zhao, Y.: Learning SVM with weighted maximum margin criterion for classification of imbalanced data. Mathematical and Computer Modelling 54, 1093–1099 (2011)MATHCrossRefGoogle Scholar
  18. 18.
    Hwang, J.P., Park, S., Kim, E.: A new weighted approach to imbalanced data classification problem via support vector machine with quadratic cost function. Expert Systems with Applications 38, 8580–8585 (2011)CrossRefGoogle Scholar
  19. 19.
    Yuchun, T., Yan-Qing, Z., Nitesh, V.C., Sven, K.: SVMs modeling for highly imbalanced classification. Trans. Sys. Man Cyber. Part B 39, 281–288 (2009)CrossRefGoogle Scholar
  20. 20.
    Imam, T., Ting, K.M., Kamruzzaman, J.: z-SVM: An SVM for Improved Classification of Imbalanced Data. In: Sattar, A., Kang, B.-H. (eds.) AI 2006. LNCS (LNAI), vol. 4304, pp. 264–273. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  21. 21.
    Chun-Fu, L., Sheng-De, W.: Fuzzy support vector machines. IEEE Transactions on Neural Networks 13, 464–471 (2002)CrossRefGoogle Scholar
  22. 22.
    Keerthi, S.S., Lin, C.-J.: Asymptotic behaviors of support vector machines with Gaussian kernel. Neural Computation 15, 1667–1689 (2003)MATHCrossRefGoogle Scholar
  23. 23.
    Guo, X.C., Yang, J.H., Wu, C.G., Wang, C.Y., Liang, Y.C.: A novel LS-SVMs hyper-parameter selection based on particle swarm optimization. Neurocomputing 71, 3211–3215 (2008)CrossRefGoogle Scholar
  24. 24.
    Lin, S.-W., Ying, K.-C., Chen, S.-C., Lee, Z.-J.: Particle swarm optimization for parameter determination and feature selection of support vector machines. Expert Systems with Applications 35, 1817–1824 (2008)CrossRefGoogle Scholar
  25. 25.
    Kennedy, J., Eberhart, R.: Particle swarm optimization. In: IEEE International Conference on Neural Networks, vol. 4, 1944, pp. 1942–1948 (1995)Google Scholar
  26. 26.
    Ratnaweera, A., Halgamuge, S.K., Watson, H.C.: Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients. IEEE Transactions on Evolutionary Computation 8, 240–255 (2004)CrossRefGoogle Scholar
  27. 27.
    Sheng, C., Xia, H., Harris, C.J.: Particle Swarm Optimization Aided Orthogonal Forward Regression for Unified Data Modeling. IEEE Transactions on Evolutionary Computation 14, 477–499 (2010)CrossRefGoogle Scholar
  28. 28.
    Gao, M., Hong, X., Chen, S., Harris, C.J.: A combined SMOTE and PSO based RBF classifier for two-class imbalanced problems. Neurocomputing 74, 3456–3466 (2011)CrossRefGoogle Scholar
  29. 29.
    Xia, H., Sheng, C., Harris, C.J.: A Kernel-Based Two-Class Classifier for Imbalanced Data Sets. IEEE Transactions on Neural Networks 18, 28–41 (2007)CrossRefGoogle Scholar
  30. 30.
    The Mini-MIAS Database of Mammograms, http://peipa.essex.ac.uk
  31. 31.
    Li, S., Tan, M.: Tuning SVM parameters by using a hybrid CLPSO-BFGS algorithm. Neurocomputing 73, 2089–2096 (2010)CrossRefGoogle Scholar
  32. 32.
    Montgomery, D.C.: Design and analysis of experiments. Wiley (1997)Google Scholar
  33. 33.
    Pan, Q.-K., Fatih Tasgetiren, M., Liang, Y.-C.: A discrete particle swarm optimization algorithm for the no-wait flowshop scheduling problem. Computers & Operations Research 35, 2807–2839 (2008)MATHCrossRefGoogle Scholar
  34. 34.
    Wang, C.-H., Lin, T.-W.: Improved particle swarm optimization to minimize periodic preventive maintenance cost for series-parallel systems. Expert Systems with Applications 38, 8963–8969Google Scholar
  35. 35.
    Efron, B.: Bootstrap Methods: Another Look at the Jackknife. The Annals of Statistics 7, 1–26 (1979)MathSciNetMATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Hussein Samma
    • 1
  • Chee Peng Lim
    • 2
  • Umi Kalthum Ngah
    • 1
  1. 1.Imaging & Computational Intelligence Group (ICI), School of Electrical and Electronic EngineeringUniversity of Science MalaysiaMalaysia
  2. 2.Centre for Intelligent Systems ResearchDeakin UniversityAustralia

Personalised recommendations