Skip to main content

A Deep Neural Network Combined with Radial Basis Function for Abnormality Classification

Abstract

Researchers working on cancer datasets often encounter two major challenges in their data science tasks. First, the numbers of samples are often low while the numbers of features needed for extraction are high. Secondly, the existence of noise and uncertainties in datasets can cause issues with any data science related tasks. Addressing such issues is of paramount importance to researchers and consequently to society as well. In this paper, making use of Principal Component Analysis (PCA) we remove irrelevant and redundant features from known cancer datasets. We then implement a novel internal structure using a deep neural network, which is based on the radial basis function (RBF) for feature extraction. This task is followed with the selection of the most informative features, which are prepared for an adaptive neuro-fuzzy inference system (ANFIS) based on Takagi-Sugeno-Kang (TSK). The entire process considers different values of thresholds which may cause a deficient number of features for classification. As a result, in the fuzzy classifier, the number of rules will not be substantial. Finally, our proposed approach is evaluated in three cancer datasets which are COLON, ALL-AML, and LEUKEMIA. We also apply two classifiers: 1) neuro-fuzzy inference system with different types of membership functions and 2) multi-layer perceptron to classify those cancer datasets into two groups. Our strong experimental results show that our method leads to a higher accuracy when compared to a multi-layer perceptron classifier.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

References

  1. 1.

    Ravi D, Wong C, Deligianni F, Berthelot M, Andreu-Perez J, Lo B, Yang G (2017) Deep learning for health informatics. IEEE J Biomed Health Inform 21(1):4–21

    Article  Google Scholar 

  2. 2.

    Roychowdhury S, Koozekanani D, Parhi K (2014) DREAM Diabetic Retinopathy Analysis Using Machine Learning. IEEE J Biomed Health Inform 18(5):1717–1728

    Article  Google Scholar 

  3. 3.

    Mohan S, Thirumalai C, Srivastava G (2019) Effective heart disease prediction using hybrid machine learning techniques. IEEE Access 7:81542–54

    Article  Google Scholar 

  4. 4.

    Reddy GT, Reddy MP, Lakshmanna K, Rajput DS, Kaluri R, Srivastava G (2019) Hybrid genetic algorithm and a fuzzy logic classifier for heart disease diagnosis. Evol Intell 26:1–2

    Google Scholar 

  5. 5.

    Shah N, Srivastava G, Savage DW, Mago V (2019) Assessing canadians health activity and nutritional habits through social media. Frontiers in Public Health: 7

  6. 6.

    Zhang L, Le L u, Nogues I, Summers R, Liu S, Yao J (2017) DeepPap deep convolutional networks for cervical cell classification. IEEE J Biomed Health Inform 21(6):1633–1643

  7. 7.

    Yap M, Pons G, Marti J, Ganau S, Sentis M, Zwiggelaar R, Davison A, Marti R (2018) Automated Breast Ultrasound Lesions Detection Using Convolutional Neural Networks. IEEE J Biomed Health Inform 22(4):1218–1226

    Article  Google Scholar 

  8. 8.

    Li K, Liu C, Zhu T, Herrero P, Georgiou P (2019) GluNet a deep learning framework for accurate glucose forecasting. IEEE J Biomed Health Inform: 1–1

  9. 9.

    Goovaerts G, Padhy S, Vandenberk B, Varon C, Willems R, Van Huffel S (2019) A machine-learning approach for detection and quantification of QRS fragmentation. IEEE J Biomed Health Inform 23 (5):1980–1989

    Article  Google Scholar 

  10. 10.

    Trivizakis E, Manikis G, Nikiforaki K, Drevelegas K, Constantinides M, Drevelegas A, Marias K (2019) Extending 2-D convolutional neural networks to 3-D for advancing deep learning cancer classification with application to MRI liver tumor differentiation. IEEE J Biomed Health Inform 23(3):923–930

    Article  Google Scholar 

  11. 11.

    Meng N, Lam E, Tsia K, So H (2019) Large-scale multi-class image-based cell classification with deep learning. IEEE J Biomed Health Inform 23(5):2091–2098

    Article  Google Scholar 

  12. 12.

    Facts C (2019) Joinpoint trends in cancer incidence rates for selected sites in two age groups, US, 1995-2015 35 Figure S6. Trends in cancer death rates for selected sites

  13. 13.

    Uppu S, Krishna A, Gopalan RP (2015) Rule-based analysis for detecting epistasis using associative classification mining. Network Modeling Analysis in Health Informatics and Bioinformatics 4(1)

  14. 14.

    Uppu S, Krishna A, Gopalan RP (2016) A deep learning approach to detect SNP interactions. J Software 11(10):965–975. https://doi.org/10.17706/jsw.11.10.965-975

    Article  Google Scholar 

  15. 15.

    Salem H, Attiya G, El-Fishawy N (2017) Classification of human cancer diseases by gene expression profiles. Appl Soft Comput 50:124–134

    Article  Google Scholar 

  16. 16.

    Chaudhari P, Agarwal H (2018) Improving feature selection using elite breeding QPSO on gene data set for cancer classification. In: Intelligent Engineering Informatics. Springer, Singapore, pp 209–219

  17. 17.

    Panda M (2017) Elephant search optimization combined with deep neural network for microarray data analysis. Journal of King Saud University-Computer and Information Sciences

  18. 18.

    Plat JC, Cristianini N, Shawe-Taylor J (2000) Large margin DAGs for multiclass classification. Advances in neural information processing systems: 547–553

  19. 19.

    Huang H-L, Chang F-L (2007) ESVM: Evolutionary support vector machine for automatic feature selection and classification of microarray data. Biosystems 90(2):516–528

    MathSciNet  Article  Google Scholar 

  20. 20.

    El Akadi A, Amine A, El Ouardighi A, Aboutajdine D (2009) A new gene selection approach based on Minimum Redundancy-Maximum Relevance (MRMR) and Genetic Algorithm (GA)

  21. 21.

    Mao Y, Zhou X, Pi D, Sun Y, Wong ST (2005) Multiclass cancer classification by using fuzzy support vector machine and binary decision tree with gene selection. J Biomed Biotechnol 2005(2):160–171

    Article  Google Scholar 

  22. 22.

    Wang L, Chu F, Xie W (2007) Accurate cancer classification using expressions of very few genes. IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB) 4(1):40– 53

    Article  Google Scholar 

  23. 23.

    Zhang R, Huang G-B, Sundararajan N, Saratchandran P (2007) Multicategory classification using an extreme learning machine for microarray gene expression cancer diagnosis. IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB) 4(3):485–495

    Article  Google Scholar 

  24. 24.

    Zainuddin Z, Pauline O (2009) Improved wavelet neural network for early diagnosis of cancer patients using microarray gene expression data. In: International Joint Conference on Neural Networks IJCNN 2009. IEEE, p 2009

  25. 25.

    Linder R, et al. (2004) The subsequent artificial neural network’(SANN) approach might bring more classificatory power to ANN-based DNA microarray analyses. Bioinformatics 20(18):3544–3552

    Article  Google Scholar 

  26. 26.

    Vanitha CDA, Devaraj D, Venkatesulu M (2015) Gene expression data classification using Support Vector Machine and Mutual Information-based gene selection. Procedia Computer Science 47:13–21. https://doi.org/10.1016/j.procs.2015.03.178

    Article  Google Scholar 

  27. 27.

    Uppu S, Krishna A, Gopalan RP (2016) Towards deep learning in genome wide association interactionstudies. Pacific Asia Conference on Information Systems

  28. 28.

    Nguyen H, Thi T, et al. (2020) Cancer classification from microarray data for genomic disorder research using optimal discriminant independent component analysis and kernel extreme learning machine. Int J Numer Methods Biomed Eng:1–27

  29. 29.

    Shukla AK, Singh P, Vardhan M (2018) A two-stage gene selection method for biomarker discovery from microarray data for cancer classification. Chemometrics and Intelligent Laboratory Systems 183:47–58

    Article  Google Scholar 

  30. 30.

    Ziasabounchi N, Askerzade I (2014) ANFIS based classification model for heart disease prediction. Int J Electrical Comput Sci 14:7–12

    Google Scholar 

  31. 31.

    Sujatha K, et al. (2020) Screening and early identification of microcalcifications in breast using texture-based ANFIS classification. Wearable and implantable medical devices. Academic Press, Cambridge, pp 15–140

    Google Scholar 

  32. 32.

    Chung I. -F., Chen Y. -C., Pal N (2017) Feature selection with controlled redundancy in a fuzzy rule based framework. IEEE Trans Fuzzy Syst 99:1–1

    Google Scholar 

  33. 33.

    Lee H. -M., Chen C. -M., Chen J. -M., Jou Y. -L. (2001) An efficient fuzzy classifier with feature selection based on fuzzy entropy. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) 31(3):426–432

    Article  Google Scholar 

  34. 34.

    Susmi SJ, Nehemiah HK, Kannan A, Christopher J (2016) Relevant gene selection and classification of leukemia gene expression data. Emerging research in computing, information, communication and applications. Springer, Singapore, pp 503–510

    Google Scholar 

  35. 35.

    Fakoor R, Ladhak F, Nazi A, Huber M (2013) Using deep learning to enhance cancer diagnosis and classification. Proceedings of the International Conference on Machine Learning, vol. 28

  36. 36.

    Min S, Lee B, Yoon S (2017) Deep learning in bioinformatics. Briefings in Bioinformatics 18(5):851–869

    Google Scholar 

  37. 37.

    SIPTA Homepage. [Online]. Available: http://leo.ugr.es/elvira/DBCRepository/index.html

  38. 38.

    Datasets|Feature Selection @ ASU. [Online]. Available: http://featureselection.asu.edu/datasets.php.

  39. 39.

    Hajian A, Styles P (2018) Fuzzy logic. Application of soft computing and intelligent methods in geophysics. Springer, Cham, pp 201–300

    Book  Google Scholar 

  40. 40.

    Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT Press, Cambridge

    MATH  Google Scholar 

  41. 41.

    Blu T, M. Unse (2002) Wavelets, fractals, and radial basis functions. IEEE Transactions on Signal Processing 50(3):543– 553

    MathSciNet  Article  Google Scholar 

  42. 42.

    Mahboob AS, Zahiri SH (2019) Automatic and heuristic complete design for ANFIS classifier. Network: Computation in Neural Systems 30:31–57

    Article  Google Scholar 

  43. 43.

    Talpur N, Salleh MNM, Hussain K (2017) An investigation of membership functions on performance of ANFIS for solving classification problems. IOP Conference Series Materials Science and Engineering 226(1). IOP Publishing

  44. 44.

    Mohammadi S, Mirvaziri H, Ahsaee MG, Karimipour H (2018) Cyber intrusion detection by combined feature selection algorithm. J Inf Secur Appl 44:80–88

    Google Scholar 

  45. 45.

    Karimipour H, Leung H (2019) Relaxation-based anomaly detection in cyber-physical systems using ensemble Kalman filter. IET Cyber-physical Systems: Theory and Applications 3:29– 38

    Google Scholar 

  46. 46.

    Rath Priyadarsini, Dash Rajani B., Ghosh Swapan Kumar (2018) Solution of fuzzy multi-objective fractional linear programming problem using fuzzy programming technique based on exponential membership function. Bull Pure Appl Sci-Math Stat 37(1):109–116

    Article  Google Scholar 

  47. 47.

    Kukolj D (2002) Design of adaptive Takagi–Sugeno–Kang fuzzy models. Appl Soft Comput 2 (2):89–103

    Article  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Gautam Srivastava.

Ethics declarations

Conflict of Interests

The authors have no conflict of interest to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Jafarpisheh, N., Zaferani, E.J., Teshnehlab, M. et al. A Deep Neural Network Combined with Radial Basis Function for Abnormality Classification. Mobile Netw Appl (2021). https://doi.org/10.1007/s11036-021-01835-0

Download citation

Keywords

  • Adaptive neuro-fuzzy inference system
  • Cancer datasets
  • Multi-layer perceptron
  • RBF-DNN