Skip to main content
SpringerLink
Log in

Efficient classification of different medical image multimodalities based on simple CNN architecture and augmentation algorithms

  • Research Article
  • Published:
Journal of Optics Aims and scope Submit manuscript

Abstract

Convolutional neural networks (CNN) are the best deep learning architecture to perform tumors classification for different imaging modalities: Us, X-ray, CT, and MRI. The scarcity of medical images and scarcity of resources are the contemporary problem for achieving successful classification. Therefore, it is preferable to use a simple network that does not require training and implementation resources than to use complex or pre-trained CNN models. Simple networks make it easy to use in clinical diagnosis and on mobile platforms. In this paper, a proposed CNN architecture for medical image multimodalities classification is presented. This proposed network is simple and is directly trained by medical images which is better than using pre-trained deep learning networks. Firstly, the data augmentation process is applied to avoid data shortage, and then, the proposed CNN is trained using the resulted augmented data. Simulation results demonstrate the efficiency of the proposed CNN architecture for efficient classification. The proposed model is trained on medical Us, X-ray, CT, and MRI datasets from scratch, and it can achieve 92.7%, 91.1%, 100%, 100% accuracies for these datasets, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Data availability

All data are available upon request from the corresponding author.

References

  1. W. El-Shafai, I. Almomani, A. Alkhayer, Optical bit-plane-based 3D-JST cryptography algorithm with cascaded 2D-FrFT encryption for efficient and secure HEVC communication. IEEE Access 2(9), 35004–35026 (2021)

    Article  Google Scholar 

  2. A. Alarifi, M. Amoon, M. Aly, W. El-Shafai, Optical PTFT asymmetric cryptosystem-based secure and efficient cancelable biometric recognition system. IEEE Access 3(8), 221246–221268 (2020)

    Article  Google Scholar 

  3. O. Faragallah, A. Afifi, H. El-Sayed, M. Alzain, J. Al-Amri, F. Abd El-Samie, W. El-Shafai, Efficient HEVC integrity verification scheme for multimedia cybersecurity applications. IEEE Access 7(8), 167069–167089 (2020)

    Article  Google Scholar 

  4. I. Elashry, W. El-Shafai, E. Hasan, S. El-Rabaie, A. Abbas, A. El-Samie, O. Faragallah, Efficient chaotic-based image cryptosystem with different modes of operation. Multimed. Tools Appl. 79(29), 20665–20687 (2020)

    Article  Google Scholar 

  5. N. Soliman, M. Khalil, A. Algarni, S. Ismail, R. Marzouk, W. El-Shafai, Efficient HEVC steganography approach based on audio compression and encryption in QFFT domain for secure multimedia communication. Multimed. Tools Appl. 80(3), 4789–4823 (2021)

    Article  Google Scholar 

  6. W. El-Shafai, Joint adaptive pre-processing resilience and post-processing concealment schemes for 3D video transmission. 3D Res. 6(1), 1–13 (2015)

    Article  Google Scholar 

  7. K. Abdelwahab, A. El-atty, M. Saied, W. El-Shafai, S. El-Rabaie, A. El-Samie, Efficient SVD-based audio watermarking technique in FRT domain. Multimed. Tools Appl. 79(9), 5617–5648 (2020)

    Article  Google Scholar 

  8. A. Algarni, G. El Banby, S. Ismail, W. El-Shafai, F. El-Samie, N.F. Soliman, Discrete transforms and matrix rotation based cancelable face and fingerprint recognition for biometric security applications. Entropy 22(12), 1361 (2020)

    Article  ADS  MathSciNet  Google Scholar 

  9. N. El-Hag, A. Sedik, W. El-Shafai, H. El-Hoseny, A. Khalaf, A. El-Fishawy, G. El-Banby, Classification of retinal images based on convolutional neural network. Microsc. Res. Tech. 84(3), 394–414 (2021)

    Article  Google Scholar 

  10. L. Abou Elazm, S. Ibrahim, M. Egila, H. Shawky, M. Elsaid, W. El-Shafai, F. Abd El-Samie, Cancellable face and fingerprint recognition based on the 3D jigsaw transform and optical encryption. Multimed. Tools Appl. 7(9), 14053–14078 (2020)

    Article  Google Scholar 

  11. W. El-Shafai, S. El-Rabaie, M. El-Halawany, F. El-Samie, Enhancement of wireless 3d video communication using color-plus-depth error restoration algorithms and Bayesian Kalman filtering. Wireless Pers. Commun. 97(1), 245–268 (2017)

    Article  Google Scholar 

  12. O. Faragallah, W. El-Shafai, A. Sallam, I, Elashry, E. EL-Rabaie, A. Afifi, H. El-sayed, Cybersecurity framework of hybrid watermarking and selective encryption for secure HEVC communication. J. Ambient. Intell. Humaniz. Comput. 13(2), 1215–1239 (2022)

    Article  Google Scholar 

  13. I. Badr, A. Radwan, E. El-Rabaie, L. Said, G. El Banby, W. El-Shafai, F. Abd El-Samie, Cancellable face recognition based on fractional-order Lorenz chaotic system and Haar wavelet fusion. Digital Sign Process. 11(6), 103103 (2021)

    Article  Google Scholar 

  14. W. El-Shafai, F. Mohamed, H. Elkamchouchi, M. Abd-Elnaby, A. Elshafee, Efficient and secure cancelable biometric authentication framework based on genetic encryption algorithm. IEEE Access 2(9), 77675–77692 (2021)

    Article  Google Scholar 

  15. F. Abd El-Samie, R. Nassar, M. Safan, M. Abdelhamed, A. Khalaf, G. El Banby, W. El-Shafai, Efficient implementation of optical scanning holography in cancelable biometrics. Appl. Opt. 60(13), 3659–3667 (2021)

    Article  ADS  Google Scholar 

  16. S. Ibrahim, M. Egila, H. Shawkey, M. Elsaid, W. El-Shafai, F. Abd El-Samie, Hardware implementation of cancellable biometric systems, In Fourth IEEE International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud)(I-SMAC), 1145–1152, (2020)

  17. H. El-Hameed, N. Ramadan, W. El-Shafai, A. Khalaf, H. Ahmed, S. Elkhamy, F. El-Samie, Cancelable biometric security system based on advanced chaotic maps. Vis. Comput. 38(6), 2171–2187 (2022)

    Article  Google Scholar 

  18. I. Almomani, W. El-Shafai, A. AlKhayer, A. Alsumayt, S. Aljameel, Proposed biometric security system based on deep learning and chaos algorithms. Comput. Mater.Continua 74(2), 3515–3537 (2023)

    Article  Google Scholar 

  19. L. Elazm, W. El-Shafai, S. Ibrahim, M. Egila, H. Shawkey, Efficient hardware design of a secure cancellable biometric cryptosystem. Intell. Autom. Soft Comput. 36(1), 929–955 (2023)

    Article  Google Scholar 

  20. W. El-Shafai, M. Elsayed, M. Rashwan, M. Dessouky, A. El-Fishawy, Optical ciphering scheme for cancellable speaker identification system. Comput. Syst. Sci. Eng. 45(1), 563–578 (2023)

    Article  Google Scholar 

  21. A. Ayoup, A. Khalaf, W. El-Shafai, F. Abd El-Samie, F. Alraddady, S. Eldin, Cancellable multi-biometric template generation based on arnold cat map and aliasing. CMC-Comput. Mater. Continua 72(2), 3687–3703 (2022)

    Article  Google Scholar 

  22. S. El-Gazar, W. El Shafai, G. El Banby, H. Hamed, G. Salama, M. Abd-Elnaby, F. Abd El-Samie, Cancelable speaker identification system based on optical-like encryption algorithms. Comput. Syst. Sci. Eng. 43(1), 87–102 (2022)

    Article  Google Scholar 

  23. A. Ayoup, A. Khalaf, F. Alraddady, F. Abd El-Samie, W. El-Shafai, Cancelable multi-biometric template generation based on dual-tree complex wavelet transform". Intell. Autom. Soft Comput. 33(2), 1289–1304 (2022)

    Article  Google Scholar 

  24. I. Almomani, A. AlKhayer, W. El-Shafai, Novel ransomware hiding model using HEVC steganography approach. CMC Comput. Mater. Contin 70(2), 1209–1228 (2021)

    Google Scholar 

  25. A. Alarifi, S. Sankar, T. Altameem, K. Jithin, M. Amoon, W. El-Shafai, A novel hybrid cryptosystem for secure streaming of high efficiency H. 265 compressed videos in IoT multimedia applications. IEEE Access 8(2), 128548–128573 (2020)

    Article  Google Scholar 

  26. O. Faragallah, H. El-Hoseny, W. El-Shafai, W. El-Rahman, H. El-sayed, S. El-Rabaie, G. Geweid, Optimized multimodal medical image fusion framework using multi-scale geometric and multi-resolution geometric analysis. Multimed. Tools Appl. 81(10), 14379–14401 (2022)

    Article  Google Scholar 

  27. R. Ali, F. El-Sayed, W. El-Shafai, T. Elsayed, Efficient fusion of medical images based on CNN. Menoufia J. Electron. Eng. Res. 30(2), 79–83 (2021)

    Article  Google Scholar 

  28. H. El-Hoseny, W. El-Rahman, W. El-Shafai, E. El-Rabaie, K. Mahmoud, F. Abd El-Samie, O. Faragallah, Optimal multi-scale geometric fusion based on non-subsampled contourlet transform and modified central force optimization. Int. J. Imaging Syst. Technol. 29(1), 4–18 (2019)

    Article  Google Scholar 

  29. H. El-Hoseny, W. El-Rahman, W. El-Shafai, G. El-Banby, S. El-Rabaie, F. Abd El-Samie, K. Mahmoud, Efficient multi-scale non-sub-sampled shearlet fusion system based on modified central force optimization and contrast enhancement. Infrared Phys. Technol. 102, 102975 (2019)

    Article  Google Scholar 

  30. W. El-Shafai, S. El-Rabaie, M. El-Halawany, F. Abd El-Samie, Security of 3D-HEVC transmission based on fusion and watermarking techniques. Multimed. Tools Appl. 78(19), 27211–27244 (2019)

    Article  Google Scholar 

  31. O. Faragallah, H. El-Hoseny, W. El-Shafai, W. Abd El-Rahman, H. El-Sayed, S. El-Rabaie, G. Geweid, A comprehensive survey analysis for present solutions of medical image fusion and future directions. IEEE Access. 9, 11358–11371 (2020)

    Article  Google Scholar 

  32. N. El-Hag, A. Sedik, G. El-Banby, W. El-Shafai, A. Khalaf, W. Al-Nuaimy, H. El-Hoseny, Utilization of image interpolation and fusion in brain tumor segmentation. Int. J. Numer. Methods Biomed. Eng. 37(8), e3449 (2021)

    Article  Google Scholar 

  33. C. Ghandour, W. El-Shafai, S. El-Rabaie, Comparative Study between Different Image Fusion Techniques Applied on Biomedical Images, In 2021 9th International Japan-Africa Conference on Electronics, Communications, and Computations (JAC-ECC) (pp. 165–176). IEEE (2021).

  34. A. Ayoup, A. Khalaf, F. Alraddady, F. Abd El-Samie, W. El-Safai, S. Eldin, Selective cancellable multi-biometric template generation scheme based on multi-exposure feature fusion. Intell Autom Soft Comput 33(1), 549–565 (2022)

    Article  Google Scholar 

  35. W. El-Shafai, N. El-Hag, A. Sedik, G. Elbanby, F. Abd El-Samie, An efficient medical image deep fusion model based on convolutional neural networks. Comput. Mater. Continua 74(2), 2905–2925 (2023)

    Article  Google Scholar 

  36. W. El-Shafai, F. Khallaf, E. El-Rabaie, F. El-Samie, Robust medical image encryption based on DNA-chaos cryptosystem for secure telemedicine and healthcare applications. J. Ambient. Intell. Humaniz. Comput. 12(10), 9007–9035 (2021)

    Article  Google Scholar 

  37. W. El-Shafai, E. Hemdan, Robust and efficient multi-level security framework for color medical images in telehealthcare services. J. Ambient. Intell. Humaniz. Comput. 8(5), 1–16 (2021)

    Google Scholar 

  38. W. El-Shafai, M. Aly, A. Algarni, F. Abd El-Samie, N. Soliman, Secure and robust optical multi-stage medical image cryptosystem. CMC-Comput. Mater. Continua 70(1), 895–913 (2022)

    Article  Google Scholar 

  39. N. Soliman, N. Ali, M. Aly, A. Algarni, W. El-Shafai, F. Abd El-Samie, An efficient breast cancer detection framework for medical diagnosis applications. CMC-Comput. Mater. Continua 70(1), 1315–1334 (2022)

    Article  Google Scholar 

  40. F. Alqahtani, M. Amoon, W. El-Shafai, A fractional fourier based medical image authentication approach. CMC-Comput. Mater. Continua 70(2), 3133–31504 (2022)

    Article  Google Scholar 

  41. W. El-Shafai, S. El-Nabi, S. El-Rabaie, A. Ali, N. Soliman, Efficient deep-learning-based autoencoder denoising approach for medical image diagnosis. CMC-Comput. Mater. Continua 70(3), 6107–6125 (2022)

    Article  Google Scholar 

  42. A. Siam, M. Almaiah, A. Al-Zahrani, A. Elazm, G. El Banby, W. El-Shafai, N. El-Bahnasawy, Secure health monitoring communication systems based on IoT and cloud computing for medical emergency applications. Comput. Intell. Neurosci. 8(3), 1–20 (2021)

    Article  Google Scholar 

  43. E. Hemdan, W. El-Shafai, A. Sayed, CR19: A framework for preliminary detection of COVID-19 in cough audio signals using machine learning algorithms for automated medical diagnosis applications. J. Ambient. Intell. Humaniz. Comput. 3(6), 1–13 (2022)

    Google Scholar 

  44. W. El-Shafai, S. El-Rabaie, M. El-Halawany, F. El-Samie, Recursive Bayesian filtering-based error concealment scheme for 3D video communication over severely lossy wireless channels. Circuits Systems Signal Process. 37(11), 4810–4841 (2018)

    Article  Google Scholar 

  45. C. Ghandour, W. El-Shafai, S. El-Rabaie, Medical image fusion based on weighted least square optimization and deep learning algorithm, In 2021 9th International Japan-Africa Conference on Electronics, Communications, and Computations (JAC-ECC) (pp. 159–163). IEEE (2021)

Download references

Funding

The authors did not receive support from any organization for the submitted work.

Author information

Authors and Affiliations

  1. Security Engineering Lab, Computer Science Department, Prince Sultan University, Riyadh, 11586, Saudi Arabia

    Walid El-Shafai

  2. Department of Electronics and Electrical Communications Engineering, Faculty of Electronic Engineering, Menoufia University, Menouf, 32952, Egypt

    Walid El-Shafai, Amira A. Mahmoud, Anas M. Ali, El-Sayed M. El-Rabaie, Taha E. Taha, Adel S. El-Fishawy, Osama Zahran & Fathi E. Abd El-Samie

  3. Alexandria Higher Institute of Engineering & Technology (AIET), Alexandria, Egypt

    Anas M. Ali

Authors
  1. Walid El-Shafai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Amira A. Mahmoud
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anas M. Ali
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. El-Sayed M. El-Rabaie
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Taha E. Taha
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Adel S. El-Fishawy
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Osama Zahran
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Fathi E. Abd El-Samie
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors are equally contributed.

Corresponding author

Correspondence to Walid El-Shafai.

Ethics declarations

Conflict of interests

The authors have no relevant financial or non-financial interests to disclose.

Ethical approval

All authors are contributing and accepting to submit the current work.

Consent for publication

All authors are accepting to submit and publish the submitted work.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

El-Shafai, W., Mahmoud, A.A., Ali, A.M. et al. Efficient classification of different medical image multimodalities based on simple CNN architecture and augmentation algorithms. J Opt 53, 775–787 (2024). https://doi.org/10.1007/s12596-022-01089-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12596-022-01089-3

Keywords

Search

Navigation