Skip to main content

An XAI Integrated Identification System of White Blood Cell Type Using Variants of Vision Transformer

  • Conference paper
  • First Online:
Proceedings of the Second International Conference on Innovations in Computing Research (ICR’23)

Abstract

White Blood Cells (WBCs) serve as one of the primary defense mechanisms against various diseases. Therefore, in order to detect blood cancer as well as many other disorders, routine WBC monitoring may be necessary. Numerous studies have proposed automated 4 types of WBC detection through Machine Learning and Deep Learning based solutions. However, transformers based applications, which primarily originated from the field of Natural Language Processing, are very scarce. Our proposed study showcases the applications of Vision Transformers (VTs) for WBC type identification. Firstly, a pre-augmented dataset of nearly 12,500 images was taken. Afterward, two variants of VTs were trained and evaluated on the dataset. Our analysis revealed that the accuracy for all the models ranged from 83% to 85%, making the performance of the VTs equivalent to that of the standard Deep Learning models. Meanwhile, VTs have demonstrated significantly faster learning symptoms during the training phase, which can be useful when one wants to maximize learning through fewer epochs, for example, in a federated learning environment. Finally, the application of Explainable AI (XAI) was visualized on the VTs using Gradient-weighted Class Activation Mapping (GradCam).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Lee, S.H., Lee, S., Song, B.C.: Vision transformer for small-size datasets, arXiv preprint arXiv:2112.13492 (2021)

  2. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 618–626 (2017)

    Google Scholar 

  3. Habibzadeh, M., Krzyżak, A., Fevens, T.: Comparative study of shape, intensity and texture features and support vector machine for white blood cell classification. J. Theor. Appl. Comput. Sci. 7(1), 20–35 (2013)

    Google Scholar 

  4. Gupta, D., Arora, J., Agrawal, U., Khanna, A., de Albuquerque, V.H.C.: Optimized Binary Bat algorithm for classification of white blood cells. Measurement 143, 180–190 (2019)

    Article  Google Scholar 

  5. Benomar, M.L., Chikh, A., Descombes, X., Benazzouz, M.: Multi-feature-based approach for white blood cells segmentation and classification in peripheral blood and bone marrow images. Int. J. Biomed. Eng. Technol. 35(3), 223–241 (2021)

    Article  Google Scholar 

  6. Cheuque, C., Querales, M., León, R., Salas, R., Torres, R.: An efficient multi-level convolutional neural network approach for white blood cells classification. Diagnostics 12(2), 248 (2022)

    Article  Google Scholar 

  7. Liang, G., Hong, H., Xie, W., Zheng, L.: Combining convolutional neural network with recursive neural network for blood cell image classification. IEEE Access 6, 36188–36197 (2018)

    Article  Google Scholar 

  8. Sahlol, A.T., Kollmannsberger, P., Ewees, A.A.: Efficient classification of white blood cell leukemia with improved swarm optimization of deep features. Sci. Rep. 10(1), 2536 (2020)

    Article  Google Scholar 

  9. Sharma, M., Bhave, A., Janghel, R.R.: White blood cell classification using convolutional neural network. Soft Comput. Signal Process.: Proc. ICSCSP 1(2019), 135–143 (2018)

    Google Scholar 

  10. Praveen, N., Punn, N.S., Sonbhadra, S.K., Agarwal, S., Syafrullah, M., Adiyarta, K.: White blood cell subtype detection and classification. In: 2021 8th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI), pp. 203–207 (2021)

    Google Scholar 

  11. Akram, N., et al.: Exploiting the multiscale information fusion capabilities for aiding the leukemia diagnosis through white blood cells segmentation. IEEE Access 10, 48747–48760 (2022)

    Article  Google Scholar 

  12. Zhang, C., et al.: Hybrid adversarial-discriminative network for leukocyte classification in leukemia. Med. Phys. 47(8), 3732–3744 (2020)

    Article  Google Scholar 

  13. Çınar, A., Tuncer, S.A.: Classification of lymphocytes, monocytes, eosinophils, and neutrophils on white blood cells using hybrid Alexnet-GoogleNet-SVM. SN Appl. Sci. 3(4), 1–11 (2021). https://doi.org/10.1007/s42452-021-04485-9

    Article  Google Scholar 

  14. Cho, P., Dash, S., Tsaris, A., Yoon, H.-J.: Image transformers for classifying acute lymphoblastic leukemia. In: Medical Imaging 2022: Computer-Aided Diagnosis, vol. 12033, pp. 633–639 (2022)

    Google Scholar 

  15. Dosovitskiy, A., et al.: An image is worth 16\(\,\times \,\)16 words: transformers for image recognition at scale, arXiv preprint arXiv:2010.11929 (2020)

  16. Lee, S.H., Lee, S., Song, B.C.: Vision transformer for small-size datasets, arXiv preprint arXiv:2112.13492 (2021)

  17. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition, arXiv preprint arXiv:1409.1556 (2014)

  18. BCCD Dataset. https://github.com/Shenggan/BCCD_Dataset. [Retrieved 14 Nov 2022]

  19. Moony, P.: Blood Cell Images. https://www.kaggle.com/datasets/paultimothymooney/blood-cells. [Retrieved 14 Nov 2022]

  20. jacobgil: Explainability for Vision Transformers. https://github.com/jacobgil/vit-explain. [Retrieved 15 Nov 2022]

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mohammad Zavid Parvez .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Dipto, S.M., Reza, M.T., Rahman, M.N.J., Parvez, M.Z., Barua, P.D., Chakraborty, S. (2023). An XAI Integrated Identification System of White Blood Cell Type Using Variants of Vision Transformer. In: Daimi, K., Al Sadoon, A. (eds) Proceedings of the Second International Conference on Innovations in Computing Research (ICR’23). Lecture Notes in Networks and Systems, vol 721. Springer, Cham. https://doi.org/10.1007/978-3-031-35308-6_26

Download citation

Publish with us

Policies and ethics