Advertisement

Smartphone-Supported Malaria Diagnosis Based on Deep Learning

  • Feng YangEmail author
  • Hang Yu
  • Kamolrat Silamut
  • Richard J. Maude
  • Stefan Jaeger
  • Sameer Antani
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11861)

Abstract

Malaria remains a major burden on global health, causing about half a million deaths every year. The objective of this work is to develop a fast, automated, smartphone-supported malaria diagnostic system. Our proposed system is the first system using both image processing and deep learning methods on a smartphone to detect malaria parasites in thick blood smears. The underlying detection algorithm is based on an iterative method for parasite candidate screening and a convolutional neural network model (CNN) for feature extraction and classification. The system runs on Android phones and can process blood smear images taken by the smartphone camera when attached to the eyepiece of a microscope. We tested the system on 50 normal patients and 150 abnormal patients. The accuracies of the system on patch-level and patient-level are 97% and 78%, respectively. AUC values on patch-level and patient-level are, respectively, 98% and 85%. Our system could aid in malaria diagnosis in resource-limited regions, without depending on extensive diagnostic expertise or expensive diagnostic equipment.

Keywords

Mobile health Computer-aided diagnosis Malaria Deep learning Image analysis 

Notes

Acknowledgment

We would like to thank Dr. Md. A. Hossain for supporting our data acquisition at Chittagong Medical Hospital, Bangladesh. This research is supported by the Intramural Research Program of the National Institutes of Health, National Library of Medicine, and Lister Hill National Center for Biomedical Communications. Mahidol-Oxford Tropical Medicine Research Unit is funded by the Wellcome Trust of Great Britain. This research is also supported by the National Basic Research Program of China under No. 61671049 and the National Key R&D Plan of China under No. 2017YFB1400100.

References

  1. 1.
    WHO: World malaria report 2018 (2018)Google Scholar
  2. 2.
    WHO: Guidelines for the treatment of malaria. 3rd edn. World Health Organization (2015)Google Scholar
  3. 3.
    Makhija, K.S., Maloney, S., Norton, R.: The utility of serial blood film testing for the diagnosis of malaria. Pathology 47(1), 68–70 (2015)CrossRefGoogle Scholar
  4. 4.
    WHO: Malaria micropscopy quality assurance manual. World Health Organization (2016)Google Scholar
  5. 5.
    Poostchi, M., Silamut, K., Maude, R.J., Jaeger, S., Thoma, G.: Image analysis and machine learning for detecting malaria. Transl. Res. 194, 36–55 (2018)CrossRefGoogle Scholar
  6. 6.
    Breslauer, D.N., Maamari, R.N., Switz, N.A., Lam, W.A., Fletcher, D.A.: Mobile phone based clinical microscopy for global health applications. PLoS ONE 4(7), 1–7 (2009)CrossRefGoogle Scholar
  7. 7.
    Tuijn, C.J., Li, J.: Data and image transfer using mobile phones to strengthen microscopy-based diagnostic services in low and middle income country laboratories. PLoS One 6(12), e28348 (2011)CrossRefGoogle Scholar
  8. 8.
    Skandarajah, A., Reber, C.D., Switz, N.A., Fletcher, D.A.: Quantitative imaging with a mobile phone microscope. PLoS One 9(5), e96906 (2014)CrossRefGoogle Scholar
  9. 9.
    Pirnstill, C.W., Coté, G.L.: Malaria diagnosis using a mobile phone polarized microscope. Sci. Rep. 5, 1–13 (2015)CrossRefGoogle Scholar
  10. 10.
    Coulibaly, J.T., et al.: Evaluation of malaria diagnoses using a handheld light microscope in a community-based setting in rural Côte d’Ivoire. Am. J. Trop. Med. Hyg. 95(4), 831–834 (2016)CrossRefGoogle Scholar
  11. 11.
    Kaewkamnerd, S., Uthaipibull, C., Intarapanich, A., Pannarut, M., Chaotheing, S., Tongsima, S.: An automatic device for detection and classification of malaria parasite species in thick blood film. BMC Bioinform. 13(Suppl 17), S18 (2012)CrossRefGoogle Scholar
  12. 12.
    Quinn, J.A., Nakasi, R., Mugagga, P.K.B., Byanyima, P., Lubega, W., Andama, A.: Deep convolutional neural networks for microscopy-based point of care diagnostics. In: International Conference on Machine Learning for Health Care, Los Angeles, CA, pp. 1–12 (2016)Google Scholar
  13. 13.
    Cesario, M., Lundon, M., Luz, S., Masoodian, M., Rogers, B.: Mobile support for diagnosis of communicable diseases in remote locations. In: 13th International Conference of the NZ Chapter of the ACM’s Special Interest Group on Human-Computer Interaction – CHINZ 2012, Dunedin, New Zealand, pp. 25–28 (2012)Google Scholar
  14. 14.
    Dallet, C., Kareem, S., Kale, I.: Real time blood image processing application for malaria diagnosis using mobile phones. In: IEEE International Symposium on Circuits and Systems, Melbourne VIC, Australia, pp. 2405–2408 (2014)Google Scholar
  15. 15.
    Rosado, L., Da Costa, J.M.C., Elias, D., Cardoso, J.S.: Automated detection of malaria parasites on thick blood smears via mobile devices. Procedia Comput. Sci. 90, 138–144 (2016)CrossRefGoogle Scholar
  16. 16.
    Rosado, L., Correia da Costa, J.M., Elias, D., Cardoso, J.S.: Mobile-based analysis of malaria-infected thin blood smears: automated species and life cycle stage determination. Sensors 17(10), 2167 (2017)Google Scholar
  17. 17.
    Eysenbach, G., Ofli, F., Chen, S., Kevin, G., Oliveira, A.D.: The malaria system microapp: a new, mobile device-based tool for malaria diagnosis. JMIR Res. Protoc. 6(4), e70 (2017)CrossRefGoogle Scholar
  18. 18.
    Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979)CrossRefGoogle Scholar
  19. 19.
    Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1137–1149 (2017)CrossRefGoogle Scholar
  20. 20.
    Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. https://arxiv.org/pdf/1506.02640.pdf. Accessed 01 Apr 2019

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.School of Computer and Information TechnologyBeijing Jiaotong UniversityBeijingChina
  2. 2.National Library of Medicine, National Institute of HealthBethesdaUSA
  3. 3.Mahidol-Oxford Tropical Medicine Research UnitMahidol UniversityBangkokThailand

Personalised recommendations