Skip to main content

Advertisement

SpringerLink
Log in

Automatic multilevel image thresholding segmentation using hybrid bio-inspired algorithm and artificial neural network for histopathology images

  • 1215: Multimodal Interaction and IoT Applications
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Automated medical imagining is growing rapidly for advanced clinical treatment and intervention in medical diagnosis. The segmentation of nuclei in digital histopathology is considered the most crucial aspect in diagnosis and evaluating the severity of disease. Therefore, in this paper, an automated nuclei segmentation method has been introduced for the histopathological images. The proposed segmentation method uses a new hybrid algorithm of lion optimization and cat swarm optimization to provide an optimal threshold value for efficient multi-level image thresholding segmentation. Moreover, a new fitness function using Otsu’s function and Yager’s entropy has also been presented for robust results. Extensive simulations are examined to determine the performance of the proposed hybrid algorithm. Firstly, evaluation on CEC 2017 benchmark suite are performed using three quality metrics, namely average fitness value, peak signal-to-noise ratio, and structural similarity index. Secondly, for the performance analysis of developed segmentation method, two Histopathological data sets are used, namely breast Histopathological images and lung Histopathological images. Furthermore, to find the optimum number of clusters, artificial neural network has been used and its performance is measured in terms of the accuracy, sensitivity, and specificity. The classifier returned an accuracy of 71.4%, sensitivity of 93.23%, and specificity of 93.12% for breast Histopathological images. For lung Histopathological images, the accuracy, sensitivity, and specificity were 66.17%, 89.53%, and 90.62% respectively. Moreover, the proposed method is also validated using the ground truth images, acquired from expert pathologist, by calculating dice coefficient and Jaccard coefficient. The findings and observation show that the proposed algorithm provides promising and significant result.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Abd El Aziz M, Ewees AA, Hassanien AE, Mudhsh M, Xiong S (2018) Multi-objective whale optimization algorithm for multilevel thresholding segmentation. In: Advances in soft computing and machine learning in image processing, Springer, pp 23–39

  2. Abd El aziz M, Ewees AA, Hassanien AE (2017) Whale optimization algorithm and moth-flame optimization for multilevel thresholding image segmentation. Expert Syst Appl 83:242–256

    Article  Google Scholar 

  3. Abdolhoseini M, Kluge MG, Walker FR, Johnson SJ (2019) Segmentation of heavily clustered nuclei from histopathological images. Sci Report 9 (1):1–13

    Article  Google Scholar 

  4. Almezeini N, Hafez A (2017) Task scheduling in cloud computing using lion optimization algorithm. Algorithms 5:7

    Google Scholar 

  5. Bansal P, Gupta S, Kumar S, Sharma S, Sharma S (2019) Mlp-loa: a metaheuristic approach to design an optimal multilayer perceptron. Soft Comput 23(23):12331–12345

    Article  Google Scholar 

  6. Belsare A, Mushrif M (2012) Histopathological image analysis using image processing techniques: an overview. Signal & Image Process 3(4):23

    Google Scholar 

  7. Bhandari AK, Kumar A, Chaudhary S, Singh GK (2016) A novel color image multilevel thresholding based segmentation using nature inspired optimization algorithms. Expert Syst Appl 63:112–133

    Article  Google Scholar 

  8. Bhandari AK, Kumar A, Singh GK (2015) Modified artificial bee colony based computationally efficient multilevel thresholding for satellite image segmentation using kapur’s, otsu and tsallis functions. Expert Syst Appl 42(3):1573–1601

    Article  Google Scholar 

  9. Bhardwaj R, Kumar D (2019) Mofpl: multi-objective fractional particle lion algorithm for the energy aware routing in the wsn. Pervasive Mobile Comput 58:101029

    Article  Google Scholar 

  10. Boothalingam R (2018) Optimization using lion algorithm: a biological inspiration from lion’s social behavior. Evol Intel 11(1-2):31–52

    Article  Google Scholar 

  11. Bosna cki RNvD, VM (2019) Deep learning with convolutional neural networks for histopathology image analysis. Autom Reason Syst Biology Med 1:453–469

    Article  Google Scholar 

  12. Chu S-C, Tsai P-W et al (2007) Computational intelligence based on the behavior of cats. Int J Innov Comput Inf Control 3(1):163–173

    Google Scholar 

  13. Crawford B, Soto R, Caballero H, Olguín E, Misra S (2016) Solving biobjective set covering problem using binary cat swarm optimization algorithm. In: international conference on computational science and its applications, Springer, pp 220–231

  14. Cruz MA, Roa AA, Ovalle JEA, OFAG (2013) A deep learning architecture for image representation, visual interpretability and automated basal cell carcinoma cancer detection. In: international conference on medical image computing and computer-assisted intervention, Nagoya, Japan, pp 403–410

  15. Çetin M, Dokur Z, Ölmez T (2019) Fuzzy local information c-means algorithm for histopathological image segmentation. In: Scientific Meeting on Electrical-Electronics & Biomedical Engineering and Computer Science (EBBT). IEEE, vol 2019, pp 1–6

  16. Dhal KG, Das A, Ray S, Das S (2019) A clustering based classification approach based on modified cuckoo search algorithm. Pattern Recogn Image Anal 29(3):344–359

    Article  Google Scholar 

  17. Duraisamy SP, Kayalvizhi R et al (2010) A new multilevel thresholding method using swarm intelligence algorithm for image segmentation. J Intell Learn Syst Appl 2(03):126

    Google Scholar 

  18. Gao H, Xu W, Sun J, Tang Y (2009) Multilevel thresholding for image segmentation through an improved quantum-behaved particle swarm algorithm. IEEE Trans Instrument Measure 59(4):934–946

    Article  Google Scholar 

  19. García-Lamont F, Cervantes J, López-Chau A, Yee-Rendón A (2020) Automatic computing of number of clusters for color image segmentation employing fuzzy c-means by extracting chromaticity features of colors. Pattern Anal Applic 23(1):59–84

    Article  Google Scholar 

  20. Geetha K, Anitha V, Elhoseny M, Kathiresan S, Shamsolmoali P, Selim MM (2020) An evolutionary lion optimization algorithm-based image compression technique for biomedical applications. Expert Syst, e12508

  21. Ghosh M, Chakraborty C, Ray AK (2013) Yager’s measure based fuzzy divergence for microscopic color image segmentation. In: 2013 Indian Conference on Medical Informatics and Telemedicine (ICMIT). IEEE, pp 13–16

  22. Ghosh M, Das D, Chakraborty C (2010) Entropy based divergence for leukocyte image segmentation. In: 2010 International Conference on Systems in Medicine and Biology. IEEE, pp 409–413

  23. Gu S, Cheng R, Jin Y (2018) Feature selection for high-dimensional classification using a competitive swarm optimizer. Soft Comput 22(3):811–822

    Article  Google Scholar 

  24. Guo J, Sun Z, Tang H, Yin L, Zhang Z (2015) Improved cat swarm optimization algorithm for assembly sequence planning. Open Autom Control Syst J 1:7

    Google Scholar 

  25. Hammouche K, Diaf M, Siarry P (2008) A multilevel automatic thresholding method based on a genetic algorithm for a fast image segmentation. Comput Vis Image Underst 109(2):163–175

    Article  Google Scholar 

  26. Huang X, He H, Wei P, Zhang C, Zhang J, Chen J (2019) Tumor tissue segmentation for histopathological images. In: Proceedings of the ACM Multimedia Asia, pp 1–4

  27. Ilea DE, Whelan PF (2008) Ctex—an adaptive unsupervised segmentation algorithm based on color-texture coherence. IEEE Trans Image Process 17(10):1926–1939

    Article  MATH  Google Scholar 

  28. Irshad H, Veillard A, Roux L, Racoceanu D (2013) Methods for nuclei detection, segmentation, and classification in digital histopathology: a review—current status and future potential. IEEE Rev Biomed Eng 7:97–114

    Article  Google Scholar 

  29. Jayaraman V, Sultana HP (2019) Artificial gravitational cuckoo search algorithm along with particle bee optimized associative memory neural network for feature selection in heart disease classification, J Ambient Intell Human Comput, 1–10

  30. Jothi JAA, Rajam VMA (2017) A survey on automated cancer diagnosis from histopathology images. Artif Intell Rev 48(1):31–81

    Article  Google Scholar 

  31. Jothi J. A. a., Rajam VMA (2015) Segmentation of nuclei from breast histopathology images using pso-based otsu’s multilevel thresholding. In: artificial intelligence and evolutionary algorithms in engineering systems, Springer, pp 835–843

  32. Jothi JAA, Rajam VMA (2016) Effective segmentation and classification of thyroid histopathology images. Appl Soft Comput 46:652–664

    Article  Google Scholar 

  33. Kate V, Shukla P (2020) Image segmentation of breast cancer histopathology images using pso-based clustering technique. In: Social Networking and Computational Intelligence, Springer, pp 207–216

  34. Kaur A, Singh M (2012) An overview of pso-based approaches in image segmentation. Int J Eng Technol 2(8):1349–1357

    Google Scholar 

  35. Khan A, Jaffar MA, Choi T-S (2013) Som and fuzzy based color image segmentation. Multimed Tool Appl 64(2):331–344

    Article  Google Scholar 

  36. Kirti AS (2020) Csbiist: cuckoo search-based intelligent image segmentation, Nature-Inspired Computation and Swarm Intelligence: Algorithms, Theory and Applications, 323

  37. Lai C-C, Tseng D-C (2004) A hybrid approach using gaussian smoothing and genetic algorithm for multilevel thresholding. Int J Hybrid Intell Syst 1 (3-4):143–152

    Google Scholar 

  38. Lee SU, Chung SY, Park RH (1990) A comparative performance study of several global thresholding techniques for segmentation. Comput Vis Graph Image Process 52(2):171–190

    Article  Google Scholar 

  39. Lei X, Fu A (2008) Two-dimensional maximum entropy image segmentation method based on quantum-behaved particle swarm optimization algorithm. In: 2008 fourth international conference on natural computation, vol 3. IEEE, pp 692–696

  40. Li L, Sun L, Guo J, Han C, Zhou J, Li S (2017) A quick artificial bee colony algorithm for image thresholding. Information 8(1):16

    Article  Google Scholar 

  41. Manic KS, Priya RK, Rajinikanth V (2016) Image multithresholding based on kapur/tsallis entropy and firefly algorithm. Indian J Sci Technol 9 (12):89949

    Article  Google Scholar 

  42. Masood A, Al-Jumaily A (2015) Differential evolution based advised svm for histopathalogical image analysis for skin cancer detection. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, pp 781–784

  43. Mirjalili S, Lewis A (2016) The whale optimization algorithm. Advan Eng Software 95:51–67

    Article  Google Scholar 

  44. Mittal H, Saraswat M (2018) An optimum multi-level image thresholding segmentation using non-local means 2d histogram and exponential kbest gravitational search algorithm. Eng Appl Artif Intell 71:226–235

    Article  Google Scholar 

  45. Mlakar U, Potočnik B, Best J (2016) A hybrid differential evolution for optimal multilevel image thresholding. Expert Syst Appl 65:221–232

    Article  Google Scholar 

  46. Olorunda O, Engelbrecht AP (2008) Measuring exploration/exploitation in particle swarms using swarm diversity. In: 2008 IEEE congress on evolutionary computation (IEEE world congress on computational intelligence). IEEE, pp 1128–1134

  47. Öztürk Ş, Akdemir B (2018) Application of feature extraction and classification methods for histopathological image using glcm, lbp, lbglcm, glrlm and sfta. Procedia Comput Sci 132:40–46

    Article  Google Scholar 

  48. Purohit AD, Khandare S (2017) A survey on different color image segmentation techniques using multilevel thresholding. Int J Comput Sci Mobile Comput 6(4):267–273

    Google Scholar 

  49. Rajakumar B (2014) Lion algorithm for standard and large scale bilinear system identification: a global optimization based on lion’s social behavior. In: in 2014 IEEE congress on evolutionary computation (CEC). IEEE, pp 2116–2123

  50. Rusu M, Rajiah P, Gilkeson R, Yang M, Donatelli C, Thawani R, Jacono FJ, Linden P, Madabhushi A (2017) Co-registration of pre-operative ct with ex vivo surgically excised ground glass nodules to define spatial extent of invasive adenocarcinoma on in vivo imaging: a proof-of-concept study. Eur Radiol 27(10):4209–4217

    Article  Google Scholar 

  51. Sahoo PK, Soltani S, Wong AK (1988) A survey of thresholding techniques. Comput Vis Graph Image Process 41(2):233–260

    Article  Google Scholar 

  52. Samantaa S, Dey N, Das P, Acharjee S, Chaudhuri SS (2013) Multilevel threshold based gray scale image segmentation using cuckoo search, arXiv:https://doi.org/abs/1307.0277

  53. Shu J, Fu H, Qiu G, Kaye P, Ilyas M (2013) Segmenting overlapping cell nuclei in digital histopathology images. In: 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, pp 5445–5448

  54. Shu J, Liu J, Zhang Y, Fu H, Ilyas M, Faraci G, Della Mea V, Liu B, Qiu G (2020) Marker controlled superpixel nuclei segmentation and automatic counting on immunohistochemistry staining images. Bioinformatics 36 (10):3225–3233

    Article  Google Scholar 

  55. Spanhol FA, Oliveira LS, Petitjean C, Heutte L (2015) A dataset for breast cancer histopathological image classification. IEEE Trans Biomed Eng 63 (7):1455–1462

    Article  Google Scholar 

  56. Tang Y-G, Liu D, Guan X-P (2007) Fast image segmentation based on particle swarm optimization and two-dimension otsu method. Control Decision 22 (2):202

    Google Scholar 

  57. Tian A-Q, Chu S-C, Pan J-S, Liang Y (2020) A novel pigeon-inspired optimization based mppt technique for pv systems. Processes 8(3):356

    Article  Google Scholar 

  58. Veta M, Van Diest PJ, Kornegoor R, Huisman A, Viergever MA, Pluim JP (2013) Automatic nuclei segmentation in h&e stained breast cancer histopathology images. PloS One 8(7):e70221

    Article  Google Scholar 

  59. Vijh S, Sharma S, Gaurav P (2020) Brain tumor segmentation using otsu embedded adaptive particle swarm optimization method and convolutional neural network. In: data visualization and knowledge engineering, Springer, pp 171–194

  60. Vishnoi S, Jain AK, Sharma PK (2019) A nuclei segmentation method based on whale optimization algorithm fuzzy clustering in histopathological images. In: 2019 4th International Conference on Information Systems and Computer Networks (ISCON), IEEE, pp 728–732

  61. Wang B, Jin X, Cheng B (2012) Lion pride optimizer: an optimization algorithm inspired by lion pride behavior. Sci China Inf Sci 55(10):2369–2389

    Article  MATH  Google Scholar 

  62. Wu G, Mallipeddi R, Suganthan PN (2017) Problem definitions and evaluation criteria for the cec 2017 competition on constrained real-parameter optimization, National University of Defense Technology, Changsha, Hunan, PR China and Kyungpook National University, Daegu, South Korea and Nanyang Technological University, Singapore, Technical Report

  63. Xu J, Luo X, Wang G, Gilmore H, Madabhushi A (2016) A deep convolutional neural network for segmenting and classifying epithelial and stromal regions in histopathological images. Neurocomputing 191:214–223

    Article  Google Scholar 

  64. Xu J, Xiang L, Liu Q, Gilmore H, Wu J, Tang J, Madabhushi A (2015) Stacked sparse autoencoder (ssae) for nuclei detection on breast cancer histopathology images. IEEE Trans Med Imag 35(1):119–130

    Article  Google Scholar 

  65. Yager RR (1995) Measures of entropy and fuzziness related to aggregation operators. Inf Sci 82(3-4):147–166

    Article  MATH  Google Scholar 

  66. Yang Y, Yan H (2000) An adaptive logical method for binarization of degraded document images. Pattern Recogn 33(5):787–807

    Article  Google Scholar 

  67. Yazdani M, Jolai F (2016) Lion optimization algorithm (loa): a nature-inspired metaheuristic algorithm. J Comput Design Eng 3(1):24–36

    Article  Google Scholar 

  68. Yin P-Y (1999) A fast scheme for optimal thresholding using genetic algorithms. Signal Process 72(2):85–95

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. ASET, Amity University, Noida, India

    Surbhi Vijh

  2. Jaypee Institute of Information Technology, Noida, India

    Mukesh Saraswat

  3. Amity University, Noida, India

    Sumit Kumar

Authors
  1. Surbhi Vijh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mukesh Saraswat
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sumit Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sumit Kumar.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vijh, S., Saraswat, M. & Kumar, S. Automatic multilevel image thresholding segmentation using hybrid bio-inspired algorithm and artificial neural network for histopathology images. Multimed Tools Appl 82, 4979–5010 (2023). https://doi.org/10.1007/s11042-022-12168-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12168-9

Keywords

Search

Navigation