Abstract
Purpose
Increasing cancer disease incidence worldwide has become a major public health issue. Manual histopathological analysis is a common diagnostic method for cancer detection. Due to the complex structure and wide variability in the texture of histopathology images, it has been challenging for pathologists to diagnose manually those images. Automatic segmentation of histopathology images to diagnose cancer disease is a continuous exploration field in recent times. Segmentation and analysis for diagnosis of histopathology images by using an efficient deep learning algorithm are the purpose of the proposed method.
Method
To improve the segmentation performance, we proposed a deep learning framework that consists of a high-resolution encoder path, an atrous spatial pyramid pooling bottleneck module, and a powerful decoder. Compared to the benchmark segmentation models having a deep and thin path, our network is wide and deep that effectively leverages the strength of residual learning as well as encoder–decoder architecture.
Results
We performed careful experimentation and analysis on three publically available datasets namely kidney dataset, Triple Negative Breast Cancer (TNBC) dataset, and MoNuSeg histopathology image dataset. We have used the two most preferred performance metrics called F1 score and aggregated Jaccard index (AJI) to evaluate the performance of the proposed model. The measured values of F1 score and AJI score are (0.9684, 0.9394), (0.8419, 0.7282), and (0.8344, 0.7169) on the kidney dataset, TNBC histopathology dataset, and MoNuSeg dataset, respectively.
Conclusion:
Our proposed method yields better results as compared to benchmark segmentation methods on three histopathology datasets. Visual segmentation results justify the high value of the F1 score and AJI scores which indicated that it is a very good prediction by our proposed model.
Similar content being viewed by others
References
Washington MK, Berlin J, Branton P, Burgart LJ, Carter DK, Fitzgibbons PL, Halling K, Frankel W, Jessup J, Kakar S, Minsky B, Nakhleh R, Compton CC (2009) Protocol for the examination of specimens from patients with primary carcinoma of the colon and rectum. Arch Pathol Lab Med 133:1539–1551
Gonzalez RC, Woods RE (2006) Digital image processing, 3rd edn. Prentice Hall, New York
Win K Y , Choomchuay S, Hamamoto K (2017) K mean clustering based automated segmentation of overlapping cell nuclei in pleural effusion cytology images. In: International conference on advanced technologies for communications (ATC), pp 265–269. https://doi.org/10.1109/ATC.2017.8167630
Dhanachandra N, ChanuY J (2020) An image segmentation approach based on fuzzy c-means and dynamic particle swarm optimization algorithm. Multimed Tools Appl 79:18839–18858. https://doi.org/10.1007/s11042-020-08699-8
Stutz D, Hermans A, Leibe B (2018) Superpixels: an evaluation of the state-of-the-art. Comput Vis Image Understanding 166:1–27. https://doi.org/10.1016/j.cviu.2017.03.007
Albayrak A, Bilgin G (2019) Automatic cell segmentation in histopathological images via two-staged superpixel-based algorithms. Med Biol Eng Comput 57(3):653–665
Cousty J, Bertrand G, Najman L, Couprie M (2010) Watershed cuts: thinnings, shortest path forests, and topological watersheds. IEEE Trans Pattern Anal Mach Intell 32(5):925–939. https://doi.org/10.1109/TPAMI.2009.71
Gamarra M, Zurek E, Escalante HJ, Hurtado L, San-Juan-Vergara H (2019) Split and merge watershed: a two-step method for cell segmentation in fluorescence microscopy images. Biomed Signal Process Control. https://doi.org/10.1016/j.bspc.2019.101575
Song T, Sanchez V, Eidaly H, Rajpoot NM (2017) Dual-channel active contour model for megakaryocytic cell segmentation in bone marrow trephine histology images. IEEE Trans Biomed Eng 64(12):2913–2923
Ciecholewski M (2016) An edge-based active contour model using an inflation/deflation force with a damping coefficient. Expert Syst Appl 44:22–36
Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Proceedings MICCAI. Springer, Munich, pp 234–241
Chen H , Qi X , Yu L, Heng PA (2016) DCAN: deep contour-aware networks for accurate gland segmentation. Computer Vision and Pattern Recognition. arXiv:1604.02677v1 [cs.CV]
Yu F, Koltun V (2016) Multi-scale context aggregation by dilated convolutions. Published as a conference paper at ICLR, San Juan, PR, USA, pp 1–13. https://arxiv.org/pdf/1511.07,122.pdf
Badrinarayanan V, Kendall A, Cipolla R (2017) SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481–2495
Shelhamer E, Long J, Darrell T (2017) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39(4):640–651
Remi Y, Eycke V, Balsat C, Verset L, Debeir O, Salmon I, Decaestecker C (2018) Segmentation of glandular epithelium in colorectal tumours to automatically compartmentalise ihc biomarker quantification: a deep learning approach. Med Image Anal 49:35–45
Naylor P, Lae M, Reyal F, Walter T (2019) Segmentation of nuclei in histopathology images by deep regression of the distance map. IEEE Trans Med Imaging 38(2):448–459
Schlemper J, Oktay O, Schaap M, Heinrich M, Kainz B, Glocker B, Rueckert D (2019) Attention gated networks: learning to leverage salient regions in medical images. Med Image Anal 53:197–207
Kim J, Heo YS (2019) Efficient semantic segmentation using spatio-channel dilated convolutions. IEEE Access 7:154239–154252
Pan X, Li L, Yang D, He Y, Liu Z, Yang H (2019) An accurate nuclei segmentation algorithm in pathological image based on deep semantic network. IEEE Access 7:110674–110686
Graham S, Epstein D, Rajpoot N (2019) Rota-Net: rotation equivariant network for simultaneous gland and lumen segmentation in colon histology images. European Congress on Digital Pathology, Springer Cham, pp 109–116
Wan T, Zhao L, Feng H, Li D, Tong C, Qin Z (2020) Robust nuclei segmentation in histopathology using ASPPU-Net and boundary refinement. Neurocomputing 408:144–156
Zhou Z, Siddiquee MMR, Tajbakhsh N, Liang J (2020) Unet++: redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans Med Imaging 39(6):1856–1867
Lal S, Das D, Alabhya K, Kanfade A, Kumar A, Kini J (2021) NucleiSegNet: robust deep learning architecture for the nuclei segmentation of liver cancer histopathology images. Comput Biol Med 128:104075
Khened M, Kori A, Rajkumar H, Krishnamurthi G, Srinivasan B (2021) A generalized deep learning framework for whole slide image segmentation and analysis. Sci Rep 11:11579
Mehta S, Hajishirzi H, Rastegari M (2019) Dicenet: dimension-wise convolutions for efficient networks. Computer Vision and Pattern Recognition. arXiv:1906.03516
Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. Machine Learning. arXiv:1502.03167
Santurkar S, Tsipras D, Ilyas A, Madry A (2019) How does batch normalization help optimization. Neural and Evolutionary Computing. arXiv:1805.11604
Chen LC, Papandreou G, Schroff F, Adam H (2017) Rethinking atrous convolution for semantic image segmentation. Computer Vision and Pattern Recognition. arXiv:1706.05587v3
Irshad H, Kouhsari LM, Waltz G, Bucur O, Nowak JA, Dong F, Knoblauch NW, Beck AH (2015) Crowdsourcing image annotation for nucleus detection and segmentation in computational pathology: evaluating experts, automated methods, and the crowd. In: Pacific Symposium on Biocomputing (PSB). https://doi.org/10.13140/2.1.4067.0721
Kumar N, Verma R, Sharma S, Bhargava S, Vahadane A, Sethi A (2017) A dataset and a technique for generalized nuclear segmentation for computational pathology. IEEE Trans Med Imaging 36(7):1550–1560
Kingma DP, Ba J (2015) Adam: a method for stochastic optimization. In: International conference on learning representations, p 9. arXiv:1412.6980v9
Chanchal AK, Kumar A, Lal S, Kini J (2021) Efficient and robust deep learning architecture for segmentation of kidney and breast histopathology images. Comput Electr Eng 92:107177
Acknowledgements
The authors would like to thank the Editor-in-Chief and anonymous Reviewers for their constructive comments, which improved the quality of the manuscript.
Funding
This research work was supported in part by the Science Engineering and Research Board, Department of Science and Technology, Govt. of India under Grant No. EEG/2018/000323, 2019.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
We have used three publically available datasets.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Chanchal, A.K., Lal, S. & Kini, J. High-resolution deep transferred ASPPU-Net for nuclei segmentation of histopathology images. Int J CARS 16, 2159–2175 (2021). https://doi.org/10.1007/s11548-021-02497-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11548-021-02497-9