Abstract
In computational pathology, nuclei segmentation from histology images is a fundamental task. While deep learning based nuclei segmentation methods yield excellent results, they rely on a large amount of annotated images; however, annotating nuclei from histology images is tedious and time-consuming. To get rid of labeling burden completely, we propose a label-free approach for nuclei segmentation, motivated from one pronounced yet omitted property that characterizes histology images and nuclei: intra-image self similarity (IISS), that is, within an image, nuclei are similar in their shapes and appearances. First, we leverage traditional machine learning and image processing techniques to generate a pseudo segmentation map, whose connected components form candidate nuclei, both positive or negative. In particular, it is common that adjacent nuclei are merged into one candidate due to imperfect staining and imaging conditions, which violate the IISS property. Then, we filter the candidates based on a custom-designed index that roughly measures if a candidate contains multiple nuclei. The remaining candidates are used as pseudo labels, which we use to train a U-Net to discover the hierarchical features distinguish nuclei pixels from background. Finally, we apply the learned U-Net to produce final nuclei segmentation. We validate the proposed method on the public dataset MoNuSeg. Experimental results demonstrate the effectiveness of our design and, to the best of our knowledge, it achieves the state-of-the-art performances of label-free segmentation on the benchmark MoNuSeg dataset with a mean Dice score of 79.2%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Note that in our experiments, we use an image of size \(1000^2\) or \(500^2\).
References
Graham, S., et al.: Hover-net: simultaneous segmentation and classification of nuclei in multi-tissue histology images. Med. Image Anal. 58, 101563 (2019)
Graham, S., et al.: Mild-net: minimal information loss dilated network for gland instance segmentation in colon histology images. Med. Image Anal. 52, 199–211 (2019)
Guo, Z., et al.: A fast and refined cancer regions segmentation framework in whole-slide breast pathological images. Sci. Rep. 9(1), 882 (2019)
Mahbod, A., et al.: Cryonuseg: a dataset for nuclei instance segmentation of cryosectioned h &e-stained histological images. Comput. Biol. Med. 132, 104349 (2021)
Xiang, T., Zhang, C., Liu, D., Song, Y., Huang, H., Cai, W.: BiO-Net: learning recurrent bi-directional connections for encoder-decoder architecture. In: Martel, A.L., et al. (eds.) MICCAI 2020. LNCS, vol. 12261, pp. 74–84. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-59710-8_8
Umesh Adiga, P.S., Chaudhuri, B.B.: An efficient method based on watershed and rule-based merging for segmentation of 3-d histo-pathological images. Pattern Recogn. 34(7), 1449–1458 (2001)
Wienert, S., et al.: Detection and segmentation of cell nuclei in virtual microscopy images: a minimum-model approach. Sci. Rep. 2(1), 503 (2012)
Nogues, I., et al.: Automatic lymph node cluster segmentation using holistically-nested neural networks and structured optimization in CT images. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9901, pp. 388–397. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46723-8_45
Ragothaman, S., Narasimhan, S., Basavaraj, M.G., Dewar, R.: Unsupervised segmentation of cervical cell images using gaussian mixture model. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 70–75 (2016)
Zhang, Y., Brady, M., Smith, S.: Segmentation of brain mr images through a hidden markov random field model and the expectation-maximization algorithm. IEEE Trans. Med. Imaging 20(1), 45–57 (2001)
Kanezaki, A.: Unsupervised image segmentation by backpropagation. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1543–1547. IEEE (2018)
Ji, X., Henriques, J.F., Vedaldi, A.: Invariant information clustering for unsupervised image classification and segmentation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 9865–9874 (2019)
Zhou, L., Wei, W.: DIC: deep image clustering for unsupervised image segmentation. IEEE Access 8, 34481–34491 (2020)
Zanjani, F.G., Zinger, S., Bejnordi, B.E., van der Laak, H.A.W.M., et al.: Histopathology stain-color normalization using deep generative models. In: Medical Imaging with Deep Learning (2018)
Nan, Y., et al.: Unsupervised tissue segmentation via deep constrained gaussian network. IEEE Trans. Med. Imaging 41(12), 3799–3811 (2022)
Kumar, N., Verma, R., Sharma, S., Bhargava, S., Vahadane, A., Sethi, A.: A dataset and a technique for generalized nuclear segmentation for computational pathology. IEEE transactions on medical imaging 36(7), 1550–1560 (2017)
Kumar, N., et al.: A multi-organ nucleus segmentation challenge. IEEE Trans. Med. Imaging 39(5), 1380–1391 (2019)
Gandelsman, Y., Shocher, A., Irani, M.: “double-dip": unsupervised image decomposition via coupled deep-image-priors. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11026–11035 (2019)
Wang, J., Jiang, J.: Unsupervised deep clustering via adaptive gmm modeling and optimization. Neurocomputing 433, 199–211 (2021)
Kim, W., Kanezaki, A., Tanaka, M.: Unsupervised learning of image segmentation based on differentiable feature clustering. IEEE Trans. Image Process. 29, 8055–8068 (2020)
Vahadane, A., et al.: Structure-preserving color normalization and sparse stain separation for histological images. IEEE Trans. Med. Imaging 35(8), 1962–1971 (2016)
Feldman, A.T., Wolfe, D.: Tissue processing and hematoxylin and eosin staining. In: Histopathology: Methods and Protocols, pp. 31–43 (2014)
Hui, Q., et al.: Weakly supervised deep nuclei segmentation using partial points annotation in histopathology images. IEEE Trans. Med. Imaging 39(11), 3655–3666 (2020)
Vu, Q.D., et al.: Methods for segmentation and classification of digital microscopy tissue images. Front. Bioeng. Biotechnol. 53 (2019)
Acknowledgement
Supported by Natural Science Foundation of China under Grant 62271465 and Open Fund Project of Guangdong Academy of Medical Sciences, China (No. YKY-KF202206).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Chen, L., Li, H., Zhou, S.K. (2023). Label-Free Nuclei Segmentation Using Intra-Image Self Similarity. In: Greenspan, H., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2023. MICCAI 2023. Lecture Notes in Computer Science, vol 14225. Springer, Cham. https://doi.org/10.1007/978-3-031-43987-2_65
Download citation
DOI: https://doi.org/10.1007/978-3-031-43987-2_65
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-43986-5
Online ISBN: 978-3-031-43987-2
eBook Packages: Computer ScienceComputer Science (R0)
