Abstract
Progesterone receptor (PR) plays a vital role in diagnosing and treating breast cancer, but PR staining is costly and time-consuming, seriously hindering its application in clinical practice. The recent rapid development of deep learning technology provides an opportunity to address this problem by virtual staining. However, supervised methods acquire pixel-level paired H &E and PR images, which almost cannot be implemented clinically. In addition, unsupervised methods lack effective constraint information, and the staining results are not reliable sometimes. In this paper, we propose a semi-supervised PR virtual staining method without any pathologist annotation. Firstly, we register the consecutive slides and obtain the patch-level labels of H &E images from the registered consecutive PR images. Furthermore, by designing a Pos/Neg classifier and corresponding constraints, the output images maintain the Pos/Neg consistency with the input images, enabling the output images to be more accurate. Experimental results show that our method can effectively generate PR images from H &E images and maintain structural and pathological consistency with the reference. Compared with existing methods, our approach achieves the best performance.
B. Zeng, Y. Lin and Y. Wang—Co-first authors.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
BenTaieb, A., Hamarneh, G.: Adversarial stain transfer for histopathology image analysis. IEEE Trans. Med. Imaging 37(3), 792–802 (2017)
Cai, Y., Hu, X., Wang, H., Zhang, Y., Pfister, H., Wei, D.: Learning to generate realistic noisy images via pixel-level noise-aware adversarial training. In: NeurIPS (2021)
Dabbs, D.J.: Diagnostic Immunohistochemistry E-Book: Theranostic and Genomic Applications. Elsevier Health Sciences (2017)
Daniel, A.R., Hagan, C.R., Lange, C.A.: Progesterone receptor action: defining a role in breast cancer. Expert Rev. Endocrinol. Metab. 6(3), 359–369 (2011)
Feldman, A.T., Wolfe, D.: Tissue processing and hematoxylin and eosin staining. In: Day, C.E. (ed.) Histopathology. MMB, vol. 1180, pp. 31–43. Springer, New York (2014). https://doi.org/10.1007/978-1-4939-1050-2_3
Kim, J., Kim, M., Kang, H., Lee, K.: U-GAT-IT: unsupervised generative attentional networks with adaptive layer-instance normalization for image-to-image translation. arXiv preprint arXiv:1907.10830 (2019)
Li, X., et al.: Unsupervised content-preserving transformation for optical microscopy. Light Sci. Appl. 10(1), 1–11 (2021)
Lin, Y., et al.: Unpaired multi-domain stain transfer for kidney histopathological images. In: Proceedings of AAAI (2022)
Liu, S., et al.: Unpaired stain transfer using pathology-consistent constrained generative adversarial networks. IEEE Trans. Med. Imaging 40(8), 1977–1989 (2021)
Odena, A.: Semi-supervised learning with generative adversarial networks. arXiv preprint arXiv:1606.01583 (2016)
Ramos-Vara, J.: Technical aspects of immunohistochemistry. Vet. Pathol. 42(4), 405–426 (2005)
Riesco, A.: MUnit: a unit framework for Maude. In: Rusu, V. (ed.) WRLA 2018. LNCS, vol. 11152, pp. 45–58. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-99840-4_3
Rivenson, Y., et al.: Virtual histological staining of unlabelled tissue-autofluorescence images via deep learning. Nat. Biomed. Eng. 3(6), 466–477 (2019)
Subik, K., et al.: The expression patterns of ER, PR, HER2, CK5/6, EGFR, KI-67 and AR by immunohistochemical analysis in breast cancer cell lines. Breast Cancer Basic Clin. Res. 4, 117822341000400000 (2010)
Wodzinski, M., Müller, H.: DeepHistReg: unsupervised deep learning registration framework for differently stained histology samples. Comput. Methods Programs Biomed. 198, 105799 (2021)
Xu, Z., Li, X., Zhu, X., Chen, L., He, Y., Chen, Y.: Effective immunohistochemistry pathology microscopy image generation using CycleGAN. Front. Mol. Biosci. 7, 243 (2020)
Zhu, J.Y., Park, T., Isola, P., Efros, A.A.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2223–2232 (2017)
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China (61922048 &62031023), in part by the Shenzhen Science and Technology Project (JCYJ20200109142808034), and in part by Guangdong Special Support (2019TX05X187).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Zeng, B. et al. (2022). Semi-supervised PR Virtual Staining for Breast Histopathological Images. In: Wang, L., Dou, Q., Fletcher, P.T., Speidel, S., Li, S. (eds) Medical Image Computing and Computer Assisted Intervention – MICCAI 2022. MICCAI 2022. Lecture Notes in Computer Science, vol 13432. Springer, Cham. https://doi.org/10.1007/978-3-031-16434-7_23
Download citation
DOI: https://doi.org/10.1007/978-3-031-16434-7_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-16433-0
Online ISBN: 978-3-031-16434-7
eBook Packages: Computer ScienceComputer Science (R0)