Abstract
Colorectal cancer is one of the most common types of cancer worldwide and the leading cause of death due to cancer. As such, an early detection and diagnosis is of paramount importance, which is, however, limited due to insufficient medical practitioners available for large-scale histopathological screening. This demands a reliable computer-aided framework that can automatically analyse histopathological slide images and assist pathologists in quick decision-making. To this end, we propose a novel deep learning framework that combines supervised learning with self-supervision for robust learning of histopathological features from colorectal tissue images. Specifically, our framework comprises a multitask training pipeline using deep metric learning that learns the embedding space using triplet loss, which is augmented using a self-supervised image reconstruction module that enhances learning of pixel-level texture features. The downstream classification is done by extracting features using the pre-trained encoder and feeding them into a support vector machine classifier. We perform qualitative and quantitative analysis on a publicly available colorectal cancer histopathology dataset, as well as compare the proposed framework against some state-of-the-art works, where the model is found to outperform several existing works in literature. The source codes of the proposed method can be found at https://github.com/soumitri2001/DMTL-CRCH.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alwassel H, Mahajan D, Korbar B, Torresani L, Ghanem B, Tran D (2019) Self-supervised learning by cross-modal audio-video clustering. arXiv:1911.12667
Annarumma M, Montana G (2018) Deep metric learning for multi-labelled radiographs. In: Proceedings of the 33rd annual ACM symposium on applied computing
Atito S, Awais M, Kittler J (2021) Sit: self-supervised vision transformer. arXiv:2104.03602
Bromley J, Bentz JW, Bottou L, Guyon I, LeCun Y, Moore C, Säckinger E, Shah R (1993) Signature verification using a “siamese’’ time delay neural network. World Scientific, IJPRAI
Chattopadhyay S, Kundu R, Singh PK, Mirjalili S, Sarkar R (2021) Pneumonia detection from lung x-ray images using local search aided sine cosine algorithm based deep feature selection method. Int J Intell Syst
Chen T, Kornblith S, Norouzi M, Hinton G (2020) A simple framework for contrastive learning of visual representations. In: ICML
Ciompi F, Geessink O, Bejnordi BE, de Souza GS (2017) The importance of stain normalization in colorectal tissue classification with convolutional networks. In: IEEE ISBI
Cortes C, Vapnik V: Support-vector networks. Mach Learn (1995)
Dai G, Xie J, Zhu F, Fang Y (2017) Deep correlated metric learning for sketch-based 3d shape retrieval. In: AAAI
Deepak P, Philipp K, Jeff D, Trevor D, Efros AA (2016) Context encoders: feature learning by inpainting. In: CVPR
Ghosh S, Bandyopadhyay A, Sahay S, Ghosh R, Kundu I, Santosh K (2021) Colorectal histology tumor detection using ensemble deep neural network. Elsevier, EAAI
He K, Fan H, Wu Y, Xie S, Girshick R (2020) Momentum contrast for unsupervised visual representation learning. In: CVPR
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: IEEE CVPR
Hoffer E, Ailon N (2015) Deep metric learning using triplet network. In: International workshop on similarity-based pattern recognition
Hu J, Lu J, Tan YP (2014) Discriminative deep metric learning for face verification in the wild. In: IEEE CVPR
Kather JN, Weis CA, Bianconi F, et al (2016) Multi-class texture analysis in colorectal cancer histology. In: Scientific reports, nature
Kaya M, Bilge, HŞ (2019) Deep metric learning: a survey. Symmetry
Kundu R, Basak H, Singh PK, Ahmadian A, Ferrara M, Sarkar R (2021) Fuzzy rank-based fusion of CNN models using Gompertz function for screening COVID-19 CT-scans. In: Scientific reports. Nature
Liu J, Deng Y, Bai T, Wei Z, Huang C (2015) Targeting ultimate accuracy: face recognition via deep embedding. arXiv:1506.07310
Van der Maaten L, Hinton G (2008) Visualizing data using t-SNE. J Mach Learn Res
Ohata EF, Chagas JVSd, Bezerra GM, Hassan MM, de Albuquerque VHC, Filho PPR (2021) A novel transfer learning approach for the classification of histological images of colorectal cancer. J Supercomput Springer
Ohri K, Kumar M (2021) Review on self-supervised image recognition using deep neural networks. Knowl-Based Syst
Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, Killeen T, Lin Z, Gimelshein N, Antiga L et al (2019) Pytorch: an imperative style, high-performance deep learning library. In: NeurIPS
Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: MICCAI
Sabol P, Sinčák P, Hartono P, Kočan P et al (2020) Explainable classifier for improving the accountability in decision-making for colorectal cancer diagnosis from histopathological images. Elsevier, JBI
Schroff F, Kalenichenko D, Philbin J (2015) Facenet: a unified embedding for face recognition and clustering. In: CVPR
Society AC (2020) What is colorectal cancer? American Cancer Society. www.cancer.org/cancer/colon-rectal-cancer/about/what-is-colorectal-cancer.html
Society AC (2021) Survival rates for colorectal cancer. American Cancer Society. www.cancer.org/cancer/colon-rectal-cancer/detection-diagnosis-staging/survival-rates.html
Sutskever I, Martens J, Dahl G, Hinton G (2013) On the importance of initialization and momentum in deep learning. In: ICML
Takamatsu M, Yamamoto N, Kawachi H, Chino A, Saito S, Ueno M, Ishikawa Y, Takazawa Y, Takeuchi K (2019) Prediction of early colorectal cancer metastasis by machine learning using digital slide images. In: CMPB
Wang C, Shi J, Zhang Q, Ying S (2017) Histopathological image classification with bilinear convolutional neural networks. In: IEEE EMBC
Xu Y, Ju L, Tong J, Zhou CM, Yang JJ (2020) Machine learning algorithms for predicting the recurrence of stage IV colorectal cancer after tumor resection. In: Scientific reports, nature
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Marik, A., Chattopadhyay, S., Singh, P.K. (2023). Supervision Meets Self-supervision: A Deep Multitask Network for Colorectal Cancer Histopathological Analysis. In: Singh, P., Singh, D., Tiwari, V., Misra, S. (eds) Machine Learning and Computational Intelligence Techniques for Data Engineering. MISP 2022. Lecture Notes in Electrical Engineering, vol 998. Springer, Singapore. https://doi.org/10.1007/978-981-99-0047-3_41
Download citation
DOI: https://doi.org/10.1007/978-981-99-0047-3_41
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-0046-6
Online ISBN: 978-981-99-0047-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)