Abstract
This paper investigates whether deep learning architectures for semantic segmentation are capable of supporting geneticists in karyotype exporting, in a more efficient manner without requiring the intervention of humans. For the sake of experiments, 62 images from the BioImLab segmentation dataset have been adopted that contain chromosomes, nucleotides, and some unknown objects. All regions of interest had been annotated manually with an emphasis on the overlapping areas between chromosomes. For this purpose, we created 10 synthetic folds, using the Holdout Cross Validation between 10 selected targeted microscope images containing all classes. The newly designed dataset is used to train 5 deep learning CNN with pretrained weights using the transfer learning technique, in order to highlight the strengths and the weaknesses of each architecture in the segmentation of “Overlapping” regions. In terms of evaluation, the metric of IoU (intersection over union) is used, which is widely used and approved in cases of the existence of overlapping between objects. The best result was 66.67% IoU in the case of Vgg19 model combined with U-Net achieving 57.1% mean IoU. The future prospects of this study are to assist the cytogeneticists to (a) remove the objects of no interest from the microscope image, (b) evaluate the suitability of the microscopic images for karyotyping, and (c) automate the karyotyping process.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Karyotyping for Chromosomal Abnormalities. https://www.nature.com/scitable/topicpage/karyotyping-for-chromosomal-abnormalities-298. Last accessed 18 May 2021
Sunil KP, Vijay KK, Ankur J, Madhavi P, Pratiksha S, Kanchan R, Seema K (2016) Cytogenetic analysis for suspected chromosomal abnormalities. A five years experience. J Clin Diagn Res 10:GC01–GC05
Shervin M, Mehran F, Babak HK (2014) A geometric approach to fully automatic chromosome segmentation. In: IEEE signal processing in medicine and biology symposium (SPMB), pp 1–6. Philadelphia PA, USA
Seema AB, Mousami VM, Alwin DA, Rupali SK (2021) Automated metaphase chromosome image selection techniques for karyotyping current status and future prospects. Turk J Comput Math Educ TURCOMAT 12:3258–3266
Grisan E, Poletti E, Ruggeri A (2009) Automatic segmentation and disentangling of chromosomes in Q-band prometaphase images. IEEE Trans Inf Technol Biomed 13:575–581
Sharma M, Saha O, Sriraman A, Hebbalaguppe R, Vig L, Karande S (2017) Crowdsourcing for chromosome segmentation and deep classification. In: IEEE conference on computer vision and pattern recognition workshops (CVPRW)
Manohar R, Gawande J (2017) Watershed and clustering based segmentation of chromosome images. In: IEEE 7th international advance computing conference (IACC)
Karvelis PS, Fotiadis DI, Tsalikakis DG, Georgiou IA (2009) Enhancement of multichannel chromosome classification using a region-based classifier and vector median filtering. IEEE Trans Inform Technol Biomed
Akila AS, Samarabandu J, Knoll J, Khan W, Rogan P (2010) An accurate image processing algorithm for detecting fish probe locations relative to chromosome landmarks on Dapi stained metaphase chromosome images. Canadian conference on computer and robot vision
Kubola K, Wayalun P (2018) Automatic determination of the G-band chromosomes number based on geometric features. In: 15th international joint conference on computer science and software engineering (JCSSE)
Andrade MF, Cordeiro FR, Macario V, Lima FF, Hwang SF, Mendonca JC (2018) A fuzzy-adaptive approach to segment metaphase chromosome images. In: 2018 7th Brazilian conference on intelligent systems (BRACIS)
Keerthi V, Remya RS, Sabeena K (2016) Automated detection of centromere in G banded chromosomes. Int Conf Inform Sci (ICIS)
Ehsani SP, Mousavi HS, Khalaj BH (2012) Iterative histogram matching algorithm for chromosome image enhancement based on statistical moments. In: 2012 9th IEEE international symposium on biomedical imaging (ISBI)
Karvelis PS, Fotiadis DI, Georgiou I, Sakaloglou P (2009) Enhancement of the classification of multichannel chromosome images using support vector machines. In: Annual international conference of the IEEE engineering in medicine and biology society
Menaka D, Vaidyanathan SG (2019) Expectation maximization segmentation algorithm for classification of human genome image. In: 3rd international conference on computing methodologies and communication (ICCMC)
Karvelis P, Likas A, Fotiadis DI (2010) Semi unsupervised M-FISH chromosome image classification. In: Proceedings of the 10th IEEE international conference on information technology and applications in biomedicine
Cao H, Deng H-W, Wang YP (2012) Segmentation of M-FISH images for improved classification of chromosomes with an adaptive fuzzy C-means clustering algorithm. IEEE Trans Fuzzy Syst 20:1–8
Dougherty AW, You J (2017) A kernel-based adaptive fuzzy C-means algorithm for M-fish image segmentation. In: International joint conference on neural networks (IJCNN)
Arora T, Dhir R, Mahajan M (2017) An algorithm to straighten the bent human chromosomes. In: Fourth international conference on image information processing (ICIIP)
Neethu SM, Remya RS, Sabeena K (2016) Automated karyotyping of metaphase chromosome images based on texture features. In: International conference on information science (ICIS)
Yilmaz IC, Yang J, Altinsoy E, Zhou L (2018) An improved segmentation for raw G-band chromosome images. In: 5th international conference on systems and informatics (ICSAI)
Swati, Gupta G, Yadav M, Sharma M, Vig L (2017) Siamese networks for chromosome classification. In: IEEE international conference on computer vision workshops (ICCVW)
Saranya S, Loganathan V, RamaPraba PS (2015) Efficient feature extraction and classification of chromosomes. In: International conference on innovation information in computing technologies
Uhlmann V, Delgado-Gonzalo R, Unser M, Michel PO, Baldi L, Wurm FM (2016) User-friendly image-based segmentation and analysis of chromosomes. In: IEEE 13th international symposium on biomedical imaging (ISBI)
Madian N, Jayanthi KB (2012) Overlapped chromosome segmentation and separation of touching chromosomes for auto-mated chromosome classification. In: Annual international conference of the IEEE engineering in medicine and biology society
Hu LR, Karnowski J, Fadely R, Pommier JP (2017) Image segmentation to distinguish between overlapping human chromosomes. In: 31st conference on neural information processing systems (NIPS 2017), Long Beach, CA, USA
Saleh HM, Saad NH, Isa NA (2019) Overlapping chromosome segmentation using U-Net: convolutional networks with test time augmentation. Procedia Comput Sci 159:524–533
Sun X, Li J, Ma J, Xu H, Chen B, Zhang Y, Feng T (2021) Segmentation of overlapping chromosome images using U-Net with improved dilated convolutions. J Intell Fuzzy Syst 40(3):5653–5668
Mei L, Yu Y, Weng Y, Guo X, Liu Y, Wang D, Liu S, Zhou F, Lei C (2020) Adversarial multiscale feature learning for overlapping chromosome segmentation. Cornell University Ithaca, New York, USA
Song S, Bai T, Zhao Y, Zhang W, Yang C, Meng J, Ma F, Su J (2021) A new convolutional neural network architecture for automatic segmentation of overlapping human chromosomes. Neural Process Lett
M-FISH Chromosome Imaging Database. http://live.ece.utexas.edu/research/mfish.html. Last accessed 03 July 2021
Andrade MFS, Cordeiro FR, Silva JJG, Lima FF, Hwang S, Macário V (2019) CRCN-NE chromosomes dataset
Human karyotypes for teaching. https://worms.zoology.wisc.edu/zooweb/Phelps/karyotype.html. Last accessed 07 April 2021
Overlapping chromosomes. https://www.kaggle.com/jeanpat/overlapping-chromosomes. Last accessed 10 July 2021
CHR OVERLAPPING DATASET. https://github.com/SifanSong/Chr_overlapping_datasets. Last accessed 02 Jan 2022
Poletti E, Grisan E, Ruggeri A (2008) Automatic classification of chromosomes in Q-band images. In: 2008 30th annual international conference of the IEEE engineering in medicine and biology society (2008)
VGG Image Annotator. https://www.robots.ox.ac.uk/~vgg/software/via. Last accessed 6 Jan 2021
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. Cornell University Ithaca, New York
Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: IEEE conference on computer vision and pattern recognition (CVPR)
Sandler M, Howard A, Zhu M, Zhmoginov A, Chen LC (2018) MobileNetV2 Inverted residuals and linear bottlenecks. In: IEEE/CVF conference on computer vision and pattern recognition
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: IEEE conference on computer vision and pattern recognition (CVPR)
Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In: IEEE conference on computer vision and pattern recognition (CVPR)
Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. Lecture notes in computer science, pp 234–241
CHEST XRAY DISEASE DETECTION USING VGG19. https://devmesh.intel.com/projects/chest-xray-disease-detection-using-vgg19. Last accessed 20 June 2021
Xiao J, Wang J, Cao S, Li B (2020) Application of a novel and improved VGG-19 network in the detection of workers wearing masks. J Phys Conf Ser (2020)
Godlin Jasil SP, Ulagamuthalvi V (2021) Skin lesion classification using pre-trained DENSENET201 deep neural network. In: 3rd international conference on signal processing and communication (ICPSC)
Lu T, Han B, Chen L, Yu F, Xue C (2021) A generic intelligent tomato classification system for practical applications using DenseNet-201 with transfer learning. Sci Rep (2021)
Toğaçar M, Cömert Z, Ergen B (2021) Intelligent skin cancer detection applying autoencoder, mobilenetv2 and spiking neural networks. Chaos, Solitons Fract (2021)
Huu PN, Thi Thu HN, Minh QT (2021) Proposing a recognition system of gestures using mobilenetv2 combining single shot detector network for smart-home applications. J Electr Comput Eng 1–18
Bharati S, Podder P, Mondal MR, Prasath VBS (2021) CO-ResNet optimized resnet model for covid-19 diagnosis from X-ray images. Int J Hybrid Intell Syst 17:71–85
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Nikolaou, A., Papakostas, G.A. (2023). Exploiting Deep Learning for Overlapping Chromosome Segmentation. In: Shukla, P.K., Singh, K.P., Tripathi, A.K., Engelbrecht, A. (eds) Computer Vision and Robotics. Algorithms for Intelligent Systems. Springer, Singapore. https://doi.org/10.1007/978-981-19-7892-0_24
Download citation
DOI: https://doi.org/10.1007/978-981-19-7892-0_24
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-19-7891-3
Online ISBN: 978-981-19-7892-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)