Abstract
Wireless capsule endoscopy (WCE) constitutes a medical imaging technology developed for the endoscopic exploration of the gastrointestinal (GI) tract, whereas it provides a more comfortable examination method, in comparison to the conventional endoscopy technologies. In this paper, we propose a novel Explainable Fuzzy Bag-of-Words (XFBoW) feature extraction model, for the classification of weakly annotated WCE images. A comparative advantage of the proposed model over state-of-the-art feature extractors is that it can provide an explainable classification outcome, even with conventional classification schemes, such as Support Vector Machines. The explanations that can be derived are based on the similarity of the image content with the content of the training images, used for the construction of the model. The feature extraction process relies on data clustering and fuzzy sets. Clustering is used to encode the image content into visual words. These words are subsequently used for the formation of fuzzy sets to enable a linguistic characterization of similarities with the training images. A state-of-the-art Brain Storm Optimization algorithm is used as an optimizer to define the most appropriate number of visual words and fuzzy sets and also the fittest parameters of the classifier, in order to optimally classify the WCE images. The training of XFBoW is performed using only image-level, semantic labels instead of detailed, pixel-level annotations. The proposed method is investigated on real datasets that include a variety of GI abnormalities. The results show that XFBoW outperforms several state-of-the-art methods, while providing the advantage of explainability.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Vasilakakis, M., Koulaouzidis, A., Yung, D.E., Plevris, J.N., Toth, E., Iakovidis, D.K.: Follow-up on: optimizing lesion detection in small bowel capsule endoscopy and beyond: from present problems to future solutions. Expert Rev. Gastroenterol. Hepatol. 13, 129–141 (2019)
Vasilakakis, M., Iakovidis, D.K., Spyrou, E., Koulaouzidis, A.: Weakly-supervised lesion detection in video capsule endoscopy based on a bag-of-colour features model. In: Peters, T., et al. (eds.) CARE 2016. LNCS, vol. 10170, pp. 96–103. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-54057-3_9
Van Gemert, J.C., Veenman, C.J., Smeulders, A.W., Geusebroek, J.-M.: Visual word ambiguity. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1271–1283 (2009)
Garca-Rodrguez, A., et al.: Polyp fingerprint: automatic recognition of unique features to univocally identify colorectal polyps. Endoscopy 51, OP186V (2019)
Altintakan, U.L., Yazici, A.: Towards effective image classification using class-specific codebooks and distinctive local features. IEEE Trans. Multimedia 17, 323–332 (2015)
Altintakan, U.L., Yazici, A.: A novel fuzzy feature encoding approach for image classification. In: 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), pp. 1134–1139. IEEE (2016)
Vasilakakis, M.D., Koulaouzidis, A., Marlicz, W., Iakovidis, D.K.: The future of capsule endoscopy in clinical practice: from diagnostic to therapeutic experimental prototype capsules. Gastroenterology 15, 179 (2020)
Iakovidis, D.K., Georgakopoulos, S.V., Vasilakakis, M., Koulaouzidis, A., Plagianakos, V.P.: Detecting and locating gastrointestinal anomalies using deep learning and iterative cluster unification. IEEE Trans. Med. Imaging 37, 2196–2210 (2018)
Yang, J., Chang, L., Li, S., He, X., Zhu, T.: WCE polyp detection based on novel feature descriptor with normalized variance locality-constrained linear coding. Int. J. Comput. Assist. Radiol. Surg. 15(8), 1291–1302 (2020). https://doi.org/10.1007/s11548-020-02190-3
García-Rodríguez, A., et al.: Polyp fingerprint: automatic recognition of colorectal polyps’ unique features. Surg. Endosc. 34(4), 1887–1889 (2020). https://doi.org/10.1007/s00464-019-07240-9
Patel, A., Rani, K., Kumar, S., Figueiredo, I.N., Figueiredo, P.N.: Automated bleeding detection in wireless capsule endoscopy images based on sparse coding. Multimedia Tools Appl. 80, 30353–30366 (2021). https://doi.org/10.1007/s11042-020-09605-y
Diamantis, D.E., Iakovidis, D.K., Koulaouzidis, A.: Look-behind fully convolutional neural network for computer-aided endoscopy. Biomed. Signal Process. Control 49, 192–201 (2019)
Sovatzidi, G., Iakovidis, D.K.: Determinative brain storm optimization. In: Tan, Y., Shi, Y., Tuba, M. (eds.) ICSI 2020. LNCS, vol. 12145, pp. 259–271. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-53956-6_24
Tuytelaars, T.: Dense interest points. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2281–2288. IEEE (2010)
Vasilakakis, M.D., Iakovidis, D.K., Spyrou, E., Koulaouzidis, A.: DINOSARC: Color features based on selective aggregation of chromatic image components for wireless capsule endoscopy. Comput. Math. Methods Med. 2018 (2018). https://doi.org/10.1155/2018/2026962. Article ID 2026962
Koulaouzidis, A., et al.: KID Project: an internet-based digital video atlas of capsule endoscopy for research purposes. Endosc. Int. Open 5, E477–E483 (2017)
Provost, F., Fawcett, T.: Analysis and visualization of classifier performance with nonuniform class and cost distributions. In: Proceedings of AAAI-97 Workshop on AI Approaches to Fraud Detection & Risk Management, pp. 57–63 (1997)
Jadon, S., Leary, O.P., Pan, I., Harder, T.J., Wright, D.W., Merck, L.H., Merck, D.L.: A comparative study of 2D image segmentation algorithms for traumatic brain lesions using CT data from the ProTECTIII multicenter clinical trial. In: Medical Imaging 2020: Imaging Informatics for Healthcare, Research, and Applications, p. 113180Q. International Society for Optics and Photonics (2020)
Jadon, S.: A survey of loss functions for semantic segmentation. In: 2020 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB), pp. 1–7. IEEE (2020)
Drake, J., Hamerly, G.: Accelerated k-means with adaptive distance bounds. In: 5th NIPS Workshop on Optimization for Machine Learning (2012)
Theodoridis, S., Koutroumbas, K.: Pattern Recognition, 4th edn. Academic Press Inc., Orlando (2008)
Steel, R.G.D., Torrie, J.H., et al.: Principles and Procedures of Statistics (1960)
Acknowledgment
This work was supported in part by the grant No. 5024 of the Special Account of Research Grants of the University of Thessaly, Greece.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Vasilakakis, M., Sovatzidi, G., Iakovidis, D.K. (2021). Explainable Classification of Weakly Annotated Wireless Capsule Endoscopy Images Based on a Fuzzy Bag-of-Colour Features Model and Brain Storm Optimization. In: de Bruijne, M., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2021. MICCAI 2021. Lecture Notes in Computer Science(), vol 12903. Springer, Cham. https://doi.org/10.1007/978-3-030-87199-4_46
Download citation
DOI: https://doi.org/10.1007/978-3-030-87199-4_46
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87198-7
Online ISBN: 978-3-030-87199-4
eBook Packages: Computer ScienceComputer Science (R0)
