Abstract
Purpose
The utility of chromoendoscopy for early gastric cancer (GC) was determined by machine learning using data of color differences.
Methods
Eighteen histopathologically confirmed early GC lesions were examined. We prepared images from white light endoscopy (WL), indigo carmine (Indigo), and acetic acid-indigo carmine chromoendoscopy (AIM). A border between cancerous and non-cancerous areas on endoscopic images was established from post-treatment pathological findings, and 2000 pixels with equivalent luminance values were randomly extracted from each image of cancerous and non-cancerous areas. Each pixel was represented as a three-dimensional vector with RGB values and defined as a sample. We evaluated the Mahalanobis distance using RGB values, indicative of color differences between cancerous and non-cancerous areas. We then conducted diagnosis test using a support vector machine (SVM) for each image. SVM was trained using the 100 training samples per class and determined which area each of 1900 test samples per class came from.
Results
The means of the Mahalanobis distances for WL, Indigo, and AIM were 1.52, 1.32, and 2.53, respectively and there were no significant differences in the three modalities. Diagnosability per endoscopy technique was assessed using the F1 measure. The means of F1 measures for WL, Indigo, and AIM were 0.636, 0.618, and 0.687, respectively. AIM images were better than WL and Indigo images for the diagnosis of GC.
Conclusion
Objective assessment by SVM found AIM to be suitable for diagnosis of early GC based on color differences.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
The detectability of early gastric cancers has improved with the use of high-resolution video endoscopy and chromoendoscopy [1,2,3]. Magnifying endoscopy combined with image-enhanced endoscopy such as narrow-band imaging has also been reported to improve the qualitative diagnosability of gastric cancers [4,5,6]. However, previous assessment of the diagnosability of early gastric cancer using endoscopy was based on the endoscopist’s subjective judgment and thereby included some problems in its objectivity [7, 8]. Therefore, we used the three-dimensional vectors with RGB value, indicative of color differences between cancerous and non-cancerous areas. Then, objective assessment of the diagnosability per endoscopy technique was conducted by its discriminator generated following training of a support vector machine (SVM) [9].
Endoscopic diagnosis of early gastric cancer has carried out based on distinct differences in the surface color and properties between the lesion and the surrounding tissues. White light endoscopy (WL) is used for the screening of gastric cancer. Indigo carmine chromoendoscopy (Indigo) is simple and easy and is also thought to be useful for the diagnosis of cancer [7, 8]. Acetic acid-indigo carmine chromoendoscopy (AIM) is a method that is based on the difference in the level of mucus, which may be due to a defense reaction of the gastric mucosa against acetic acid, between cancerous and non-cancerous areas. It has been reported that the diagnosability of gastric cancer is high using AIM [10, 11].
There have been remarkable advances in the artificial intelligence field recently, and the application of this technology to the medical field is expected [12, 13]. However, there are few cases of its application to the endoscopic field except for the detection of dysplasia in patients with Barrett’s esophagus and diagnosis via capsule endoscopy [14, 15]. In the present study, by using a SVM, which is one of machine learning techniques available for high-precision discrimination, the diagnosability of gastric cancer using different endoscopy techniques was compared based on the color difference between the cancerous and non-cancerous areas.
Materials and Methods
Subjects
Eighteen patients underwent upper endoscopy and endoscopic resection or surgical resection at the Yamaguchi University Hospital, and 18 lesions that were diagnosed histopathologically as early gastric cancer were examined. Our 18 subjects were patients who were undergone endoscopic examination by WL, Indigo, and AIM from June 2014 to August 2016. In these cases, the images by WL, Indigo, and AIM were recorded as similar views. Clinicopathological features of cases of the early gastric carcinomas were shown in Table 1.
This study was conducted after obtaining the approval of the ethics committee of the Yamaguchi University Hospital. All the 18 patients provided their informed consent before resection for images to be acquired.
Image Acquisition
The endoscope and the image processor used in our study were a GIF-H260Z and an EVIS LUCERA ELITE, respectively (both from Olympus, Tokyo, Japan). White light endoscopy was performed, and then 0.2% indigo carmine was dispersed. Following this, a solution consisting of 0.2% indigo carmine plus 2.1% acetic acid was dispersed, and the images were acquired 12 s later. The images of the same lesions were thus obtained in order through WL, Indigo, and AIM (Fig. 1).
Determination of Tumor Boundary and Extraction of RGB Data
A total of 54 still images of the 18 lesions were evaluated. A specialist certified by the Japan Gastroenterological Endoscopy Society (JN) examined the endoscopic images along with the corresponding macroscopic and histopathology findings and then circled a cancerous area on the individual images (Fig. 2).
Pixels were extracted randomly from both the cancerous and non-cancerous areas on the images. To exclude the difference in the luminance value of the targeted pixels, the luminance value of each pixel was calculated from the extracted RGB values [16]. Then, 2000 pixels with equivalent luminance values were chosen from each image of the cancerous and non-cancerous areas (4000 pixels in total) obtained using the three endoscopy techniques. Following this, a pixel represented as a three-dimensional vector with RGB values was defined as a sample (Fig. 3).
The Mahalanobis Distance
The mean vectors (μ1) and covariance matrix (Σ1) were estimated using 2000 samples in the cancerous area, and similarly, the mean vectors (μ2) and covariance matrix (Σ2) were estimated using 2000 samples in the non-cancerous area on the image (Fig. 3). The Mahalanobis distances, indicative of color differences between cancerous and non-cancerous areas, were obtained for WL, Indigo, and AIM, respectively [17]. Differences in the mean of Mahalanobis distances between WL and Indigo, WL and AIM, and Indigo and AIM were calculated respectively for each of the 18 lesions.
Machine Learning and F1 Measure
One hundred samples from the cancerous areas and 100 samples from the non-cancerous areas were used for training, and the remaining 3800 samples (1900 samples from the cancerous and 1900 samples from the non-cancerous areas) were used for testing (Fig. 3). The LIBSVM (Library for Support Vector Machines) [18] was trained using the training samples. Then, the SVM diagnosed whether the test samples were from cancerous areas or non-cancerous areas. Each diagnosability per endoscopy technique was assessed using the F1 measure, which was calculated as the harmonic mean of the sensitivity (reproducible rate) and the positive predictive value (precision), and this measure was used as the indicator of diagnosability [19]. The mean of the F1 measures in each of the 18 lesions was statistically compared for each endoscopy technique.
Subjective Assessment of the Images
Fifty-four still images with white light (WL), Indigo, and AIM of the 18 lesions were randomly sorted to prevent the influence of display order. Five endoscopists completely blinded to patient information including the pathological diagnosis and endoscopic images evaluated the 54 still images to determine whether gastric cancer could be diagnosed. Re-examination of previously examined images was strictly prohibited. The mean of the ratio of the images that the endoscopists could diagnose gastric cancer was statistically compared for each endoscopy technique.
Results
The means of the Mahalanobis distances with WL, Indigo, and AIM were 1.52, 1.32, and 2.53 respectively. The AIM images tend to be superior in color difference to WL and Indigo images. There were no significant differences in the three modalities (Fig. 4).
When we compared each diagnosability by using SVM, the means of the F1 measures with WL, Indigo, and AIM were 0.636, 0.618, and 0.687, respectively. These results indicated that the images from the AIM were suitable for the diagnosis of gastric cancer based on color differences (Fig. 5).
From the subjective assessment, the mean rates that the endoscopists could diagnose gastric cancer for WL, Indigo, and AIM were 50.0, 52.2, and 83.3%, respectively (Fig. 6). Compared with the results for the WL and Indigo images, the mean ratio of diagnosability was significantly higher for the AIM images.
Discussion
The usefulness of indigo carmine and AIM was generally assessed based on the endoscopist’s subjective assessment [7, 8]. Objective tests of each technique in the endoscopy field are rarely performed. The Mahalanobis distances and machine learning using the RGB values of the pixels extracted randomly from the endoscopic image were used to objectively assess the endoscopic technique based on color differences. We previously reported the diagnostic ability of optical enhancement system in early gastric cancer demarcation with the same method [16]. The means of the Mahalanobis distances with the three modalities were not significantly different while SVM worked well for discrimination of the utility of the three techniques.
Recently, machine learning has attracted attention as support for diagnostic tools in the medical field [12, 13]. The SVM used in our study is classified as a data-knowledge integration artificial intelligence and has excellent pattern discriminability. By setting a boundary line where the training sample can be distinguished at the maximum, the SVM can identify two classes with high precision [20, 21]. The F1 measure, which was used as the indicator of diagnosability, is considered an accurate indicator focusing not only on the sensitivity but also on the positive predictive value [19]. Van der Sommen et al. showed the usefulness of the SVM and the F1 measure for evaluating the endoscopic image of Barrett’s esophagus [14].
Endoscopic diagnosis of early gastric cancer has carried out based on distinct differences in the surface color and properties between the lesion and the surrounding tissues. The images obtained from AIM were the most suitable for diagnosis of gastric cancer based on color differences compared with the images from WL and Indigo. Kawahara et al. reported that the outcome of endoscopic resection was good in lesions in which the gastric tumor margin was determined using AIM [10, 11]. The usefulness of this type of chromoendoscopy might be based on the enhanced color difference.
When a classifier designed by machine learning is used for the endoscopic diagnosis of gastric cancer, it is desirable to use a versatile system for various lesions. However, in a previous examination, it was found that the color of the cancerous areas in each lesion or the gastric mucosa of the non-cancerous areas was different on the endoscopic images of each patient. The individual variation results in the difficulty of diagnosis. Consequently, it is necessary to examine the color differences between cancerous areas and non-cancerous areas as the reference in individual patients [22].
As limitations of this study, it was performed with a small number of patients in a single institution. In addition, gastric cancer with differentiated tumors, for which endoscopic treatment is indicated, accounted for most of the cases. In the future, we plan to perform another study with more patients from multiple institutions and with various histologic types of gastric cancer.
Conclusion
Objective assessment with a SVM showed AIM to be suitable technique for the diagnosis of early gastric cancer based on variances in color differences in the endoscopic images.
References
Kaise M, Kato M, Tajiri H. High-definition endoscopy and magnifying endoscopy combined with narrow band imaging in gastric cancer. Gastroenterology Clinics of North America. 2010;39:771–84. https://doi.org/10.1016/j.gtc.2010.08.028.
Sugano K. Detection and management of early gastric cancer. Curr Treat Options Gastroenterol. 2015;13:398–408. https://doi.org/10.1007/s11938-015-0070-y.
Lambert R, Saito H, Saito Y. High-resolution endoscopy and early gastrointestinal cancer...dawn in the East. Endoscopy. 2007;39:232–7.
Ezoe Y, Muto M, Uedo N, Doyama H, Yao K, Oda I, et al. Magnifying narrowband imaging is more accurate than conventional white-light imaging in diagnosis of gastric mucosal cancer. Gastroenterology. 2011;141:2017–25. https://doi.org/10.1053/j.gastro.2011.08.007.
Yao K, Anagnostopoulos GK, Ragunath K. Magnifying endoscopy for diagnosing and delineating early gastric cancer. Endoscopy. 2009;41:462–7. https://doi.org/10.1055/s-0029-1214594.
Sumie H, Sumie S, Nakahara K, Watanabe Y, Matsuo K, Mukasa M, et al. Usefulness of magnifying endoscopy with narrow-band imaging for diagnosis of depressed gastric lesions. Mol Clin Oncol. 2014;2:129–33. https://doi.org/10.3892/mco.2013.213.
Szalóki T. Indigo carmine contrast staining in combination with high resolution electronic endoscopy. Orv Hetil. 2002;143:25–9.
Dinis-Ribeiro M. Chromoendoscopy for early diagnosis of gastric cancer. Eur J Gastroenterol Hepatol. 2006;18:831–8.
Vladimir NV (1995) The nature of statistical learning theory. Springer-Verlag, New York.
Numata N, Oka S, Tanaka S, Yoshifuku Y, Miwata T, Sanomura Y, et al. Useful condition of chromoendoscopy with indigo carmine and acetic acid for identifying a demarcation line prior to endoscopic submucosal dissection for early gastric cancer. BMC Gastroenterol. 2016;16:72. https://doi.org/10.1186/s12876-016-0483-7.
Kawahara Y, Takenaka R, Okada H, Kawano S, Inoue M, Tsuzuki T, et al. Novel chromoendoscopic method using an acetic acid-indigo carmine mixture for diagnostic accuracy in delineating the margin of early gastric cancers. Dig Endosc. 2009;21:14–9. https://doi.org/10.1111/j.1443-1661.2008.00824.x.
Nishio M, Nagashima C. Computer-aided diagnosis for lung cancer: usefulness of nodule heterogeneity. Acad Radiol. 2017;24:328–36. https://doi.org/10.1016/j.acra.2016.11.007.
Chang CC, Chen HH, Chang YC, Yang MY, Lo CM, Ko WC, et al. Computer-aided diagnosis of liver tumors on computed tomography images. Comput Methods Prog Biomed. 2017;14:45–51. https://doi.org/10.1016/j.cmpb.2017.04.008.
Van der Sommen F, Zinger S, Curvers WL, Bisschops R, Pech O, Weusten BL, et al. Computer-aided detection of early neoplastic lesions in Barrett’s esophagus. Endoscopy. 2016;48:617–24. https://doi.org/10.1055/s-0042-105284.
Kodogiannis VS, Boulougoura M, Lygouras JN, Petrounias I. A neuro-fuzzy-based system for detecting abnormal patterns in wireless-capsule endoscopic images. Neurocomputing. 2005;70:704–17. https://doi.org/10.1016/j.neucom.2006.10.024.
Nagao M, Nishikawa J, Ogawa R, Sasaki S, Nakamura M, Nishimura J, Goto A, Hashimoto S, Okamoto T, Suenaga M, Hamamoto Y, Sakaida I. Evaluation of the diagnostic ability of optical enhancement system in early gastric cancer demarcation. Gastroenterol Res Pract. 2016;2016:2439621. https://doi.org/10.1155/2016/2439621.
Mahalanobis PC (1936) On the generalized distance in statistics. In: Proc Nat Inst Sciences, India, pp 49–55.
Chang CC, Lin CJ. LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol. 2011;2:27.1–27.
Powers DMW. Evaluation: from precision, recall and f-measure to ROC, informedness, markedness & correlation. Journal of Machine Learning Technology. 2011;2:37–63.
Hassanpour S, Langlotz CP, Amrhein TJ, Befera NT, Lungren MP. Performance of a machine learning classifier of knee MRI reports in two large academic radiology practices: a tool to estimate diagnostic yield. AJR Am J Roentgenol. 2017;208:750–3.
Li Y, Zhang T. Deep neural mapping support vector machines. Neural Netw. 2017;93:185–94. https://doi.org/10.1016/j.neunet.2017.05.010.
Kiyotoki S, Nishikawa J, Okamoto T, Hamabe K, Saito M, Goto A, et al. New method for detection of gastric cancer by hyperspectral imaging: a pilot study. J Biomed Opt. 2013;18:026010. https://doi.org/10.1117/1.JBO.18.2.026010.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
This study was conducted after obtaining the approval of the ethics committee of the Yamaguchi University Hospital. All the 18 patients provided their informed consent before resection for images to be acquired.
Conflict of Interest
The authors declare that there is no conflict of interest.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Ogawa, R., Nishikawa, J., Hideura, E. et al. Objective Assessment of the Utility of Chromoendoscopy with a Support Vector Machine. J Gastrointest Canc 50, 386–391 (2019). https://doi.org/10.1007/s12029-018-0083-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12029-018-0083-6