Abstract
Purpose
Dysphagia has a large impact on the society because it is a risk factor of malnutrition and aspiration pneumonia, and therefore, it is necessary to elucidate the entire mechanism of dysphagia. In this study, we propose a segmentation method of cervical intervertebral disks (CIDs) in videofluorography (VF) by use of patch-based convolutional neural network (CNN), our multi-channelization (MC) method and image feature selection.
Methods
Twenty image filters are individually applied to a VF frame image to generate feature images. One color image, called a multi-channelized image, is generated by setting three selected feature images to its red, green and blue channels. Patch-based CNN is applied to the MC image, and the segmentation accuracy of CIDs is evaluated by the pixel-based F-measure. The combination of the three feature images is optimized by the simulated annealing method.
Results
The proposed method was applied to actual VF dataset consisting of 19 patients and 39 healthy participants. The segmentation accuracy was 59.3% in the F-measure when Sobel and morphological top-hat filters were selected in MC, whereas it was 56.2% when original frame images were used.
Conclusion
The experimental results demonstrated that the proposed method was able to segment CIDs from actual VF and also that the MC method was able to increase the segmentation accuracy by approximately 3%. In this study, LeNet was used as CNN. One of our future tasks is to use other CNNs.
Similar content being viewed by others
References
Marik PE, Kaplan D (2003) Aspiration pneumonia and dysphagia in the elderly. Chest 124(1):328–336
Palmer JB, Tanaka E, Ensrud E (2000) Motions of the posterior pharyngeal wall in human swallowing: a quantitative videofluorographic study. Arch Phys Med Rehabil 81(11):1520–1526
Kim Y, Park G-Y, Seo YJ, Im S (2015) Effect of anterior cervical osteophyte in poststroke dysphagia: a case-control study. Arch Phys Med Rehabil 96(7):1269–1276
Ryu JS, Lee JH, Kang JY, Kim MY, Shin DE, Shin DA (2012) Evaluation of dysphagia after cervical surgery using laryngeal electromyography. Dysphagia 27(3):318–324
Zhang Z, Coyle JL, Sejdić E (2018) Automatic hyoid bone detection in fluoroscopic images using deep learning. Sci Rep 8(1):12310
Reinartz R, Platel B, Boselie T, van Mameren H, van Santbrink H, ter Haar Romeny B (2009) Cervical vertebrae tracking in video-fluoroscopy using the normalized gradient field. In: International conference on medical image computing and computer-assisted intervention (MICCAI 2009), Proceedings. Berlin, pp 524–531
Lee JT, Park E, Jung T-D (2019) Automatic detection of the pharyngeal phase in raw videos for the videofluoroscopic swallowing study using efficient data collection and 3d convolutional networks. Sensors 19(18):3873
Sa R, Owens W, Wiegand R, Studin M, Capoferri D, Barooha K, Greaux A, Rattray R, Hutton A, Cintineo J, Chaudhary V (2017) Intervertebral disc detection in X-ray images using faster R-CNN. In: 2017 39th annual international conference of the IEEE engineering in medicine and biology society (EMBC). Seogwipo, pp 564–567
Fujinaka A, Mekata K, Takizawa H, Kudo H (2019) Preliminary study on intervertebral disk segmentation from videofluorography by multi channelization and CNN. In: The 7th IIAE international conference on intelligent systems and image processing 2019 (ICISIP 2019), Proceedings, Taipei
Jadoon MM, Zhang Q, Haq IU, Butt S, Jadoon A (2017) Three-class mammogram classification based on descriptive CNN features. BioMed Res Int 2017:3640901 11 pages
Matsuyama E, Lee Y, Takahashi N, Tsai DY (2019) A wavelet coefficient-based convolutional neural network for histological classification of lung cancer in CT images. Med Imag Inf Sci 36(2):64–7
The Japanese society of dysphagia rehabilitation. http://www.jsdr.or.jp/wp-content/uploads/file/doc/VF18-2-p166-186.pdf. Accessed 18 December 2019
Fujinaka A, Saito Y, Mekata K, Takizawa H, Kudo H (2019) Segmentation of intervertebral disks from videofluorographic images using convolutional neural network. In: International forum on medical imaging in asia (IFMIA), Proceedings, Vol 11050, 110501I, Singapore
The Swallowing Rehabilitation Research Laboratory. https://steeleswallowinglab.ca/srrl/best-practice/videofluoroscopy-frame-rate/. Accessed 9 March 2020
Layly J, Marmouset F, Chassagnon G, Bertrand P, Sirinelli D, Cottier J-P, Morel B (2019) Can we reduce frame rate to 15 images per second in pediatric videofluoroscopic swallow studies? Dysphagia 1–5
He Q, Perera S, Khalifa Y, Zhang Z, Mahoney AS, Sabry A, Donohue C, Donohue C, Sejdić E (2019) The association of high resolution cervical auscultation signal features with hyoid bone displacement during swallowing. IEEE Trans Neural Syst Rehabil Eng 27(9):1810–1816
Acknowledgements
We are grateful to Dr. Jun Matsubayashi in Department of Human Health Sciences, Graduate School of Medicine, Kyoto University, Dr. Tomoyuki Takigawa in Department of Orthopaedic Surgery, Okayama University Hospital, Dr. Kazukiyo Toda and Dr. Yasuo Ito in Department of Orthopaedic Surgery, Kobe Red Cross Hospital for helpful discussion.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Fujinaka, A., Mekata, K., Takizawa, H. et al. Segmentation of cervical intervertebral disks in videofluorography by CNN, multi-channelization and feature selection. Int J CARS 15, 901–908 (2020). https://doi.org/10.1007/s11548-020-02145-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11548-020-02145-8