Abstract
In this study, the super-resolution convolutional neural network (SRCNN) scheme, which is the emerging deep-learning-based super-resolution method for enhancing image resolution in chest CT images, was applied and evaluated using the post-processing approach. For evaluation, 89 chest CT cases were sampled from The Cancer Imaging Archive. The 89 CT cases were divided randomly into 45 training cases and 44 external test cases. The SRCNN was trained using the training dataset. With the trained SRCNN, a high-resolution image was reconstructed from a low-resolution image, which was down-sampled from an original test image. For quantitative evaluation, two image quality metrics were measured and compared to those of the conventional linear interpolation methods. The image restoration quality of the SRCNN scheme was significantly higher than that of the linear interpolation methods (p < 0.001 or p < 0.05). The high-resolution image reconstructed by the SRCNN scheme was highly restored and comparable to the original reference image, in particular, for a ×2 magnification. These results indicate that the SRCNN scheme significantly outperforms the linear interpolation methods for enhancing image resolution in chest CT images. The results also suggest that SRCNN may become a potential solution for generating high-resolution CT images from standard CT images.
Similar content being viewed by others
References
Park SC, Park MK, Kang MG: Super-resolution image reconstruction: a technical overview. IEEE Signal Process Mag 20(3):21–36, 2003
Yeh JJ, Chen SCC, Teng WB, Chou CH, Hsieh SP, Lee TL, Wu MT: Identifying the most infectious lesions in pulmonary tuberculosis by high-resolution multi-detector computed tomography. Eur Radiol 20(9):2135–2145, 2010
Akira M, Inoue Y, Arai T, Sugimoto C, Tokura S, Nakata K, Kitaichi M: Osaka respiratory diseases symposia group: pulmonary fibrosis on high-resolution CT of patients with pulmonary alveolar proteinosis. AJR 207(3):544–551, 2016
Lee HY, Lee KS, Jeong YJ, Hwang JH, Kim HJ, Chung MP, Han J: High-resolution CT findings in fibrotic idiopathic interstitial pneumonias with little honeycombing: serial changes and prognostic implications. AJR 199(5):982–989, 2012
Mathieson JR, Mayo JR, Staples CA, Müller NL: Chronic diffuse infiltrative lung disease: comparison of diagnostic accuracy of CT and chest radiography. Radiology 171(1):111–116, 1989
Itoh H, Murata K, Konishi J, Nishimura K, Kitaichi M, Izumi T: Diffuse lung disease: pathologic basis for the high-resolution computed tomography findings. J Thorac Imaging 8(3):176–188, 1993
Sverzellati N: Highlights of HRCT imaging in IPF. Respir Res 14(1):S3, 2013
Siu WC, Hung KW: Review of image interpolation and super-resolution. Proceedings of the 2012 Asia Pacific Signal & Information Processing Association Annual Summit and Conference: 1–10, 2012
Roweis ST, Saul LK: Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326, 2000
Yang J, Wright J, Huang TS, Ma Y: Image super-resolution via sparse representation. IEEE Trans Image Process 19(11):2861–2873, 2010
Timofte R, De Smet V, Van Gool L: Anchored neighborhood regression for fast example-based super-resolution. Proceedings of the IEEE International Conference on Computer Vision: 1920–1927, 2013
Ota J, Umehara K, Ishimaru N, Ohno S, Okamoto K, Suzuki T, Shirai N, Ishida T: Evaluation of the sparse coding super-resolution method for improving image quality of up-sampled images in computed tomography. Proc SPIE 10133: 101331S-1-101331S-9, 2017
Xie J, Xu L, Chen E: Image denoising and inpainting with deep neural networks. Advances in Neural Information Processing Systems 25:341–349, 2012
Xu L, Ren JS, Liu C, Jia J: Deep convolutional neural network for image deconvolution. Advances in Neural Information Processing Systems 27:1790–1798, 2014
Dong C, Loy CC, He K, Tang X: Learning a deep convolutional network for image super-resolution. In European Conference on Computer Vision: 184–199, 2014
Dong C, Loy CC, He K, Tang X: Image super-resolution using deep convolutional networks. IEEE Trans Pattern Anal Mach Intell 38(2):295–307, 2016
Umehara K, Ota J, Ishimaru N, Ohno S, Okamoto K, Suzuki T, Shirai N, Ishida T: Super-resolution convolutional neural network for the improvement of the image quality of magnified images in chest radiographs. Proc SPIE 10133: 101331P-1–101331P-7, 2017
Umehara K, Ota J, Ishimaru N, Ohno S, Okamoto K, Suzuki T, Ishida T: Performance evaluation of super-resolution methods using deep-learning and sparse-coding for improving the image quality of magnified images in chest radiographs. Open J Med Imaging, 7(3):100–111, 2017
Aerts H, Rios V, Emmanuel L, Ralph TH, Parmar C, Grossmann P, Carvalho S et al.: Data From NSCLC-Radiomics-Genomics. The Cancer Imaging Archive, 2015. https://doi.org/10.7937/K9/TCIA.2015.L4FRET6Z
Aerts HJWL, Velazquez ER, Leijenaar RT, Parmar C, Grossmann P, Cavalho S et al.: Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun, 5, 1–8, 2014
Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M, Tarbox L, Prior F: The Cancer Imaging Archive (TCIA): Maintaining and operating a public information repository. J Digit Imaging 26(6):1045–1057, 2013
Nair V, Hinton GE: Rectified linear units improve restricted boltzmann machines. Proceedings of the 27th international conference on machine learning: 807–814, 2010
Huynh-Thu Q, Ghanbari M: Scope of validity of PSNR in image/video quality assessment. Electronics Letters 44:800–801, 2008
Wang Z, Bovik AC, Sheikh HR, Simoncelli EP: Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612, 2004
Avcibas I, Sankur B, Sayood K: Statistical evaluation of image quality measures. J Electron Imaging 11:206–223, 2002
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Umehara, K., Ota, J. & Ishida, T. Application of Super-Resolution Convolutional Neural Network for Enhancing Image Resolution in Chest CT. J Digit Imaging 31, 441–450 (2018). https://doi.org/10.1007/s10278-017-0033-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10278-017-0033-z