Advertisement

Improving Image Resolution of Whole-Heart Coronary MRA Using Convolutional Neural Network

  • Hiroki Kobayashi
  • Ryohei NakayamaEmail author
  • Akiyoshi Hizukuri
  • Masaki Ishida
  • Kakuya Kitagawa
  • Hajime Sakuma
Article

Abstract

Whole-heart coronary magnetic resonance angiography (WHCMRA) permits the noninvasive assessment of coronary artery disease without radiation exposure. However, the image resolution of WHCMRA is limited. Recently, convolutional neural networks (CNNs) have obtained increased interest as a method for improving the resolution of medical images. The purpose of this study is to improve the resolution of WHCMRA images using a CNN. Free-breathing WHCMRA images with 512 × 512 pixels (pixel size = 0.65 mm) were acquired in 80 patients with known or suspected coronary artery disease using a 1.5 T magnetic resonance (MR) system with 32 channel coils. A CNN model was optimized by evaluating CNNs with different structures. The proposed CNN model was trained based on the relationship of signal patterns between low-resolution patches (small regions) and the corresponding high-resolution patches using a training dataset collected from 40 patients. Images with 512 × 512 pixels were restored from 256 × 256 down-sampled WHCMRA images (pixel size = 1.3 mm) with three different approaches: the proposed CNN, bicubic interpolation (BCI), and the previously reported super-resolution CNN (SRCNN). High-resolution WHCMRA images obtained using the proposed CNN model were significantly better than those of BCI and SRCNN in terms of root mean squared error, peak signal to noise ratio, and structure similarity index measure with respect to the original WHCMRA images. The proposed CNN approach can provide high-resolution WHCMRA images with better accuracy than BCI and SRCNN. The high-resolution WHCMRA obtained using the proposed CNN model will be useful for identifying coronary artery disease.

Keywords

Resolution improvement Convolutional neural network Whole-heart coronary magnetic resonance angiography 

Notes

References

  1. 1.
    World Health Organization. Available at http://www.who.int/en/news-room/fact-sheets/detail/the-top-10-causes-of-death. Accessed 2 September 2018.
  2. 2.
    Wu W, Liu Z, He X: Learning-based super resolution using kernel partial least squares. Image and Vision Computing 29(6):394–406, 2011CrossRefGoogle Scholar
  3. 3.
    Xian Y, Yang X, Tian Y: Hybrid example-based single image super-resolution. In: International Symposium on Visual Computing, Vol. 9475, 2015, pp. 3–15Google Scholar
  4. 4.
    Yang CY, Yang MH: Fast direct super-resolution by simple functions. In Proceedings of the IEEE International Conference on Computer Vision:561–568, 2013Google Scholar
  5. 5.
    Hizukuri A, Nakayama R: Computer-aided diagnosis scheme for determining histological classification of breast lesions on ultrasonographic images using convolutional neural network. Diagnostics 8(3):1–9, 2018CrossRefGoogle Scholar
  6. 6.
    Kumar K, Rao ACS: Breast cancer classification of image using convolutional neural network. In 2018 4th International Conference on Recent Advances in Information Technology (RAIT):1–6, 2018Google Scholar
  7. 7.
    Dmitriev K, Kaufman AE, Javed AA, Hruban RH, Fishman EK, Lennon AM, Saltz JH: Classification of pancreatic cysts in computed tomography images using a random forest and convolutional neural network ensemble. In: International Conference on Medical mage Computing and Computer-Assisted Intervention 10435, 2017, pp. 150–158Google Scholar
  8. 8.
    Halicek M, Lu G, Little JV, Wang X, Patel M, Griffith CC, El-Deiry MW, Chen AY, Fei B: Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging. Journal of Biomedical Optics 22(6):060503–0601–4, 2017CrossRefGoogle Scholar
  9. 9.
    Dou Q, Chen H, Yu L, Zhao L, Qin J, Wang D, Mok VCT, Shi L, Heng PA: Automatic detection of cerebral microbleeds from MR images via 3D convolutional neural networks. IEEE Transactions on Medical Imaging 35(5):1182–1195, 2016CrossRefGoogle Scholar
  10. 10.
    Pereira S, Pinto A, Alves V, Silva CA: Brain tumor segmentation using convolutional neural networks in MRI images. IEEE Transactions on Medical Imaging 35(5):1240–1251, 2016CrossRefGoogle Scholar
  11. 11.
    Park J, Hwang D, Kim KY, Kang SK, Kim YK, Lee JS: Computed tomography super-resolution using deep convolutional neural network. Physics in Medicine and Biology 63(14):145011, 2018CrossRefGoogle Scholar
  12. 12.
    Dong C, Loy CC, He K, Tang X: Image super-resolution using deep convolutional networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 38(2):295–307, 2016CrossRefGoogle Scholar
  13. 13.
    Dong C, Loy CC, He K, Tang X: Learning a deep convolutional network for image super-resolution. In: European Conference on Computer Vision, 2014, pp. 184–199Google Scholar
  14. 14.
    Umehara K, Ota J, Ishimaru N, Ohno S, Okamoto K, Suzuki T, Shirai N, Ishida T: Super-resolution convolutional neural network for the improvement of the image quality of magnified images in chest radiographs. In Medical Imaging 2017: Image Processing. International Society for Optics and Photonics 10133:101331P1–101331P7, 2017Google Scholar
  15. 15.
    Magnotta VA, Friedman L: BIRN F: Measurement of signal-to-noise and contrast-to-noise in the fBIRN multicenter imaging study. Journal of Digital Imaging 19(2):140–147, 2006CrossRefGoogle Scholar
  16. 16.
    Dincer HA, Gokcay D: Evaluation of MRIS of the brain with respect to SNR, CNR and GWR in young versus old subjects. In Signal Processing and Communications Applications Conference (SIU):1079–1082, 2014Google Scholar
  17. 17.
    Wang Z, Bovik AC, Sheikh HR, Simoncelli EP: Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing 13(4):600–612, 2004CrossRefGoogle Scholar

Copyright information

© Society for Imaging Informatics in Medicine 2019

Authors and Affiliations

  1. 1.Graduate School of Science and EngineeringRitsumeikan UniversityKusatsuJapan
  2. 2.Department of RadiologyMie University School of MedicineTsuJapan

Personalised recommendations