Improving Image Resolution of Whole-Heart Coronary MRA Using Convolutional Neural Network
- 65 Downloads
Whole-heart coronary magnetic resonance angiography (WHCMRA) permits the noninvasive assessment of coronary artery disease without radiation exposure. However, the image resolution of WHCMRA is limited. Recently, convolutional neural networks (CNNs) have obtained increased interest as a method for improving the resolution of medical images. The purpose of this study is to improve the resolution of WHCMRA images using a CNN. Free-breathing WHCMRA images with 512 × 512 pixels (pixel size = 0.65 mm) were acquired in 80 patients with known or suspected coronary artery disease using a 1.5 T magnetic resonance (MR) system with 32 channel coils. A CNN model was optimized by evaluating CNNs with different structures. The proposed CNN model was trained based on the relationship of signal patterns between low-resolution patches (small regions) and the corresponding high-resolution patches using a training dataset collected from 40 patients. Images with 512 × 512 pixels were restored from 256 × 256 down-sampled WHCMRA images (pixel size = 1.3 mm) with three different approaches: the proposed CNN, bicubic interpolation (BCI), and the previously reported super-resolution CNN (SRCNN). High-resolution WHCMRA images obtained using the proposed CNN model were significantly better than those of BCI and SRCNN in terms of root mean squared error, peak signal to noise ratio, and structure similarity index measure with respect to the original WHCMRA images. The proposed CNN approach can provide high-resolution WHCMRA images with better accuracy than BCI and SRCNN. The high-resolution WHCMRA obtained using the proposed CNN model will be useful for identifying coronary artery disease.
KeywordsResolution improvement Convolutional neural network Whole-heart coronary magnetic resonance angiography
- 1.World Health Organization. Available at http://www.who.int/en/news-room/fact-sheets/detail/the-top-10-causes-of-death. Accessed 2 September 2018.
- 3.Xian Y, Yang X, Tian Y: Hybrid example-based single image super-resolution. In: International Symposium on Visual Computing, Vol. 9475, 2015, pp. 3–15Google Scholar
- 4.Yang CY, Yang MH: Fast direct super-resolution by simple functions. In Proceedings of the IEEE International Conference on Computer Vision:561–568, 2013Google Scholar
- 6.Kumar K, Rao ACS: Breast cancer classification of image using convolutional neural network. In 2018 4th International Conference on Recent Advances in Information Technology (RAIT):1–6, 2018Google Scholar
- 7.Dmitriev K, Kaufman AE, Javed AA, Hruban RH, Fishman EK, Lennon AM, Saltz JH: Classification of pancreatic cysts in computed tomography images using a random forest and convolutional neural network ensemble. In: International Conference on Medical mage Computing and Computer-Assisted Intervention 10435, 2017, pp. 150–158Google Scholar
- 13.Dong C, Loy CC, He K, Tang X: Learning a deep convolutional network for image super-resolution. In: European Conference on Computer Vision, 2014, pp. 184–199Google Scholar
- 14.Umehara K, Ota J, Ishimaru N, Ohno S, Okamoto K, Suzuki T, Shirai N, Ishida T: Super-resolution convolutional neural network for the improvement of the image quality of magnified images in chest radiographs. In Medical Imaging 2017: Image Processing. International Society for Optics and Photonics 10133:101331P1–101331P7, 2017Google Scholar
- 16.Dincer HA, Gokcay D: Evaluation of MRIS of the brain with respect to SNR, CNR and GWR in young versus old subjects. In Signal Processing and Communications Applications Conference (SIU):1079–1082, 2014Google Scholar