Abstract
In order to solve the problems of low SNR and low use value of low-dose CT images, this study proposes a multi- layer enhancement of low-dose CT images via adaptive fusion. In our study, the image denoising training based on generative adversarial network is carried out, and the perceptual loss and structural loss optimization generator are used to strengthen the denoising ability and retain the details of the image. To clearly observe the pathological tissue structure, it is necessary to perform a certain degree of image enhancement and image fusion on CT images. Using the real clinical data disclosed in the AAPM competition as the experimental dataset, in the image denoising experiment, the PSNR, SSIM, and RMSE are 33.0155, 0.9185, and 5.99. Compared to traditional methods, the effectiveness of the proposed method was better by 10.76%, 4.08% and 24.54% on average, respectively. The proposed model in this study obviously reduces the noise of CT images, and the obtained CT images are more detailed, its brightness and contrast are significantly enhanced, which proves the feasibility and effectiveness of the algorithm.
Similar content being viewed by others
References
Xu, Y.D.Y.P.: Learning to Read Chest X-Ray Images from 16000+ Examples Using CNN. In: IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE) (2017) doi:https://doi.org/10.1109/chase.2017.59
Purcell, L.N., et al.: Low-dose whole-body computed tomography and radiation exposure in patients with trauma—trust, but verify. JAMA Surg. 155(3), 232 (2020). https://doi.org/10.1001/jamasurg.2019.5469
Lee, H., Lee, J., et al.: Deep-neural-network based sinogram synthesis for sparse-view CT image reconstruction. IEEE Trans. Radiat. Plasma Med. Sci. 3, 109–119 (2018). https://doi.org/10.1109/trpms.2018.2867611
Ravenel, J.G., et al.: Radiation exposure and image quality in chest CT examinations. Ajr Am. J. Roentgenol. (2012). https://doi.org/10.2214/ajr.177.2.1770279
Gao, Y., et al.: A task-dependent investigation on dose and texture in CT image reconstruction. IEEE Trans. Radiat. Plasma Med. Sci. 4(4), 441–449 (2020). https://doi.org/10.1109/TRPMS.2019.2957459
van der Molen, A.J., et al.: A national survey on radiation dose in CT in The Netherlands. Insights Imag. 4(3), 383–390 (2013). https://doi.org/10.1007/s13244-013-0253-9
Seetharaman, R., et al.: A novel approach in hybrid median filtering for denoising medical images. IOP Conf.: Series Mater. Sci. Eng (2021). https://doi.org/10.1088/1757899x/1187/1/012028
Chen, B.Q., Cui, J.G., Qing, X.U., et al.: Coupling denoising algorithm based on discrete wavelet transform and modified median filter for medical image. J. Cent. South Univ. (2019). https://doi.org/10.1007/s11771-019-3987-9
Li, L., et al.: Deep learning based low-dose synchrotron radiation CT reconstruction. EPJ Web Conf. (2021). https://doi.org/10.1051/epjconf/202125103058
Dong, X., Vekhande, S., Cao, G.: Sinogram interpolation for sparse-view micro-CT with deep learning neural network. Med. Imag. Phys. Med. Imag. 10948, 692–698 (2019). https://doi.org/10.1117/12.2512979
Gholizadeh-Ansari M, et al. Deep learning for low-dose CT denoising. 2019.doi:https://doi.org/10.48550/arXiv.1902.10127
Shan, H., et al.: Competitive performance of a modularized deep neural network compared to commercial algorithms for low-dose CT image reconstruction. Nat. Mach. Intell. 1(6), 269–276 (2019). https://doi.org/10.1038/s42256-019-0057-9
Li, L., Wang, H., Song, J., et al.: A feasibility study of realizing low-dose abdominal CT using deep learning image reconstruction algorithm. J. X-ray Sci. Technol. 29(1), 1–12 (2021). https://doi.org/10.3233/XST-200826
Chen, H., Zhang, Y., et al.: Low-dose CT with a residual encoder-decoder convolutional neural network. IEEE Trans. Med. Imag. 36(12), 2524–2535 (2017). https://doi.org/10.1109/TMI.2017.2715284
Goodfellow, I.: NIPS 2016 Tutorial: Generative Adversarial Networks. In: arXiv:1701.00160 (2016).
Armanious, K., et al.: MedGAN: medical image translation using GANs. Comput. Med. Imag. Graph. 79, 101684 (2015). https://doi.org/10.1016/j.compmedimag.2019.101684]
Yang, L., Shangguan, H., Zhang, X., et al.: High-frequency sensitive generative adversarial network for low-dose CT image denoising. IEEE access 8, 930–943 (2019). https://doi.org/10.1109/ACCESS.2019.2961983
Yin, Z., Xia, K., He, Z., et al.: Unpaired Image Denoising via Wasserstein GAN in Low-Dose CT Image with Multi-Perceptual Loss and Fidelity Loss. Symmetry 13(1), 126 (2021). https://doi.org/10.3390/sym13010126
Ran, M., Hu, J., Chen, Y., et al.: Denoising of 3D magnetic resonance images using a residual encoder-decoder wasserstein generative adversarial network. Med. Image Anal. 55, 165–180 (2019). https://doi.org/10.1016/j.media.2019.05.001
Arjovsky M, Chintala S, Bottou Wasserstein Gan. ArXiv preprint doi:https://doi.org/10.48550/arXiv.1701.07875
Gulrajani, I., Ahmed, F., Arjovsky, M., et al.: Improved training of Wasserstein GANs. Adv. Neural Inf. Process. Syst. (2017). https://doi.org/10.5555/3295222.3295327
Yang, Q., et al.: Low-dose CT image denoising using a generative adversarial network with Wasserstein distance and perceptual loss. IEEE Trans. Med. Imag. 37, 1348–1357 (2018). https://doi.org/10.1109/TMI.2018.2827462
Yadav, S.P., Yadav, S.: Image fusion using hybrid methods in multimodality medical images. Med. Biol. Eng. Comput. 58(4), 669–687 (2020). https://doi.org/10.1007/s11517-020-02136-6
Ashwanth, B., Swamy, K.V.: Medical image fusion using transform techniques. 2020 5th Int. Conf. Dev. Circuits Syst. (ICDCS) (2020). https://doi.org/10.1109/ICDCS48716.2020.243604
Bhardwaj, J., et al.: Lifting wavelet and KL transform (LWKL) based CT and MRI image fusion scheme. Bio-Opt. Design Appl. (2019). https://doi.org/10.1364/boda.2019.jt4a.5
Wang, S., Meng, J., Zhou, Y., et al.: Polarization image fusion algorithm using NSCT and CNN. J. Russian Laser Res. (2021). https://doi.org/10.1007/s10946-021-09981-2
Zhu, Z., Zheng, M., Qi, G., et al.: A phase congruency and local laplacian energy based multi-modality medical image fusion method in NSCT domain. IEEE Access 2019, 1–1 (2019). https://doi.org/10.1109/ACCESS.2019.2898111
Bhatnagar, G., Wu, Q., Zheng, L.: Directive contrast based multimodal medical image fusion in NSCT domain. IEEE Trans. Multimed. 9(5), 1014–1024 (2013). https://doi.org/10.1109/TMM.2013.2244870
McCollough, C.H., Chen, B., Holmes, D., III., Duan, X., Yu, Z., Yu, L., Leng, S., Fletcher, J.: Low dose CT image and projection data. Cancer Imag. Archiv. (2020). https://doi.org/10.7937/9npb-2637
Acknowledgements
This work was supported in part by the Natural Science Foundation of Xinjiang Uygur Autonomous Region (2020D01A131), the Teaching and Research Fund of Yangtze University (JY2020101), the Undergraduate Training Programs for Innovation and Entrepreneurship of Yangtze University under Grant Yz2020057, Yz2020059, Yz2020156, and the National College Student Innovation and Entrepreneurship Training Program (202110489003). In addition, we are particularly grateful to those who have allowed their imaging data to be shared for research purposes. We would also like to thank the work of many researchers in the collection, standardization, evaluation and annotation of the patient cases.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Li, MR., Xie, K., Chen, HQ. et al. Multi-layer enhancement of low-dose CT images via adaptive fusion. SIViP 17, 1285–1295 (2023). https://doi.org/10.1007/s11760-022-02336-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-022-02336-7