Abstract
Accurately identifying and locating lesions in chest X-rays has the potential to significantly enhance diagnostic efficiency, quality, and interpretability. However, current methods primarily focus on detecting of specific diseases in chest X-rays, disregarding the presence of multiple diseases in a single chest X-ray scan. Moreover, the diversity in lesion locations and attributes introduces complexity in accurately discerning specific traits for each lesion, leading to diminished accuracy when detecting multiple diseases. To address these issues, we propose a novel detection framework that enhances multi-scale lesion feature extraction and fusion, improving lesion position perception and subsequently boosting chest multi-disease detection performance. Initially, we construct a multi-scale lesion feature extraction network to tackle the uniqueness of various lesion features and locations, strengthening the global semantic correlation between lesion features and their positions. Following this, we introduce an instance-aware semantic enhancement network that dynamically amalgamates instance-specific features with high-level semantic representations across various scales. This adaptive integration effectively mitigates the loss of detailed information within lesion regions. Additionally, we perform lesion region feature mapping using candidate boxes to preserve crucial positional information, enhancing the accuracy of chest disease detection across multiple scales. Experimental results on the VinDr-CXR dataset reveal a 6% increment in mean average precision (mAP) and an 8.4% improvement in mean recall (mR) when compared to state-of-the-art baselines. This demonstrates the effectiveness of the model in accurately detecting multiple chest diseases by capturing specific features and location information.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Availability of Data and Materials
The datasets utilized in the present investigation are publicly accessible and can be found at https://www.physionet.org/content/vindr-cxr/1.0.0/.
References
EE H, CS M, J V, DW D: The global impact of Aspergillus infection on COPD. BMC Pulm Med. 20:241, 2020
Waller J, O’Connor A, Rafaat E, Amireh A, Dempsey J, Martin C, Umair M: Applications and challenges of artificial intelligence in diagnostic and interventional radiology. Pol J Radiol. 87:e113-e117, 2022
Çallı E, Sogancioglu E, van Ginneken B, van Leeuwen KG, Murphy K: Deep learning for chest X-ray analysis: A survey. Med Image Anal. 72:102125, 2021
Malik H, Anees T, Chaudhry MU, Gono R, Jasiński M, Leonowicz Z, Bernat P: A Novel Fusion Model of Hand-Crafted Features With Deep Convolutional Neural Networks for Classification of Several Chest Diseases Using X-Ray Images. IEEE Access. 11:39243-39268, 2023
Rehman A, Khan A, Fatima G, Naz S, Razzak I: Review on chest pathogies detection systems using deep learning techniques. Artif Intell Rev. 56:12607-12653, 2023
Elhanashi A, Saponara S, Zheng Q: Classification and Localization of Multi-Type Abnormalities on Chest X-Rays Images. IEEE Access. 11:83264-83277, 2023
Lee JH, Hong H, Nam G, Hwang EJ, Park CM: Effect of Human-AI Interaction on Detection of Malignant Lung Nodules on Chest Radiographs. Radiology. 307:e222976, 2023
Li X, Shen L, Xie X, Huang S, Xie Z, Hong X, Yu J: Multi-resolution convolutional networks for chest X-ray radiograph based lung nodule detection. Artif Intell Med. 103:101744, 2020
Xu S, Lu H, Ye M, Yan K, Zhu W, Jin Q: Improved Cascade R-CNN for Medical Images of Pulmonary Nodules Detection Combining Dilated HRNet. Proc. ICML: 283–288, 2020
Harsono IW, Liawatimena S, Cenggoro TW: Lung nodule detection and classification from Thorax CT-scan using RetinaNet with transfer learning. J King Saud Univ-Com. 34:567-577, 2022
El-Dahshan E-SA, Bassiouni MM, Hagag A, Chakrabortty RK, Loh H, Acharya UR: RESCOVIDTCNnet: A residual neural network-based framework for COVID-19 detection using TCN and EWT with chest X-ray images. Expert Syst Appl. 204:117410, 2022
Ozturk T, Talo M, Yildirim EA, Baloglu UB, Yildirim O, Rajendra Acharya U: Automated detection of COVID-19 cases using deep neural networks with X-ray images. Comput Biol Med. 121:103792, 2020
Fan Y, Liu J, Yao R, Yuan X: COVID-19 Detection from X-ray Images using Multi-Kernel-Size Spatial-Channel Attention Network. Pattern Recognit. 119:108055, 2021
Manickam A, Jiang J, Zhou Y, Sagar A, Soundrapandiyan R, Dinesh Jackson Samuel R: Automated pneumonia detection on chest X-ray images: A deep learning approach with different optimizers and transfer learning architectures. Meas. 184:109953, 2021
Tolkachev A, Sirazitdinov I, Kholiavchenko M, Mustafaev T, Ibragimov B: Deep Learning for Diagnosis and Segmentation of Pneumothorax: The Results on the Kaggle Competition and Validation Against Radiologists. IEEE J Biomed Health. 25:1660-1672, 2021
Hwang EJ, Park S, Jin K-N, Kim JI, Choi SY, Lee JH, Goo JM, Aum J, Yim J-J, Cohen JG, Ferretti GR, Park CM, Development ftD, Group E: Development and Validation of a Deep Learning–Based Automated Detection Algorithm for Major Thoracic Diseases on Chest Radiographs. Jama Netw Open. 2:e191095-e191095, 2019
Jaszcz A, Połap D, Damaševičius R: Lung X-Ray Image Segmentation Using Heuristic Red Fox Optimization Algorithm. Sci Programming-Neth. 2022:4494139, 2022
Zhao G, Fang C, Li G, Jiao L, Yu Y: Contralaterally Enhanced Networks for Thoracic Disease Detection. IEEE Trans Med Imaging. 40:2428-2438, 2021
Zhirui Z, Qiang L, Xin G: Multilabel chest X-ray disease classification based on a dense squeeze-and-excitation network. J Image Graph. 25:2238-2248, 2020
Gong Y, Yu X, Ding Y, Peng X, Zhao J, Han Z: Effective Fusion Factor in FPN for Tiny Object Detection. Proc. WACV: 1159–1167, 2021
Luo Y, Cao X, Zhang J, Guo J, Shen H, Wang T, Feng Q: CE-FPN: enhancing channel information for object detection. Multimed Tools Appl. 81:30685-30704, 2022
Girshick R: Fast R-CNN. Proc. IEEE ICCV: 1440–1448, 2015
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I: Attention is all you need. Proc. NeurIPS: 6000–6010, 2017
Liu S, Qi L, Qin H, Shi J, Jia J: Path Aggregation Network for Instance Segmentation. Proc. IEEE CVPR: 8759–8768, 2018
Irvin J, Rajpurkar P, Ko M, Yu Y, Ciurea-Ilcus S, Chute C, Marklund H, Haghgoo B, Ball R, Shpanskaya K, Seekins J, Mong D, Halabi S, Sandberg J, Jones R, Larson D, Langlotz C, Patel B, Lungren M, Ng A: CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison. AAAI Conf Artif Intell. 33:590-597, 2019
Wang X, Peng Y, Lu L, Lu Z, Bagheri M, Summers RM: ChestX-Ray8: Hospital-Scale Chest X-Ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases. Proc. IEEE CVPR: 3462–3471, 2017
Johnson AEW, Pollard TJ, Berkowitz SJ, Greenbaum NR, Lungren MP, Deng C-y, Mark RG, Horng S: MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports. Sci Data. 6:317, 2019
Nguyen HQ, Lam K, Le LT, Pham HH, Tran DQ, Nguyen DB, Le DD, Pham CM, Tong HTT, Dinh DH, Do CD, Doan LT, Nguyen CN, Nguyen BT, Nguyen QV, Hoang AD, Phan HN, Nguyen AT, Ho PH, Ngo DT, Nguyen NT, Nguyen NT, Dao M, Vu V: VinDr-CXR: An open dataset of chest X-rays with radiologist’s annotations. Sci Data. 9:429, 2022
Solovyev R, Wang W, Gabruseva T: Weighted boxes fusion: Ensembling boxes from different object detection models. Image Vision Comput. 107:104117, 2021
Lin C, Huang Y, Wang W, Feng S, Feng S: Lesion detection of chest X-Ray based on scalable attention residual CNN. Math Biosci Eng. 20:1730-1749, 2023
Le KH, Tran TV, Pham HH, Nguyen HT, Le TT, Nguyen HQ: Learning from multiple expert annotators for enhancing anomaly detection in medical image analysis. IEEE Access. 11:14105-14114, 2023
Xu Q, Duan W: DualAttNet: Synergistic fusion of image-level and fine-grained disease attention for multi-label lesion detection in chest X-rays. Comput Biol Med. 168:107742, 2024
Luo J, Wang S, Wang Q, Liu S: A Lung Lesion Detection Algorithm Based on YOLOv7 and Self-Attention Mechanism. Proc. CCC: 8786–8791, 2023
Funding
This work was supported by the National Natural Science Foundation of China (Grant No.81860318), Kunming University of Science and Technology (KUST) introduced talents research start-up fund project (Grant No.KKZ3202203020).
Author information
Authors and Affiliations
Contributions
Yubo Yuan and Lijun Liu originated the presented concept and authored the manuscript. Yubo Yuan conducted the majority of the experiments. All authors read and approved the manuscript.
Corresponding author
Ethics declarations
Ethics Approval and Consent to Participate
We propose an innovative machine-learning method for the identification of multiple diseases in chest X-rays. The X-ray images utilized in this study are collected from the publicly accessible VinDr-CXR dataset, and we have acquired the necessary authorization for their usage via their licensing agreement.
Competing Interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Yuan, Y., Liu, L., Yang, X. et al. Multi-scale Lesion Feature Fusion and Location-Aware for Chest Multi-disease Detection. J Digit Imaging. Inform. med. (2024). https://doi.org/10.1007/s10278-024-01133-7
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10278-024-01133-7