Abstract
Infectious lung diseases are a global health concern, and deep learning, particularly convolutional neural networks (CNNs), holds promise for diagnosing these conditions using chest x-rays (CXRs). However, existing models prioritize accuracy, often neglecting challenges in deploying on resource-limited devices. This study introduces "ConvInceptNet," a lightweight CNN leveraging depth-wise separable convolutions (DSC) and a modified Inception (M-Inception) module. Our approach addresses computational complexities, enhancing efficiency and reducing model size. We replaced the traditional convolutions in the original Inception module with DSC layers to enhance feature extraction and reduce the number of computation parameters required for the model. To further enhance detection performance and prevent overfitting in ConvInceptNet, we employed various regularization techniques such as dropout layers and data augmentation using different geometries. We validated our approach using four publicly available datasets comprising CXRs of normal cases, pneumonia, TB, COVID-19, and pneumothorax, offering a diverse range for comprehensive performance evaluation. ConvInceptNet achieved high accuracy rates for detecting various pulmonary abnormalities, including 98.90% for COVID-19, 99.22% for TB, 96.73% for pneumonia, and 99.56% for pneumothorax detection. For more accurate analysis, ConvInceptNet was benchmarked against three pre-trained models, MobileNetV2, Xception, InceptionV3 and the state of the art (SOTA) heavy models. Our statistical analysis confirmed ConvInceptNet's superior performance in accuracy, parameter efficiency, model size, FLOP counts, and inference time compared to other models. This establishes ConvInceptNet as an efficient solution for detecting pulmonary abnormalities on resource-limited mobile and edge devices.
Similar content being viewed by others
Data availability
The data that support the findings of this study are available from the first author upon reasonable request.
References
Abideen ZU, Ghafoor M, Munir K, Saqib M, Ullah A, Zia T, Zahra A (2020) Uncertainty assisted robust tuberculosis identification with bayesian convolutional neural networks. Ieee Access 8:22812–22825
Alshazly H, Linse C, Abdalla M, Barth E, Martinetz T (2021) COVID-Nets: deep CNN architectures for detecting COVID-19 using chest CT scans. PeerJ Comput Sci 7:e655
Arican E, Aydin T (2022) An RGB-D descriptor for object classification. Rom J Inf Sci Technol (ROMJIST) 25(3–4):338–349
Asif S, Amjad K (2022) Deep residual network for diagnosis of retinal diseases using optical coherence tomography images. Interdiscip Sci. https://doi.org/10.1007/s12539-022-00533-z
Asif S, Wenhui Y, Jin H, Jinhai S (2020) Classification of COVID-19 from chest X-ray images using deep convolutional neural network. In: Paper presented at the 2020 IEEE 6th international conference on computer and communications (ICCC).
Asif S, Zhao M, Tang F, Zhu Y (2022) A deep learning-based framework for detecting COVID-19 patients using chest X-rays. Multimed Syst
Asif S, Zhao M, Tang F, Zhu Y (2023a) LWSE: a lightweight stacked ensemble model for accurate detection of multiple chest infectious diseases including COVID-19. Multimed Tools Appl. https://doi.org/10.1007/s11042-023-16432-4
Asif S, Wenhui Y, Amjad K, Jin H, Tao Y, Jinhai S (2023b) Detection of COVID-19 from chest X-ray images: Boosting the performance with convolutional neural network and transfer learning. Expert Syst. https://doi.org/10.1016/j.mlwa.2021.100138
Ayaz M, Shaukat F, Raja G (2021) Ensemble learning based automatic detection of tuberculosis in chest X-ray images using hybrid feature descriptors. Phys Eng Sci Med 44(1):183–194
Borlea I-D, Precup R-E, Borlea A-B (2022) Improvement of K-means cluster quality by post processing resulted clusters. Proced Comput Sci 199:63–70
Casha A, Gauci M, Gatt R, Grima JN (2014). Spontaneous pneumothorax.
Cha S-M, Lee S-S, Ko B (2021) Attention-Based transfer learning for efficient pneumonia detection in chest X-ray images. Appl Sci 11(3):1242
Chan Y-H, Zeng Y-Z, Wu H-C, Wu M-C, Sun H-M (2018) Effective pneumothorax detection for chest X-ray images using local binary pattern and support vector machine. J Healthc Eng. https://doi.org/10.1155/2018/2908517
Chen J, Chen W, Zeb A, Yang S, Zhang D (2022) Lightweight inception networks for the recognition and detection of rice plant diseases. IEEE Sens J 22(14):14628–14638
Chollet F (2017) Xception: deep learning with depthwise separable convolutions. In: Paper presented at the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.
Choudhary P, Hazra A (2021) Chest disease radiography in twofold: using convolutional neural networks and transfer learning. Evol Syst 12(2):567–579
Chouhan V, Singh SK, Khamparia A, Gupta D, Tiwari P, Moreira C, De Albuquerque VHC (2020) A novel transfer learning based approach for pneumonia detection in chest X-ray images. Appl Sci 10(2):559
Chowdhury ME, Rahman T, Khandakar A, Mazhar R, Kadir MA, Mahbub ZB, Al Emadi N (2020a) Can AI help in screening viral and COVID-19 pneumonia? IEEE Access 8:132665–132676
Chowdhury NK, Rahman MM, Kabir MA (2020b) PDCOVIDNet: a parallel-dilated convolutional neural network architecture for detecting COVID-19 from chest X-ray images. Health Inf Sci Syst 8(1):27
Das D, Santosh K, Pal U (2020) Truncated inception net: COVID-19 outbreak screening using chest X-rays. Phys Eng Sci Med 43(3):915–925
Das AK, Kalam S, Kumar C, Sinha D (2021) TLCoV-An automated Covid-19 screening model using Transfer Learning from chest X-ray images. Chaos, Solitons Fractals 144:110713
Dasanayaka C, Dissanayake MB (2021) Deep learning methods for screening pulmonary tuberculosis using chest X-rays. Comput Methods Biomech Biomed Eng 9(1):39–49
Demertzis K, Iliadis L, Pimenidis E (2020) Large-scale geospatial data analysis: Geographic object-based scene classification in remote sensing images by GIS and deep residual learning. In: Paper presented at the Proceedings of the 21st EANN (Engineering Applications of Neural Networks) 2020 Conference: Proceedings of the EANN 2020 21
Do Gan NO, Pekdemir M (2022) Early detection of mortality in COVID-19 patients through laboratory findings with factor analysis and artificial neural networks. Sci Technol (ROMJIST) 25(3–4):290–302
El Asnaoui K (2021) Design ensemble deep learning model for pneumonia disease classification. Int J Multimed Inf Retr 10(1):55–68
Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Adam H (2017) Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861
Huang M-L, Liao Y-C (2022) A lightweight CNN-based network on COVID-19 detection using X-ray and CT images. Comput Biol Med 10:105604
Imran A (2019). Training a CNN to detect Pneumonia. https://medium.com/datadriveninvestor/training-acnn-to-detect-pneumonia-c42a44101deb. Accessed 14 May 2021
Jun TJ, Kim D, Kim D (2018) Automated diagnosis of pneumothorax using an ensemble of convolutional neural networks with multi-sized chest radiography images. arXiv preprint arXiv:1804.06821
Kermany DS, Goldbaum M, Cai W, Valentim CC, Liang H, Baxter SL, Yan F (2018) Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172(5):1122–1131
Khan AI, Shah JL, Bhat MM (2020) CoroNet: a deep neural network for detection and diagnosis of COVID-19 from chest x-ray images. Comput Methods Progr Biomed 196:105581
Kim TK, Paul HY, Hager GD, Lin CT (2020) Refining dataset curation methods for deep learning-based automated tuberculosis screening. J Thorac Dis 12(9):5078
Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980
Lakhani P, Sundaram B (2017) Deep learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks. Radiology 284(2):574–582
Lindsey T, Lee R, Grisell R, Vega S, Veazey S (2018) Automated pneumothorax diagnosis using deep neural networks. In: Paper Presented at the Ibero-American Congress on Pattern Recognition.
Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, Sánchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60–88
Lopes U, Valiati JF (2017) Pre-trained convolutional neural networks as feature extractors for tuberculosis detection. Comput Biol Med 89:135–143
Mahase E (2020) Coronavirus: covid-19 has killed more people than SARS and MERS combined, despite lower case fatality rate. British Medical Journal Publishing Group
Mahbub MK, Biswas M, Gaur L, Alenezi F, Santosh K (2022) Deep features to detect pulmonary abnormalities in chest X-rays due to infectious diseaseX: Covid-19, pneumonia, and tuberculosis. Inf Sci 592:389–401
Mittal A, Kumar D, Mittal M, Saba T, Abunadi I, Rehman A, Roy S (2020) Detecting pneumonia using convolutions and dynamic capsule routing for chest X-ray images. Sensors 20(4):1068
Montalbo FJP (2021) Diagnosing Covid-19 chest x-rays with a lightweight truncated DenseNet with partial layer freezing and feature fusion. Biomed Signal Process Control 68:102583
Montalbo FJ (2022) Truncating fined-tuned vision-based models to lightweight deployable diagnostic tools for SARS-CoV-2 infected chest X-rays and CT-scans. Multimedia Tools Appl 81(12):16411–16439
Mukherjee H, Ghosh S, Dhar A, Obaidullah SM, Santosh K, Roy K (2021) Deep neural network to detect COVID-19: one architecture for both CT Scans and Chest X-rays. Appl Intell 51(5):2777–2789
Nikolaou V, Massaro S, Fakhimi M, Stergioulas L, Garn W (2021) COVID-19 diagnosis from chest x-rays: developing a simple, fast, and accurate neural network. Health Inf Sci Syst 9:1–11
Oh Y, Park S, Ye JC (2020) Deep learning COVID-19 features on CXR using limited training data sets. IEEE Trans Med Imaging 39(8):2688–2700
Ozturk T, Talo M, Yildirim EA, Baloglu UB, Yildirim O, Acharya UR (2020) Automated detection of COVID-19 cases using deep neural networks with X-ray images. Comput Biol Med 121:103792
Panwar H, Gupta P, Siddiqui MK, Morales-Menendez R, Singh V (2020) Application of deep learning for fast detection of COVID-19 in X-rays using nCOVnet. Chaos, Solitons Fractals 138:109944
Pasa F, Golkov V, Pfeiffer F, Cremers D, Pfeiffer D (2019) Efficient deep network architectures for fast chest X-ray tuberculosis screening and visualization. Sci Rep 9(1):1–9
Rahman T, Khandakar A, Kadir MA, Islam KR, Islam KF, Mazhar R, Mahbub ZB (2020) Reliable tuberculosis detection using chest X-ray with deep learning, segmentation and visualization. IEEE Access 8:191586–191601
Rajaraman S, Candemir S, Kim I, Thoma G, Antani S (2018) Visualization and interpretation of convolutional neural network predictions in detecting pneumonia in pediatric chest radiographs. Appl Sci 8(10):1715
Rajpurkar P, Irvin J, Ball RL, Zhu K, Yang B, Mehta H, Langlotz CP (2018) Deep learning for chest radiograph diagnosis: a retrospective comparison of the CheXNeXt algorithm to practicing radiologists. PLoS Med 15(11):e1002686
Sahlol AT, AbdElaziz M, Tariq Jamal A, Damaševičius R, Farouk Hassan O (2020) A novel method for detection of tuberculosis in chest radiographs using artificial ecosystem-based optimisation of deep neural network features. Symmetry 12(7):1146
Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2017) Grad-cam: Visual explanations from deep networks via gradient-based localization. In: Paper Presented at the Proceedings of the IEEE International Conference on Computer Vision
Shi F, Wang J, Shi J, Wu Z, Wang Q, Tang Z, Shen D (2020) Review of artificial intelligence techniques in imaging data acquisition, segmentation, and diagnosis for COVID-19. IEEE Rev Biomed Eng 14:4–15
Shin H-C, Roth HR, Gao M, Lu L, Xu Z, Nogues I, Summers RM (2016) Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging 35(5):1285–1298
Shorten C, Khoshgoftaar TM (2019) A survey on image data augmentation for deep learning. J Big Data 6(1):1–48
Sifre L, Mallat S (2014) Rigid-motion scattering for image classification [PhD thesis]. Ecole Polytechnique.
Subbarao K, Mahanty S (2020) Respiratory virus infections: understanding COVID-19. Immunity 52(6):905–909
Sun W, Zhang X, He X (2020) Lightweight image classifier using dilated and depthwise separable convolutions. J Cloud Comput 9(1):1–12
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Rabinovich A (2015) Going deeper with convolutions. In: Paper Presented at the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
Tian Y, Wang J, Yang W, Wang J, Qian D (2022) Deep multi-instance transfer learning for pneumothorax classification in chest X-ray images. Med Phys 49(1):231–243
Trivedi M, Gupta A (2022) A lightweight deep learning architecture for the automatic detection of pneumonia using chest X-ray images. Multimed Tools Appl 81(4):5515–5536
Wu F, Zhao S, Yu B, Chen Y-M, Wang W, Song Z-G, Pei Y-Y (2020) A new coronavirus associated with human respiratory disease in China. Nature 579(7798):265–269
XIANU (2023) Pneumothorax. Retrieved from https://www.kaggle.com/datasets/twerwweqweq/pneumothorax?select=images
Zhao Z-Q, Zheng P, Xu S-T, Wu X (2019) Object detection with deep learning: a review. IEEE Trans Neural Netw Learn Syst 30(11):3212–3232
Funding
The authors did not receive support from any organization for the submitted work.
Author information
Authors and Affiliations
Contributions
SA: Conceptualization, Data curation, Methodology, Software, Writing—original draft, Writing—review and editing. Qurrat-ul-Ain: Visualization, Data curation, Formal analysis, Investigation, Writing – review & editing. All authors reviewed the manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no competing interests to declare that are relevant to the content of this article and there are no financial interests.
Consent to participate
Not applicable.
Consent to publish
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Asif, S., Qurrat-ul-Ain Enhancing pulmonary abnormality detection with an optimized CNN architecture incorporating depth-wise separable convolution and inception module. Evolving Systems (2024). https://doi.org/10.1007/s12530-023-09565-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s12530-023-09565-2