Should the ultrasound probe replace your stethoscope? A SICS-I sub-study comparing lung ultrasound and pulmonary auscultation in the critically ill
In critically ill patients, auscultation might be challenging as dorsal lung fields are difficult to reach in supine-positioned patients, and the environment is often noisy. In recent years, clinicians have started to consider lung ultrasound as a useful diagnostic tool for a variety of pulmonary pathologies, including pulmonary edema. The aim of this study was to compare lung ultrasound and pulmonary auscultation for detecting pulmonary edema in critically ill patients.
This study was a planned sub-study of the Simple Intensive Care Studies-I, a single-center, prospective observational study. All acutely admitted patients who were 18 years and older with an expected ICU stay of at least 24 h were eligible for inclusion. All patients underwent clinical examination combined with lung ultrasound, conducted by researchers not involved in patient care. Clinical examination included auscultation of the bilateral regions for crepitations and rhonchi. Lung ultrasound was conducted according to the Bedside Lung Ultrasound in Emergency protocol. Pulmonary edema was defined as three or more B lines in at least two (bilateral) scan sites. An agreement was described by using the Cohen κ coefficient, sensitivity, specificity, negative predictive value, positive predictive value, and overall accuracy. Subgroup analysis were performed in patients who were not mechanically ventilated.
The Simple Intensive Care Studies-I cohort included 1075 patients, of whom 926 (86%) were eligible for inclusion in this analysis. Three hundred seven of the 926 patients (33%) fulfilled the criteria for pulmonary edema on lung ultrasound. In 156 (51%) of these patients, auscultation was normal. A total of 302 patients (32%) had audible crepitations or rhonchi upon auscultation. From 130 patients with crepitations, 86 patients (66%) had pulmonary edema on lung ultrasound, and from 209 patients with rhonchi, 96 patients (46%) had pulmonary edema on lung ultrasound. The agreement between auscultation findings and lung ultrasound diagnosis was poor (κ statistic 0.25). Subgroup analysis showed that the diagnostic accuracy of auscultation was better in non-ventilated than in ventilated patients.
The agreement between lung ultrasound and auscultation is poor.
NCT02912624. Registered on September 23, 2016.
KeywordsProspective study Lung ultrasound Auscultation Pulmonary edema Clinical examination Critical care Diagnostic accuracy
- APACHE IV
Acute Physiology and Chronic Health Evaluation
Bedside Lung Ultrasound in Emergency protocol
Critical care ultrasound
Intensive care unit
Negative predictive value
Positive predictive value
Statistical analysis plan
Simple Intensive Care Studies
Physicians are trained to use auscultation as part of clinical examination in routine care for critically ill patients. Auscultation is accepted as one of the essential components of the clinical examination. Frequent pathologies encountered in the critically ill are pulmonary edema and pneumonia; both present with an increase in alveolar fluid and often coexist. Crepitations and rhonchi can be present in patients with pulmonary edema . In recent years, clinicians have started to consider lung ultrasound (LUS) as a useful diagnostic tool for a variety of pulmonary pathologies [2, 3, 4]. An increasing body of evidence supports the use of LUS in diagnosing pulmonary edema and/or pneumonia . Several studies have shown the diagnostic value of LUS in patients with dyspnea or specific diagnoses, such as pneumothorax, high-altitude pulmonary edema, and cardiogenic pulmonary edema [6, 7, 8, 9, 10]. LUS has even been suggested to be superior to chest radiography (X-ray) and comparable to chest computed tomography (CT) scan for the diagnosis of pulmonary edema and increased alveolar fluid (commonly referred to as interstitial syndrome) [3, 8]. However, few studies have compared LUS to pulmonary auscultation, even while the stethoscope still constitutes the majority of contemporary practice [11, 12, 13].
In critically ill patients, auscultation might be challenging as dorsal lung fields are difficult to reach in supine-positioned patients, and the environment is often noisy. No studies have prospectively compared auscultation with LUS in the intensive care unit (ICU) setting. Accordingly, the aim was to compare the agreement of LUS with pulmonary auscultation for the detection of pulmonary edema in acutely admitted ICU patients. We hypothesized that auscultation for pulmonary edema would have insufficient agreement compared to LUS.
Design and setting
This was a planned sub-study of the Simple Intensive Care Studies-I (SICS-I), a single-center, prospective observational study designed to evaluate the diagnostic and prognostic value of combinations of clinical examination and critical care ultrasound (CCUS), in critically ill patients . This sub-study and a prespecified hypothesis were added to the SICS-I study . The local institutional review board (Medisch Ethische Toetsingscommissie of the University Medical Center Groningen (UMCG)) approved the study (M15.168207). This manuscript was reported according to the Standards for Reporting of Diagnostic Accuracy Studies guidelines .
All acutely admitted patients who were 18 years and older with an expected ICU stay of at least 24 h were eligible for inclusion. Patients were excluded if their ICU admission was planned; if acquiring research data interfered with clinical care due to, for example., continuous resuscitation efforts (e.g., mechanical circulatory support); or if consent was not obtained. In this sub-study, we selected a convenience sample of patients who had bilateral LUS images in at least two scan sites.
All included patients underwent clinical examination followed by CCUS within the first 24 h of their ICU admission. The researchers were senior medical students and junior residents trained by cardiologist-intensivists for both clinical examination and CCUS before contributing to the study. Training included self-study of theory on how to perform auscultation and lung ultrasound, at least 2 h hands-on training from cardiologists-intensivists, practice on healthy individuals during practical sessions, and supervised clinical examination and CCUS in the first 20 patients.
Data from the clinical examination was prospectively collected based on definitions in the protocol, including the presence of crepitations and rhonchi . Abnormal auscultation was defined as the presence of crepitations and/or rhonchi at any of the sites. Pulmonary edema was defined as the presence of three or more B lines; diffuse pulmonary edema was defined as edema in two or more scan sites of LUS bilaterally .
The overall statistical methods were described in the predefined statistical analysis plan (SAP) of the main study (NCT02912624). Continuous variables were reported as means with standard deviation (SD) or median with interquartile range (IQR) depending on the distributions. Categorical data were presented in proportions. Student’s t test, Mann-Whitney U test, or the chi-square tests were used as appropriate. The agreement between LUS and auscultation for pulmonary edema was described by using the Cohen κ coefficient. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and diagnostic accuracy of lung ultrasound against auscultation to detect pulmonary edema were calculated. Analyses were performed using Stata version 15 (StataCorp, College Station, TX, USA). A subgroup analysis was performed to assess whether these results were robust in patients who were not mechanically ventilated. We performed a sensitivity analysis to assess the agreement and diagnostic accuracy of LUS for pulmonary edema on chest X-ray, in patients where a chest X-ray was available shortly before or after study inclusion (i.e., on the same day).
The SICS-I was designed to address multiple hypotheses on six different outcomes, and therefore, the pulmonary edema outcome was adjusted for multiple hypothesis testing. We refer to our SAP for more details, but in short, a p value of 0.015 indicated statistical significance and p values between 0.015 and 0.05 indicated suggestive significance with an increased family-wise error rate . For secondary or sensitivity analyses, a p value below 0.05 indicated statistical significance due to the hypothesis-generating purpose. Accordingly, the primary analyses are presented with 98.5%CIs and secondary (subgroup) analyses with 95%CIs.
Baseline characteristics of all included patients
N = 926
Age, years (SD)
Gender, male (%)
Height, cm (SD)
Weight, kg (SD)
Mechanical ventilation, n (%)
Vasoactive medication, n (%)
APACHE IV score, mean (SD)
- Surgical, n (%)
- Medical, n (%)
- Length of stay, days
- 90-day mortality, n (%)
Findings of lung ultrasound and auscultation
The criteria for pulmonary edema diagnosed by LUS were met in 307 of 926 patients (33%). In 156 of these patients (51%), auscultation was normal. A total of 302 of 926 patients (32%) had pulmonary edema diagnosed by pulmonary auscultation. From these patients, 151 patients (50%) had pulmonary edema on LUS. Of the 302 patients with pulmonary edema on auscultation, 130 patients had crepitations and 209 patients had rhonchi.
From 130 patients with crepitations, 86 patients (66%) had pulmonary edema on LUS, and of the 209 patients with rhonchi, 96 patients (46%) had pulmonary edema on LUS. The agreement between auscultation and LUS was poor (κ statistic 0.25).
Test characteristics of specific findings compared to LUS in all patients
Diagnostic performance in % (98.5% confidence intervals)
The sensitivity of abnormal auscultation overall was 52% (98.5% CI 45–59), specificity was 74% (98.5% CI 70–79), positive predictive value was 49% (98.5% CI 42–56), and the negative predictive value was 76% (98.5% CI 72–80). The overall diagnostic accuracy of auscultation was 67% (98.5% CI 64–70).
Test characteristics of specific findings compared to LUS in non-mechanically ventilated patients
Diagnostic performance in % (95% confidence intervals)
Radiologists’ reports assessing the chest X-ray were analyzed in a subset of 315 patients as this was part of the standard ICU management until November 21, 2016. The baseline characteristics of these patients were comparable to the overall population (Additional file 1: Table S1). The median time lag between LUS and chest X-ray was 4 h (2–7 h). In 89 of these patients (28%), the radiologist reported the diagnosis of edema; in 6 patients (2%), it was unclear; and in 220 patients (70%), there was no pulmonary edema on chest X-ray according to the radiologist (Additional file 1: Table S2). The agreement and diagnostic accuracy of LUS for pulmonary edema as diagnosed on chest X-ray were limited (κ statistic 0.12; Additional file 1: Table S3).
In this prospective observational study, we found poor agreement between auscultation and LUS for the diagnosis of pulmonary edema in acutely admitted critically ill patients.
Several previous studies focused on the diagnostic accuracy of LUS compared to other imaging modalities, such as chest X-ray and CT scan [4, 10, 20]. However, few studies have compared the diagnostic accuracy of LUS with the stethoscope, one of the most frequently used instruments at the bedside. Lichtenstein et al. prospectively compared the diagnostic performance of auscultation, LUS, and chest X-ray for detecting alveolar consolidation and alveolar-pulmonary edema with CT scan in 32 patients with acute respiratory distress syndrome and in 10 healthy volunteers . The authors found that auscultation had a diagnostic accuracy of 55% for alveolar-pulmonary edema, which corresponds fairly to the 67% accuracy in our study . In that study, LUS had a diagnostic accuracy of 97% for alveolar consolidation and 95% for alveolar-pulmonary edemas, and chest X-ray had a diagnostic accuracy of 75% for alveolar consolidation and 72% for alveolar-pulmonary edema . In a sensitivity analysis, we observed that the agreement and diagnostic accuracy of LUS for pulmonary edema were limited when compared to chest X-ray, which is in line with other studies .
Another study by Torino et al. prospectively investigated the agreement between auscultation and LUS in non-admitted patients before and after undergoing hemodialysis . The authors similarly found a very poor agreement (κ statistic 0.16, in this study κ statistic 0.25) between the presence of crepitations on auscultation and the presence of B lines on LUS in a total of 1106 measurements in 79 patients . Although their population seems different to ours, patients receiving dialysis may also suffer from pulmonary edema as a consequence of fluid overload. Their results and conclusions are similar to ours, and therefore, these observations may be generalizable to populations beyond the critically ill.
We found that the diagnostic accuracy of auscultation improved if patients were not mechanically ventilated; no previous study has reported this finding. Acoustic disturbances caused by the ventilators might explain the complicated appreciation of subtle auscultation findings.
Implications and generalizability
Improved diagnostic accuracy for detecting pulmonary edema could lead to improved treatment leading to increased benefits and decreased harms for the patient. In critically ill patients, typically multiple pathophysiological processes are co-occurring at the same time, which hampers the extrapolation of the test characteristics for diagnosing abnormalities in these patients, such as pulmonary edema. As some physicians still use auscultation to detect pulmonary edema, we think our study clarifies that auscultation may not be as reliable for detecting pulmonary edema as classically perceived, especially in the ICU. Ultrasonography becomes increasingly available, and our data add nuance to the discussion surrounding how this technology might be properly integrated into clinical practice in the care of the critically ill. These observations encourage further research of LUS; the need for external validation remains to increase the generalizability of this diagnostic modality.
Several limitations of this study must be acknowledged. First, the clinical examination and ultrasonography were conducted as early as possible after ICU admission which limits the applicability of use in patients with prolonged admission. Further studies should explicate how auscultation and LUS compare in other departments and more specifically other pathologies such as a pneumothorax. Second, we were not able to validate all our LUS assessments by experts, also because there are no reference standards for the interpretation of LUS. Chest X-ray and CT are other diagnostic methods that are frequently used for the assessment of pulmonary edema. However, previous studies have suggested that LUS is superior to chest X-ray and comparable to chest CT scan for diagnosing pulmonary edema [3, 8]. Therefore, we decided not to use these modalities as a reference standard and only included a sensitivity analysis of chest X-ray. We limited LUS reporting to the number of B lines per field and did not use further qualitative commentary. Third, the auscultation was not standardized. During clinical examination, researchers performed both auscultation and LUS; however, in contrast to LUS, we did not describe in detail the location of auscultation. In practice, these were similar to the LUS scan sites. Therefore, we think the influence on our results is minimal. Also, the researchers only specified whether they heard significant crepitation or rhonchi on auscultation. Other abnormal breathing sounds were not recorded and we only documented their overall presence or absence; we are unable to compare auscultation with LUS for each specific scan site. In addition, ideally, we ask the patient to cough to distinguish between rhonchi and/or crepitations. Unfortunately, the large majority of the patients in the ICU are not cooperative with this request. Fourth, even though the researchers who performed the measurements were not involved in patient care, they were not blinded for patient information, such as admission diagnoses, other clinical variables and the results of auscultation when performing the CCUS. However, as ultrasonography was always performed after auscultation, we believe it is proper to discuss this potential source of bias but do not believe that it substantially influenced our results due to the objective nature of B line appearance. Fifth, since researchers were senior medical students and junior residents, auscultation by more experienced medical doctors could potentially improve the diagnostic accuracy. Last, 83 (8%) patients were excluded from the analyses due to the absence of LUS or auscultation data. However, the relatively small proportion of this excluded patient group makes it unlikely that excluded patients would have altered the conclusions. Despite the potential biases and limitations, we showed that the agreement between auscultation and lung ultrasound was poor. This is important as current data is scarce on the diagnostic value of new non-invasive bed tools such as CCUS, especially in comparison with clinical examination in critically ill patients.
The agreement between auscultation and LUS for detecting pulmonary edema is poor. As some physicians still use auscultation to detect pulmonary edema, this study clarifies that auscultation may not be as reliable for detecting pulmonary edema as classically perceived, especially in the ICU.
We would like to thank all medical students and coordinators from the SICS Study Group for their devoted involvement with patient inclusions.
The following are the SICS Study Group members: project leaders—Geert Koster, MD; Frederik Keus, MD, PhD; Iwan CC van der Horst, MD, PhD. Research coordinator—Willem Dieperink, PhD. Researchers who conducted patient inclusions: Roos Bleijendaal, MD; Yasmin F. Cawale, MD; Ramon P. Clement, MD; Devon Dijkhuizen, BSc; Ruben J Eck, MD; Bart Hiemstra, MD, PhD; Anja Haker, BSc; Casper D.H. Hilbink, MD; Thomas Kaufmann, MD; Martiene Klasen; MD, Manon Klaver, MD; Laura J. Schokking, BSc; Victor W. Sikkens, MD; Madelon Vos, MD; Justin Woerlee, MD; Renske Wiersema, BSc.
EC, RW, and AB drafted the manuscript and conducted the analyses. IvdH and FK created the idea of the study. GK, TK, RE, and BH developed the protocol and implemented the study. AW, TCK, CV, and JT critically reviewed the manuscript for important intellectual content. All authors critically reviewed the manuscript and agreed with the final version and findings.
Ethics approval and consent to participate
In unresponsive patients, informed consent was first obtained from the legal representatives. Consent for the use of the study data was asked at a later time if the patient recovered consciousness. If the patient died before consent was obtained, the study data was used, and the legal representatives were informed of the study. The study was approved by the local institutional review board (METc M15.168207).
Consent for publication
The authors declare that they have no competing interests.
- 10.Martindale JL, Wakai A, Collins SP, Levy PD, Diercks D, Hiestand BC, et al. Diagnosing acute heart failure in the emergency department: a systematic review and meta-analysis. Carpenter C, editor. Acad Emerg Med 2016;23:223–242.Google Scholar
- 17.Wiersema R, Castela Forte JN, Kaufmann T, de Haas RJ, Koster G, Hummel YM, Koeze J, Franssen CFM, Vos ME, Hiemstra B, Keus F, van der Horst ICC. Observational Study Protocol for Repeated Clinical Examination and Critical Care Ultrasonography Within the Simple Intensive Care Studies. J Vis Exp. 2019;(143). PubMed PMID: 30735183. https://doi.org/10.3791/58802.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.