Intensive Care Medicine

, Volume 45, Issue 2, pp 190–200 | Cite as

The diagnostic accuracy of clinical examination for estimating cardiac index in critically ill patients: the Simple Intensive Care Studies-I

  • Bart HiemstraEmail author
  • Geert Koster
  • Renske Wiersema
  • Yoran M. Hummel
  • Pim van der Harst
  • Harold Snieder
  • Ruben J. Eck
  • Thomas Kaufmann
  • Thomas W. L. Scheeren
  • Anders Perner
  • Jørn Wetterslev
  • Anne Marie G. A. de Smet
  • Frederik Keus
  • Iwan C. C. van der Horst
  • SICS Study Group
Open Access



Clinical examination is often the first step to diagnose shock and estimate cardiac index. In the Simple Intensive Care Studies-I, we assessed the association and diagnostic performance of clinical signs for estimation of cardiac index in critically ill patients.


In this prospective, single-centre cohort study, we included all acutely ill patients admitted to the ICU and expected to stay > 24 h. We conducted a protocolised clinical examination of 19 clinical signs followed by critical care ultrasonography for cardiac index measurement. Clinical signs were associated with cardiac index and a low cardiac index (< 2.2 L min−1 m2) in multivariable analyses. Diagnostic test accuracies were also assessed.


We included 1075 patients, of whom 783 (73%) had a validated cardiac index measurement. In multivariable regression, respiratory rate, heart rate and rhythm, systolic and diastolic blood pressure, central-to-peripheral temperature difference, and capillary refill time were statistically independently associated with cardiac index, with an overall R2 of 0.30 (98.5% CI 0.25–0.35). A low cardiac index was observed in 280 (36%) patients. Sensitivities and positive and negative predictive values were below 90% for all signs. Specificities above 90% were observed only for 110/280 patients, who had atrial fibrillation, systolic blood pressures < 90 mmHg, altered consciousness, capillary refill times > 4.5 s, or skin mottling over the knee.


Seven out of 19 clinical examination findings were independently associated with cardiac index. For estimation of cardiac index, clinical examination was found to be insufficient in multivariable analyses and in diagnostic accuracy tests. Additional measurements such as critical care ultrasonography remain necessary.


Physical examination Cardiac index Haemodynamics Sensitivity and specificity Ultrasonography Critical care Intensive care unit Prospective study 

Take-home message

Abnormal clinical signs and a low cardiac index were often present in acutely admitted ICU patients and seven out of nineteen clinical examination findings were independently associated with cardiac index. To estimate cardiac index, clinical examination performs insufficiently in both multivariable analyses and in diagnostic accuracy tests; additional measurements such as critical care ultrasonography remain necessary.


Clinical examination is the first step to estimate cardiac index of critically ill patients to guide interventions and further diagnostic testing. Clinical signs such as altered consciousness, oliguria and a cold, clammy skin indicate organ hypoperfusion and are used to diagnose shock in critically ill patients [1]. If the initial clinical examination is inconclusive, further hemodynamic assessment with critical care ultrasonography (CCUS) is advocated [1, 2]. The evidence base of clinical examination is currently considered ‘best practice’ as there are scarce data on its diagnostic value, especially in comparison with newer, non-invasive bedside tools such as CCUS [1, 3].

Clinical examination for diagnosing shock is fast, easy to conduct and low in cost, yet its diagnostic accuracy is questioned [3, 4, 5]. Particularly, physicians seem insufficiently capable of diagnosing a low cardiac index purely based on their clinical examination [6, 7, 8, 9]. Previous studies scarcely specified their methods of clinical examination in terms of variables collected and definitions employed, leaving variability at the physician’s discretion and making these studies difficult to reproduce [7, 9, 10, 11, 12, 13, 14, 15]. Cardiac index was measured only in small samples of selected patients who failed to respond to initial therapy or in whom clinical examination alone was deemed insufficient, so the accuracy of clinically estimated cardiac index was biased by definition [1, 12, 13, 14, 15].

The value of clinical signs for estimating cardiac index remains to be established in a large, consecutively recruited cohort of critically ill patients. Our aim was to study the diagnostic performance of clinical examination in a twostep approach: to establish (1) which combination of clinical examination findings are independently associated with cardiac index and (2) the performance of clinical signs to diagnose a low or high cardiac index. The Simple Intensive Care Studies-I (SICS-I) was designed to assess the ability of clinical examination to estimate cardiac index and to identify patients with a low or high cardiac index [16].


Design, setting and patients

We conducted the prospective, observational, single-centre SICS-I following a pre-published protocol and statistical analysis plan (SAP;; NCT02912624) [17]. All consecutive patients admitted to the intensive care unit (ICU) of the University Medical Center Groningen (UMCG) between 27 March 2015 and 22 July 2017 were considered eligible. We included patients who were aged 18 years or older, had an unplanned ICU admission and were expected to stay for at least 24 h. We excluded patients if their ICU admission was planned preoperatively, if acquiring research data interfered with clinical care (e.g., mechanical circulatory support) and if informed consent was not provided (e.g., refusal, serious language barrier). In unresponsive patients, informed consent was first obtained from the legal representatives. Consent for use of the study data was asked at a later time if the patient recovered consciousness. If the patient died before consent was obtained, the study data was used, and the legal representatives were informed on the study. The study was approved by the local institutional review board (METc M15.168207).

All patients were included within the first 24 h of their ICU admission and underwent clinical examination, immediately followed by CCUS. Patients were included by medical research interns and PhD students who had received a focused CCUS training course given by experienced cardiologist-intensivists (protocol in Supplements 1) [16]. These researchers were not involved in patient care, and their findings were not revealed to the patients’ caregivers.

Clinical examination

All clinical examinations were standardised and cut-off values for abnormal clinical signs predefined in the protocol (; NCT02912624). We recorded in total 19 clinical signs per patient (e-Table 1). Respiratory rate, heart rate and rhythm, arterial blood pressures and central venous pressures were recorded from the bedside monitor. Patients were auscultated for the presence of cardiac murmurs and crepitations. Clinical signs reflecting organ perfusion were obtained from the three organs readily accessible to clinical examination: cerebral (mental status), renal (urine output) and skin perfusion (capillary refill time (CRT), central-to-peripheral temperature difference (ΔTc–p) and skin mottling). Mental status was assessed with the AVPU scale, which consists of the categories ‘Alert’, ‘responsive to Voice’, ‘responsive to Pain’ and ‘Unresponsive’ and was not scored in patients who were receiving sedative drugs or who were admitted after a trauma. Urine output was scored 1 and 6 h prior to the clinical examination, adjusted for body weight, and considered decreased if < 0.5 mL kg−1 h−1. CRT was the time for skin colour to fully return after applying firm pressure at the sternum, index finger, and knee for 15 s and considered prolonged if > 4.5 s [18]. ΔTc–p was the difference between central temperature measured by a bladder thermistor catheter and peripheral temperature measured by a skin probe on the big toe and dorsum of the foot and considered abnormal if > 7 °C [19]. The degree of skin mottling was rated at the knee according to a score from 0 to 5, where 0–1 was regarded as mild, 2–3 as moderate and 4–5 as severe mottling [20].

Outcome definition

Cardiac index was measured by transthoracic echocardiography using the Vivid-S6 system (General Electric, Horton, Norway) with cardiac probe M3S or M4S, and with default cardiac imaging setting. The parasternal long axis (PLAX) was used to measure the left ventricular outflow tract (LVOT) diameter. In the apical five chamber (AP5CH) view, a pulse wave Doppler signal in the LVOT was used to measure the velocity time integral (VTI): three VTIs were traced when the heart rhythm was regular and eight VTIs when the heart rhythm was irregular. Cardiac output was calculated using an established formula and was adjusted for body surface area, i.e. cardiac index, because it allowed us to compare patients with different body dimensions [21]. We tested the diagnostic accuracy of clinical signs on four frequently used cut-off values: below 2.2 and 2.5. and above 4.0 and 4.5 L min−1 m−2 [10, 11, 22, 23].

All CCUS images were validated and each cardiac index measured by experts from an independent imaging core laboratory (Groningen Imaging Core Laboratory, These experts were blinded for the clinical examination findings. The most-often used modality for measuring cardiac index in the literature currently is the transpulmonary thermodilution method [24, 25]. We chose CCUS because it is non-invasive, its use is advocated by guidelines, and ensured high-quality measurements throughout validation by experts who followed recent guidelines [26].

Sample size and missing data

No previous research has studied clinical examination in a cohort of consecutively included critically ill patients. Therefore, we estimated our sample size based on the number of acute ICU admissions annually (n = 1500) and estimated that half would fulfil the inclusion criteria. When our sample size exceeded 1000 patients, we calculated a potentially detectable difference using CRT as an example; we were able to detect a 0.10 L min−1 m−2 increase in cardiac index for each second of CRT increase with a power of 100% and alpha of 0.015 [17]. Missing clinical examination values were imputed using multiple imputations (20 times) as these were considered missing at random. Regression coefficients of our final models were averaged using Rubin’s formula [27]. Central venous pressure was missing in 822 (76%) patients and was therefore excluded from the analyses and imputations. Following our SAP, we also imputed missing cardiac index values based on validated LVOT diameters and VTIs (Supplements 2; sensitivity analyses).

Analytical approach

The aims of our analyses were twofold: first, we conducted a least-squares linear regression analysis to identify the clinical examination findings that were independently associated with cardiac index as a continuous variable. Second, we calculated diagnostic test accuracies for each clinical sign and conducted multivariable logistic regression analyses to determine which combined clinical signs were independently associated with a low (< 2.2 and < 2.5 L min−1 m−2) or high (> 4.0 and > 4.5 L min−1 m−2) cardiac index.

Multivariable model development and validation

We conducted a linear regression analysis when using cardiac index as a continuous variable and logistic regression analysis when using a dichotomised cardiac index. We used a p < 0.25 threshold for inclusion in the multivariable models, which was constructed using forward stepwise regression by adding blocks of variables. Noradrenaline infusion rate was added as a confounder to our multivariable models on a theory-driven basis. For the linear regression model, normality of the residuals was assessed with kernel density plots and multicollinearity was checked with variance inflation factors. The model was internally validated with bootstrap sampling, in which we tested whether each predictor was significant in at least 80 of the 100 bootstrap replications. For the logistic regression model, we assessed calibration with the Hosmer–Lemeshow test and evaluated discrimination using receiver operating characteristic (ROC)-curves.

Diagnostic test accuracy

The following diagnostic test accuracies were calculated: sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and overall accuracy. Furthermore, we calculated likelihood ratios (LRs), which represent the increase of probability of a low cardiac index when a clinical sign is abnormal (positive LR) or normal (negative LR) [28]. Following specific Standards for Reporting of Diagnostic Accuracy Studies of medical history and physical examination [29], we summarised all 2 × 2 tables in an overview table (e-Tables 7a and 8a). Clinical signs reflecting central circulation were also dichotomised to test their diagnostic performance.

Subgroup analyses

We conducted two planned subgroup analyses on the diagnostic test accuracies. First, we stratified the study population by noradrenaline administration. Second, we divided patients by primary reasons of ICU admittance as these underlying pathologies may have influenced cardiac index: i.e., acute liver failure or post orthotopic liver transplantation (OLT), heart failure, septic shock, cardiac arrest, and central nervous system (CNS) pathologies.

Statistical significance

We conducted our analyses with Stata version 15.1 software (StataCorp, College Station, TX, USA) and followed a published SAP [17]. Cardiac index was one of the six primary outcomes tested in our cohort and, therefore, we adjusted for multiple hypothesis testing [16, 30]. We refer to our SAP for more details (Supplements 3), but in short a p value of 0.015 indicated statistical significance and p values between 0.015 and 0.05 indicated suggestive significance with an increased family-wise error rate [17]. Accordingly, we presented our primary analysis with 98.5% CI, all secondary analyses with 95% CIs, and discussed any suggestively significant findings based on the p value and results from the bootstrap replications.


Study population

A total of 1212 patients were eligible, of which 137 patients were not included because the desired CCUS window was obstructed by chest drains, wounds, emphysema, or prone positioning (n = 80); routine clinical care such as acute surgery or angiography did not allow patient inclusion (n = 40); or other reasons such as colonisation with multiresistant bacteria (n = 17), leaving 1075 patients for inclusion. Of these, 292 (27%) patients were excluded because one or both of the CCUS views were of insufficient quality as scored by the independent echocardiography core laboratory, resulting in a total of 783 (73%) patients included in the current analyses (Fig. 1). One-third of the patients were admitted after acute or complicated surgery, and the most common admission diagnoses were of cardiovascular or respiratory origin (Table 1). The median time from ICU admission to inclusion was 15 h (IQR 8–20 h).
Fig. 1

Flow diagram of the Simple Intensive Care Studies-I (SICS-I). ICU intensive care unit, CCUS critical care ultrasonography, PLAX parasternal long axis, AP5CH apical 5-chamber

Table 1

Clinical characteristics


All patients

N = 783

Age (years)

61 ± 15

Male gender

484 (62%)

Mechanical ventilation

438 (56%)

PEEP (cm H2O)

7 (5, 8)

Admission type


544 (69%)

 Acute surgery

207 (26%)

 Complications of surgery

32 (4%)

Admission diagnosis by organ system


228 (29%)


120 (15%)


20 (3%)


14 (2%)


16 (2%)


11 (1%)


116 (15%)


173 (22%)


29 (4%)


55 (7%)


 Acute heart failure

49 (11%)

 Cardiac arrest

94 (21%)

 CNS failure

115 (25%)

 Liver failure

42 (9%)


151 (33%)

PEEP positive end-expiratory pressure

The mean cardiac index was 2.65 ± 0.93 L min−1 m−2. Table 2 shows that 12 clinical examination findings differed significantly over five cardiac index categories. Clinical signs reflecting normal skin, renal and cerebral perfusion were present in 36 (5%) patients. Abnormal clinical signs were observed in 598 (76%) patients for skin perfusion, 536 (68%) patients for renal perfusion, and 204 (26%) patients for cerebral perfusion. Both cerebral and renal perfusion were abnormal in 141 (18%) patients; skin, renal and cerebral perfusion were abnormal in 103 (13%) patients.
Table 2

Clinical examination and cardiac index


All patients

CI < 1.8

CI 1.8–2.2

CI 2.2–2.5

CI 2.5–4.0

CI > 4.0

p value

N = 783

N = 138

N = 142

N = 105

N = 332

N = 66

Central circulation

 Respiratory rate (per minute)

18 ± 6

18 ± 6

18 ± 5

18 ± 5

18 ± 5

19 ± 7


 Heart rate (beats per minute)

87 ± 21

77 ± 19

84 ± 21

82 ± 18

90 ± 19

101 ± 22

< 0.001

 Atrial fibrillation

56 (7%)

11 (8%)

15 (11%)

7 (7%)

18 (5%)

5 (8%)


 Systolic blood pressure (mmHg)

120 ± 24

113 ± 23

119 ± 21

117 ± 24

123 ± 25

122 ± 26

< 0.001

 Diastolic blood pressure (mmHg)

60 ± 12

61 ± 11

60 ± 10

59 ± 13

59 ± 11

59 ± 12


 Mean arterial pressure (mmHg)

79 ± 14

78 ± 14

79 ± 12

77 ± 16

80 ± 15

79 ± 15


 Central venous pressure (mmHg)

9 (5, 13)

9 (5, 14)

10 (7, 12)

13 (6, 16)

8 (5, 12)

10 (6, 13)


 Cardiac murmurs

75 (10%)

5 (4%)

13 (9%)

12 (11%)

34 (10%)

11 (17%)



115 (15%)

26 (19%)

10 (7%)

13 (12%)

52 (16%)

14 (21%)



361 (46%)

73 (53%)

72 (51%)

48 (46%)

136 (41%)

32 (48%)


Organ perfusion



254 (32%)

33 (24%)

39 (27%)

30 (29%)

127 (38%)

25 (38%)

< 0.001

  Reacting to voice

154 (20%)

19 (14%)

24 (17%)

22 (21%)

73 (22%)

16 (24%)


  Reacting to pain

67 (9%)

10 (7%)

20 (14%)

7 (7%)

25 (8%)

5 (8%)



308 (39%)

76 (55%)

59 (42%)

46 (44%)

107 (32%)

20 (30%)


 Urine output (mL kg−1 h−1)

0.56 (0.31, 1.11)

0.53 (0.26, 1.15)

0.54 (0.30, 1.00)

0.50 (0.25, 1.03)

0.61 (0.35, 1.14)

0.63 (0.35, 1.43)


 Urine output (mL kg−1 6 h−1)

0.65 (0.37, 1.16)

0.64 (0.37, 1.06)

0.58 (0.34, 1.08)

0.56 (0.36, 1.20)

0.70 (0.41, 1.19)

0.68 (0.34, 1.33)


 Central temperature (°C)

36.9 ± 0.9

36.6 ± 0.9

37.0 ± 0.9

36.9 ± 0.9

37.0 ± 0.9

37.2 ± 1.0

< 0.001

 ΔTc–p, dorsum foot (°C)

7.5 ± 3.1

8.6 ± 3.1

8.2 ± 3.0

7.5 ± 3.0

7.0 ± 3.0

6.4 ± 3.1

< 0.001

 ΔTc–p, big toe (°C)

9.1 ± 3.6

10.1 ± 3.2

9.9 ± 3.4

9.3 ± 3.5

8.5 ± 3.6

7.5 ± 3.8

< 0.001

 Cold extremities, subjective

285 (36%)

77 (56%)

55 (39%)

43 (41%)

93 (28%)

17 (26%)

< 0.001

 Capillary refill time sternum (s)

3.0 (2.0, 3.0)

3.0 (3.0, 4.0)

3.0 (2.0, 3.0)

3.0 (2.0, 3.0)

3.0 (2.0, 3.0)

2.0 (2.0, 3.0)

< 0.001

 Capillary refill time finger (s)

3.0 (2.0, 4.0)

4.0 (2.0, 5.0)

3.0 (2.0, 4.0)

3.0 (2.0, 4.0)

2.0 (2.0, 3.0)

2.0 (2.0, 4.0)

< 0.001

 Capillary refill time knee (s)

3.0 (2.0, 4.0)

4.0 (3.0, 5.0)

3.0 (3.0, 5.0)

3.0 (2.0, 4.0)

3.0 (2.0, 4.0)

3.0 (2.0, 4.0)

< 0.001

 Skin mottling severitya

  Mild (0–1)

543 (69%)

80 (58%)

96 (68%)

78 (74%)

243 (73%)

46 (70%)


  Moderate (2–3)

217 (28%)

52 (38%)

43 (30%)

24 (23%)

79 (24%)

19 (29%)


  Severe (4–5)

23 (3%)

6 (4%)

3 (2%)

3 (3%)

10 (3%)

1 (2%)


CI cardiac index in L min−1 m−2, ΔTc–p, central-to-peripheral temperature difference

aMottling was scored according to Ait-Oufella et al. [20]

Clinical examination associated with cardiac index

Univariable analyses in the overall population showed that heart rate, systolic blood pressure and all clinical signs reflecting abnormal organ perfusion were statistically significantly associated with cardiac index (supplements; e-Table 2). The strongest association was found for heart rate with an R2 of 0.15. At the mean heart rate of 87 beats per minute, the mean cardiac index was 2.1 L min−1 m−2 with an individual 95% CI that ranged from 0.87 to 4.1 L min−1∙m−2 (e-Fig. 1), reflecting the inaccuracy of a univariable prediction. In multivariable linear regression seven clinical signs, i.e., respiratory rate, heart rate and rhythm, systolic and diastolic blood pressure, ΔTc–p, and CRT were independently associated with cardiac index (e-Table 3). The presence of cardiac murmurs had a p value > 0.015 and was statistically significant in less than 80 of the 100 bootstrap replications. The multivariable model had an R2 of 0.30 (98.5% CI 0.26–0.37). Other model diagnostics and sensitivity analyses are presented in the supplements (e-Figs. 2–4 and e-Tables 4, 5).

Diagnostic test performance of clinical signs

Accuracy of single clinical signs

A cardiac index below 2.2 L min−1 m−2 was observed in 280 (36%) patients. The performance of the 19 clinical signs to diagnose a low cardiac index showed that none had sensitivities, PPVs and NPVs that exceeded 90% (Table 3). A specificity above 90% was found when patients had atrial fibrillation, a systolic blood pressure below 90 mmHg or a diastolic blood pressure below 45 mmHg, an altered consciousness without sedation (i.e., patients who reacted to a pain stimulus only or who were unresponsive), a CRT of  > 4.5 s at the sternum, or had mottling over the knee (Fig. 2). One of these five clinical signs was abnormal in 110 (39%) of the 280 patients with a cardiac index below 2.2 L min−1 m−2. A low cardiac index was over 1.5 times more likely when patients had atrial fibrillation, subjectively cold feet, or a CRT at the sternum or index finger of more > 4.5 s (Table 3; positive likelihood ratio).
Table 3

Diagnostic performance of clinical signs for estimating a cardiac index below 2.2 L∙min−1∙m−2

Clinical sign


Diagnostic performance in %

Likelihood and odds ratios

N (%)









Central circulation

 Respiratory rate > 22 pm

550 (70%)

77 (72–82)

34 (29–38)

39 (37–41)

73 (67–77)

49 (46–53)

1.16 (1.06–1.27)

0.68 (0.53–0.87)

1.71 (1.22–2.38)

 Heart rate < 100 bpm

571 (73%)

82 (77–86)

32 (28–36)

40 (36–44)

76 (70–82)

50 (46–53)

1.20 (1.11–1.31)

0.57 (0.43–0.75)

2.11 (1.48–3.02)

 Atrial fibrillation

56 (7%)

9 (6–13)

94 (92–96)

46 (33–60)

64 (60–67)

64 (61–67)

1.56 (0.94–2.58)

0.96 (0.92–1.01)

1.61 (0.94–2.77)

 SBP < 90 mmHg

56 (7%)

6 (4–10)

92 (90–95)

32 (20–46)

62 (58–65)

63 (60–66)

0.85 (0.50–1.46)

1.01 (0.97–1.05)

0.84 (0.47–1.49)

 DBP < 45 mmHg

40 (5%)

5 (3–8)

95 (92–96)

33 (19–49)

64 (61–68)

62 (59–66)

0.86 (0.45–1.65)

1.01 (0.97–1.04)

0.86 (0.44–1.67)

 MAP < 65 mmHg

97 (12%)

11 (8–16)

87 (84–90)

33 (24–43)

64 (60–68)

60 (57–63)

0.88 (0.59–1.32)

1.02 (0.96–1.07)

0.87 (0.56–1.36)

 Cardiac murmurs

75 (10%)

6 (4–10)

89 (86–91)

24 (15–35)

63 (59–67)

59 (56–63)

0.57 (0.34–0.94)

1.06 (1.01–1.10)

0.54 (0.31–0.93)


115 (15%)

13 (9–17)

84 (81–87)

31 (23–41)

64 (60–67)

59 (55–62)

0.82 (0.57–1.18)

1.03 (0.97–1.10)

0.79 (0.52–1.21)

Organ perfusion


  Reacting to voice

121 (15%)

11 (8–15)

82 (79–85)

26 (18–34)

62 (59–66)

57 (53–60)

0.62 (0.24–0.91)

1.08 (1.02–1.15)

0.57 (0.37–0.88)

  Reacting to pain

33 (4%)

5 (3–8)

96 (94–98)

42 (26–61)

65 (61–68)

64 (60–67)

1.32 (0.67–2.60)

0.99 (0.96–2.60)

1.34 (0.67–2.68)


50 (6%)

7 (4–10)

94 (91–96)

38 (25–53)

63 (59–66)

63 (60–66)

1.10 (0.63–1.91)

0.99 (0.96–1.03)

1.11 (0.62–1.99)

 Urine output < 0.5 ml∙kg−1∙h−1

  Over 1 h

345 (44%)

47 (41–53)

58 (53–62)

38 (33–44)

66 (62–71)

54 (50–57)

1.11 (0.95–1.31)

0.92 (0.80–1.05)

1.21 (0.91–1.63)

  Over 6 h

288 (37%)

40 (34–46)

65 (61–69)

39 (33–44)

66 (62–70)

56 (52–59)

1.13 (0.93–1.36)

0.93 (0.83–1.04)

1.21 (0.90–1.63)

 Skin temperature colda

  ΔTc–p, dorsum foot

402 (51%)

78 (72–82)

40 (35–44)

42 (37–46)

76 (70–81)

53 (50–57)

1.28 (1.17–1.41)

0.57 (0.45–0.72)

2.25 (1.62–3.14)

  ΔTc–p, big toe

521 (67%)

65 (59–71)

56 (52–61)

45 (40–50)

74 (70–79)

59 (56–63)

1.49 (1.30–1.69)

0.62 (0.52–0.74)

2.39 (1.77–3.23)

  Cold subjective

285 (36%)

47 (41–53)

70 (65–74)

46 (40–52)

70 (66–74)

62 (58–65)

1.55 (1.29–1.86)

0.76 (0.67–0.86)

2.04 (1.51–2.76)

 CRT prolongedb


62 (8%)

10 (7–15)

93 (91–95)

47 (34–60)

65 (62–69)

64 (60–67)

1.58 (0.98–2.54)

0.96 (0.92–1.00)

1.65 (0.98–2.76)


147 (19%)

25 (20–31)

85 (82–88)

48 (40–57)

67 (63–71)

64 (60–67)

1.68 (1.26–2.24)

0.88 (0.81–0.95)

1.91 (1.33–2.74)


199 (25%)

33 (27–39)

79 (75–82)

46 (39–53)

68 (64–72)

62 (59–66)

1.54 (1.22–1.96)

0.85 (0.78–0.94)

1.81 (1.31–2.51)

 Skin mottling severityc

  Over the knee (≥ 3)

92 (12%)

16 (12–21)

91 (88–93)

49 (38–60)

66 (62–70)

64 (61–67)

1.72 (1.17–2.52)

0.93 (0.87–0.98)

1.86 (1.20–2.87)

  Severe (≥ 4)

23 (3%)

3 (2–6)

97 (95–99)

39 (20–62)

64 (61–68)

64 (60–67)

1.15 (0.51–2.63)

1.00 (0.97–1.02)

1.16 (0.51–2.66)

Values between parentheses present 95% confidence intervals

SBP systolic blood pressure, DBP diastolic blood pressure, MAP mean arterial pressure, PPV positive predictive value, NPV negative predictive value, ΔTc–p central-to-peripheral temperature difference, CRT capillary refill time

aΔTc–p was considered cold if  > 7 °C

bCRT was considered prolonged if > 4.5 s

cMottling was scored according to Ait-Oufella et al. [19]

Fig. 2

Diagnostic performance of clinical signs for estimating a cardiac index below 2.2 L min−1 m−2. SBP systolic blood pressure, DBP diastolic blood pressure, PPV positive predictive value, NPV negative predictive value

The diagnostic performance was also assessed for cardiac index cut-off values below 2.5 and above 4.0 and 4.5 L min−1 m−2, and results are presented in the supplements (e-Fig. 6, e-Tables 7 and 8). The accuracy of diagnostic test performance was comparable in all 1075 patients with an imputed cardiac index (e-Tables 9, 10).

Accuracy of combined clinical signs

The PPV of a cardiac index below 2.2 L min−1 m−2 was higher when patients had lower heart rates and lower systolic blood pressures, and when more organs showed signs of hypoperfusion (Fig. 3). Multivariable logistic regression analyses adjusted for noradrenaline infusion rate showed that respiratory rate, heart rate, atrial fibrillation, systolic and diastolic blood pressure, CRT at the sternum and ΔTc–p were independently associated with a cardiac index below 2.2 L min−1 m−2. The model had an area under the ROC of 0.74 (95% CI 0.70–0.78; e-Table 6). These clinical signs correctly classified 556 (71%) of the 783 patients into a low or normal cardiac index.
Fig. 3

Positive predictive values of combined clinical signs to diagnose a cardiac index < 2.2 L min−1 m−2. The figure displays the positive predictive value for combinations of the clinical signs heart rate, systolic blood pressure, and number of skin signs showing hypoperfusion (i.e., capillary refill time, cold peripheral temperature, and skin mottling). The figure shows that the PPV increases when patients have lower heart rates combined with lower systolic blood pressures and more signs of skin hypoperfusion. SBP systolic blood pressure

Subgroup analyses

We conducted two predefined subgroup analyses according to noradrenaline use and primary reason for admission. The subgroups were either small (n < 50) or the diagnostic test performance showed little improvement compared to the entire cohort (i.e., < 5%; e-Fig. 7).


In the SICS-I, we studied the association of 19 clinical examination findings with cardiac index and assessed their performance in diagnosing a low cardiac index in a consecutive cohort of acutely ill patients admitted to the ICU. We observed that only 5% of the patients had clinical signs indicating normal cerebral, renal and skin perfusion. A little over one-third of all patients had a cardiac index below 2.2 L min−1 m−2 and clinical examination findings were more often abnormal when cardiac index was low. Seven clinical examination findings which reflect respiration, central circulation and skin hypoperfusion were independently associated with cardiac index. Five clinical signs with a high specificity may be used to conclude that a low cardiac index is likely. Nevertheless, the performance of clinical examination in both multivariable analyses and diagnostic tests is insufficient for estimating cardiac index.

This study is the first to associate a broad set of clinical examination variables with cardiac index measured by CCUS. The multivariable regression analyses of our primary outcome showed that 30% of the variance was explained by the model, implicating that clinical examination is insufficiently capable of estimating cardiac index. Compared to smaller studies which assessed one, two or three clinical examination variables, the associations for heart rate, respiratory rate and ΔTc–p gradients were similar [31, 32, 33, 34, 35]. In contrast, by including all previously clinical signs, we showed that a CRT measured at the sternum and not peripheral CRT is independently associated with cardiac index [20].

Studies that reported on the physician’s educated guess of cardiac output lacked the design to assess the diagnostic performance of each clinical sign, obtained according to strict definitions. Using multivariable logistic regression, we correctly classified 556 (71%) patients into a low or normal cardiac index, which contrasts with others who found agreements of 50–60% [8, 9, 10, 11, 13, 14, 15]. One other study evaluated three standardised clinical signs and also found that an abnormality of all three clinical signs have high specificities and low sensitivities to diagnose a low cardiac index [36]. In the above mentioned studies, cardiac index was obtained with transpulmonary thermodilution, compared to echocardiography in our study; evidence indicates that these two techniques may not be interchangeable [37].

Implications for practice

Clinical signs are important warning signals of a deteriorating patient condition, but cannot reliably indicate whether the cardiac index is low, normal or high, or the underlying cause. Our results show both the relevance and limitations of clinical examination: five clinical signs had a specificity above 90%, yet the PPV is much more pertinent than specificity in the clinical process, as it reflects the probability that a low CI is present given that the clinical signs indicate hypoperfusion. The PPV of single clinical signs (Fig. 2) is too low in the majority of patients. PPVs above 90% were observed in a minority of patients with several abnormal clinical signs (Fig. 3). It is unacceptable for a diagnostic test to miss a low cardiac index in one-quarter of cases, or even a larger proportion when diagnosing a high cardiac index (e-Table 6). If physicians immediately perform CCUS, they could diagnose cardiac failure within a few minutes and perform the adequate supportive and therapeutic measures. In the acute setting, this is superior to the collection of urine over 1 h.

The results of our study imply that physicians should not rely solely on clinical signs for their decision making. Although the clinical signs atrial fibrillation, systolic blood pressure below 90 mmHg, altered consciousness, CRT of  > 4.5 s at the sternum and skin mottling over the knee make a low cardiac index very likely, we advocate ultrasonography for additional evaluation in these patients. For patients with normal clinical signs additional evaluation should be performed on indication. Therewith, we verify two important statements of the current circulatory shock guidelines for which no evidence base existed (i.e., ‘best practice’) [1].

Strengths and limitations

The clinical examination findings measured in the SICS-I were prone to confounding by interventions. The administration of noradrenaline may have influenced both cardiac index and organ perfusion variables, which is why we added it as a confounder in our multivariable models. The observational design of our study  does not allow for conclusions if the measured cardiac index is sufficient for the individual patient. CCUS is focused on obtaining few potentially important measurements and therewith valve pathologies can be overseen. Additional CCUS measures such as ejection fraction and end-diastolic volumes are needed to distinguish between a compensating or a failing heart, but this was beyond the scope of our current research question.

The SICS-I included acutely ill patients admitted to the ICU of a tertiary referral hospital. Compared to others who selected patients with sepsis or myocardial infarction, we studied the value of clinical examination in a large, unselected cohort. Since PPV and NPV values are dependent on the baseline prevalence of low cardiac index, we selected all consecutive patients to maximise representativeness of our cohort to the ICU. However, our study requires external validation before its findings can be applied to other ICUs. Furthermore, our study did not test the inter- and intra-observer agreement of cardiac index measured with CCUS; we will address the inter-observer agreement (researcher versus expert) separately.


Abnormal clinical signs and a low cardiac index were often present in acutely admitted ICU patients, and seven out of 19 clinical examination findings were independently associated with cardiac index. To estimate cardiac index, clinical examination performs insufficiently in both multivariable analyses and in diagnostic accuracy tests. Additional measurements such as critical care ultrasonography remain necessary.



We would like to thank all medical students and coordinators from the SICS Study Group for their devoted involvement with patient inclusions.

SICS Study Group information: The SICS Study Group members include the following: project leaders: Geert Koster, MD; Frederik Keus, MD, PhD; Iwan CC van der Horst, MD, PhD. Research coordinator: Willem Dieperink, PhD. Researchers who conducted patient inclusions: Roos Bleijendaal, MD; Yasmin F. Cawale, MD; Ramon P. Clement, MD; Devon Dijkhuizen, BSc; Ruben J Eck, MD; Bart Hiemstra, MD; Anja Haker, BSc; Casper D.H. Hilbink, MD; Thomas Kaufmann, MD; Martiene Klasen; MD, Manon Klaver, MD; Laura J. Schokking, BSc; Victor W. Sikkens, MD; Madelon Vos, MD; Justin Woerlee, MD and Renske Wiersema, BSc.

Author contributions

BH, IvdH and EK drafted the manuscript and conducted the analyses. IvdH and EK were involved in the study conception. BH, RJE and GK developed the protocol and implemented the study. RW, YMH and TK contributed substantially to the data collection. JW and HS contributed to the design of the detailed statistical analysis plan. TWLS, AP, and AMdS critically reviewed the manuscript for important intellectual content. All authors critically reviewed the manuscript and agreed with the final version and findings.


This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.

Compliance with ethical standards

Conflicts of interest

TWLS reports personal fees and other compensation from Edwards Lifesciences, personal fees from Masimo Inc., outside the submitted work. The other authors declare that they have no conflict of interest.

Ethical approval

The study was approved by the local institutional review board (Medisch Ethische Toetsingscommissie, University Medical Center Groningen; METc M15.168207).

Supplementary material

134_2019_5527_MOESM1_ESM.pdf (498 kb)
Supplementary material 1 (PDF 498 kb)
134_2019_5527_MOESM2_ESM.pdf (780 kb)
Supplementary material 2 (PDF 781 kb)
134_2019_5527_MOESM3_ESM.pdf (843 kb)
Supplementary material 3 (PDF 844 kb)


  1. 1.
    Cecconi M, De Backer D, Antonelli M et al (2014) Consensus on circulatory shock and hemodynamic monitoring. Task force of the European Society of Intensive Care Medicine. Intensive Care Med 40:1795–1815. CrossRefGoogle Scholar
  2. 2.
    Vincent JL, De Backer D (2013) Circulatory shock. N Engl J Med 369:1726–1734. CrossRefGoogle Scholar
  3. 3.
    Narula J, Chandrashekhar Y, Braunwald E (2018) Time to add a fifth pillar to bedside physical examination: inspection, palpation, percussion, auscultation, and insonation. JAMA Cardiol. Google Scholar
  4. 4.
    Verghese A, Charlton B, Kassirer JP, Ramsey M, Ioannidis JP (2015) Inadequacies of physical examination as a cause of medical errors and adverse events: a collection of vignettes. Am J Med. Google Scholar
  5. 5.
    Elder A, Japp A, Verghese A (2016) How valuable is physical examination of the cardiovascular system? BMJ 354:i3309. CrossRefGoogle Scholar
  6. 6.
    Hiemstra B, Eck RJ, Keus F, van der Horst ICC (2017) Clinical examination for diagnosing circulatory shock. Curr Opin Crit Care. Google Scholar
  7. 7.
    Perel A, Saugel B, Teboul JL et al (2016) The effects of advanced monitoring on hemodynamic management in critically ill patients: a pre and post questionnaire study. J Clin Monit Comput 30:511–518. CrossRefGoogle Scholar
  8. 8.
    Duan J, Cong LH, Wang H, Zhang Y, Wu XJ, Li G (2014) Clinical evaluation compared to the pulse indicator continuous cardiac output system in the hemodynamic assessment of critically ill patients. Am J Emerg Med 32:629–633. CrossRefGoogle Scholar
  9. 9.
    Nowak RM, Sen A, Garcia AJ, Wilkie H, Yang JJ, Nowak MR, Moyer ML (2012) The inability of emergency physicians to adequately clinically estimate the underlying hemodynamic profiles of acutely ill patients. Am J Emerg Med 30:954–960. CrossRefGoogle Scholar
  10. 10.
    Iregui MG, Prentice D, Sherman G, Schallom L, Sona C, Kollef MH (2003) Physicians’ estimates of cardiac index and intravascular volume based on clinical assessment versus transesophageal Doppler measurements obtained by critical care nurses. Am J Crit Care 12:336–342Google Scholar
  11. 11.
    Veale WN Jr, Morgan JH, Beatty JS, Sheppard SW, Dalton ML, Van de Water JM (2005) Hemodynamic and pulmonary fluid status in the trauma patient: are we slipping? Am Surg 71:621–626Google Scholar
  12. 12.
    Connors AF Jr, Dawson NV, McCaffree R, Gray BA, Siciliano CJ (1987) Assessing hemodynamic status in critically ill patients: do physicians use clinical information optimally? J Crit Care 2:174–180CrossRefGoogle Scholar
  13. 13.
    Staudinger T, Locker GJ, Laczika K et al (1998) Diagnostic validity of pulmonary artery catheterization for residents at an intensive care unit. J Trauma 44:902–906CrossRefGoogle Scholar
  14. 14.
    Mimoz O, Rauss A, Rekik N, Brun-Buisson C, Lemaire F, Brochard L (1994) Pulmonary artery catheterization in critically ill patients: a prospective analysis of outcome changes associated with catheter-prompted changes in therapy. Crit Care Med 22:573–579CrossRefGoogle Scholar
  15. 15.
    Steingrub JS, Celoria G, Vickers-Lahti M, Teres D, Bria W (1991) Therapeutic impact of pulmonary artery catheterization in a medical/surgical ICU. Chest 99:1451–1455CrossRefGoogle Scholar
  16. 16.
    Hiemstra B, Eck RJ, Koster G et al (2017) Clinical examination, critical care ultrasonography and outcomes in the critically ill: cohort profile of the simple intensive care studies-I. BMJ Open. Google Scholar
  17. 17.
    Hiemstra B, Nolte IM, Thio CH et al. (2018) Detailed statistical analysis plan of the simple intensive care studies-I (SICS-I). NCT02912624. Accessed 3 Apr 2018
  18. 18.
    Schriger DL, Baraff L (1988) Defining normal capillary refill: variation with age, sex, and temperature. Ann Emerg Med 17:932CrossRefGoogle Scholar
  19. 19.
    Curley FJ, Smyrnios NA (1990) Routine monitoring of critically ill patients. J Intensive Care Med 5:153–174. CrossRefGoogle Scholar
  20. 20.
    Ait-Oufella H, Lemoinne S, Boelle PY et al (2011) Mottling score predicts survival in septic shock. Intensive Care Med 37:801–807. CrossRefGoogle Scholar
  21. 21.
    Coats AJ (1990) Doppler ultrasonic measurement of cardiac output: reproducibility and validation. Eur Heart J 11(Suppl I):49–61CrossRefGoogle Scholar
  22. 22.
    Rao V, Ivanov J, Weisel RD, Ikonomidis JS, Christakis GT, David TE (1996) Predictors of low cardiac output syndrome after coronary artery bypass. J Thorac Cardiovasc Surg 112:38–51CrossRefGoogle Scholar
  23. 23.
    National Heart L, Wheeler AP, Bernard GR et al (2006) Pulmonary-artery versus central venous catheter to guide treatment of acute lung injury. N Engl J Med 354:2213CrossRefGoogle Scholar
  24. 24.
    Godje O, Hoke K, Goetz AE et al (2002) Reliability of a new algorithm for continuous cardiac output determination by pulse-contour analysis during hemodynamic instability. Crit Care Med 30:52–58CrossRefGoogle Scholar
  25. 25.
    Teboul JL, Saugel B, Cecconi M et al (2016) Less invasive hemodynamic monitoring in critically ill patients. Intensive Care Med 42:1350–1359. CrossRefGoogle Scholar
  26. 26.
    Lang RM, Badano LP, Mor-Avi V et al (2015) Recommendations for cardiac chamber quantification by echocardiography in adults: an update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. Eur Heart J Cardiovasc Imaging 16:233–270. CrossRefGoogle Scholar
  27. 27.
    White IR, Royston P, Wood AM (2011) Multiple imputation using chained equations: issues and guidance for practice. Stat Med 30:377–399. CrossRefGoogle Scholar
  28. 28.
    Bossuyt PM, Reitsma JB, Bruns DE et al (2015) STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. BMJ. Google Scholar
  29. 29.
    Simel DL, Rennie D, Bossuyt PM (2008) The STARD statement for reporting diagnostic accuracy studies: application to the history and physical examination. J Gen Intern Med. Google Scholar
  30. 30.
    Jakobsen JC, Wetterslev J, Winkel P, Lange T, Gluud C (2014) Thresholds for statistical and clinical significance in systematic reviews with meta-analytic methods. BMC Med Res Methodol 14:120. CrossRefGoogle Scholar
  31. 31.
    Joly HR, Weil MH (1969) Temperature of the great toe as an indication of the severity of shock. Circulation 39:131–138CrossRefGoogle Scholar
  32. 32.
    Bailey JM, Levy JH, Kopel MA, Tobia V, Grabenkort WR (1990) Relationship between clinical evaluation of peripheral perfusion and global hemodynamics in adults after cardiac surgery. Crit Care Med 18:1353–1356CrossRefGoogle Scholar
  33. 33.
    Vincent JL, Moraine JJ, van der Linden P (1988) Toe temperature versus transcutaneous oxygen tension monitoring during acute circulatory failure. Intensive Care Med 14:64–68CrossRefGoogle Scholar
  34. 34.
    Schey BM, Williams DY, Bucknall T (2009) Skin temperature as a noninvasive marker of haemodynamic and perfusion status in adult cardiac surgical patients: an observational study. Intensive Crit Care Nurs 25:31–37. CrossRefGoogle Scholar
  35. 35.
    Sasse SA, Chen PA, Mahutte CK (1996) Relationship of changes in cardiac output to changes in heart rate in medical ICU patients. Intensive Care Med 22:409–414CrossRefGoogle Scholar
  36. 36.
    Grissom CK, Morris AH, Lanken PN et al (2009) Association of physical examination with pulmonary artery catheter parameters in acute lung injury. Crit Care Med 37:2720–2726Google Scholar
  37. 37.
    Wetterslev M, Moller-Sorensen H, Johansen RR, Perner A (2016) Systematic review of cardiac output measurements by echocardiography vs. thermodilution: the techniques are not interchangeable. Intensive Care Med 42:1223–1233. CrossRefGoogle Scholar

Copyright information

© The Author(s) 2019

OpenAccessThis article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (, which permits any noncommercial use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Authors and Affiliations

  1. 1.Department of Critical CareUniversity of Groningen, University Medical Center GroningenGroningenThe Netherlands
  2. 2.Department of CardiologyUniversity of Groningen, University Medical Center GroningenGroningenThe Netherlands
  3. 3.Department of EpidemiologyUniversity of Groningen, University Medical Center GroningenGroningenThe Netherlands
  4. 4.Department of AnesthesiologyUniversity of Groningen, University Medical Center GroningenGroningenThe Netherlands
  5. 5.Department of Intensive CareCopenhagen University Hospital, RigshospitaletCopenhagenDenmark
  6. 6.Centre for Research in Intensive CareCopenhagen University Hospital, RigshospitaletCopenhagenDenmark
  7. 7.The Copenhagen Trial UnitCentre for Clinical Intervention ResearchCopenhagenDenmark

Personalised recommendations