Background

Vancomycin (VCM) is a broad-spectrum antibiotic that acts against Gram-positive bacteria, including methicillin-resistant Staphylococcus aureus (MRSA), and is used for the treatment of several infections [1, 2]. However, its use requires therapeutic drug monitoring (TDM) to ensure its therapeutic effectiveness and avoid nephrotoxicity.

A recent meta-analysis revealed that compared to low area under the curve/minimum inhibitor concentration ratios (AUC/MIC), high AUC/MIC ratios were associated with significantly lower mortality and treatment failure rates [3]. The practice guidelines for TDM of VCM recommended an AUC/MIC ratio of ≥400 to predict the clinical efficacy of VCM against MRSA (MIC ≤1 μg/mL) [4, 5]. However, Dalton et al. reported that the target AUC/MIC could not be calculated that related to the effectiveness and safety of VCM [6]. Therefore, the target AUC/MIC value, which is an indicator of effectiveness in MRSA infection therapy, is still controversial. On the other hand, in real-world clinical situations, trough concentrations are used as alternate indicators of AUC values, and in practice, target trough concentrations between 10 and 20 μg/mL are recommended to achieve an AUC/MIC ratio of ≥400 at MIC values of 0.5 and 1 μg/mL. Furthermore, in cases of serious infections such as bacteraemia, infective endocarditis, osteomyelitis, meningitis, and hospital-acquired and healthcare-associated pneumonia caused by MRSA, trough concentrations of 15–20 μg/mL are recommended to further improve patient outcomes [5, 7]. Thus, Tongsai et al. performed a meta-analysis to clarify the relationship between trough concentrations and effectiveness. They reported that no significant differences in mortality and treatment success rate between trough concentrations of ≥15 and < 15 μg/mL [8]. However, because AUC values increase as trough concentrations rise, it is unclear why or how this result was reached. Thus, a reanalysis of the relationship between trough concentrations and effectiveness is needed.

One of the adverse events associated with VCM use is acute kidney injury (AKI). Lodise et al. reported incidence rates for AKI of 21% for trough VCM concentrations of 10–15 μg/mL, 20% for 15–20 μg/mL, and 33% for ≥20 μg/mL [9]. Bellos et al. evaluated the risk of AKI at cutoff values of 10, 15, 20, and 25 μg/mL, and reported that the risk of AKI increased as the trough level increased [10]. These results indicate a clear relationship between AKI incidence and increased trough concentrations [9, 10]. A meta-analysis of AKI incidence indicated significantly higher incidence rates for trough concentrations ≥15 μg/mL compared to those for concentrations < 15 μg/mL [8, 10, 11]. In the clinical setting, dosage regimens based on the trough level is still used because it is a conventional method. As we mentioned above, the cutoff value for the effectiveness and safety of VCM is still under discussion, and it is important to clarify the optimal target value.

Recent evidence suggests that VCM-induced AKI correlates better with AUC values than with trough concentrations. For example, rat studies indicated that urine kidney injury molecule 1 (KIM-1) concentration was a useful indicator for the early detection of VCM-induced AKI [12] and that increases in urine KIM-1 concentration exhibited higher correlation coefficients with AUC values than with trough concentrations [13]. In their meta-analysis of clinical research, Aljefri et al. showed a significantly higher AKI incidence with a high AUC compared to that with a low AUC. They also reported that an AUC ≥650 μg × hr./mL is a risk indicator for AKI [14]. Furthermore, their meta-analysis judging the comparative usefulness of AUC-guided and trough-guided monitoring strategies for avoiding AKI showed that AUC-guided monitoring significantly reduced the AKI incidence compared to trough-guided monitoring [14]. However, this meta-analysis included only two papers; therefore, one would be hard-pressed to consider such a finding to be thoroughly demonstrated. Subsequent trials comparing AKI incidence rates associated with different VCM monitoring strategies have been reported [15, 16].

The present study performed a systematic review and meta-analysis to clarify the relationship between VCM trough concentrations or AUC values and its effectiveness and safety. Further, we studied whether trough-guided or AUC value-guided VCM monitoring strategies were more appropriate.

Methods

Search strategies

Search strategy for the evaluation of VCM target trough concentrations

We performed a literature search in the MEDLINE, Web of Science, and Cochrane Register of Controlled Trials electronic databases (August 92,020). Two of the four reviewers (MT, HM, NK, and YM) independently searched for literature using the following search terms: “vancomycin”, “trough”, and “monitoring”. The detailed search strategies are shown in Supplementary Table S1. Screening was conducted and duplicated articles were excluded.

Search strategy for the evaluation of VCM target AUC values

We performed a literature search in the MEDLINE, Web of Science, and Cochrane Register of Controlled Trials electronic databases (August 92,020). Two of the four reviewers (MT, HM, NK, and YM) independently searched for literature using the following search terms: “vancomycin”, “AUC”, or “area under the curve”. The detailed search strategies are shown in Supplementary Table S2. Screening was conducted and duplicated articles were excluded.

Search strategy for the evaluation of different monitoring strategies

We performed a literature search in the MEDLINE, Web of Science, and Cochrane Register of Controlled Trials electronic databases (August 92,020). Two of the four reviewers (MT, HM, NK, and YM) independently searched for literature using the following search terms: “vancomycin” or “monitoring”. The detailed search strategies are shown in Supplementary Table S3. Screening was conducted and duplicated articles were excluded.

Study selection

Study selection for the evaluation of VCM target trough concentrations

A study was considered eligible for the evaluation of the VCM target trough concentrations it met the following criteria: trough levels were determined after the intravenous administration of VCM; more than two ranges of trough level were compared; data on the detailed outcomes regarding the effectiveness (clinical cure, treatment success or failure) or nephrotoxicity were available; and all subjects had MRSA bacteraemia only for analysis of the effectiveness. Studies that met the following exclusion criteria were excluded: questionnaire study, letter, case report, and review articles; non-adult patients or non-human subjects; and detailed results not available in English.

Study selection for the evaluation of the VCM target AUC values

A study was considered eligible for the evaluation of the VCM target trough concentrations it met the following criteria: AUC values were determined after the intravenous administration of VCM; more than two ranges of AUC values were compared; and available data on the detailed outcomes of the effectiveness (clinical response, treatment success or failure, mortality, or bacterial eradication) or nephrotoxicity. All subjects had MRSA bacteraemia only for the analysis of the effectiveness. Studies that met the following exclusion criteria were excluded: questionnaire study, letter, case report, and review articles; non-adult patients or non-human subjects; MICs determined by Etest, and detailed results not available in English.

Study selection for the evaluation of different monitoring strategies

A study was considered eligible for the evaluation of the VCM target trough concentrations it met the following criteria: a comparative study comparing AUC-guided monitoring and trough-guided monitoring of VCM; VCM was intravenously administrated; and availability of detailed outcomes regarding the effectiveness (clinical cure, treatment success or failure) or nephrotoxicity. Furthermore, studies that met the following exclusion criteria were excluded: questionnaire study, letter, case report, and review articles; non-adult patients or non-human subjects; the VCM dose was not adjusted based on AUC or trough; and detailed results not available in English.

Two of the four reviewers (MT, HM, NK, and YM) independently conducted the screening. When opinions differed, the screening results were determined based on discussions involving a third person (ST).

Data extraction

Two of the four reviewers (MT, HM, NK, and YM) independently extracted data from the studies. When opinions differed, they were extracted through discussion with two additional people (ST and SO). The design, country, duration, age of patients, number of patients, target values (AUC and trough), causative bacteria, lesion, and rate of MRSA were extracted. The AUC definition method was also extracted in the evaluation of the AUC values.

Outcomes analysis

Outcome analysis for the evaluation of VCM target trough concentrations

In the analysis of the relationship between trough levels of VCM and its effectiveness and nephrotoxicity, the primary outcomes (effectiveness and nephrotoxicity) were defined according to each study’s definition. Definitions of the nephrotoxicity criteria in each study are indicated in Table S4.

Outcome analysis for the evaluation of the VCM target AUCvalues

Unlike trough levels, the included studies showed considerable variation in the AUC/MIC ratio and AUC value cutoff in the comparison of clinical failure and adverse effects. Considering the differences in methodological and technical measurements, rounding within 15% of the AUC was considered appropriate for the meta-analysis. Therefore, the cut-off value of AUC/MIC ratios of 340–460 was defined as 400, and AUC values of 510–690 were defined as 600. The analysis of the relationship between the AUC values of VCM and its effectiveness and nephrotoxicity, the primary outcomes (effectiveness and nephrotoxicity) were defined as follows: effectiveness was defined as a clinical response, treatment failure, mortality, or bacterial eradication, while nephrotoxicity was defined as according to the 2009 VCM consensus guideline (a serum creatinine (SCr) increase of ≥0.5 mg/dL or ≥ 50% of the baseline SCr for ≥2 consecutive measurements) or AKIN stage 1 (SCr increase of ≥0.3 mg/dL or ≥ 1.5 times the baseline SCr).

Outcome analysis for the evaluation of different monitoring strategies

Our analysis of the differences in monitoring strategies defined effectiveness and safety as the primary outcome measures. Effectiveness was defined as mortality, while nephrotoxicity was defined according to the 2009 VCM consensus guideline or AKIN stage 1, as described above.

Assessment of the risk of bias

Two of the four reviewers (MT, HM, NK, and YM) independently assessed the methodologic quality and risk of bias based on the Cochrane Collaboration (Risk Of Bias In Non-Randomized Studies of Interventions, ROBINS-I) [17]. Disagreements were resolved by discussion with a third person a resolution was reached.

Analysis of the results and statistical analyses

We performed the meta-analysis using Review Manager for Windows (RevMan, Version 5.3, Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2014) and prepared forest plots. We calculated the odds ratios (ORs) and 95% confidence intervals (CIs) using a Mantel–Haenszel random-effects model. Statistical heterogeneity among studies was assessed using I2. I2 values of ≥50%, 25–50%, and ≤ 25% were regarded as strong, moderate, and no heterogeneity, respectively.

Results

Search results

In database searching for VCM target trough concentrations evaluation, we obtained 3293 articles to be screened (Fig. 1a). Of these, 86 articles were further examined in detail, and finally, eight studies [18,19,20,21,22,23,24,25] were included in the meta-analysis for effectiveness evaluation, 16 studies [9, 20, 26,27,28,29,30,31,32,33,34,35,36,37,38,39] were included in the meta-analysis for safety evaluation, and one study was included in both analyses (Kullar 2011).

Fig. 1
figure 1

Flow chart of the selection process for studies. a Studies of trough-guided monitoring strategy associated with effectiveness and safety of VCM treatment. b Studies of AUC-guided monitoring strategy associated with effectiveness and safety of VCM treatment. c Studies of AUC-guided monitoring vs. trough-guided monitoring strategy associated with effectiveness and safety of VCM treatment

In database searching for VCM target AUC values evaluation, we obtained 1029 articles to be screened (Fig. 1b). Of these, 31 articles were further examined in detail, and finally, five studies [22, 23, 40,41,42] included in the meta-analysis for effectiveness evaluation, five studies [15, 43,44,45,46] were included in the meta-analysis for safety evaluation.

In database searching for the different monitoring strategies, we obtained 3156 articles to be screened (Fig. 1c). Of these, six articles were further examined in detail, and finally, four studies [15, 47,48,49] were included in the meta-analysis.

Characteristics

The characteristics of the eight studies on effectiveness and the 16 studies on safety that were included in the meta-analysis of evaluating target trough concentrations are shown in Table 1. Of these, Song 2015, Obara 2016, Shime 2018, and de Almeida 2019 were prospective; the others were retrospective. The trough concentrations were measured at various times, including initial, mean, steady-state, and highest.

Table 1 Characteristics of included studies for target trough evaluation

The characteristics of the five studies on effectiveness and five studies on safety that were included in our meta-analysis evaluating target AUC values are shown in Tables 2 and 3, respectively. Three studies (Song 2015, Meng 2019, and Lodies 2020) were prospective studies; others were retrospective.

Table 2 Characteristics of the included studies for target AUC/MIC based on effectiveness
Table 3 Characteristics of the included studies for target AUC based on nephrotoxicity

The characteristics of the four studies included in our meta-analysis of differences in monitoring strategies are shown in Table 4. The target AUC values were as follow: Finch 2017: 400–600 μg × hr./mL, Neely 2018, Meng 2019: 400–800 μg × hr./mL, and Oda 2020: > 400 μg × hr./mL. Target trough concentrations were as follows: Finch 2017 and Oda 2020, 15–20 μg/mL and Neely 2018 and Meng 2019, 10–20 μg/mL.

Table 4 Characteristics of the included studies for AUC and trough-guided monitoring

Assessment of the risks of bias

The results of the assessment of the risk of bias are presented in Fig. 2. Three studies (Kullar 2011, Ley 2013, and Obara 2016) showed high risks of confounding and selection biases. No problems in intervention bias were identified and few problems were identified regarding missing data and measurement of outcome biases. No information was available for deviation from the intended intervention and reporting biases.

Fig. 2
figure 2

Methodological quality summary for each included study. The studies included in the evaluation of target trough concentration for a effectiveness and b safety. The studies included in the evaluation of c target AUC/MIC for effectiveness and d AUC for safety. e The studies included in the evaluation of effectiveness and safety associated with VCM monitoring strategy

Outcome analysis for the association of VCM target trough concentrations with effectiveness in adult patients

The VCM trough concentrations were divided into two groups, ≥10 μg/mL and < 10 μg/mL or ≥ 15 μg/mL and < 15 μg/mL, and a meta-analysis of treatment failure was performed. Both studies included in Fig. 3a were on MRSA bacteraemia. No significant difference in treatment failure was observed for VCM trough concentrations ≥10 μg/mL vs. < 10 μg/mL (OR 0.75, 95% CI 0.30–1.86, p = 0.53) (Fig.3a). However, trough concentrations ≥15 μg/mL had significantly lower treatment failure rates than those of < 15 μg/mL in patients with MRSA bacteraemia (OR 0.63, 95% CI 0.47–0.85, p = 0.003) (Fig. 3b). We also performed this analysis in patients with MRSA infection, which was not restricted to bacteraemia, and found no significant differences between ≥15 μg/mL and < 15 μg/mL (OR 0.85, 95% CI 0.58–1.25) (Supplementary Fig. S1).

Fig. 3
figure 3

Forest plot of the treatment failure associated with VCM trough concentration. The vertical line indicates no significant difference between the groups compared. Diamond shapes and horizontal lines represent ORs and 95% CIs, respectively. Squares indicate point estimates, and the size of each square indicates the weight of each study included in this meta-analysis. a ≥10 μg/mL vs. < 10 μg/mL. b ≥15 μg/mL vs. < 15 μg/mL

Outcome analysis for the association between VCM target trough concentrations and safety

Trough concentrations were granularly divided into several categories before performing the meta-analysis. As shown in Fig. 4, the AKI incidence rates were significantly higher for (1) trough concentrations of 10–15 μg/mL compared to those < 10 μg/mL (OR 1.73, 95% CI 1.22–2.47, p = 0.002), (2) trough concentrations of 15–20 μg/mL compared to those of 10–15 μg/mL (OR 1.63, 95% CI 1.16–2.27, p = 0.004), (3) trough concentrations > 20 μg/mL compared to those 15–20 μg/mL (OR 2.39, 95% CI 1.78–3.20, p < 0.00001). The AKI incidence rates increased higher as VCM trough concentrations increased, with ORs markedly increasing at concentrations ≥20 μg/mL (Fig. 4c).

Fig. 4
figure 4

Forest plot of the risk of nephrotoxicity associated with VCM trough concentration. The vertical line indicates no significant difference between the groups compared. Diamond shapes and horizontal lines represent ORs and 95% CIs, respectively. Squares indicate point estimates, and the size of each square indicates the weight of each study included in this meta-analysis. a 10–15 μg/mL vs. < 10 μg/mL. b 15–20 μg/mL vs. 10–15 μg/mL. c > 20 μg/mL vs. 15–20 μg/mL

Outcome analysis for the association between VCM target AUC/MIC ratios and AUC values with effectiveness and safety

As analysis conducted using an AUC/MIC cutoff of 400 (400 ± 15%, 392.7–451) as an indicator of effectiveness showed that compared to low AUC/MIC ratios, high AUC/MIC ratios had significantly lower treatment failure rates (OR 0.28, 95% CI 0.18–0.45, p < 0.0001) (Fig. 5a). Based on the results of the analysis conducted using an AUC cut-off of 600 (600 ± 15%, 550–683) as an indicator of safety, the VCM-induced AKI incidence rates were significantly higher for high AUC values than for low AUC values (OR 2.10, 95% CI 1.13–3.89, p = 0.02) (Fig. 5b).

Fig. 5
figure 5

Forest plot of treatment failure and risk of nephrotoxicity associated with VCM AUC/MIC ratio and AUC value. The vertical line indicates no significant difference between the groups compared Diamond shapes and horizontal lines represent ORs and 95% CIs, respectively. Squares indicate point estimates, and the size of each square indicates the weight of each study included in this meta-analysis. a The OR of treatment failure associated with AUC/MIC ratios restricted with 400 ± 15% (392.7–451). b The OR of risk of nephrotoxicity associated with AUC values restricted with 600 ± 15% (550–683)

Outcome analysis of the differences between monitoring strategies

The mortality rates did not differ significantly between AUC-guided monitoring and trough-guided monitoring (OR 0.57, 95% CI 0.06–5.42) (Fig. 6a). While the incidence of AKI associated with VCM tended to be lower for AUC-guided monitoring than for trough-guided monitoring, the difference was not significant (OR 0.54, 95% CI 0.28–1.01, p = 0.05) (Fig. 6b).

Fig. 6
figure 6

Forest plot of the effectiveness and risk of nephrotoxicity associated with VCM monitoring. The vertical line indicates no significant difference between the groups compared Diamond shapes and horizontal lines represent ORs and 95% CIs, respectively. Squares indicate point estimates, and the size of each square indicates the weight of each study included in this meta-analysis. a The OR of mortality associated with different monitoring strategies. b The OR of risk of nephrotoxicity associated with the difference in monitoring strategy

Discussion

We performed a meta-analysis to evaluate the effectiveness and safety of VCM trough concentrations. We observed a significantly lower treatment failure rate among bacteraemia patients with trough concentrations ≥15 μg/mL. However, we observed no significant difference in patients with MRSA infection. This may be because the subject population studied in the latter case including a large number of MRSA pneumonia patients. Even when MRSA is detected in a patient’s sputum, it is often not the causative agent of the infection in question, but rather a colonising species, making the diagnosis of MRSA pneumonia extremely difficult [50,51,52,53]. However, when bacteraemia is concerned, the causative agent can be definitively identified as MRSA through blood culture. We found that trough concentrations of ≥15 mg/L were used for the treatment of MRSA bacteraemia.

We also performed a meta-analysis to explore the relationship between trough concentrations and AKI incidence through granularly defined trough concentration categories. The AKI incidence rates significantly increased as trough concentrations increased. Particularly, when trough concentrations were ≥ 20 μg/mL, the odds ratio of AKI markedly increased. Several reports have explored the relationship between VCM-induced AKI incidence and trough concentrations [8, 10, 33, 54]. AKI incidence rates reportedly increase with trough concentrations ≥15 μg/mL and further increased for trough concentrations ≥20 μg/mL [8, 10, 54]. Thus, we believe that VCM trough concentrations should be kept below 20 μg/mL at all times and minimised wherever possible.

The AUC value is the best indicator of VCM effectiveness and safety. To define the target AUC values for effectiveness, we performed analyses based on an AUC/MIC cutoff value of 400 ± 15%. We observed that high AUC/MIC ratios were significantly superior to low AUC/MIC ratios. Similar to that of effectiveness, we also performed an analysis based on an AUC cutoff values of 600 ± 15% to define the target AUC values for safety. We observed that high AUC values significantly increased the AKI incidence rates. Consistent with our results and previous reports [4, 55], the recommended target AUC value threshold for avoiding VCM-induced AKI is approximately 600 μg × h/mL. While, trough concentrations are used primarily as alternate indicators of AUC values, recent reports suggest that the measurement of trough concentrations alone is not sufficient for the proper evaluation of AUC values [56,57,58,59]. Neely et al. showed that a correlation coefficient (r2) of 0.94 between AUC values calculated with VCM concentrations measured from blood collected at five or six points and AUC values calculated using peak and trough concentrations. The correlation coefficient (r2) between the former AUC values and those calculated using only trough concentrations was 0.70. Other reports also indicate that at least two points of measurement of peak and trough concentrations are needed to accurately calculate AUC levels. The present study incorporated two new reports to those used by Aljefri et al. in their analysis [14] and carried out a meta-analysis of the relationship between the incidence of kidney injury and AUC-guided vs. trough-guided monitoring. We found that AUC-guided monitoring was associated with lower incidence rates of kidney injury. However, the mortality rates did not differ significantly between AUC-guided monitoring and trough-guided monitoring. The target AUC values and trough concentrations in each study incorporated into this meta-analysis differed. Dalton et al. concluded that it was difficult to calculate the optimal target AUC/MIC as the AUC estimation method and study background varied among the studies [6]. In the future, a comparative trial of AUC-guided vs. trough-guided monitoring with appropriately defined target AUC values and trough concentrations is needed to determine if AUC-guided monitoring lowers the risk of mortality and AKI.

This study has subject to several limitations. First, most of the reports incorporated in our analyses were observational studies. The design of these studies may result in allocation bias, selection bias, and various types of other confounding factors in our results. Further, publication bias, in particular, is quite likely; that is, the idea that papers that demonstrate an effect of monitoring strategy differences on the primary outcome (AKI incidence) are preferentially selected and published. Second, the trials included in this study used several different definitions of AKI. Third, the detailed MICs of VCM were not available in the analysis of the effectiveness of VCM target trough concentrations. Therefore, we could not perform a subgroup analysis by MIC. Fourth, the methods used for the calculation of AUC values varied considerably among papers. Thus, to address these issues, future research efforts should involve large-scale prospective randomised clinical trials, which will enable further high-quality meta-analyses.

Conclusion

This systematic review and meta-analysis identified trough concentrations and AUC values of VCM associated with its effectiveness and safety. Furthermore, compared to trough-guided monitoring, AUC-guided monitoring showed higher potential to reduce the incidence of VCM-induced AKI. Further high-quality trials exploring monitoring strategies for VCM use and the safety and effectiveness of VCM are needed to expand the research horizons in this area.