Introduction

Carotid atherosclerotic plaque (CAP) is an important cause of carotid artery stenosis and has a high global prevalence. CAP global prevalence was approximately 21.1% in 2020, equivalent to 815.76 million people, and carotid artery stenosis global prevalence was approximately 1.5%, equivalent to 57.79 million people between the ages of 30 and 79 [1]. CAP prevalence between the ages of 30 and 79 was approximately 20.15%, equivalent to 199.83 million people in China [2]. The global burden of CAP is expected to increase as populations age, placing a huge burden on health care. Some guidelines have recommended CAP as a potentially useful predictor of coronary events and stroke [3]. CAP is an independent risk factor for stroke, and 45–50% of ischemic strokes are associated with bilateral CAP [4]. CAP is also detected in up to 80% of ischemic stroke patients [1]. According to a study, every 10% increase in plaque burden leads to a 2.26− fold higher risk of stroke recurrence (95% CI 1.03–4.96) [5]. Additionally, CAP is an effective predictor for coronary event incidence. A study involving 89 papers with 2,783 patients exhibited that CAP outperforms intimal− medial thickness (IMT) in predicting coronary artery disease, with a summary sensitivity of 80% and a summary specificity of 67%, regardless of the diagnostic technique [6]. CAP has become an important global public health concern, increasing the risk of cardiovascular and cerebrovascular disease. CAP increases as the global population ages and is highest among the elderly, significantly increasing the health care burden. However, several studies have discovered that CAP formation can be slowed, stopped, reversed, or even disappear, which has significant implications for improving human health and relieving the medical burden [7].

Currently, carotid endarterectomy (CEA), carotid stent placement (CAS), and optimal drug therapy (OMT) are the primary treatments for CAP and carotid artery stenosis [8]. Although surgical methods may improve stenosis caused by excessive CAP growth, these invasive treatments always carry surgical risks and complications, such as cervical hematoma, craniofacial nerve injury, cardiovascular events, cerebral hyperperfusion syndrome, and infection, and should be reserved for patients with significant syndromes, high stenosis, or vulnerable plaque. Additionally, a study has demonstrated that CEA reduced the risk of bilateral stroke by only 4.1% at five years compared to OMT [9]. Therefore, OMT, as a non− invasive treatment for CAP, is receiving increasing attention [10]. Statin is the central drug in OMT to stabilize and reverse atherosclerotic plaque. A three− dimensional ultrasound study to evaluate CAP has demonstrated regression of 90.25 ± 85.12 mm3 in CAP volume after three months of atorvastatin treatment, compared to a progression of 16.81 ± 74.10 mm3 on placebo (P < 0.0001) [11]. The effect of statin on reversing CAP progression depends on lowering the low− density lipoprotein cholesterol (LDL− C) levels. Expert consensus has recommended long− term intensive statin therapy to reduce LDL− C to 1.8 mmol/L and significantly increase HDL− C, potentially reversing atherosclerotic plaque, but inducing a 12% increased risk of new diabetes, a 5% increased risk of muscle disease and a two—to three− fold increased risk of severe liver damage [12]. An MRI assessment study revealed that statin therapy did not consistently reduce the CAP lipid content. The effect occurred primarily between years one and two, with little further reduction in year three [13]. Long− term intensive statin therapy carries a greater risk, especially for patients who use statins cautiously, such as the elderly, those with low body mass, abnormal liver and kidney function, and those with a history of adverse drug reactions. Therefore, there is an urgent need for complementary and alternative drugs to improve drug regimens of OMT further because the efficacy of statins in reversing CAP is not entirely satisfactory.

Traditional Chinese patent medicines (TCPMs) with reliable pharmaceutical ingredients and manufacturing processes have been widely used to treat chronic diseases as an important part of Traditional Chinese medicine (TCM) in China [14]. In 2018, a meta− analysis of 12 randomized controlled trials (RCT) articles, including 1,052 CAP patients, demonstrated that combined TCM and Western medicine are superior to Western medicine alone for treating CAP regarding clinical efficacy (OR = 3.07 [1.96, 4.81], P < 0.00001), IMT (OR =—0.09 [become an important global public health concern 0.10, − 0.08], P < 0.00001), course score (OR = − 0.96 [− 1.09, − 0.83], P < 0.00001), and plaque area (OR = − 0.20 [− 0.23, − 0.17], P < 0.00001)[15]. Guidelines have recommended that TCPMs combined with conventional Western medicine (CWM) to treat atherosclerotic disease, including coronary arteries, carotid and cerebral arteries [16, 17]. Among them, Tongxinluo capsule (TXL), Xiaoshuang granules/enteric capsule (XS), Naoxintong capsule (NXT), Xuesaitong capsule/soft capsule (XST), Jiangzhiling pill (JZL), Pushen capsule (PS), Shexiang baoxin pill (SXBX), Zhibitai (ZBT), and Dengzhan shengmai capsule (DZSM) were approved by the State Food and Drug Administration of China to treat symptoms of cerebrovascular disease, including dizziness, headache, stroke, aphasia, paralysis and fainting. In the treatment of CPA, TCPMs have the functions of tonifying qi, activating blood, resolving stasis, freeing the collateral vessels, resolving phlegm and resolving turbidity. According to Pharmacopoeia of the people’s Republic of China 2020, Table 1 presents the details of traditional effects of the included TCPMs. A vast number of randomized controlled trials have reported and published TCPMs for treating CAP [18, 19]. However, systematic evaluation of the clinical efficacy of TCPMs for CAP is still unknown, and the comparative effectiveness of different TCPMs is unclear. This study utilizes Bayesian network meta− analysis (NMA) to compare and rank different TCPMs to provide reference and evidence support for the clinical optimization of TCPM selection in CAP treatment.

Table 1 Ingredients and traditional effects of the included TCPMs

Methods

Protocol and registration

This NMA was performed per the Preferred Reporting Items for Systematic Reviews and Meta− Analyses (PRISMA) Extension Statement [20]. This study’s protocol was registered in the international prospective register of systematic reviews (PROSPERO) (CRD42022366012).

Eligibility criteria

Study types

RCTs published in Chinese or English, regardless of blinding, publication status, were included.

Participant types

A patient was diagnosed with CAP, including hypertension, coronary atherosclerotic heart disease, and diabetes, using carotid ultrasound [21]. Age, gender, race, disease course, region, and nationality were unrestricted.

Intervention types

The experiment group was administrated TCPMs, regardless of dosage and treatment duration, combined with CWM per guidelines. Patients in the control group received CWM with or without a placebo (PBO) of TCPM or CWM plus another TCPM. Considering that patients with CAP were complicated with hyperlipidemia, hypertension, diabetes, coronary heart disease, cerebral infarction and other underlying diseases, the CWM was primarily used against antihypertensive, hypoglycemic, hypolipidemic, and anti− platelet aggregation.

Outcome types

The primary outcome was the change in indicators of carotid artery IMT at the end of treatment. The additional outcomes were the change in the carotid maximal plaque area, carotid atherosclerotic plaque Course score, serum levels of lipids, CRP, and adverse events rate (AER) at the end of treatment.

Exclusion criteria

Studies that met the following criteria were excluded: (1) animal experiments, reviews, meta− analyses, retrospective studies, or case reports; (2) research data with serious errors or no access to the full text after seeking help online or contacting the corresponding author via email; (3) repeated publication (the first published article was retained); (4) studies with incomparable baseline data between the two groups; (5) studies with a high or unclear risk of bias in sequence generation according to the Cochrane Collaboration’s risk of bias tool; (6) interventions that were combined with other Chinese herbal medicines or common TCM technology, such as acupuncture, moxibustion, and massage; (7) several cases less than 60.

Search strategy

We searched the following databases from their inception to August 2023. Chinese databases include CNKI, WanFang Data, VIP, and CBM, while English databases include PubMed, Embase, the Cochrane Library, and Web of Science. Additionally, other databases include clinical trial registries (WHO ICTRP, Clinical Trials, and ChiCTR) and Allied and Complementary Medicine Database (AMED). The literature search was constructed around search terms for “Chinese patent medicines”, “carotid atherosclerotic plaque”, and “randomized controlled trial” and adapted for each database as necessary. Additional file 1 provides a detailed and specific search strategy.

Literature screening and data extraction

We screened the retrieved articles during the searches and two authors independently conducted a comprehensively assessment of potentially eligible articles according to the inclusion/exclusion criteria. The following data were extracted: author, year of publication, place of conduct, baseline characteristics (sex, age), sample size, intervention(s), comparison(s), course of treatment, and outcome(s). Any disagreement was resolved by discussion until a consensus was reached or by consulting a third author.

Risk of bias assessment

All authors received advanced training and used the Cochrane Risk of Bias tool for quality assessment [22]. Each article was assessed independently by two authors. In case of disagreement between the two authors, a discussion was conducted or a third author was asked for advice. Seven items were used to assess biases covering six different domains for each included study. The bias domains and items were selection bias (random sequence generation and allocation concealment), performance bias (blinding of participants and personnel), detection bias (blinding of outcome assessment), attrition bias (incomplete outcome data), reporting bias (selective reporting), and other biases (other sources of bias). Each domain was assigned a risk of bias judgment within the included study using the labels 'low risk' of bias, 'high risk' of bias, or 'unclear' risk of bias.

Statistical analysis

We conducted a head− to− head comparisons pairwise meta− analyses between CWM combined with TCPM and CWM using Review Manager 5.3. We conducted an NMA analysis using Stata17.0 software and the GeMTC package of R software, applying the Markov Chain Monte Carlo algorithm and a Bayesian hierarchical random− effects model [23]. The results were presented as odds ratios (ORs) with 95% confidence intervals (CIs) for dichotomous variables, and the standardized mean differences (SMDs) with 95% CIs for continuous variables. If the range of 95% CIs of ORs did not cross 1 and 95% CIs of SMDs did not cross 0, then the differences between the groups would be considered statistically significant. The model was used four chains and 50,000 iterations, with the initial 20,000 iterations discarded as the starting point for annealing to eliminate the influence of initial value [24]. Using the surface under the cumulative ranking curve (SUCRA), we sorted the probabilities of different interventions of each outcome [25]. We used the node− splitting analysis to separate mixed evidence into direct and indirect evidence, to evaluate the consistency of the model. We also conducted the multi− dimensional efficacy analysis integrate multiple outcomes, and obtain the optimal intervention. Furthermore, we used a comparison− adjusted funnel plot to detect the publication bias of included RCTs [26]. The interventions were stratified according to the certainty of evidence supporting their relative efficacy which was graded using the GRADE NMA rating system.

Results

Literature screening

Initially, the search strategy yielded 2,159 articles. Duplication resulted in the removal of 1,308 articles. The remaining 851 articles were filtered further and excluded according to the eligibility and exclusion criteria. After rereading the full texts, 27 studies remained for quantitative synthesis [27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53]. Figure 1 presents the details of the literature screening process.

Fig. 1
figure 1

Flowchart of the literature screening process

Study characteristics

There were 25 Chinese articles and two English articles involving 11 interventions. All the articles were conducted in China. Overall, 4,131 patients (2,069 in the experimental control group and 2,062 in the control groups). Nine kinds of CPMs were enrolled: Tongxinluo capsule (TXL), Xiaoshuang granules/enteric capsule (XS), Naoxintong capsule (NXT), Xuesaitong capsule/soft capsule (XST), Jiangzhiling pill (JZL), Pushen capsule (PS), Shexiang baoxin pill (SXBX), Zhibitai (ZBT), and Dengzhan shengmai capsule (DZSM). Table 1 presents the details of ingredients of the included TCPMs. Plant names have been checked with www.theplantlist.org.

Most articles were open− label trials except for two double− blind trials. Both groups were based on CWM, with TCPM addition in the treatment group and PBO addition or blank to the control group, including CWM + TXL vs. CWM + PBO (n = 1), CWM + TXL vs. CWM (n = 6), CWM + XS vs. CWM (n = 2), CWM + NXT vs. CWM (n = 3), CWM + XST vs. CWM (n = 2), CWM + JZL vs. CWM (n = 2), CWM + PS vs. CWM (n = 3), CWM + SXBX vs. CWM (n = 3), CWM + ZBT vs. CWM (n = 3), and CWM + DZSM vs. CWM (n = 2). There were no significant differences in gender and age between the study groups with comparable baselines, and most were middle− aged or elderly. Table 2 presents the details of the included study characteristics.

Table 2 Characteristics of the studies included in this network meta− analysis

Risk of bias assessment

All the included trials reported ‘randomly allocating’ participants, generating random sequences using random number tables or computer− based or lottery methods, so they were evaluated as "low risk." Two trials reported allocation concealment, evaluated as "low risk," and the other studies did not mention allocation concealment and were evaluated as "uncertain risk." One trial reported double− blind trials were evaluated as "low risk," and the other studies did not mention blinding was evaluated as "high risk" or "uncertain risk". All trials had complete data, no selective reporting or other risk bias, and were all evaluated as "low risk." Fig. 2A depicts the risk bias assessment results. Figure 2B provides the detailed and specific risk of bias assessment.

Fig. 2
figure 2

Risk of bias graph of the included RCT A: the risk of bias graph; B: the risk of bias summary

Outcomes

Pairwise meta-analysis

We conducted eight pairwise meta− analyses comparing the effects of CWM and CWM combined with TCPM on improving the IMT, the carotid maximal plaque area, the carotid atherosclerotic plaque Course score, blood lipids, and CRP (Fig. 3). We assessed the certainty of the evidence for each outcome under the GRADE framework. The quality of the evidence for all of these comparisons was rated as low. The detailed GRADE assessment was presented in Table 3.

Fig. 3
figure 3figure 3figure 3figure 3

Forest plot of Pairwise meta-analysis. A: IMT; B: carotid maximal plaque area; C: carotid atherosclerotic plaque course score; D: TC; E: TG; F: LDL; G: HDL; H: CRP; IMT carotid artery intimal- medial thickness, TC total cholesterol, TG Triglyceride, LDL low density lipoprotein, HDL high density lipoprotein, CRP C− reactive protein, AER adverse events rate

Table 3 GRADE assessment

Compared to CWM, CWM combined with TCPM had a stronger effect in reducing the IMT [26 RCTs; SMD − 1.26 (95% CI − 1.59, − 0.93); p < 0.00001; I2 = 94%; low− quality of evidence] (Fig. 3A), decreasing the carotid maximal plaque area [15 RCTs; SMD − 1.27 (95% CI − 1.71, − 0.82); p < 0.00001; I2 = 94%; low− quality of evidence] (Fig. 3B), lowering the carotid atherosclerotic plaque Course score [8 RCTs; SMD − 0.72 (95% CI − 1.20, − 0.25); p < 0.00001; I2 = 91%; low− quality of evidence] (Fig. 3C), lowering the TC [20 RCTs; SMD − 1.26 (95% CI − 1.66, − 0.86); p < 0.00001; I2 = 95%; low− quality of evidence] (Fig. 3D), lowering the TG [20 RCTs; SMD 1.17 (95% CI − 1.53, − 0.81); p < 0.00001; I2 = 94%; low− quality of evidence] (Fig. 3E), lowering the LDL [20 RCTs; SMD − 1.20 (95% CI − 1.55, − 0.85); p < 0.00001; I2 = 93%; low− quality of evidence] (Fig. 3F), raising the HDL [18 RCTs; SMD 0.80 (95% CI 0.38, 1.22); p < 0.00001; I2 = 95%; low− quality of evidence] (Fig. 3G), and lowering the CRP [10 RCTs; SMD − 0.87 (95% CI − 1.11, − 0.64); p = 0.002; I2 = 66%; low− quality of evidence] (Fig. 3H). Substantial heterogeneity was observed in all results.

We conducted sensitivity analysis comparing pooled results from “ < 6 months of course” and “ ≥ 6 months of course” is illustrated in Fig. 3. There was no significant subgroup difference between the two groups, implying that the difference in length of course did not influence the pooled results on improving the IMT, the carotid maximal plaque area, the carotid atherosclerotic plaque Course score, blood lipids, and CRP.

Network meta− analysis

IMT

A total of 27 RCTs referred to the IMT of nine types of TCPMs and 11 types of interventions, including CWM + TXL vs. CWM + PBO (n = 1), CWM + TXL vs. CWM (n = 6), CWM + XS vs. CWM (n = 2), CWM + NXT vs. CWM (n = 3), CWM + XST vs. CWM (n = 2), CWM + JZL vs. CWM (n = 2), CWM + PS vs. CWM (n = 3), CWM + SXBX vs. CWM (n = 3), CWM + ZBT vs. CWM (n = 3), and CWM + DZSM vs. CWM (n = 2) (Table 2). Figure 4A presents the network evidence plot.

Fig. 4
figure 4

Network diagrams for different outcomes. A: IMT; B: carotid maximal plaque area; C: carotid atherosclerotic plaque course score; D: TC; E: TG; F: LDL; G: HDL; H: CRP; I: AER; CWM conventional western medicine, PBO placebo, TXL Tongxinluo capsule, XS Xiaoshuang granules/enteric capsule, NXT Naoxintong capsule, XST Xuesaitong capsule/soft capsule, JZL Jiangzhiling pill, PS Pushen capsule, SXBX Shexiang baoxin pill, ZBT Zhibitai, DZSM Dengzhan shengmai capsule, IMT carotid artery intimal- medial thickness, TC total cholesterol, TG Triglyceride, LDL low density lipoprotein, HDL high density lipoprotein, CRP C-reactive protein, AER adverse events rate. The width of the lines represents the proportion of the number of trials for each comparison with the total number of trials, and the size of the nodes represents the proportion of the number of randomized patients (sample sizes)

Compared to CWM, except for CWM + NXT [MD − 0.18 (95% CI − 0.39, 0.03)], CWM + XST [MD − 0.18 (95% CI − 0.43, 0.08)], CWM + PS [MD − 0.17 (95% CI: − 0.39, 0.04)] and CWM + DZSM [MD − 0.09 (95% CI − 0.34, 0.17)], other five TCPMs demonstrated a statistically significant effect in reducing the IMT. Accordingly, other interventions had no statistically significant difference. The details were shown in Table 4.

Table 4 Pairwise league table of IMT (lower− left quadrant) and carotid maximal plaque area (upper− right quadrant)

According to the SUCRA probability results (Fig. 5A), CWM + JZL was likely the best intervention for reducing the IMT. Table 5 illustrates the detailed SUCRA and ranking probability. The interventions were ranked as follows: CWM + JZL (70.6%) > CWM + SXBX (70.5%) > CWM + XS (68.6%) > CWM + TXL (57.8%) > CWM + ZBT (56.5%) > CWM + PBO (51.7%) > CWM + XST (48.0%) > CWM + NXT (46.8%) > CWM + PS (46.8%) > CWM + DZSM (27.2%) >  > CWM (5.4%).

Fig. 5
figure 5

Surface under the cumulative ranking curve (SUCRA) plots for different outcomes. The vertical axis represents cumulative probabilities and the horizontal axis represents rank. A: IMT; B: carotid maximal plaque area; C: carotid atherosclerotic plaque course score; D: TC; E: TG; F: LDL; G: HDL; H: CRP; I: AER; CWM conventional western medicine, PBO placebo; TXL Tongxinluo capsule, XS Xiaoshuang granules/enteric capsule, NXT Naoxintong capsule, XST Xuesaitong capsule/soft capsule, JZL Jiangzhiling pill, PS Pushen capsule, SXBX Shexiang baoxin pill, ZBT Zhibitai, DZSM Dengzhan shengmai capsule, IMT carotid artery intimal-medial thickness, TC total cholesterol, TG Triglyceride, LDL low density lipoprotein, HDL high density lipoprotein, CRP C− reactive protein

Table 5 Pairwise league table of TC (lower− left quadrant) and carotid atherosclerotic plaque course score (upper− right quadrant)

Carotid maximal plaque area

A total of 16 RCTs referred to the carotid maximal plaque area of eight types of TCPMs and 10 types of interventions, including CWM + TXL vs. CWM + PBO (n = 1), CWM + TXL vs. CWM (n = 4), CWM + NXT vs. CWM (n = 1), CWM + XST vs. CWM (n = 1), CWM + JZL vs. CWM (n = 2), CWM + PS vs. CWM (n = 2), CWM + SXBX vs. CWM (n = 2), CWM + ZBT vs. CWM (n = 2), and CWM + DZSM vs. CWM (n = 1) (Table 2). Figure 4B presents the network evidence plot. All interventions had no statistically significant difference. The details were shown in Table 4.

According to the SUCRA probability results (Fig. 5B), CWM + SXBX was the most likely the best intervention for reducing the carotid maximal plaque area. Table 8 presents the detailed SUCRA and ranking probability. The ranking of interventions was as follows: CWM + SXBX (83.0%) > CWM + JZL (82.7%) > CWM + XST (53.1%) > CWM + ZBT (52.0%) > CWM + TXL (48.4%) > CWM + NXT (45.3%) > CWM + DZSM (44.7%) > CWM + PS (35.0%) > CWM + PBO (31.1%) > CWM (24.8%).

Carotid atherosclerotic plaque course score

Eight RCTs referred to the carotid atherosclerotic plaque Course score of six types of TCPMs and seven types of interventions, including CWM + TXL vs. CWM (n = 2), CWM + XST vs. CWM (n = 1), CWM + PS vs. CWM (n = 1), CWM + SXBX vs. CWM (n = 1), CWM + ZBT vs. CWM (n = 2), and CWM + DZSM vs. CWM (n = 1). (Table 2). Figure 4C presents the network evidence plot. All interventions had no statistically significant differences. The details were shown in Table 5.

According to the SUCRA probability results (Fig. 5C), CWM + XSBX was the most likely the best intervention for lowering the carotid atherosclerotic plaque Course score. Table 8 depicts the detailed SUCRA and ranking probability. The interventions were ranked as follows: CWM + SXBX (92.5%) > CWM + TXL (85.9%) > CWM + ZBT (61.0%) > CWM + PS (55.0%) > CWM (23.2%) > CWM + XST (22.7%) > CWM + DZSM (9.7%).

TC

A total of 21 RCTs referred to the TC of nine types of TCPMs and 11 types of interventions, including CWM + TXL vs. CWM + PBO (n = 1), CWM + TXL vs. CWM (n = 4), CWM + XS vs. CWM (n = 1), CWM + NXT vs. CWM (n = 1), CWM + XST vs. CWM (n = 1), CWM + JZL vs. CWM (n = 2), CWM + PS vs. CWM (n = 3), CWM + SXBX vs. CWM (n = 3), CWM + ZBT vs. CWM (n = 3), and CWM + DZSM vs. CWM (n = 2). (Table 2). Figure 4D presents the network evidence plot.

CWM + TXL [MD − 0.58 (95% CI − 1.14, − 0.03)], CWM + SXBX [MD − 1.33 (95% CI − 1.95, − 0.70)], and CWM + ZBT [MD − 0.69 (95% CI − 1.32, − 0.07)] had a statistically significant effect on lowering TC compared to CWM. CWM + SXBX [MD − 1.30 (95% CI − 2.57, − 0.03)] had a statistically significant effect on lowering TC compared to CWM + XST. Accordingly, other interventions had no statistically significant differences. The details were shown in Table 5.

According to the SUCRA probability results (Fig. 5D), CWM + XSBX was the most likely the best intervention for lowering TC. Table 8 indicates the detailed SUCRA and ranking probability. The 11 types of interventions were ranked as follows: CWM + SXBX (95.6%) > CWM + XS (73.6%) > CWM + ZBT (63.8%) > CWM + JZL (57.1%) > CWM + TXL (57.0%) > CWM + PS (56.3%) > CWM + PBO (46.9%) > CWM + NXT (37.9%) > CWM + DZSM (24.6%) > CWM + XST (23.2%) > CWM (14.0%).

TG

A total of 21 RCTs referred to the TG of nine types of TCPMs and 11 types of interventions, including CWM + TXL vs. CWM + PBO (n = 1), CWM + TXL vs. CWM (n = 4), CWM + XS vs. CWM (n = 1), CWM + NXT vs. CWM (n = 1), CWM + XST vs. CWM (n = 1), CWM + JZL vs. CWM (n = 2), CWM + PS vs. CWM (n = 3), CWM + SXBX vs. CWM (n = 3), CWM + ZBT vs. CWM (n = 3), and CWM + DZSM vs. CWM (n = 2) (Table 2). Figure 4E presents the network evidence plot.

CWM + NXT [MD − 0.76 (95% CI − 1.35, − 0.17)], CWM + JZL [MD − 0.52 (95% CI − 0.94, − 0.10)] and CWM + SXBX [MD − 0.59 (95% CI − 0.95, − 0.23)] had a statistically significant effect on lowering TG compared to CWM. Consequently, other interventions had no statistically significant differences. The details were shown in Table 6.

Table 6 Pairwise league table of LDL (lower− left quadrant) and TG (upper− right quadrant)

According to the SUCRA probability results (Fig. 5E), CWM + NXT was the most likely the best intervention for lowering the TG. Table 8 presents the detailed SUCRA and ranking probability. The interventions were ranked as follows: CWM + NXT (90.1%) > CWM + SXBX (81.1%) > CWM + JZL (72.7%) > CWM + XS (66.1%) > CWM + PS (52.5%) > CWM + TXL (47.0%) > CWM + PBO (44.7%) > CWM + ZBT (41.6%) > CWM + DZSM (22.2%) > CWM + XST (21.9%) > CWM (10.0%).

LDL

A total of 21 RCTs referred to the LDL of nine types of TCPMs and 11 types of interventions, including CWM + TXL vs. CWM + PBO (n = 1), CWM + TXL vs. CWM (n = 4), CWM + XS vs. CWM (n = 1), CWM + NXT vs. CWM (n = 1), CWM + XST vs. CWM (n = 1), CWM + JZL vs. CWM (n = 2), CWM + PS vs. CWM (n = 3), CWM + SXBX vs. CWM (n = 3), CWM + ZBT vs. CWM (n = 3), and CWM + DZSM vs. CWM (n = 2). (Table 2). Figure 4F presents the network evidence plot.

CWM + TXL [MD − 0.43 (95% CI − 0.84, − 0.02)], CWM + JZL [MD − 0.63 (95% CI − 1.22, − 0.05)], CWM + SXBX [MD − 0.96 (95% CI − 1.44, − 0.48)], and CWM + ZBT [MD − 0.56 (95% CI − 1.04, − 0.09)] has a statistically significant effect on lowering LDL compared to CWM. CWM + SXBX [MD − 0.86 (95% CI − 1.60, − 0.11)] had a statistically significant effect on lowering LDL compared to CWM + DZSM. Therefore, other interventions had no statistically significant difference. The details were shown in Table 6.

According to the SUCRA probability results (Fig. 5F), CWM + SXBX was the most likely the best intervention for lowering the LDL. Table 8 depicts the detailed SUCRA and ranking probability. The interventions were ranked as follows: CWM + SXBX (92.6%) > CWM + XS (76.9%) > CWM + JZL (69.9%) > CWM + ZBT (64.4%) > CWM + TXL (53.5%) > CWM + PS (49.1%) > CWM + PBO (47.0%) > CWM + NXT (35.9%) > CWM + XST (24.9%) > CWM + DZSM (23.5%) > CWM (12.3%).

HDL

A total of 19 RCTs referred to the HDL of eight types of TCPMs and 10 types of interventions, including CWM + TXL vs. CWM + PBO (n = 1), CWM + TXL vs. CWM (n = 4), CWM + XS vs. CWM (n = 1), CWM + NXT vs. CWM (n = 1), CWM + JZL vs. CWM (n = 2), CWM + PS vs. CWM (n = 3), CWM + SXBX vs. CWM (n = 2), CWM + ZBT vs. CWM (n = 3), and CWM + DZSM vs. CWM (n = 2). (Table 2). Figure 4G presents the network evidence plot.

CWM + TXL [MD 0.34 (95% CI: 0.05, 0.64)] had a statistically significant effect on raising HDL compared to CWM. Thus, no statistically significant difference existed between the other interventions. The details were shown in Table 7.

Table 7 Pairwise league table of HDL (lower-left quadrant) and CRP (upper-right quadrant)

According to the SUCRA probability results (Fig. 5G), CWM + XS was the most likely the best intervention for improving HDL. Table 8 illustrates the detailed SUCRA and ranking probability. The interventions were ranked as follows: CWM + XS (86.1%) > CWM + JZL (72.9%) > CWM + TXL (72.9%) > CWM + PBO (62.4%) > CWM + PS (45.6%) > CWM + NXT (45.2%) > CWM + DZSM (43.1%) > CWM + ZBT (28.6%) > CWM + SXBX (26.8%) > CWM (16.4%).

Table 8 Surface under the cumulative ranking curve and ranking probability of different Chinese patent medicines on each outcome

CRP

A total of 11 RCTs referred to the CRP of five types of TCPMs and seven types of interventions, including CWM + TXL vs. CWM + PBO (n = 1), CWM + TXL vs. CWM (n = 5), CWM + NXT vs. CWM (n = 2), CWM + PS vs. CWM (n = 2), CWM + SXBX vs. CWM (n = 1), and CWM + ZBT vs. CWM (n = 1). (Table 2). Figure 4H presents the network evidence plot. All interventions had no statistically significant difference. The details were shown in Table 7.

According to the SUCRA probability results (Fig. 5H), CWM + ZBT was the most likely the best intervention for lowering the CRP. Table 8 presents the detailed SUCRA and ranking probability. The interventions were ranked as follows: CWM + ZBT (71.3%) > CWM + PS (67.0%) > CWM + NXT (64.9%) > CWM + TXL (52.3%) > CWM + SXBX (45.7%) > CWM + PBO (42.8%) > CWM (6.0%).

Safety

A total of 18 RCTs reported the number of the AER of eight types of TCPMs and 10 types of interventions, including CWM + TXL vs. CWM + PBO (n = 1), CWM + TXL vs. CWM (n = 5), CWM + XS vs. CWM (n = 1), CWM + XST vs. CWM (n = 1), CWM + JZL vs. CWM (n = 2), CWM + PS vs. CWM (n = 2), CWM + SXBX vs. CWM (n = 2), CWM + ZBT vs. CWM (n = 2), and CWM + DZSM vs. CWM (n = 2) (Table 2). Figure 4I presents the network evidence plot.

Four studies reported no adverse reactions in the experimental and control groups, while the remaining 14 studies reported 204 cases of adverse reactions. Adverse events included gastrointestinal reactions, such as nausea, discomfort, indigestion, abdominal distension, pain, and diarrhea. Autonomic nervous dysfunction symptoms had dizziness, headache, rash, myalgia, mild hepatic or renal insufficiency, bleeding, and delayed PT. However, most resolved spontaneously without special treatment. The detailed list of adverse reactions was shown in Table 9.

Table 9 Occurrence of adverse reactions

Inconsistency test

No closed loops were found in the NMA due to the lack of direct comparison of TCPMs. The inconsistency test could not be carried out. Hence, the results were analyzed using a consistency model.

Publication bias

IMT is the leading indicator for publishing the results of the evaluation applications. The comparison− adjusted funnel plots were plotted to test the publication bias of IMT. When the points in the funnel chart are symmetrical based on the position of the centerline, presenting that there is no publication bias. Figure 6 depicts that the points in the funnel chart are asymmetrical along the center line, indicating the potential presence of publication bias favoring CWM + TCPMs in reducing IMT, as compared to CWM and CWM + PBO.

Fig. 6
figure 6

Funnel plot of IMT. CWM conventional western medicine, PBO placebo, TXL Tongxinluo capsule, XS Xiaoshuang granules/enteric capsule, NXT Naoxintong capsule, XST Xuesaitong capsule/soft capsule, JZL Jiangzhiling pill, PS Pushen capsule, SXBX Shexiang baoxin pill, ZBT Zhibitai, Dengzhan shengmai capsule

Discussion

OMT, a pharmacotherapy regimen based on statins, is an important non− invasive treatment for CAP. The clinical efficacy of OMT can be improved by adding complementary and alternative medicines [54]. In our study, this NMA was based on 27 RCT trials with 4131 patients with CAP. We compared the efficacy and safety of nine kinds of TCPMs, including JZL, SXBX, TXL, ZBT, XS, XST, NXT, PS, and DZSM, combined with CWM with or without placebo of TCPM for improving IMT, carotid maximal plaque area, carotid atherosclerotic plaque Course score, serum lipid levels, and CRP. Pairwise meta− analyses demonstrated that CWM + TCPM was superior to CWM in the treatment of CAP. This study revealed that CWM + JZL was the most likely the best intervention for reducing IMT, and CWM + SXBX exhibited the highest effective intervention for reducing carotid maximal plaque area, and atherosclerotic plaque Course score. Lipids and inflammatory factors contribute to an increase in CAP volume and vulnerability [55]. The guideline has recommended that LDL− C and CRP are independent risk factors for atherosclerosis and play important roles in the primary and secondary prevention of atherosclerosis [56]. Our study suggested that CWM + XSBX was superior to other TCPMs in decreasing the TC and LDL levels. CWM + NXT and CWM + XS were superior to other TCPMs in reducing TG and increasing HDL, respectively. ​CWM + ZBT was the most likely the best intervention for lowering the CRP. Together, these results implied that CWM + TCPM may be a more effective intervention for patients with CAP than using CWM alone. Of the TCPMs included, SXBX was among the most effective in reducing carotid maxima, atherosclerotic plaque score, TC and LDL levels, and had a more comprehensive advantage. However, the efficacy of XSBX also needs to be evaluated through high− quality, large, double− blind, randomized controlled trials. XSBX still needs to be used with caution. No serious adverse events were reported in the CWM + TCPM and CWM groups. However, adverse events were poorly reported (18/27) in the included studies, and the safety of TCPMs needs further investigation.

Numerous pharmacological studies have also found that TCPMs could improve CAP through multiple targets and signaling pathways. JZL, which traditionally removes dampness and dissolves phlegm, was the best intervention for reducing IMT in this study. Crataegus pinnatifida Bunge, the essential herb of JZL, has anti− atherosclerotic effects by lowering blood lipids, inhibiting oxidative and inflammation, and protecting vascular endothelium [57]. According to TCM theory, XSBX has the traditional functions of resuscitation with aromatics, modifying Qi, and activating circulation. XSBX was the optimal drug for reducing the carotid maximal plaque area compared to the other eight CPMs. A pharmacological study also demonstrated that XSBX could markedly decrease atherosclerotic plaque size by inhibiting the arterial wall's inflammation response and lipid accumulation [58]. XSBX reduced the inflammation pathways by increasing Mfn2 and decreasing the phosphorylation of p38, JNK, and NF− κB levels. XSBX inhibited lipid influx by reducing SR− A and LOX− 1 and increased lipid efflux by promoting LXRα, ABCA1, and ABCG1. Additionally, XSBX could activate macrophages to improve endothelial cell proliferation, migration, and tubule formation and regulate PI3K/Akt and MAPK/Erk1/2 signaling pathways, thereby promoting angiogenesis [59]. Plaque thickness is the principal predictor of carotid stenosis risk. TXL, which traditionally promotes circulation to remove meridional obstructions, was optimal for treating carotid atherosclerotic plaque Course score in nine TCPMs. A study discovered that TXL could inhibit arterial intimal proliferation by reducing the LOX− 1 and improving blood lipids [60]. Moreover, several studies have exposed that TXL could improve plaque stability by inhibiting ROS expression and increasing the relative abundance of Alistipes in the gut microbiome [61].

This NMA study had several strengths. First, this study was the first to evaluate the comparative efficacy and safety of TCPMs for CAP and to guide optimal medication in a clinical setting. Second, this study set strict inclusion criteria and excluded RCTs with incorrect randomization methods, ensuring methodological quality. Finally, the ranking of TCPMs contributed to the formulation of clinical medication plans.

However, this study still has some limitations. First, the overall quality of the studies included was limited because most studies did not report the allocation concealment and blinding in detail. Additionally, clinical heterogeneity may have occurred due to the diversity of CWM and the various TCPMs dosage and duration, and these results should be interpreted with caution. Finally, assuming that the studies included were mainly conducted among Chinese populations, the external adaptability of the results would be restricted when applied for reference in populations of different countries and regions.

Conclusions

This study aims to evaluate the efficacy of TCPMs in treating CAP based on the characteristics of carotid plaque, blood lipids, inflammatory markers, and adverse reactions to guide the clinical medication of CAP more accurately. CWM + JZL was the most effective in reducing IMT. CWM + SXBX was the most effective in reducing carotid maximal plaque area, and atherosclerotic plaque Course score. CWM + XSBX also significantly reduced TC and LDL levels and outperformed other CPMs. CWM + XSBX may be considered an effective intervention for the treatment of CAP. However, further direct comparisons are warranted. This study provides a more accurate selection of TCPMs in CAP therapy, which may help improve drug regimens of OMT by supplementing complementary and alternative drugs. More adequately powered, well− designed clinical trials to increase the quality of the available evidence are still needed in the future due to several limitations.