Chinese Journal of Integrative Medicine

, Volume 23, Issue 11, pp 871–877 | Cite as

Methological quality of systematic reviews and meta-analyses on acupuncture for stroke: A review of review

  • Xin-lin Chen
  • Chuan-wei Mo
  • Li-ya Lu
  • Ri-yang Gao
  • Qian Xu
  • Min-feng Wu
  • Qian-yi Zhou
  • Yue Hu
  • Xuan Zhou
  • Xian-tao Li
Evidence-Based Integrative Medicine



To assess the methodological quality of systematic reviews and meta-analyses regarding acupuncture intervention for stroke and the primary studies within them.


Two researchers searched PubMed, Cumulative index to Nursing and Allied Health Literature, Embase, ISI Web of Knowledge, Cochrane, Allied and Complementary Medicine, Ovid Medline, Chinese Biomedical Literature Database, China National Knowledge Infrastructure, Wanfang and Traditional Chinese Medical Database to identify systematic reviews and meta-analyses about acupuncture for stroke published from the inception to December 2016. Review characteristics and the criteria for assessing the primary studies within reviews were extracted. The methodological quality of the reviews was assessed using adapted Oxman and Guyatt Scale. The methodological quality of primary studies was also assessed.


Thirty-two eligible reviews were identified, 15 in English and 17 in Chinese. The English reviews were scored higher than the Chinese reviews (P=0.025), especially in criteria for avoiding bias and the scope of search. All reviews used the quality criteria to evaluate the methodological quality of primary studies, but some criteria were not comprehensive. The primary studies, in particular the Chinese reviews, had problems with randomization, allocation concealment, blinding, dropouts and withdrawals, intent-to-treat analysis and adverse events.


Important methodological flaws were found in Chinese systematic reviews and primary studies. It was necessary to improve the methodological quality and reporting quality of both the systematic reviews published in China and primary studies on acupuncture for stroke.


systematic review meta-analyses stroke acupuncture review of review methodological quality 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.



We thank Dr. Michael Fleming from University of Glasgow for his assistance in editing the manuscript.

Supplementary material

11655_2017_2764_MOESM1_ESM.pdf (123 kb)
Methological quality of systematic reviews and meta-analyses on acupuncture for stroke: A review of review


  1. 1.
    Donnan GA, Fisher M, Macleod M, Davis SM. Stroke. Lancet 2008;371:1612–1623.CrossRefPubMedGoogle Scholar
  2. 2.
    Feigin VL. Stroke in developing countries: can the epidemic be stopped and outcomes improved? Lancet Neurol 2007;6:94–97.CrossRefPubMedGoogle Scholar
  3. 3.
    He J, Gu D, Wu X, Reynolds K, Duan X, Yao C, et al. Major causes of death among men and women in China. N Engl J Med 2005;353:1124–1134.CrossRefPubMedGoogle Scholar
  4. 4.
    Zhao D, Liu J, Wang W, Zeng Z, Cheng J, Liu J, et al. Epidemiological transition of stroke in China twenty-oneyear observational study from the Sino-MONICA-Beijing project. Stroke 2008;39:1668–1674.CrossRefPubMedGoogle Scholar
  5. 5.
    Rabinstein AA, Shulman LM. Acupuncture in clinical neurology. Neurologist 2003; 9:137–148.CrossRefPubMedGoogle Scholar
  6. 6.
    Zhao XF, Du Y, Liu PG, Wang S. Acupuncture for stroke: evidence of effectiveness, safety, and cost from systematic reviews. Top Stroke Rehabil 2012;19:226–233.CrossRefPubMedGoogle Scholar
  7. 7.
    Zhang YM, Zhang YQ, Cheng SB, Chen SX, Chen AL, Tang CZ. Effect of acupuncture on proliferation and differentiation of neural stem cells in brain tissues of rats with traumatic brain injury. Chin J Integr Med 2013;19:132–136.CrossRefPubMedGoogle Scholar
  8. 8.
    Liu ZH, Qi YC, Pan PG, Ma MM, Qian XG, Fu WJ. Clinical observation on treatment of clearing the governor vessel and refreshing the mind needling in neural development and remediation of children with cerebral palsy. Chin J Integr Med 2013;19:505–509.CrossRefPubMedGoogle Scholar
  9. 9.
    Park J, Hopwood V, White AR, Ernst E. Effectiveness of acupuncture for stroke: a systematic review. J Neurol 2001;248:558–563.CrossRefPubMedGoogle Scholar
  10. 10.
    Zhang S, Liu M, Asplund K, Li L. Acupuncture for acute stroke. Cochrane Database Syst Rev 2005;CD003317.Google Scholar
  11. 11.
    Jiang GH, Xu XY, Chen ZH, Zhou ZH, Xu ZQ. The systematic review about effectiveness of CT-aided enchosure needling to treat stroke. J Clin Acupunct Moxibust (Chin) 2009;25:13–15.Google Scholar
  12. 12.
    Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med 2009;6:e1000100.CrossRefGoogle Scholar
  13. 13.
    Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med 2009;6:e1000097.CrossRefGoogle Scholar
  14. 14.
    Moja L, Mp FDR, Banzi R, Cusi C, D'Amico R, Liberati A, et al. Multiple systematic reviews: methods for assessing discordances of results. Inter Emerg Med 2012;7:563–568.CrossRefGoogle Scholar
  15. 15.
    Jadad AR, Cook DJ, Browman GP. A guide to interpreting discordant systematic reviews. CMAJ 1997;156:1411–1416.PubMedPubMedCentralGoogle Scholar
  16. 16.
    Santaguida P, Oremus M, Walker K, Wishart LR, Siegel KL, Raina P. Systematic reviews identify important methodological flaws in stroke rehabilitation therapy primary studies: review of reviews. J Clin Epidemiol 2012;65:358–367.CrossRefPubMedGoogle Scholar
  17. 17.
    Oxman AD, Guyatt GH. Validation of an index of the quality of review articles. J Clin Epidemiol 1991;44:1271–1278.CrossRefPubMedGoogle Scholar
  18. 18.
    Oxman AD, Guyatt GH, Singer J, Goldsmith CH, Hutchison BG, Milner RA, et al. Agreement among reviewers of review articles. J Clin Epidemiol 1991;44:91–98.CrossRefPubMedGoogle Scholar
  19. 19.
    Wong V, Cheuk DKL, Chu V. Acupuncture for hypoxic ischemic encephalopathy in neonates. Cochrane Database Sys Rev 2013;CD007968.Google Scholar
  20. 20.
    Liu AJ, Li JH, Li HQ, Fu DL, Lu L, Bian ZX, et al. Electroacupuncture for acute ischemic stroke: a metaanalysis of randomized controlled trials. Am J Chin Med 2015;43:1541–1566.CrossRefPubMedGoogle Scholar
  21. 21.
    Vados L, Ferreira A, Zhao S, Vercelino R, Wang S. Effectiveness of acupuncture combined with rehabilitation for treatment of acute or subacute stroke: a systematic review. Acupunct Med 2015;33:180–187.CrossRefPubMedGoogle Scholar
  22. 22.
    Li L, Zhang H, Meng SQ, Qian HZ. An updated metaanalysis of the efficacy and safety of acupuncture treatment for cerebral infarction. PLoS One 2014;9:e114057.CrossRefGoogle Scholar
  23. 23.
    Lee SJ, Shin BC, Lee MS, Han CH, Kim JI. Scalp acupuncture for stroke recovery: a systematic review and meta-analysis of randomized controlled trials. Eur J Integr Med 2013;5:87–99.CrossRefGoogle Scholar
  24. 24.
    Zhou JW, Li J, Zhao JJ, Xie HJ, Wang M. Meta analysis on ischemic stroke treated with scalp acupuncture. World J Acupunct Moxibust 2013;23:41–47.CrossRefGoogle Scholar
  25. 25.
    Wang Y, Shen J, Wang XM, Fu DL, Chen CY, Lu LY, et al. Scalp acupuncture for acute ischemic stroke: a metaanalysis of randomized controlled trials. Evid Based Complement Alter Med 2012;2012:480950.Google Scholar
  26. 26.
    Zheng GQ, Zhao ZM, Wang Y, Gu Y, Li Y, Chen XM, et al. Meta-analysis of scalp acupuncture for acute hypertensive intracerebral hemorrhage. J Alter Complement Med 2011;17:293–299.CrossRefGoogle Scholar
  27. 27.
    Lee MS, Shin BC, Kim JI, Han CH, Ernst E. Moxibustion for stroke rehabilitation: systematic review. Stroke 2010;41:817–820.CrossRefPubMedGoogle Scholar
  28. 28.
    Kong JC, Lee MS, Shin BC, Song YS, Ernst E. Acupuncture for functional recovery after stroke: a systematic review of sham-controlled randomized clinical trials. CMAJ 2010;182:1723–1729.CrossRefPubMedPubMedCentralGoogle Scholar
  29. 29.
    Wu P, Mills E, Moher D, Seely D. Acupuncture in poststroke rehabilitation: a systematic review and meta-analysis of randomized trials. Stroke 2010;41:e171-e179.CrossRefGoogle Scholar
  30. 30.
    Kim MK, Choi TY, Lee MS, Lee H, Han CH. Contralateral acupuncture versus ipsilateral acupuncture in the rehabilitation of post-stroke hemiplegic patients: a systematic review. BMC Complement Altern Med 2010;10:41.CrossRefPubMedPubMedCentralGoogle Scholar
  31. 31.
    Wu HM, Tang JL, Lin XP, Lau J, Leung PC, Woo J, et al. Acupuncture for stroke rehabilitation. Cochrane Database Syst Rev 2006;CD004131.Google Scholar
  32. 32.
    Sze FK-h, Wong E, Or KKH, Lau J, Woo J. Does acupuncture improve motor recovery after stroke? A meta-analysis of randomized controlled trials. Stroke 2002;33:2604–2619.PubMedGoogle Scholar
  33. 33.
    Li J, Li L, Zhu Y, Wang K, Tang H. Systematic review and Meta-analysis: Ziwuliuzhu Najia acupuncture therapy on stroke. Chin Arch Tradit Chin Med (Chin) 2016;34:1374–1377.Google Scholar
  34. 34.
    Jin D, Wang J. Meta-analysis about clinical effect of acupuncture to treat stroke patients with hemiplegia. J New Chin Med (Chin) 2016;48:284–286.Google Scholar
  35. 35.
    Tian L, Wang JH, Sun YJ, Zhang XH, Yuan B, Du XZ. A meta-analysis of randomized controlled trials on acupuncture plus medicine for ischemic stroke. Clin J Chin Med (Chin) 2015;7:4–8.Google Scholar
  36. 36.
    Xie JH, Yang ZX, Liu YP, Zhang HY, Xin LJ. Systematic evaluation of the therapeutic effect and security of Xingnao Kaiqiao needling method in treatment of ischemic stroke. Chin J Tradit Chin Med Pharm (Chin) 2015;30:890–894.Google Scholar
  37. 37.
    Dong QJ, Yang ZX. Systematic review of resuscitation needling technique for wind stroke. Chin Acupunct Moxibusti (Chin) 2013;33:475–480.Google Scholar
  38. 38.
    Huang YW, Fang XL, Yan XK. Meta-analysis on RCTs of midnight-noon ebb-flow acupuncture for treatment of stroke. J Liaoning Univ Tradit Chin Med (Chin) 2013;15:109–112.Google Scholar
  39. 39.
    Wu ZW, Li TL, Tang X. Meta analysis on the therapeutic effect of acupuncture plus rehabilition exercise on poststroke hemiplegic patients. J Emerg Tradit Chin Med (Chin) 2013;22:224–227.Google Scholar
  40. 40.
    Zhong Z, Li DP, Chen JQ, Fang Q, Xiao SY, Jiang XY, et al. Meta-analysis of domestic literature about different methods of acupuncture treatment for stroke. Hebei J Tradit Chin Med (Chin) 2012;34:1071–1074.Google Scholar
  41. 41.
    Zhang T, Zhang L, Zhang HM, Li Q. Systematic review of acupuncture therapy for acute ischemic stroke. China J Tradit Chin Med Pharm (Chin) 2009;24:101–104.CrossRefGoogle Scholar
  42. 42.
    Qi YZ, Fu LX, Xiong J, Wang ZL, Mou J, Lu YM. Systematic evaluation of acupuncture for treatment of post-stroke spastic paralysis. Chin Acupunct Moxibust (Chin) 2009;29:683–688.Google Scholar
  43. 43.
    Liu ZD, Li HY, Song Y, Zhang BH, Guo JW, Cai YF, et al. Systematic evaluation of randomized controlled trails about acupuncture on post-stroke patients with motor dysfunction. Shanghai J Acupunct Moxibust (Chin) 2008;127:38–42.Google Scholar
  44. 44.
    Yang SL, Chen LD, Tao J, Zhang B. Systematic evaluation of rehabilitation exercise plus needling on post-stroke patients with motor dysfunction. Chin J Rehabil Med (Chin) 2008;23:649–652.Google Scholar
  45. 45.
    Yang ZX, Shi XM. Systematic evaluation of the therapeutic effect and safety of Xingnao Kaiqiao needling method in treatment of stroke. Chin Acupunct Moxibust (Chin) 2007;27:601–608.Google Scholar
  46. 46.
    Zhang SH, Liu M, Li L. Acupuncture in the treatment of acute stroke: a Cochrane system evaluation of randomized or semi-randomized controlled trails. Chin J Rehabil Med (Chin) 2005;9:108–110.CrossRefGoogle Scholar
  47. 47.
    Li H, Liang WX, Guo XF. Meta-analysis of consciousnessrestoring and orifice-opening acupuncture manipulation in treating stroke. J Guangzhou Univ Tradit Chin Med (Chin) 2004;21:215–219.Google Scholar
  48. 48.
    Li N, Feng B, Zou J, Liu Y. Meta-analysis of acupuncture for semiplegia caused by stroke. J Chengdu Univ Tardit Chin Med (Chin) 2002;25:37–39.Google Scholar
  49. 49.
    Alderson P, Green S, Higgins JPT. Cochrane reviewers' handbook 4.2.3, section 9.2 [updated May 2005]. Available at: Scholar
  50. 50.
    Maher CG, Sherrington C, Herbert RD, Moseley AM, Elkins M. Reliability of the PEDro scale for rating quality of randomized controlled trials. Physical Therapy 2003;83:713–721.PubMedGoogle Scholar
  51. 51.
    Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJM, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials 1996;17:1–12.CrossRefPubMedGoogle Scholar
  52. 52.
    MacPherson H, White A, Cummings M, Jobst KA, Rose K, Niemtzow RC. Standards for reporting interventions in controlled trials of acupuncture: the STRICTA recommendations. J Altern Complement Med 2002;8:85–89.CrossRefPubMedGoogle Scholar
  53. 53.
    Balshem H, Helfand M, Schünemann HJ, Oxman AD, Kunz R, Brozek J, et al. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol 2011;64:401–406.CrossRefPubMedGoogle Scholar
  54. 54.
    Schultz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 1995;273:408–412.Google Scholar
  55. 55.
    Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMC Med 2010;8:18.CrossRefPubMedPubMedCentralGoogle Scholar

Copyright information

© Chinese Association of the Integration of Traditional and Western Medicine and Springer-Verlag GmbH Germany 2017

Authors and Affiliations

  • Xin-lin Chen
    • 1
  • Chuan-wei Mo
    • 1
  • Li-ya Lu
    • 2
  • Ri-yang Gao
    • 1
  • Qian Xu
    • 1
  • Min-feng Wu
    • 3
  • Qian-yi Zhou
    • 3
  • Yue Hu
    • 1
  • Xuan Zhou
    • 1
  • Xian-tao Li
    • 1
  1. 1.College of Basic Medical ScienceGuangzhou University of Chinese MedicineGuangzhouChina
  2. 2.Public Health, Institute of Health and WellbeingUniversity of GlasgowGlasgow, ScotlandUK
  3. 3.First Clinical CollegeGuangzhou University of Chinese MedicineGuangzhouChina

Personalised recommendations