Background

Interest in medical applications of marijuana (Cannabis sativa) has increased dramatically during the past 20 years. A 1999 report from the National Academies of Sciences, Engineering, and Medicine supported the use of marijuana in medicine, leading to a number of regulatory medical colleges providing recommendations for its prescription to patients [1]. An updated report in 2017 called for a national research agenda, improvement of research quality, improvement in data collection and surveillance efforts, and strategies for addressing barriers in advancing the cannabis agenda [2].

Proponents of medical cannabis support its use for a highly varied range of medical conditions, most notably in the fields of pain management [3] and multiple sclerosis [4]. Marijuana can be consumed by patients in a variety of ways including smoking, vaporizing, ingesting, or administering sublingually or rectally. The plant consists of more than 100 known cannabinoids, the main ones of relevance to medical applications being tetrahydrocannabinol (THC) and cannabidiol (CBD) [5]. Synthetic forms of marijuana such as dronabinol and nabilone are also available as prescriptions in the USA and Canada [6].

Over the last decade, there has been an increased interest in the use of medical cannabis products in North America. It is estimated that over 3.5 million people in the USA are legally using medical marijuana, and a total of USD$6.7 billion was spent in North America on legal marijuana in 2016 [7]. The number of Canadian residents with prescriptions to purchase medical marijuana from Health Canada–approved growers tripled from 30,537 in 2015 to near 100,000 in 2016 [8]. With the legalization of recreational-use marijuana in parts of the USA and in Canada in October 2018, the number of patients using marijuana for therapeutic purposes may become more difficult to track. The likely increase in the numbers of individuals consuming cannabis also necessitates a greater awareness of its potential benefits and harms.

Plant-based and plant-derived cannabis products are not monitored as more traditional medicines are, thereby increasing the uncertainty regarding its potential health risks to patients [3]. While synthetic forms of cannabis are available by prescription, different cannabis plants and products contain varied concentrations of THC and CBD, making the effects of exposure unpredictable [9]. While short-lasting side effects including drowsiness, loss of short-term memory, and dizziness are relatively well known and may be considered minor, other possible effects (e.g., psychosis, paranoia, anxiety, infection, withdrawal) may be more harmful to patients.

There remains a considerable degree of clinical equipoise as to the benefits and harms of marijuana use for medical purposes [10,11,12,13]. To understand the extent of synthesized evidence underlying this issue, we conducted a scoping review [14] of systematic reviews evaluating the benefits and/or harms of cannabis (plant-based, plant-derived, and synthetic forms) for any medical condition. We located and mapped systematic reviews to summarize research that is available for consideration for practice or policy questions in relation to medical marijuana.

Methods

A scoping review protocol was prepared and posted to the University of Ottawa Health Sciences Library’s online repository (https://ruor.uottawa.ca/handle/10393/37247). We used the PRISMA for Scoping Reviews checklist to guide the reporting of this report (see Additional file 1) [15].

Literature search and process of study selection

An experienced medical information specialist developed and tested the search strategy using an iterative process in consultation with the review team. Another senior information specialist peer-reviewed the strategy prior to execution using the PRESS Checklist [16]. We searched seven Ovid databases: MEDLINE®, including Epub Ahead of Print and In-Process & Other Non-Indexed Citations, Embase, Allied and Complementary Medicine Database, PsycINFO, the Cochrane Database of Systematic Reviews, the Database of Abstracts of Reviews of Effects, and the Health Technology Assessment Database. The final peer-reviewed search strategy for MEDLINE was translated to the other databases (see Additional file 2). We performed the searches on November 3, 2017.

The search strategy incorporated controlled vocabulary (e.g., “Cannabis,” “Cannabinoids,” “Medical Marijuana”) and keywords (e.g., “marijuana,” “hashish,” “tetrahydrocannabinol”) and applied a broad systematic review filter where applicable. Vocabulary and syntax were adjusted across the databases and where possible animal-only and opinion pieces were removed, from the search results.

Gray literature searching was limited to relevant drug and mental health databases, as well as HTA (Health Technology Assessment) and systematic review databases. Searching was guided by the Canadian Agency for Drugs and Technologies in Health’s (CADTH) checklist for health-related gray literature (see Additional file 3). We performed searches between January and February 2018. Reference lists of overviews were searched for relevant systematic reviews, and we searched for full-text publications of abstracts or protocols.

Management of all screening was performed using Distiller SR Software ® (Evidence Partners Inc., Ottawa, Canada). Citations from the literature search were collated and de-duplicated in Reference Manager (Thomson Reuters: Reference Manager 12 [Computer Program]. New York: Thomson Reuters 2011), and then uploaded to Distiller. The review team used Distiller for Levels 1 (titles and abstracts) and 2 (full-text) screening. Pilot testing of screening questions for both levels were completed prior to implementation. All titles and abstracts were screened in duplicate by two independent reviewers (MT and MP) using the liberal accelerated method [17]. This method requires only one reviewer to assess an abstract as eligible for full-text screening, and requires two reviewers to deem the abstract irrelevant. Two independent reviewers (MT and MP) assessed full-text reports for eligibility. Disagreements during full-text screening were resolved through consensus, or by a third team member (AS). The process of review selection was summarized using a PRISMA flow diagram (Fig. 1) [18].

Fig. 1
figure 1

PRISMA-style flow diagram of the review selection process

Full size image

Review selection criteria

English-language systematic reviews were included if they reported that they investigated harms and/or benefits of medical or therapeutic use of cannabis for adults and children for any indication. Definitions related to medical cannabis/marijuana are provided in Table 1. We also included synthetic cannabis products, which are prescribed medicines with specified doses of THC and CBD. Reviews of solely observational designs were included only in relation to adverse effects data, in order to focus on the most robust evidence available. We considered studies to be systematic reviews if at least one database was searched with search dates reported, at least one eligibility criterion was reported, the authors had assessed the quality of included studies, and there was a narrative or quantitative synthesis of the evidence. Reviews assessing multiple interventions (both pharmacological and complementary and alternative medicine (CAM) interventions) were included if the data for marijuana studies was reported separately. Published and unpublished guidelines were included if they conducted a systematic review encompassing the criteria listed above.

Table 1 Context for the use of cannabis-related terms during the review selection process
Full size table

We excluded overviews of systematic reviews, reviews in abstract form only, and review protocols. We further excluded systematic reviews focusing on recreational, accidental, acute, or general cannabis use/abuse and interventions such as synthetic cannabinoids not approved for therapeutic use (e.g., K2 or Spice).

Data collection and quality assessment

All data were collected electronically in a pre-developed form using Microsoft Excel software (Microsoft Corporation, Seattle, USA). The form was pilot tested on three included reviews by three people. One reviewer (MP or CB) independently extracted all data, and a second reviewer (MT) verified all of the items collected and checked for any omitted data. Disagreements were resolved by consensus and consultation with a third reviewer if necessary. A data extraction form with the list of included variables is provided in Additional file 4. All collected data has also been made available in the online supplemental materials associated with this report.

Quality assessment of systematic reviews was performed using the AMSTAR-2 [20] tool. One reviewer (MP or CB) independently assessed quality, while a second reviewer (MT) verified the assessments. Disagreements were resolved by consensus and consultation with a third reviewer if necessary. The tool consists of 16 items in total, with four critical domains and 12 non-critical domains. The AMSTAR-2 tool is not intended to generate an overall score, and instead allows for an overall rating based on weaknesses in critical domains. Reviews were rated as high (no critical flaws with zero or one non-critical flaw), moderate (no critical flaws with ≥ 1 non-critical flaw), low (one critical flaw with/without non-critical weakness), or critically low (> 1 critical flaw with/without non-critical weakness) quality.

Evidence synthesis

We used a directed content analytic approach [21] with an initial deductive framework [22] that allowed flexibility for inductive analysis if refinement or development of new categorization was needed. The framework used to categorize outcome data results is outlined in Table 2. Where reviews had a mix of narrative and quantitative data, results from meta-analyses were prioritized over count data or study-by-study data. The extraction and reporting of data results was performed at a high level and did not involve an in-depth evaluation, which is appropriate for a scoping review [14]. Review authors’ conclusions and/or recommendations were extracted and reported narratively.

Table 2 Outcome result categorization
Full size table

Changes from the study protocol

For feasibility, we decided to limit the inclusion of systematic reviews of only observational study designs to those that addressed adverse events data. All other steps of the review were performed as planned.

Results

Search findings

The PRISMA flow diagram describing the process of review selection is presented in Fig. 1. After duplicates were removed, the search identified a total of 1925 titles and abstracts, of which 47 references were located through the gray literature search. Of the total 1925 citations assessed during Level 1 screening, 1285 were deemed irrelevant. We reviewed full-text reports for the 640 reviews of potential relevance, and of these, 567 were subsequently excluded, leaving a total of 72 systematic reviews that were included; the associated data collected are provided in Additional file 5. A listing of the reports excluded during full-text review is provided in Additional file 6.

Characteristics of included reviews

There were 63 systematic reviews [4, 19, 23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83] and nine guidelines with systematic reviews [84,85,86,87,88,89,90,91,92]. Overall, 27 reviews were performed by researchers in Europe, 16 in the USA, 15 in Canada, eight in Australia, two in Brazil, and one each in Israel, Singapore, South Africa, and China. Funding was not reported in 29 (40%) of the reviews, and the remaining reviews received funding from non-profit or academic (n = 20; 28%), government (n = 14; 19%), industry (n = 3; 4%), and mixed (n = 1; 1%) sources. Five reviews reported that they did not receive any funding for the systematic review. Tables 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, and 13 provide an overview of the characteristics of the 72 included systematic reviews.

Table 3 Multiple sclerosis
Full size table
Table 4 Movement disorders
Full size table
Table 5 Pain
Full size table
Table 6 Cancer
Full size table
Table 7 Rheumatic disease
Full size table
Table 8 Injury
Full size table
Table 9 Mental health
Full size table
Table 10 HIV/AIDS
Full size table
Table 11 Neurological conditions
Full size table
Table 12 Various conditions
Full size table
Table 13 Other conditions
Full size table

The reviews were published between 2000 and 2018 (median year 2014), and almost half (47%) were focused solely on medical cannabis. Four (6%) reviews covered both medical and other cannabis use (recreational and substance abuse), 19 (26%) reported multiple pharmaceutical interventions (cannabis being one), six (8%) reported various CAM interventions (cannabis being one), and nine (13%) were mixed pharmaceutical and CAM interventions (cannabis being one). Multiple databases were searched by almost all of the reviews (97%), with Medline/PubMed or Embase common to all.

Cannabis use

Figure 2 illustrates the different cannabis-based interventions covered by the included reviews. Plant-based cannabis consists of whole plant products such as marijuana or hashish. Plant-derived cannabinoids are active constituents of the cannabis plant, such as tetrahydrocannabinol (THC), cannabidiol (CBD), or a combination of THC:CBD (also called nabiximols, under the brand name Sativex) [3]. Synthetic cannabinoids are manufactured rather than extracted from the plant and include drugs such as nabilone and dronabinol.

Fig. 2
figure 2

Review coverage of the various cannabis-based interventions

Full size image

Twenty-seven reviews included solely interventions from plant-derived cannabinoids, 10 studied solely synthetic cannabinoids, and eight included solely studies on plant-based cannabis products. Twenty-four reviews covered a combination of different types of cannabis, and the remaining three systematic reviews did not report which type of cannabinoid was administered in the included studies.

Population

The systematic reviews covered a wide range of conditions and illnesses, the most notable being pain management. Seventeen reviews looked at specific types of pain including neuropathic [31, 42, 62, 69, 85, 90], chronic [26, 32, 52, 58, 80], cancer [84, 87], non-cancer [41, 68], and acute [38] types of pain (one review covered all types of pain) [65]. Twenty-seven reviews (38%) also focused on management of pain as a symptom of conditions such as multiple sclerosis (MS) [6, 23, 27, 43, 46, 52, 63, 85, 92], injury [29, 35, 36, 69], cancer [37, 43, 65, 88], inflammatory bowel disease (IBD) [28], rheumatic disease (RD) [49, 51, 73], diabetes [68,69,70], and HIV [48, 53, 67]. In Fig. 3, the types of illnesses addressed by the set of included reviews are graphically represented, with overlap between various conditions and pain. Some systematic reviews covered multiple diseases, and therefore the total number of conditions represented in Fig. 3 is greater than the total number of included reviews.

Fig. 3
figure 3

Conditions or symptoms across reviews that were treated with cannabis. IBD inflammatory bowel disease, MS multiple sclerosis, RD rheumatic disease

Full size image

One review included a pediatric-only population, in the evaluation of marijuana for nausea and vomiting following chemotherapy [54]. Although trials in both adult and child populations were eligible for thirteen (18%) reviews, only two additional reviews included studies in children; these reviews evaluated cannabis in cancer [60] and a variety of conditions [25]. Many of the reviews (n = 25, 35%) included only adults ≥ 18 years of age. Almost half of the reviews (n = 33, 46%) did not report a specific population for inclusion.

Cannabis was prescribed for a wide range of medical issues. The indication for cannabis use is illustrated in Fig. 4. Pain management (n = 27) was the most common indication for cannabis use. A number of reviews sought to address multiple disease symptoms (n = 12) or explored a more holistic treatment for the disease itself (n = 11). After pain, the most common symptoms being treated with cannabis were spasticity in MS, movement disturbances (such as dyskinesia, tics, and spasms), weight or nausea/vomiting, and mental health symptoms.

Fig. 4
figure 4

Indications for cannabis use across included reviews

Full size image

Figure 5 summarizes the breadth of outcomes analyzed in the included reviews. The most commonly addressed outcomes were withdrawal due to adverse effects, “other pain,” neuropathic pain, spasticity, and the global impression of the change in clinical status. Many outcomes were reported using a variety of measures across reviews. For example, spasticity was measured both objectively (using the Ashworth scale) and subjectively (using a visual analog scale [VAS] or numerical rating scale [NRS]). Similarily, outcomes for pain included VAS or NRS scales, reduction in pain, pain relief, analgesia, pain intensity, and patient assessment of change in pain.

Fig. 5
figure 5

Outcomes

Full size image

Quality of the systematic reviews

Quality assessments of the included reviews based upon AMSTAR-2 are detailed in Additional file 7 and Additional file 8. Only one review was rated as high quality [45]. All other reviews were deemed to be of moderate (n = 36) or low/critically low (n = 35) methodological quality. Assessments for the domains deemed of critical importance for determining quality ratings are described below.

Only 20% of reviews used a comprehensive search strategy; another 47% were given a partial score because they had not searched the reference lists of the included reviews, trial registries, gray literature, and/or the search date was older than 2 years. The remaining reviews did not report a comprehensive search strategy.

Over half of the reviews (51%) used a satisfactory technique for assessing risk of bias (ROB) of the individual included studies, while 35% were partially satisfactory because they had not reported whether allocation sequence was truly random and/or they had not assessed selective reporting. The remaining reviews did not report a satisfactory technique for assessing ROB.

Most reviews (71%) could not be assessed for an appropriate statistical method for combining results in a meta-analysis, as they synthesized study data narratively. Approximately 19% of reviews used an appropriate meta-analytical approach, leaving 10% that used inappropriate methods.

The final critical domain for the AMSTAR-2 determines whether review authors accounted for ROB in individual studies when discussing or interpreting the results of the review. The majority of reviews (83%) did so in some capacity.

Mapping results of included systematic reviews

We mapped reviews according to authors’ comparisons, the conditions or symptoms they were evaluating, and the categorization of the results (see Table 2). In some cases, reviews contributed to more than one comparison (e.g., cannabis versus placebo or active drug). As pain was the most commonly addressed outcome, we mapped this outcome separately from all other endpoints. This information is shown for all reviews and then restricted to reviews of moderate-to-high quality (as determined using the AMSTAR-2 criteria): cannabis versus placebo (Figs. 6 and 7), cannabis versus active drugs (Figs. 8 and 9), cannabis versus a combination of placebo and active drug (Figs. 10 and 11), one cannabis formulation versus other (Figs. 12 and 13), and cannabis analyzed against all other comparators (Fig. 14). Details on how to read the figures are provided in the corresponding figure legends. The median number of included studies across reviews was four, and ranged from one to seventy-nine (not shown in figures).

Fig. 6
figure 6

Cannabis vs. placebo. Authors’ presentations of the findings were mapped using the categorization shown in Table 2. According to the reviews’ intended scope for the condition being treated, outcomes were mapped into “pain,” “non-pain outcomes,” and “adverse events.” For each condition and outcome pair (i.e., each row in the grid), the number of reviews reporting findings is shown according to the results categorization. For pain, reviews numbered in different categories signal discordant findings across those reviews. For non-pain outcomes, reviews presenting findings in the different categories would signal different results for different outcomes, as well as discordant findings within and across reviews. Adverse events are grouped as a whole and “favors intervention” would be interpreted as a decrease in events with cannabis when compared with the control group. Favors int = favors intervention; Favors Ctrl = favors control; Not stat sig = not statistically significant

Full size image
Fig. 7
figure 7

Cannabis vs. placebo, high and moderate quality reviews. Authors’ presentations of the findings were mapped using the categorizations shown in Table 2. According to the reviews’ intended scope for the condition being treated, outcomes were mapped into “pain,” “non-pain outcomes,” and “adverse events.” For each condition and outcome pair (i.e., each row in the grid), the number of reviews reporting findings is shown according to the results categorization. For pain, reviews numbered in different categories signal discordant findings across those reviews. For non-pain outcomes, reviews presenting findings in the different categories would signal different results for different outcomes, as well as discordant findings within and across reviews. Adverse events are grouped as a whole and “favors intervention” would be interpreted as a decrease in events with cannabis when compared with the control group. Favors int = favors intervention; Favors Ctrl = favors control; Not stat sig = not statistically significant

Full size image
Fig. 8
figure 8

Cannabis vs. active drugs. Authors’ presentations of the findings were mapped using the categorizations shown in Table 2. According to the reviews’ intended scope for the condition being treated, outcomes were mapped into “pain,” “non-pain outcomes,” and “adverse events.” For each condition and outcome pair (i.e., each row in the grid), the number of reviews reporting findings is shown according to the results categorization. For pain, reviews numbered in different categories signal discordant findings across those reviews. For non-pain outcomes, reviews presenting findings in the different categories would signal different results for different outcomes, as well as discordant findings within and across reviews. Adverse events are grouped as a whole and “favors intervention” would be interpreted as a decrease in events with cannabis when compared with the control group. Favors int = favors intervention; Favors Ctrl = favors control; Not stat sig = not statistically significant

Full size image
Fig. 9
figure 9

Cannabis vs. active drugs, high and moderate quality reviews. Authors’ presentations of the findings were mapped using the categorizations shown in Table 2. According to the reviews’ intended scope for the condition being treated, outcomes were mapped into “pain,” “non-pain outcomes,” and “adverse events.” For each condition and outcome pair (i.e., each row in the grid), the number of reviews reporting findings is shown according to the results categorization. For pain, reviews numbered in different categories signal discordant findings across those reviews. For non-pain outcomes, reviews presenting findings in the different categories would signal different results for different outcomes, as well as discordant findings within and across reviews. Adverse events are grouped as a whole and “favors intervention” would be interpreted as a decrease in events with cannabis when compared with the control group. Favors int = favors intervention; Favors Ctrl = favors control; Not stat sig = not statistically significant

Full size image
Fig. 10
figure 10

Cannabis vs. placebo + active drug. Authors’ presentations of the findings were mapped using the categorizations shown in Table 2. According to the reviews’ intended scope for the condition being treated, outcomes were mapped into “pain,” “non-pain outcomes,” and “adverse events.” For each condition and outcome pair (i.e., each row in the grid), the number of reviews reporting findings is shown according to the results categorization. For pain, reviews numbered in different categories signal discordant findings across those reviews. For non-pain outcomes, reviews presenting findings in the different categories would signal different results for different outcomes, as well as discordant findings within and across reviews. Adverse events are grouped as a whole and “favors intervention” would be interpreted as a decrease in events with cannabis when compared with the control group. Favors int = favors intervention; Favors Ctrl = favors control; Not stat sig = not statistically significant

Full size image
Fig. 11
figure 11

Cannabis vs. placebo + active drug, high and moderate quality reviews. Authors’ presentations of the findings were mapped using the categorizations shown in Table 2. According to the reviews’ intended scope for the condition being treated, outcomes were mapped into “pain,” “non-pain outcomes,” and “adverse events.” For each condition and outcome pair (i.e., each row in the grid), the number of reviews reporting findings is shown according to the results categorization. For pain, reviews numbered in different categories signal discordant findings across those reviews. For non-pain outcomes, reviews presenting findings in the different categories would signal different results for different outcomes, as well as discordant findings within and across reviews. Adverse events are grouped as a whole and “favors intervention” would be interpreted as a decrease in events with cannabis when compared with the control group. Favors int = favors intervention; Favors Ctrl = favors control; Not stat sig = not statistically significant

Full size image
Fig. 12
figure 12

One cannabis formulation vs. other. Authors’ presentations of the findings were mapped using the categorizations shown in Table 2. According to the reviews’ intended scope for the condition being treated, outcomes were mapped into “pain,” “non-pain outcomes,” and “adverse events.” For each condition and outcome pair (i.e., each row in the grid), the number of reviews reporting findings is shown according to the results categorization. For pain, reviews numbered in different categories signal discordant findings across those reviews. For non-pain outcomes, reviews presenting findings in the different categories would signal different results for different outcomes, as well as discordant findings within and across reviews. Adverse events are grouped as a whole and “favors intervention” would be interpreted as a decrease in events with cannabis when compared with the control group. Favors int = favors intervention; Favors Ctrl = favors control; Not stat sig = not statistically significant

Full size image
Fig. 13
figure 13

One cannabis formulation vs. other, high and moderate quality reviews. Authors’ presentations of the findings were mapped using the categorizations shown in Table 2. According to the reviews’ intended scope for the condition being treated, outcomes were mapped into “pain,” “non-pain outcomes,” and “adverse events.” For each condition and outcome pair (i.e., each row in the grid), the number of reviews reporting findings is shown according to the results categorization. For pain, reviews numbered in different categories signal discordant findings across those reviews. For non-pain outcomes, reviews presenting findings in the different categories would signal different results for different outcomes, as well as discordant findings within and across reviews. Adverse events are grouped as a whole and “favors intervention” would be interpreted as a decrease in events with cannabis when compared with the control group. Favors int = favors intervention; Favors Ctrl = favors control; Not stat sig = not statistically significant

Full size image
Fig. 14
figure 14

Cannabis vs. all comparators combined. Authors’ presentations of the findings were mapped using the categorizations shown in Table 2. According to the reviews’ intended scope for the condition being treated, outcomes were mapped into “pain,” “non-pain outcomes,” and “adverse events.” For each condition and outcome pair (i.e., each row in the grid), the number of reviews reporting findings is shown according to the results categorization. For pain, reviews numbered in different categories signal discordant findings across those reviews. For non-pain outcomes, reviews presenting findings in the different categories would signal different results for different outcomes, as well as discordant findings within and across reviews. Adverse events are grouped as a whole and “favors intervention” would be interpreted as a decrease in events with cannabis when compared with the control group. Favors int = favors intervention; Favors Ctrl = favors control; Not stat sig = not statistically significant

Full size image

Cannabis versus placebo

Most reviews (59/72, 82%) compared cannabis with placebo. Of these reviews, 34 (58%) addressed pain outcomes and 47 (80%) addressed non-pain outcomes, with most outcomes addressed by three reviews or fewer (Fig. 6). Some reviews had a mix of quantitative syntheses and study-by-study data reported (13/59, 22%), while another group of reviews (14/59, 24%) only reported results study-by-study. Overall, 24% (14/59) of the cannabis versus placebo reviews had only one included study.

  1. 1.

    Pain outcomes

    1. i.

      Reviews focused on addressing pain across conditions. In most cases, findings were discordant across reviews for the pain outcomes measured. For chronic non-cancer pain, however, two reviews favored cannabis over placebo for decreasing pain. One review assessing acute pain for postoperative pain relief found no difference between various cannabinoid medications and placebo. The distribution of findings was similar when restricting to moderate-to-high-quality reviews.

    2. ii.

      Reviews focused on treating a condition or family of related conditions. Various results were observed for pain. For MS and HIV/AIDS, one review each reported quantitative results favoring cannabis for decreased pain but with other reviews reporting results study-by-study, it is difficult to know, broadly, how consistent those findings are. For cancer, two reviews reported results favoring cannabis for decreased pain. For rheumatic disease, findings are discordant between two reviews, and another two reviews reported results study-by-study. One review that included studies of MS or paraplegia found no difference in pain between groups. For treating injury, one review showed that the placebo group had less pain and one review reported data study-by-study. No reviews addressed pain in movement disorders, neurological conditions, and IBD.

For those reviews assessing pain as part of a focus on treating a range of conditions, two showed cannabis reduced pain [43, 52], but one showed mixed results depending on how pain was measured [43]. These reviews covered several different conditions, including injury, chronic pain, rheumatoid arthritis, osteoarthritis, fibromyalgia, HIV/AIDS, cancer, and MS or paraplegia.

When restricting to moderate-to-high-quality reviews, only one review each in multiple sclerosis and HIV/AIDS with a study-by-study analysis on pain remained. One review on cancer favored cannabis for pain reduction. Findings remained the same for MS or paraplegia and rheumatic disease. No review for injury and paint outcomes was of higher quality.

  1. 2.

    Non-pain outcomes

The types of non-pain outcomes included in the reviews varied by condition/illness. The most commonly reported outcomes (see Fig. 5 for overall outcomes) when comparing cannabis to placebo included muscle- or movement-related outcomes (n = 20), quality of life (n = 14), and sleep outcomes (n = 10).

There was no consistent pattern for non-pain outcomes either within or across medical conditions. Many (n = 24, 33%) reviews assessing non-pain outcomes reported the results of those analyses study-by-study. Conflicting results are observed in some cases due to the use of different measures, such as different ways of quantifying spasticity in patients with multiple sclerosis [56, 91]. One review each addressing neurological conditions [50] (outcome: muscle cramps) and MS/paraplegia [27] (outcomes: spasticity, spasm, cognitive function, daily activities, motricity, and bladder function) showed no difference between groups.

  1. 3.

    Adverse effects

Adverse effects were reported in most reviews comparing cannabis with placebo (49/59, 83%). Most adverse events were reported study-by-study, with few reviews (n = 16/59, 27%) conducting a narrative or quantitative synthesis. Serious adverse effects were reported in 21/59 (36%) reviews, and minor adverse effects were reported in 30/59 (51%) reviews. The remaining reviews did not define the difference between serious and minor adverse events. The most commonly reported serious adverse events included psychotic symptoms (n = 6), severe dysphoric reactions (n = 3), seizure (n = 3), and urinary tract infection (n = 2). The most commonly reported minor adverse events included somnolence/drowsiness (n = 28), dizziness (n = 27), dry mouth (n = 20), and nausea (n = 18). Many reviews (n = 37/59, 63%) comparing cannabis to placebo reported both neurocognitive and non-cognitive adverse effects. Withdrawals due to adverse events were reported in 22 (37%) reviews.

Of the moderate-/high-quality reviews, adverse effect analyses were reported in reviews on pain, multiple sclerosis, cancer, HIV/AIDS, movement disorders, rheumatic disease, and several other conditions. Two reviews on pain showed fewer adverse events with cannabis for euphoria, events linked to alternations in perception, motor function, and cognitive function, withdrawal due to adverse events, sleep, and dizziness or vertigo [58, 90]. One review on MS showed that there was no statistically significant difference between cannabis and placebo for adverse effects such as nausea, weakness, somnolence, and fatigue [91], while another review on MS/paraplegia reported fewer events in the placebo group for dizziness, somnolence, nausea, and dry mouth [27]. Within cancer reviews, one review found no statistically significant difference between cannabis and placebo for dysphoria or sedation but reported fewer events with placebo for “feeling high,” and fewer events with cannabis for withdrawal due to adverse effects [40]. In rheumatic disease, one review reported fewer total adverse events with cannabis and found no statistically significant difference between cannabis and placebo for withdrawal due to adverse events [51].

Cannabis versus other drugs

Relatively fewer reviews compared cannabis with active drugs (n = 23/72, 32%) (Fig. 8). Many of the reviews did not synthesize studies quantitatively, and results were reported study-by-study. The most common conditions in reviews comparing cannabis to active drugs were pain, cancer, and rheumatic disease. Comparators included ibuprofen, codeine, diphenhydramine, amitriptyline, secobarbital, prochlorperazine, domperidone, metoclopramide, amisulpride, neuroleptics, isoproterenol, megestrol acetate, pregabalin, gabapentin, and opioids.

  1. 1.

    Pain outcomes

    1. i.

      Reviews focused on addressing pain across conditions. When comparing across reviews, a mix of results are observed (see Fig. 8), and some were reported study-by-study. One review found no statistically significant difference between cannabinoids and codeine for nociceptive pain, postoperative pain, and cancer pain [65]. Another review favored “other drugs” (amitriptyline and pregabalin) over cannabinoids for neuropathic pain [90]. The distribution of findings was similar when restricting to moderate-to-high-quality reviews.

    2. ii.

      Reviews focused on treating a condition or family of related conditions. One review on cancer compared cannabinoids and codeine or secobarbital and reported pain results study-by-study. Another review on fibromyalgia comparing synthetic cannabinoids with amitriptyline also reported pain data study-by-study [39].

  2. 2.

    Non-pain outcomes

Two reviews on cancer favored cannabinoids over active drugs (prochlorperazine, domperidone, metoclopramide, and neuroleptics) for patient preference and anti-emetic efficacy [40, 60]. Non-pain outcomes were reported study-by-study for the outcome of sleep in neuropathic pain [90] and rheumatic disease [39, 49]. In a review covering various conditions (pain, MS, anorexia, cancer, and immune deficiency), results were unclear or indeterminate for subjective measures of sleep [46].

  1. 3.

    Adverse effects

Adverse effects were reported in 20/24 (83%) of the reviews comparing cannabis to active drugs, and only 6/20 (30%) reported a narrative or quantitative synthesis. Many reviews that reported narrative data did not specify whether adverse effects could be attributed to a placebo or active drug comparator.

Of the moderate-to-high-quality reviews, two pain reviews found no statistically significant difference for cannabis compared to codeine or amitriptyline for withdrawals due to adverse events [65, 90]. Results from one cancer review were mixed, with fewer adverse events for cannabis (compared to prochlorperazine, domperidone, or metoclopramide) or no difference between groups, depending on the type of subgroup analysis that was conducted [40].

Cannabis + active drugs versus placebo + active drugs

Two reviews compared cannabis with placebo cannabis in combination with an active drug (opioids and gabapentin) (Figs. 10 and 11). Both were scored to be of moderate quality. Although one review showed that cannabis plus opioids decreased chronic pain [80], another review on pain in MS included only a single study [81], precluding the ability to determine concordance of results. Cannabis displayed varied effects on non-pain outcomes, including superiority of placebo over cannabis for some outcomes. One review reported withdrawal due to adverse events study-by-study and also reported that side effects such as nausea, drowsiness, and dizziness were more frequent with higher doses of cannabinoids (data from two included studies) [80].

Cannabis versus other cannabis comparisons

Six (8%) reviews compared different cannabis formulations or doses (Figs. 12 and 13). Almost all were reported as study-by-study results, with two reviews including only one RCT. One review for PTSD found only observational data [33] and another review on anxiety and depression combined data from one RCT with cross-sectional study data [19]. A single review on MS reported a narrative synthesis that found a benefit for spasticity. However, it was unclear if the comparator was placebo or THC alone [56]. Four reviews reported adverse effects study-by-study, with a single review comparing side effects from different dosages; in this review, combined extracts of THC and CBD were better tolerated than extracts of THC alone [56].

Cannabis versus all comparators

One review combined all comparators for the evaluation (Fig. 14). The review (combining non-users, placebo and ibuprofen) covered a range of medical conditions and was rated as low quality [30]. No adverse effects were evaluated for this comparison.

Mapping the use of quality assessment and frameworks to interpret the strength of evidence

Although 83% of reviews incorporated risk of bias assessments in their interpretation of the evidence, only 11 (15%) reviews used a framework such as GRADE to evaluate important domains other than risk of bias that would inform the strength of the evidence.

Mapping authors’ conclusions or recommendations

Most reviews (43/72 60%) indicated an inability to draw conclusions, whether due to uncertainty, inconsistent findings, lack of (high quality) evidence, or focusing their conclusion statement on the need for more research. Almost 15% of reviews (10/72) reported recommendations or conclusions that included some uncertainty. One review (1%) provided a statement of the extent of the strength of the evidence, which differed according to outcome.

Eleven reviews provided clearer conclusions (14%). Four indicated that cannabis was not effective or not cost-effective compared to placebo in relation to multiple sclerosis, acute pain, cancer, and injury. Three reviews addressing various conditions provided varying conclusions: one stated cannabis was not effective, one indicated it was modestly safe and effective, and one concluded that cannabis was safe and efficacious as short-term treatment; all reviews were of low quality. The three remaining reviews stated moderate or modest effects for improving chronic pain, compared with placebo or other analgesia; two of those reviews were of medium AMSTAR-2 quality, and one used the GRADE framework for interpreting the strength of the evidence.

The eight remaining included reviews (11%) did not provide a clear conclusion statement or reported only limitations.

Mapping authors’ limitations of the research

Several of the reviews indicated that few studies, small sample sizes, short duration of treatment, and issues related to outcomes (e.g., definition, timing, and types) were drawbacks to the literature. Some reviews noted methodological issues with and heterogeneity among studies as limitations. A few authors stated that restricting eligibility to randomized trials, English-language studies, or full publications may have affected their review results.

Discussion

With the increasing use of medical cannabis, an understanding of the landscape of available evidence syntheses is needed to support evidence-informed decision-making, policy development, and to inform a research agenda. In this scoping review, we identified 72 systematic reviews evaluating medical cannabis for a range of conditions and illnesses. Half of the reviews were evaluated as being of moderate quality, with only one review scoring high on the AMSTAR-2 assessment tool.

There was disparity in the reported results across reviews, including non-synthesized (study-by-study) data, and many were unable to provide a definitive statement regarding the effectiveness of cannabis (as measured by pain reduction or other relevant outcomes), nor the extent of increased side effects and harms. This is consistent with the limitations declared in general across reviews, such as the small numbers of relevant studies, small sample sizes of individual studies, and methodological weaknesses of available studies. This common theme in review conclusions suggests that while systematic reviews may have been conducted with moderate or high methodological quality, the strength of their conclusions are driven by the availability and quality of the relevant underlying evidence, which was often found to be limited.

Relatively fewer reviews addressed adverse effects associated with cannabis, except to narratively summarize study level data. Although information was provided for placebo-controlled comparisons, none of the comparative effectiveness reviews quantitatively assessed adverse effects data. For the placebo-controlled data, although the majority of adverse effects were mild, the number of reviews reporting serious adverse effects such as psychotic symptoms [25, 42] and suicidal ideation [68, 85] warrants caution.

A mix of reviews supporting and not supporting the use of cannabis, according to authors’ conclusions, was identified. Readers may wish to consider the quality of the reviews, the use of differing quality assessment tools, additional considerations covered by the GRADE framework, and the potential for spin as possible reasons for these inconsistencies. It is also possible that cannabis has differing effects depending on its type (e.g., synthetic), dose, indication, the type of pain being evaluated (e.g., neuropathic), and the tools used for outcome assessment, which can be dependent on variations in condition. Of potential interest to readers may be a closer examination of the reviews evaluating chronic pain, in order to locate the source(s) of discordance. For example, one review was deemed of moderate quality, used the GRADE framework, and rated the quality of evidence for the effectiveness of cannabis for reducing neuropathic pain as moderate, suggesting that further investigation of cannabis for neuropathic pain may be warranted [80]. The exploration aspects outlined in this paragraph are beyond the purview of scoping review methodology; a detailed assessment of the reviews, including determining the overlap of included studies among similar reviews, potential reasons for the observed discordance of findings, what re-analysis of study-by-study analyses would yield, and an undertaking of missing GRADE assessments would fall outside the bounds of a scoping review and require the use of overview methodology [14].

Our findings are consistent with a recently published summary of cannabis-based medicines for chronic pain management [3]. This report found inconsistent results in systematic reviews of cannabis-based medicines compared to placebo for chronic neuropathic pain, pain management in rheumatic diseases and painful spasms in MS. The authors also concluded that cannabis was not superior to placebo in reducing cancer pain. Four out of eight included reviews scored high on the original AMSTAR tool. The variations between the two tools can be attributed to the differences in our overall assessments. Lastly, the summary report included two reviews that were not located in our original search due to language [93] and the full-text [94] of an abstract [95] that was not located in our search.

This scoping review has identified a plethora of synthesized evidence in relation to medical cannabis. For some conditions, the extent of review replication may be wasteful. Many reviews have stated that additional trials of methodologically robust design and, where possible, of sufficient sample size for precision, are needed to add to the evidence base. This undertaking may require the coordination of multi-center studies to ensure adequate power. Future trials may also help to elucidate the effect of cannabis on different outcomes.

Given authors’ reporting of issues in relation to outcomes, future prospective trials should be guided by a standardized, “core” set of outcomes to strive for consistency across studies and ensure relevance to patient-centered care. Development of those core outcomes should be developed using the Core Outcome Measures in Effectiveness Trials (COMET) methodology [96], and further consideration will need to be made in relation to what outcomes may be common across all cannabis research and which outcomes are condition-specific. With maturity of the evidence base, future systematic reviews should seek and include non-journal-published (gray literature) reports and ideally evaluate any non-English-language papers; authors should also adequately assess risk of bias and undertake appropriate syntheses of the literature.

The strengths of this scoping review include the use of an a priori protocol, peer-reviewed search strategies, a comprehensive search for reviews, and consideration of observational designs for adverse effects data. For feasibility, we restricted to English-language reviews, and it is unknown how many of the 39 reviews in other languages that we screened would have met our eligibility criteria. The decision to limit the inclusion of reviews of observational data to adverse effects data was made during the process of full-text screening and for pragmatic reasons. We also did not consider a search of the PROSPERO database for ongoing systematic reviews; however, in preparing this report, we performed a search and found that any completed reviews were already considered for eligibility or were not available at the time of our literature search. When charting results, we took a broad perspective, which may be different than if these reviews were more formally assessed during an overview of systematic reviews.

Conclusions

Cannabis-based medicine is a rapidly emerging field of study, with implications for both healthcare practitioners and patients. This scoping review is intended to map and collate evidence on the harms and benefits of medical cannabis. Many reviews were unable to provide firm conclusions on the effectiveness of medical cannabis, and results of reviews were mixed. Mild adverse effects were frequently but inconsistently reported, and it is possible that harms may outweigh benefits. Evidence from longer-term, adequately powered, and methodologically sound RCTs exploring different types of cannabis-based medicines is required for conclusive recommendations.