Background

Defining complementary, alternative and integrative medicine (CAIM) has been both complex and dynamic. The US National Center for Complementary and Integrative Health (NCCIH) defines “complementary” medicine as a non-mainstream practice that is used together with conventional medicine and “alternative” medicine as a non-mainstream practice used in place of it. They define “integrative health” as the bringing together of conventional and complementary approaches in a coordinated way [1]. In all three instances, these terms imply a relationship to conventional medicine, which may limit the categorization of therapies that have an undefined or non-existent relationship to conventional care [2]. Another challenge is that many of these terms are used interchangeably in the medical literature despite having marked differences in their meanings, and there is no universal consensus regarding which term ought to be used or is the most “correct”. Other, less frequently used terms to describe these therapies also include “unconventional”, “unorthodox”, and “non-mainstream”, which are all reflective of therapies that are not typically taught at and/or provided by Western health care systems. Historically, subsets of such therapies have also been referred to as “quackery” and “charlatanism”, among other pejorative terms that are generally not used to describe them in the medical literature today [2].

Despite the difficulties in defining CAIM, it is well-documented that therapies described as complementary, alternative, traditional, or integrative are used with a high prevalence across the world. Many patients use CAIM in combination with, and a minority in lieu of, conventional care. Eighty-eight percent of World Health Organization member states (170 countries) have acknowledged the use of CAIM, having formally developed policies, laws, regulations, programs and offices for CAIM, as examples [3, 4]. The prevalence of CAIM use among many Western countries is highly variable, though in some countries it can be high; for example, among Canadians it is approximately 80% [5]. Across European countries, CAIM use has been found to vary from 0.3% to 86% [6, 7]. The use of CAIM is also known to be highly prevalent among patients living with a wide range of diseases/conditions; in cancer patients, as many as 90% report using some form of CAIM [8,9,10]. While one reason for these large differences in the prevalence of CAIM use across different jurisdictions may indeed be attributed to cultural norms or true preferences for or against CAIM, another reason includes the fact that there is simply no consensus, and therefore standard, for what is or is not included in an operational definition of CAIM. Even national surveys, themselves, do not contain an identical list of therapies when compared across time within countries.

The popularity and acceptance of different CAIM therapies have also not remained equal, but instead have varied over time, culture, and geographical region. For example, in the 1900s, animal magnetism (also known as mesmerism) was a type of CAIM that had gained some popularity in Europe and the United States, though conventional medical practitioners at the time viewed it with skepticism [11, 12]. Today, however, it is largely unpracticed and could arguably be excluded from an operational definition of CAIM. Other CAIMs have gained increased popularity, as well as greater acceptance from conventional healthcare practitioners in some regions of the world, such as chiropractic [13], naturopathy [14, 15], acupuncture [16, 17], and traditional Chinese medicine [18, 19].

Regardless of how CAIM therapies gain popularity among patients, the reasons that motivate patients to use CAIM are well-studied and some of the most common ones include: symptom relief, improved quality of life, augmentation of conventional therapy, support of one’s philosophical orientations towards health, and achievement in control over one’s care [20,21,22]. Due to the popularity of these therapies in some populations [23] and even some significant results of efficacy [24], they could arguably be offered in conventional healthcare settings including family physician practices, hospitals and hospices. The very fact that patients actively choose to use CAIM therapies, with many lacking safety and efficacy profiles, justifies the conducting of research in this field. New knowledge gained in turn, can be incorporated into the medical curriculum, and can help inform shared decision-making between healthcare practitioners and patients. Unsurprisingly, it is also known that the quantity of CAIM research being conducted has increased greatly over the past few decades [2, 25].

A theoretical definition of CAIM, however, is arguably not enough to inform certain types of CAIM research. Aside from studies testing specific CAIM therapies, such as those conducted through randomized controlled trials, currently published systematic reviews and bibliometric analyses on CAIM in general address multiple CAIM therapies and lack complete search strategies [26]. This can be attributed to the fact that no standard list of CAIM therapies is agreed upon within the research community, largely due to the lack of an existing comprehensive operational definition. This, in turn, results in a great omission of potentially eligible studies across these research methods, which yield biased or incomplete results. This justifies the development of an operational definition of CAIM, which if comprehensive, can serve as a solution. An operational definition serves a different purpose than a theoretical definition, as it identifies all (if not, as many as possible) therapies that can be categorized as CAIM, yet it is also a far more challenging definition to create. Like CAIM itself, an operational definition of it is dynamic, changing based on both historical time period in light of new evidence generated from medical research, and geographical location whereby many jurisdictions may integrate or consider their traditional system(s) of medicine as conventional care.

Developing an operational definition of CAIM

To date, only one operational definition of complementary and alternative medicine (CAM, not CAIM) has been published by Wieland et al. in 2011. They began by considering ways in which the 2005 Institute of Medicine theoretical definition of CAM, as therapies “other than those intrinsic to the politically dominant health system of a particular society or culture in a given historical period”, was relevant to the landscape of the early twenty-first century. To obtain a list of specific therapies, they examined sources in the US National Library of Medicine (NLM) PubMed database including the Medical Subject Heading (MeSH) definition of “Complementary Therapies” and the CAM on PubMed subset search strategy. They created an initial list of 70 alphabetical CAM terms or combinations of terms under subtopics according to the 5 categories of CAM therapies set by the National Center for Complementary and Alternative Medicine (NCCAM, the former name of the NCCIH at the time), and then subjected these terms to further qualifications and refinements based on setting, route of administration, and therapy/indication pairings [27]. Although the term “integrative” medicine had been in use as early as 1995 [28, 29], it remained a relatively infrequently used term at the time that Wieland et al.’s study was published [2]; thus, it is understandable why their definition did not include this term. Over the last decade, however, the use of the term “integrative” to refer to such therapies has become increasingly popular by both healthcare practitioners and researchers alike [2, 30, 31]. Considering that the NCCAM was renamed the National Centre for Complementary and Integrative Health (NCCIH) in December 2014, the update to their name is significant and indicates the emergence of patient, clinician, researcher and policy maker interest in an integrative approach in medical treatment plans [32]. It thus follows that a new operational definition that includes “integrative” is created.

Despite the omission of the term “integrative”, Wieland et al.’s study is a valuable starting point for the development of the present study’s operational definition, as they detailed how they constructed their definition, such as considering the historical context of a therapy, whether it is a standard treatment within the dominant medical system, whether it is a standard treatment for a given condition, and the setting in which the therapy is provided [27]. A number of sentiments shared by Wieland et al., with respect to the value of an operational definition, therefore, equally apply to the present study. An operational definition of CAIM would support the harmonization of research, as CAIM-specific research databases can be developed in a more standardized fashion with respect to classifying what constitutes included therapies. This may also allow for more effective collaboration among research groups, as a general consensus can be reached rapidly [27]. Operationalization also enables the precise comparison of different CAIM areas over time and across investigators [27]. Undoubtedly, value has emerged from Wieland et al.’s (2011) work, as a variety of studies have utilized their operational definition to inform their research. Some examples include a literature review of traditional and complementary medicine in the context of mental health services in low- or middle-income countries [33] and a systematic review of the cost-effectiveness of common complementary and integrative therapies [34]. Studies have also used Wieland et al.’s operational definition with some modification [6], or in combination with other approaches to propose an operational definition for clinical pathways [35].

The methods used by Wieland et al. (2011) to construct their operational definition, was not without its weaknesses, however, and the present study aims to update and build on their work in a few ways. Wieland et al. (2011) only reviewed two sources within the US National Library of Medicine’s PubMed database, the MeSH definition of "Complementary Therapies" and the Complementary Medicine subset search strategy, to generate a listing of specific therapies [27]. In light of these shortcomings, the objective of the present study was to create an operational definition of CAIM derived from a systematic search of four peer-reviewed or otherwise quality-assessed information resource types.

Methods

Approach

Preliminary searches were conducted to identify studies that have provided an operational definition of CAIM (and CAIM-related terms), of which only Wieland et al.’s (2011) study was found. Following this, searches were conducted during the weeks of August 24 and 31, 2020 across four different types of quality-assessed media, including 1) peer-reviewed articles from seven major databases (MEDLINE, EMBASE, AMED, PsycINFO, CINAHL, Scopus and Web of Science, searched systematically), 2) “Aims and Scope” webpages of peer-reviewed CAIM journals, 3) entries containing CAIM therapies in highly-accessed online encyclopaedias, and 4) highly ranked websites resulting from Health On the Net Code of Conduct (HONcode) searches. These four types of media were specifically selected, as they have been deemed to contain quality-assessed information. Peer-reviewed articles and peer-reviewed CAIM journals are both academic authorities on CAIM research. Highly accessed encyclopedias contain entries written by experts in their corresponding fields; they are fact-checked and frequently are also peer-reviewed. Websites present on HONcode are assessed for reliability and credibility of information, and must meet specific criteria in order to be certifiable and appear in HONcode searches (unlike Google or Yahoo!, for example). Eligible items identified across all four resource types were reviewed for therapies relating to CAIM (and CAIM-related terms, such as “complementary”, “alternative” or “integrative” medicine), which were then data extracted for inclusion in the operational definition of CAIM. A protocol was registered with the (Prospective Register of Systematic Reviews) PROSPERO, registration number CRD42020206301. It should be noted that in our PROSPERO registration, we also describe the development of academic database search strategies informed by this operational definition, which we plan to publish separately. At present, a preprint of this second manuscript is available here: https://doi.org/10.21203/rs.3.rs-1390385/v1.

Eligibility criteria

Based on the differing nature of these four media sources, we applied specific inclusion criteria to each in order to inform the development of an operational definition of CAIM. Peer-reviewed articles were deemed eligible if they provided a list or group of CAIMs, or CAIM-related terms (e.g. a list of alternative medicines, etc.). We specifically excluded articles that did not provide a list or group of CAIM therapies, as this would have been extremely time-consuming with little return in benefit, as the vast majority of these articles pertained to the study of a single CAIM. Peer-reviewed journals’ “Aims and Scope” webpages were deemed eligible if the title of the journal contained the words “complementary”, “alternative”, and/or “integrative”. Highly-accessed online encyclopaedias were eligible if they were not publicly editable (e.g. Wikipedia entries were excluded) and contained entries relating to complementary, alternative and/or integrative/integrated medicine. As we sought to develop an operational definition, we did not include encyclopaedia entries about specific CAIMs (e.g. chiropractic, acupuncture, etc.). Highly ranking websites which appeared within the first 20 results (or first two search results pages) of each HONcode search were reviewed; websites were deemed eligible if they contained any CAIM therapies (i.e. therapies explicitly described/listed as a CAIM [or synonym thereof, e.g. complementary medicine, alternative medicine, integrative medicine] on the website itself). HONcode search results also yielded peer-reviewed articles, which were treated based on the eligibility criteria of peer-reviewed articles. Any items not published in the English language were excluded across all four media types.

Searching and screening

MEDLINE, EMBASE, AMED, PsycINFO, CINAHL, Scopus and Web of Science (WoS) were searched from inception of each respective database on August 25th, 2020. The search strategies were developed by JYN and included terms that commonly refer to CAIM [1]. Eligible full-text articles were identified by screening abstracts and titles independently and in duplicate. Citations of these articles were also checked to retrieve new literature to contribute to the operational definition. Eligible “Aims and Scope” webpages were identified using Scimago (https://www.scimagojr.com/ [“Complementary and Alternative Medicine” Category]) and Journal Citation Reports (https://jcr.clarivate.com/ [“Integrative and Complementary Medicine” Category]). Highly-accessed online encyclopaedias were identified via Alexa ranking [36]. The search strategies run on the seven databases can be found in Table 1.

Table 1 Academic Database Search Strategies Informing the Development of an Operational Definition of Complementary, Alternative, and Integrative Medicine, Executed August 25, 2020
Full size table

Highly-ranking websites were identified by means of search strategies developed by JYN, relating to CAIM definitions via HONcode searches [37]. Twenty terms were searched on https://www.hon.ch/en/search.html and sorted by “Relevance” and “All” including: “alternative medicine search strategy”; “complementary medicine search strategy”; “integrated medicine search strategy”; “integrative medicine search strategy”; “list of alternative medicine”; “list of complementary medicine”; “list of integrated medicine”; “list of integrative medicine”; “operational definition of alternative medicine”; “operational definition of complementary medicine”; “operational definition of integrated medicine”; “operational definition of integrative medicine”; “types of alternative medicine”; “types of complementary medicine”; “types of integrated medicine”; and “types of integrative medicine”. The first two pages (first 20 results) were reviewed for each search, totalling 320 webpages (16 search terms).

TD and ED screened the titles and abstracts of peer-reviewed articles recovered from MEDLINE, EMBASE, AMED, PsycINFO, CINAHL, Scopus, Web of Science and HONcode independently and in duplicate. TD and ED screened a subset of the CAIM journal “Aims and Scope” webpages independently and in duplicate. ZT and AV screened CAIM entries in highly-accessed online encyclopaedias, HONcode searches, and a subset of the journal “Aims and Scope” webpages, both independently and in duplicate. Duplicates resulting from searches between and across all four media sources were removed. After all the items were screened, TD, ED, ZT, and AV met with JYN to discuss and resolve discrepancies. These results were checked over an additional time by LSW and DM.

Data extraction and analysis

The full-texts of each eligible item was saved offline, and these versions were used to conduct our data extraction and analysis, as opposed to revisiting the online sources, to ensure that any content did not change over time. ZT and AV data extracted the names of CAIM therapies from eligible HONcode searches, CAIM-related entries in the most-visited online encyclopaedias, and journals’ “Aims and Scopes” webpages, in addition to those from the the Cochrane operational definition of complementary medicine, independently and in duplicate. TD and ED extracted the names of CAIM therapies from eligible peer-reviewed articles, including those resulting from HONCode searches, independently and in duplicate. After all the names of CAIM therapies were data extracted, TD, ED, ZT, and AV met with JYN to discuss and resolve discrepancies. These results were checked over an additional time by LSW and DM.

Creation of a CAIM operational definition

A list of all names of CAIM therapies yielded from all data extractions across were compiled into a Microsoft Excel spreadsheet, and duplicates were removed. Given the large number of CAIM therapies identified, TD, ED, ZT, and AV reviewed each item an additional time for accuracy. Upon finalizing the list of CAIM therapies included in the operational definition, we grouped similar/identical CAIM therapies (e.g. “St. John’s wort” and “Hypericum perforatum”) together to appear on a single line, then alphabetized all lines. A certain degree of evaluator judgement was exercised in determining 1) whether a therapy was considered CAIM and 2) whether one or more CAIMs were similar/identical to one another. To guide our decisions, we also consulted monographs published by the Natural Medicines Research Collaboration [38] to identify all common and scientific names pertaining to each CAIM therapy; in cases where no professional monograph was available, we consulted the peer-reviewed literature. We note that we did not discriminate between very broad (i.e. “complementary and alternative medicine”) and highly specific (i.e. “St. John’s wort”) CAIMs; therefore, we included any term that we identified that referred to a single or a group of CAIM(s) or this category of therapies altogether. We also note that we included therapies that may serve as CAIM in one context and conventional medicine in another; these were included based on the fact that they were denoted as CAIM in the original source found through our systematic search. Additionally, JYN and LSW have considerable experience studying CAIM, and DM is a highly experienced research methodologist; both assisted in guiding the other authors in making a finalized judgement resulting in the finalized operational definition of CAIM.

Results

The search conducted on OVID databases (AMED, EMBASE, MEDLINE, PsycINFO), Web of Science, CINAHL, Scopus and HONCode peer-reviewed sources retrieved a total of 1255 results, of which a total of 483 were unique. From the 483 results, 424 titles/abstracts were excluded, leaving 59 results that were deemed eligible based on their title/abstracts. This was followed by 34 further exclusions, leaving 25 results deemed eligible based on their full text. Of the remaining 25 full-text articles, 9 were excluded, resulting in 16 full-text publications to remain. Three additional publications were retrieved from the citations of the 16 full-texts, totaling 19 full-text publications. Thus, 19 journal articles contributed to providing CAIM terms for the operational definition. In terms of non peer-reviewed article sources, 22 journals from SCIMAGO and JCR, 11 encyclopedias from Alexa rankings, and 49 eligible non-peer reviewed article HONCode search entries were also reviewed for contribution to the CAIM terms for the operational definition. Overall, a total of 101 items were obtained from both peer-reviewed and non-peer reviewed sources; a complete bibliography of these items are provided in Supplementary File 1. Our final operational definition in this study includes a total of 604 unique CAIM terms, based on the 1561 terms CAIM terms extracted from the final 101 items in addition to the 259 terms retrieved from the Cochrane operational definition of complementary medicine. A modified Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) diagram depicting all searched, screened, and included items is shown in Fig. 1.

Fig. 1
figure 1

PRISMA Diagram

Full size image

Operational definition of CAIM

Of the 1561 final terms that underwent further analysis, 149 terms were removed as they were not considered CAIM, resulting in 1412 terms. The 259 terms retrieved from the Cochrane Complementary Medicine operational definition of complementary medicine were screened for CAIM terms that were not already included in the list of final terms, after which 82 were deemed to be unique, and subsequently added to the operational definition on March 18, 2021. After these changes, a total of 1494 terms were standardized as informed by the process of proximity searching; terms were standardized under keywords or phrases that typically appear in approximate sets of words in literature. After standardization, the final list of CAIM therapies included in our study was 604 as they described the fundamental nature of CAIM rather than actual CAIM therapies. The complete operational definition of CAIM is provided in Table 2.

Table 2 Operational Definition of Complementary, Alternative and Integrative Medicine
Full size table

Discussion

In the present study, we created an operational definition of CAIM informed by a systematic search of four quality-assessed media sources. Prior to the creation of this operational definition, only one study conducted by Wieland et al.’s (2011) had developed an operational definition of CAM (excluding the term “integrative”) containing 70 therapies. This number was later expanded through addition of further examples to 259 therapies which are listed on the Cochrane Complementary Medicine website [39]. The present study’s operational definition contains 1561 unique terms which comprise 604 CAIM therapies, in which all 259 aforementioned therapies are included. This updated definition more than doubles the list of CAIM therapies and provides researchers with a considerably more comprehensive list of therapies to improve the conduct of future CAIM research involving systematic searches, such as reviews and bibliometric analyses.

Perceived utility of an updated operational definition for future CAIM research

Systematic and scoping reviews

Systematic and scoping reviews are research methodologies which use repeatable analytical methods to search for, gather, and summarize literature on a given topic in order to fill a knowledge gap [40,41,42,43,44,45]. Standardized academic search strategies are of great benefit to researchers seeking to conduct these types of studies, as this yields more consistent search results; this in turn, can maximize the opportunity of capturing as much of the relevant available peer-reviewed literature as possible, identify gaps in research, and inform potential future directions [46,47,48,49,50]. This is no exception with respect to CAIM-specific research, however, conducting systematic searches within this particular field comes with its own particular challenges [51] due to the fact that prior to this study, there was no standardized list of terms used to inform a search. To date, the search strategies used to identify general CAIM-related literature appear to differ from researcher to researcher, undoubtedly resulting in selection biases with respect to therapies included [51]. Furthermore, indexed headings relating to CAIM are not standardized across different databases, nor is any single indexed term (or group of indexed terms) comprehensive enough to capture the entirety of the CAIM literature [51,52,53,54]. The standardized search strategies provided in this study can, therefore, mitigate this challenge by establishing a replicable collection of literature pertinent to the topic of CAIM. It can be anticipated that should future systematic and scoping reviews employ the search strategies informed by this operational definition, they will yield more comprehensive results, which will consequently serve to more comprehensively capture eligible articles regardless of the defined inclusion criteria.

Bibliometric analyses

A bibliometric analysis is a research methodology that involves the statistical assessment of scientific articles or books, to identify the characteristics and determine the impact of the literature published in a specific academic discipline [55,56,57,58,59]. Unlike the systematic or scoping review, however, no reporting guideline nor standard checklist for the conduct of a bibliometric analysis exists to date [60]; despite this, all bibliometric analyses typically share common similarities such as the assessing of one or more of the following characteristics: number of publications (in total and per year); open access status; articles per journals; journal names and impact factors; language of article; document type; publication country; author affiliations; funding sponsors; most highly published authors; and highest-cited articles [46, 61, 62]. Unlike the literature on other academic topics which may be captured by relatively short and simple search strategies, the conduct of a comprehensive bibliometric analysis specific to CAIM in general needed to include a defined list of CAIM therapies for the purpose of constructing the search strategy employed on academic databases. Hence, published bibliometric analyses on CAIM have been largely relegated to those assessing research published in CAIM journals [63,64,65], based on certain research methodologies (i.e. trials [66, 67]), or those specific to certain categories of CAIM (i.e. acupuncture [68, 69], apitherapy [70], yoga [71, 72] and homeopathy [73], among others). As with this operational definition’s utility to reviews, these standardized search strategies provided in this study can also mitigate these challenges by establishing a replicable collection of literature pertinent to the topic of CAIM [27]. It can be anticipated that should future bibliometric analyses employ search strategies informed by this operational definition, they will yield more comprehensive results, which will serve to better monitor the development, growth, and characteristics of the field of CAIM in general.

Existing challenges and limitations of developing an operational definition of CAIM

While we anticipate that this operational definition of CAIM will provide much value to the future of CAIM research, it must be acknowledged that it is not without limitations, many of which are a result of a number of existing challenges that remain with respect to conducting research in this field.

Underinclusiveness and overinclusiveness: different countries, cultures, systems of traditional medicine and schools of thought

Firstly, it must be re-stated that CAIM therapies are and will likely forever be dynamic in nature, which makes it complex to define operationally. Even though our operational definition was informed by systematic searches, because there is no general standard nor agreement as to what constitutes a CAIM therapy, even among experts [27, 51], this list was therefore, constructed based on media sources largely authored by this group of individuals. It must also be acknowledged that certain types of CAIMs are inherently challenging to define. For example, certain CAIM therapies or systems of CAIM are difficult to categorize for multiple reasons; they originate from different regions of the world, cultures, systems of traditional medicine, and schools of thought [4, 74]. For example, CAIM therapies rooted in Buddhist practices originate from Eastern cultures such as Cambodia, Thailand, Myanmar, Bhutan, and Sri Lanka where they may be considered part of conventional care, however, their usage is considered to be CAIM across many European and North American countries [75, 76]. This challenge is further compounded across certain categories of CAIM. Herbal therapies, for example are referred to in multiple different ways, which may include scientific names and multiple common names, the latter of which may be derived from multiple languages, and not necessarily just English [77]. For other therapies, whether they are defined as CAIM or not are situational, even if considered within the context of conventional medical care. One example of this includes chelation therapy, which is the primary treatment method of heavy metal poisoning, and in this context it is considered as conventional care. However, when this same therapy is used for the treatment of atherosclerosis, it is considered CAIM [39]. Another example of this includes vitamins; in the context of treating diseases resulting from vitamin deficiency, these therapies are considered part of conventional care, however, the use of large doses of vitamins, often many times greater than the recommended dietary allowance (known as megavitamin therapy or orthomolecular medicine) is typically categorized as CAIM [39, 78]. Thus, even the most well-constructed operational definition of CAIM will suffer from both underinclusiveness and overinclusiveness; certainly a deeper discussion of the contexts and settings whereby each of the therapies found on our list constitute CAIM is of value, however, this is beyond the scope of the present study. Despite this, the value added by this operational definition as a result of being informed by a systematic search strategy, includes the fact that it has largely captured the most common terms used to refer to the most commonly-researched CAIMs.

English-language bias

Apart from the aforementioned challenges in defining CAIM, the very fact that this operational definition was searched for and constructed based on only the English language and literature serves as a limitation. Language biases are an additional and significant obstacle to CAIM research, and no single language or group of languages can sufficiently capture the entirety of the CAIM literature. It can reasonably be inferenced that research conducted on CAIM therapies originating from a certain region or culture are commonly published in the local or national language(s). The majority of CAIM studies, however, are published by English-language non-CAIM journals and by Chinese-language CAIM journals [67]. It has also been found that while the English journals publish a higher frequency of studies reporting negative results associated with CAIM therapies, Chinese, Japanese, and Russian journals have published more positive results [79, 80]. Although little is known about CAIM research published in other languages, such stark differences in findings only based on the English versus Chinese, Japanese and Russian languages, likely mean that large degrees of variance in findings likely exist between other languages too [81, 82].

Our operational definition is, therefore, limited by an English-language and Western bias, as the umbrella term of CAIM itself is largely a Western concept [83]. As mentioned earlier, many traditional medicines comprise a part of conventional care in non-Western countries, and are sometimes regarded as safe and effective (if not safer and more effective) in comparison to conventional Western medicine [80, 84]. One example includes Kampo, a Japanese traditional medicine system which incorporates herbal medicine and acupuncture therapies, which is commonly practiced in tandem with Western medicine, and is partly covered by public health insurance in Japan [85,86,87,88]; such therapies arguably would not fall under a Japanese definition of CAIM. Another example includes traditional Chinese medicine (TCM), which like Kampo, is used in conjunction with Western medicine in China. Although it has existed for many thousands of years, in recent years the study of TCM has been studied, produced, and dosed based on modern research technologies [89, 90]. Furthermore, TCM has been standardized by the government of China in a gradual process, with complete diagnostic and treatment guidelines and basic principles that act as the basis of scientific research and education on TCM [89,90,91]. From a Chinese cultural perspective, therefore, TCM would by definition not be considered CAIM either. Similar challenges in Western countries to the CAIM status of some therapies originating from early professional or quasi-professional practitioners of Western medicine can also be observed. Among CAIM professions, disputes among practitioners can lead to divisions in how a given therapy is practiced and perceived. The chiropractic profession is one example with a turbulent history; while some practitioners sought to align themselves more closely with conventional medical practitioners, others acted to reject this notion [92, 93]. Today, the profession in North America still remains divided, however, a significant number of members have succeeded in advancing the profession to a point whereby certain jurisdictions regard chiropractic care as conventional medicine [94,95,96].

Lack of CAIM therapy categorization

Following the development of the operational definition, we opted not to categorize the list of CAIM therapies, and instead present it alphabetically. While this may be perceived as a limitation, this decision was made based on the fact that no international standard for categorizing CAIM therapies exist [27]. While it could be argued that the CAIM therapies could have been categorized based on an arbitrarily-selected categorization system (i.e. natural products, mind and body practices [1]), a subsequent challenge included the fact that no consensus exists regarding which CAIM therapies fall into which categories. While management of an additional layer of classifications may be an onerous task to conduct in this already ambitious present study, its operationalization may support further work in identifying categories of CAIM therapies. Further research seeking to develop consensus around both CAIM therapy categories, and the categories under which each CAIM therapy falls into, may be of value in the future, however, the achievement of this represents both a time-consuming and resource-intensive venture that is beyond the scope of our present study.

Plans to update the operational definition

We propose a two-stage approach with respect to updating this operational definition of CAIM. This group of authors will convene annually to discuss the definition and the emergence of new publications that may influence the need to update. The group will decide via consensus on the need to update (yes/no). In the event of “no”, the group will meet the following year. In the event of a “yes” the group will post their decision either through social media or formal correspondence to the publishing journal. This will be followed by a formal update.

Conclusion

The present study involved a systematic search of four quality-assessed information resource types which was used to create an operational definition of CAIM. While this operational definition is not without its limitations, it represents a highly comprehensive list of therapies. This operational definition can be used to improve the conduct of future CAIM research involving systematic searches, thereby supporting the harmonization of CAIM-related research through the provision of a standard of classification, as well as support improved collaboration between different research groups with a vested interest in this topic area.