Research Methodology Evaluating Complementary and Alternative Therapies

Abstract

Complementary and alternative medicine (CAM) represents an opportunity to expand tools for assisting patients with health care issues, retain or increase market share by proactively responding to consumers, and increase our understanding of interventions outside of conventional medicine. CAM research is a flourishing area that is currently receiving a new focus as a result of the creation of recognized CAM research centers in university settings worldwide. Several botanical products, complex CAM interventions and individual approaches are now being tested with rigorous and well-controlled research. Adequate execution of clinical trials, however, represents a major challenge, particularly in medical fields such as pediatrics and CAM therapies such as acupuncture and herbal medicine.

The scientific community, industry, and consumers are joining efforts to provide reliable and objective information about the efficacy and safety of CAM therapies. Medical journals are publishing CAM-related issues regularly and there is concern about quality of clinical trials, reliability of results, placebo effect, and publication bias. The number of CAM clinical trials continues to grow although it is still very low compared with conventional medicine trials. There are major research methodology issues that need to be considered in CAM research that have not been completely and thoroughly evaluated. Nevertheless, ideas have been proposed and innovative projects are ongoing. The conduct of CAM research requires the commitment of the scientific community as well as substantial funding from governmental institutions and the pharmaceutical industry.

This is a preview of subscription content, access via your institution.

References

  1. 1.

    Malik IA, Khan NA, Khan W. Use of unconventional methods of therapy by cancer patients in Pakistan. Eur J Epidemiol. 2000;16(2):155–160.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  2. 2.

    Wootton JC. Sparber A. Surveys of complementary and alternative medicine: part I. General trends and demographic groups. J Altern Complement Med. 2001;7(2):195–208.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  3. 3.

    Thomas KJ, Nicholl JP, Coleman P. Use and expenditure on complementary medicine in England: a population based survey. Complement Ther Med. 2001;9(1):2–11.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  4. 4.

    Eisenberg DM, Davis RB, Ettner SL. Appel S, Wilkey S. Van Rompay M. et al. Trends in alternative medicine use in the United States, 1990–1997: Results of a follow-up national survey. JAMA. 1998;280(18):1569–1575.

    CAS  Article  Google Scholar 

  5. 5.

    Fisher P, Ward A. Complementary medicine in Europe. Br Med J. 1994;309(6947):107–111.

    CAS  Article  Google Scholar 

  6. 6.

    MacLennan AH, Wilson DH. Taylor AW. Prevalence and cost of alternative medicine in Australia. Lancet. 1996; 347(9001):569–573.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  7. 7.

    Archer C. Research issues in complementary therapies. Complement Ther Nurs Midwifery. 1999;5(4):108–114.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  8. 8.

    Astin JA, Marie A, Pelletier KR, Hansen E. Haskell WL. A review of the incorporation of complementary and alternative medicine by mainstream physicians. Arch Intern Med. 1998;158(21):2303–2310.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  9. 9.

    Kessler RC, Davis RB, Foster DF, Van Rompay MI, Walters EE, Wilkey SA, et al. Long-term trends in the use of complementary and alternative medical therapies in the United States. Ann Intern Med. 2001;135(4):262–268.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  10. 10.

    Emst E. Research into complementary/alternative medicine: an attempt to dispel the myths. Int J Clin Pract. 2001;55(6):376–379.

    Google Scholar 

  11. 11.

    Mills SY. The House of Lords report on complementary medicine: a summary. Complement Ther Med. 2001;9(1):34–39.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  12. 12.

    Nahin RL, Straus SE. Research into complementary and alternative medicine: problems and potential. Br Med J. 2001;20;322(7279):161–164.

    CAS  Article  Google Scholar 

  13. 13.

    Muscat M. Straus gives state of the center, CAM on PUBMED unveiled. Altern Ther Health Med. 2001;7(2):23–26.

    CAS  PubMed  PubMed Central  Google Scholar 

  14. 14.

    Bensoussan A. Complementary medicine. Searching for the evidence. Aust Fam Physician. 2000;29(12):1129–1133

    CAS  PubMed  PubMed Central  Google Scholar 

  15. 15.

    Vickers A. Recent advances: complementary medicine. Br Med J. 2000;321(7262):683–686.

    CAS  Article  Google Scholar 

  16. 16.

    Dougherty K, Touger-Decker R, O’Sullivan MJ. Personal and professional beliefs and practices regarding herbal medicine among the full time faculty of the Newark-based schools of the University of Medicine and Dentistry of New Jersey. Integrative Med. 2000;2(2):57–64.

    CAS  Article  Google Scholar 

  17. 17.

    Haynes B. Can it work? Does it work? Is it worth it? The testing of healthcare interventions is evolving. Br Med J. 1999;319(7211):652–653.

    CAS  Article  Google Scholar 

  18. 18.

    Barnes J, Abbot NC, Harkness EF, Ernst E. Articles on complementary medicine in the mainstream medical literature: an investigation of MEDLINE, 1966 through 1996. Arch Intern Med. 1999;159(15):1721–1725.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  19. 19.

    Vickers AJ. Bibliometric analysis of randomised controlled trials in complementary medicine. Complement Ther Med. 1998;(6):185–189.

    Google Scholar 

  20. 20.

    Eisenberg DM, et al. Unconventional Medicine in the United States: Prevalence, Cost, Patterns of Usage. New Engl J Med. 1993;328:246–252

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  21. 21.

    Beyerstein BL. Alternative medicine and common errors of reasoning. Acad Med. 2001;76(3):230–237.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  22. 22.

    Bostrom H. Placebo—the forgotten drug. Scand J Work Environ Health. 1997;23 Suppl 3:53–57.

    PubMed  PubMed Central  Google Scholar 

  23. 23.

    Vickers A. Methodological issues in complementary and alternative medicine research: a personal reflection on 10 years of debate in the United Kingdom. J Altern Complement Med. 1996;2(4):515–524.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  24. 24.

    Levin JS. Glass TA, Kushi LH, Schuck JR, Steele L, Jonas WB. Quantitative methods in research on complementary and alternative medicine. A methodological manifesto. NIH Office of Alternative Medicine. Med Care. 1997:35(11):1079–1094.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  25. 25.

    Enkin MW, Jadad AR. Using anecdotal information in evidence-based health care: heresy or necessity? Ann Oncol. 1998;9(9):963–966.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  26. 26.

    Redelmeier DA, Rozin P, Kahneman D. Understanding patients’ decisions. Cognitive and emotional perspectives. JAMA. 1993;270(1):72–76.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  27. 27.

    Benson K, Hartz AJ. A comparison of observational studies and randomized, controlled trials. N Engl J Med. 2000;342(25):1878–1886.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  28. 28.

    Gill P, Dowell AC, Neal RD, Smith N, Heywood P, Wilson AE. Evidence based general practice: a retrospective study of interventions in one training practice. Br Med J. 1996;312(7034):819–821.

    CAS  Article  Google Scholar 

  29. 29.

    Sackett DL, Cook DJ. Can we learn anything from small trials? Ann N Y Acad Sci. 1993;703:25–31; discussion 31–2.:25–31.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  30. 30.

    Jadad A. Types of randomised controlled trials, In: Randomised Controlled Trials. A User’s Guide. Chapter 2. London: BMJ Books; 1998.

    Google Scholar 

  31. 31.

    Jadad AR, Rennie D. The randomized controlled trial gets a middle-aged checkup. JAMA. 1998;279(4):319–320.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  32. 32.

    Gould AL. Another view of active-controlled trials. Control Clin Trials. 1991;12(4):474–485.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  33. 33.

    Resch K. Pragmatic randomised controlled trials for complex therapies. Forsch Komplementarmed. 1998; 5 Suppl SI: 136–139.:136–139.

    PubMed  PubMed Central  Google Scholar 

  34. 34.

    Abel U, Koch A. The role of randomization in clinical studies: myths and beliefs. J Clin Epidemiol. 1999;52(6):487–497.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  35. 35.

    Wilson GT. The clinical utility of randomized controlled trials. Int J Eat Disord. 1998;24(1):13–29.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  36. 36.

    Britton A, McKee M, Black N, McPherson K, Sanderson C, Bain C. Threats to applicability of randomised trials: exclusions and selective participation. J Health Serv Res Policy. 1999;4(2):112–121.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  37. 37.

    Herman J. Shortcomings of the randomized controlled trial: a view from the boondocks. J Eval Clin Pract. 1998;4(4):283–286.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  38. 38.

    Bottomley A. To randomise or not to randomise: methodological pitfalls of the RCT design in psychosocial intervention studies. Eur J Cancer Care. 1997; 6(3):222–230.

    CAS  Article  Google Scholar 

  39. 39.

    Vijan S, Kent DM, Hayward RA. Are randomized controlled trials sufficient evidence to guide clinical practice in type II (non-insulin-dependent) diabetes mellitus? Diabetologia. 2000;43(1):125–130.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  40. 40.

    Clarke GN. Improving the transition from basic efficacy research to effectiveness studies: methodological issues and procedures. J Consult Clin Psychol. 1995;63(5):718–725.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  41. 41.

    Wells KB. Treatment research at the crossroads: the scientific interface of clinical trials and effectiveness research. Am J Psychiatry. 1999;156(1):5–10.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  42. 42.

    Hotopf M, Churchill R, Lewis G. Pragmatic randomised controlled trials in psychiatry. Br J Psychiatry. 1999;175:217–23.:217–223.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  43. 43.

    Hotopf M, Lewis G, Normand C. Putting trials on trial—the costs and consequences of small trials in depression: a systematic review of methodology. J Epidemiol Community Health. 1997:51(4):354–358.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  44. 44.

    Hilsden RJ, Verhoef MJ. Complementary and alternative medicine: evaluating its effectiveness in inflammatory bowel disease. Inflamm Bowel Dis. 1998;4(4):318–323.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  45. 45.

    Vickers A. A basic introduction to medical research. Part I: What is research and why do it? Complement TherNurs Midwifery. 1995:1(3):85–88.

    CAS  Article  Google Scholar 

  46. 46.

    Jacobson JS, Workman SB, Kronenberg F. Research on complementary and alternative therapies for cancer: issues and methodological considerations. J Am Med Womens Assoc. 1999;54(4):177–80, 183.

    CAS  Google Scholar 

  47. 47.

    Walker LG, Anderson J. Testing complementary and alternative therapies within a research protocol. Eur J Cancer. 1999;35(11):1614–1618.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  48. 48.

    Rudolf MC, Lyth N, Bundle A, Rowland G, Kelly A, Bosson S et al. A search for the evidence supporting community paediatric practice. Arch Dis Child. 1999;80(3):257–261.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  49. 49.

    Geddes JR, Game D, Jenkins NE. Peterson LA, Pottinger GR, Sackett DL. What proportion of primary psychiatric interventions are based on evidence from randomised controlled trials? Qual Health Care. 1996;5(4):215–217.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  50. 50.

    Sackett DL, Wennberg JE. Choosing the best research design for each question. Br Med J. 1997;20-27:315(7123):1636.

    CAS  Article  Google Scholar 

  51. 51.

    Vickers A, Cassileth B. Emst E, Fisher P, Goldman P, Jonas W, et al. How should we research unconventional therapies? A panel report from the Conference on Complementary and Alternative Medicine Research Methodology, National Institutes of Health. Int J Technol Assess Health Care. 1997;13(1):111–121.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  52. 52.

    Vickers A. The NIH Methodology Conference: the methodology debate in the United Kingdom during the past ten years. J Altern Complement Med. 1995;1(2):209–212.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  53. 53.

    Silverman WA, Chalmers I. Sir Austin Bradford Hill: an appreciation. Control Clin Trials. 1992;13(2):100–105.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  54. 54.

    Moher D. Schulz KF. Altman DG. Upage L. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet. 2001:357(9263):1191–1194.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  55. 55.

    White A, Ernst E. The case for uncontrolled clinical trials: a starting point for the evidence base for CAM. Complement Ther Med. 2001;9(2):111–116.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  56. 56.

    Guyatt G. Sackett D, Taylor DW, Chong J, Roberts R, Pugsley S. Determining optimal therapy—randomized trials in individual patients. N Engl J Med. 1986;314(14):889–892.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  57. 57.

    Cook DJ. Randomized trials in single subjects: the N of 1 study. Psychopharmacol Bull. 1996;32(3):363–367.

    CAS  PubMed  PubMed Central  Google Scholar 

  58. 58.

    Guyatt GH, Keller JL, Jaeschke R, Rosenbloom D, Adachi JD, Newhouse MT. The n-of-1 randomized controlled trial: clinical usefulness. Our three-year experience. Ann Intern Med. 1990;112(4):293–299.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  59. 59.

    Sackett DL, Haynes RB. Guyatt GH, Tugwell P. Clinical Epidemiology: A Basic Science for Clinical Medicine. 2nd ed. New York, NY: Little, Brown & Company; 1991.

    Google Scholar 

  60. 60.

    Ernst E, Resch KL. The “optional cross-over design” for randomized controlled trials. Fundam Clin Pharmacol. 1995;9(5):508–511.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  61. 61.

    Chadwick D. Monotherapy comparative trials: equivalence and differences in clinical trials. Epilepsy Res. 2001;45(1–3):101–103.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  62. 62.

    Chadwick D. Better comparisons of antiepileptic drugs: what measures of efficacy? Pharm World Sci. 1997;19(5):214–216.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  63. 63.

    Bero LA, Jadad AR. How consumers and policymakers can use systematic reviews for decision making. Ann Intern Med. 1997;127(1):37–42.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  64. 64.

    Jadad AR. Randomised Controlled Trials: A User’s Guide. London, United Kingdom: BMJ Books; 1998.

    Google Scholar 

  65. 65.

    Kemper KJ. Complementary and alternative medicine for children: does it work? Arch Dis Child. 2001;84(1):6–9.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  66. 66.

    Eisenberg DM, Kesslcr RC, Van Rompay MI, Kaptchuk TJ, Wilkey SA, Appel S. et al. Perceptions about complementary therapies relative to conventional therapies among adults who use both: results from a national survey. Ann Intern Med. 2001;135(5):344–351.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  67. 67.

    Astin JA. Why patients use alternative medicine: results of a national study. JAMA. 1998;279:1548–1553.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  68. 68.

    Kemper KJ. Holistic pediatrics = good medicine. Pediatrics. 2000;105(1 Pt 3):214–218.

    CAS  PubMed  PubMed Central  Google Scholar 

  69. 69.

    Spigelblatt L, Laine-Ammara G, Pless IB, Guyver A. The use of alternative medicine by children. Pediatrics. 1994;94(6 Pt 1):811–814.

    CAS  PubMed  PubMed Central  Google Scholar 

  70. 70.

    Simpson N. Pearch A, Finlay F, Lenton S. The use of complementary medicine in pediatric outpatient clinics. Ambulatory Child Health. 1998;3:351–356.

    Google Scholar 

  71. 71.

    Ottolini M, Hamburger E, Loprieto J. Alternative Medicine Use Among Children in the Washington DC Area. San Francisco, CA: Pediatric Academic Societies; 1999.

    Google Scholar 

  72. 72.

    Kelly KM, Jacobson JS, Kennedy DD, Braudt SM, Mallick M, Weiner MA. Use of unconventional therapies by children with cancer at an urban medical center. J Pediatr Hematol Oncol. 2000;22(5):412–416.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Carmen Tamayo MD.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Tamayo, C., Boon, H., Ghishan, F. et al. Research Methodology Evaluating Complementary and Alternative Therapies. Ther Innov Regul Sci 36, 535–548 (2002). https://doi.org/10.1177/009286150203600308

Download citation

Key Words

  • Alternative medicine
  • Complementary therapies
  • Research methodology
  • Clinical trials
  • Methods