Introduction

Despite the essential role of clinical trials in the advancement of medicine, less than 5% of adult oncology patients in the USA are enrolled in clinical trials [1]. Furthermore, minority populations are disproportionately underrepresented in clinical trials [2]. Physicians play a key role in translating research to the bedside, implementing evidence-based medicine, and recruiting participants for clinical trials [3, 4]. Physician confidence that “clinical trials provide high-quality care” have been associated with higher enrollment of patients in clinical trials [5]. Considering the essential role of research to the field, it is important that physicians be equipped to understand research and feel comfortable discussing clinical trials with their patients.

Medical school curriculum is the ideal venue to foster physician understanding of clinical research and trial accessibility. The Association of American Medical Colleges reports that 62% of matriculating medical students express interest in conducting research and over 60% considered access to research experiences during medical school “important” or “very important” when selecting a medical school [6]. In addition, 78% of graduating medical students participated in research during medical school, with 51% of respondents wanting to participate in research during their career [7]. Despite high rates of research participation during medical school, there remains a gap in research knowledge with one study finding that only 25% of second- and fourth-year medical students across three universities felt adequately trained to critically assess scientific literature [8]. Medical students need clinical research education so that they will have a solid foundation from which to interpret clinical trials, be more inclined to incorporate research into their careers, and gain confidence in discussing trials with their patients.

Physicians play a key role in recruiting a representative sample of participants into clinical trials [3, 9]. Generalizability of clinical trials is drastically limited when the sample population is not representative of the general population [10]. The U.S. Census Bureau predicts that by the year 2043, the USA will be a majority-minority nation for the first time in history, yet minority groups are still largely underrepresented in clinical trials research [11]. Composed of approximately 75% ethnic minorities, the state of Hawai ‘i can contribute valuable data essential to identifying and correcting health disparities among diverse populations [12]. With 40.8% of Hawai ‘i’s physicians receiving medical training in-state [13], medical student clinical trials education at the only allopathic medical school in the state may increase the likelihood that minority populations are recruited to clinical trials and thus improve evidence-based medicine by addressing specific sub-populational healthcare needs [12]. This article discusses a unique, comprehensive clinical research curriculum intervention for medical students at a community-based allopathic medical school designed to increase knowledge and positive attitudes about clinical research based on previous findings supporting the feasibility, desirability, and importance of such an intervention [14, 15].

To our knowledge, this institution is the only medical school in the USA to require comprehensive clinical trials education as part of the curriculum. This novel educational initiative was developed in partnership with the National Cancer Institute’s Pacific region Cancer Information Service (CIS) and the University of Hawai ‘i Cancer Center’s (UHCC) Community Outreach and Education program. The goal of the program was to foster student confidence in describing the types and phases of clinical trials, identifying barriers to enrollment, explaining the importance of clinical trials to patients, and familiarizing students with resources available to patients. In addition, in 2013 the medical school introduced a year-long elective with UHCC that provides an in-depth opportunity to learn from cancer researchers, clinical trials coordinators, and community physicians about ongoing local and national research studies on a weekly basis.

Materials and Methods

Design

The clinical trials educational programming was based on a 2002 initiative from the NCI’s CIS Pacific Region, which served Hawai ‘i and US territories in the Pacific. The CIS established a Clinical Trial Education Coalition, which is led by the UHCC with the intent of increasing awareness of clinical trials in Hawai ‘i. The clinical trials education intervention starts with a 1-h lecture for first-year medical students taught by UHCC faculty and second-year students who have completed an immersive year in clinical research with UHCC. Content covered in the lecture includes a brief history of clinical research, basic trial design, and ethical considerations, as well as national and local study participation statistics. Each student is provided with free electronic and hard copies of the Clinical Trials Education Series (CTES) Cancer Clinical Trials: The In-depth Program workbook to use as a resource throughout pre-clinical and clinical years. Two problem-based learning (PBL) clinical scenarios related to oncology trials are included in the case-based learning schedule of the first pre-clinical year. Students are tasked with learning about patient access to and available resources for clinical trials as they pertain to the cases and present their findings to a small group of classmates under the supervision of a physician tutor.

Within the first month of matriculation, medical students completed the pre-intervention baseline survey composed of 22 questions based on the NCI’s Office of Education and Special Initiative-Clinical Trial Education Series for health professionals. Survey measures were anonymous and an alphanumeric code was utilized to link baseline and post-intervention measures. Participation was voluntary, signed consent was obtained from those who chose to participate, and the research project received IRB approval from the University of Hawai ‘i. Students were asked to rate their confidence in their ability to communicate clinical trials information to patients and other health professionals in the following five domains: (1) The Clinical Trials Process, (2) Clinical Trials Design, (3) Advancing Cancer Care, (4) Barriers to Clinical Trial Participation, and (5) Conducting, Referring and Locating Clinical Trials. Responses were recorded using a 5-point Likert-type scale, where 5 represented “extremely doubtful” and 1 represented “extremely confident” in their ability to communicate the information adequately. Student attitudes about clinical trials were also assessed on a 5-point Likert-type scale where 5 was “strongly disagree” and 1 was “strongly agree” with various statements about clinical trials. A detailed description of the questionnaire and preliminary data were previously described by Mitschke et al. [14].

Participants

Baseline surveys were obtained from each cohort of first-year medical students enrolled at the medical school from 2006 through 2017 (N = 651). The 2012 cohort was not surveyed due to a scheduling conflict. Post-intervention surveys were obtained from third-year medical students of the 2006, 2011, and 2015 cohorts (N = 130) within 2 months of completing third-year clinical rotations. Scheduling difficulties prevented more consistent post-intervention administration. The post-intervention survey was identical to the baseline with the addition of three free-response questions to allow students to reflect on activities that most effectively enhanced their clinical trials education.

Data Analysis

Data analysis was conducted using IBM Statistical Package for the Social Science (SPSS version 25). Chi-squared analyses were used to determine differences in clinical trials confidence levels and attitudes between medical student cohort years. Independent samples t tests were used to compare the mean pre-intervention (N = 651) and post-intervention (N = 130) knowledge and attitudes. The means of the cumulative pre- and post-intervention scores were utilized for this analysis to include the maximal number of responses given the limited number of respondents who completed both pre- and post-intervention measures. Levene’s test for equal variance was used to determine whether equal variances could be assumed and are reflected in the confidence interval reporting.

Results

Of the 724 students who matriculated from 2006 to 2017, 651 responses were obtained for an overall baseline response rate of 90%, ranging from 78 to 97% of students in each cohort year (Table 1). A total of 191 students completed third year in the 2006, 2011, and 2015 cohorts. Post-test surveys were obtained from 130 third-year medical students for a post-intervention response rate of 68% from the cohorts surveyed. Response rates ranged from 19 to 95% (Table 1).

Table 1 Medical student pre-intervention and post-intervention survey response rates by matriculation year

The 16 statements in Table 2 directly align with the content taught in the clinical trials curriculum. The pre-intervention survey data demonstrated that first-year medical students were uncertain at best about their ability to communicate clinical trials information adequately to patients or other health professionals with a mean confidence level ranging from 3.07 to 3.73 on a Likert-type scale where a score of 1 represented “extremely confident,” 2 represented “fairly confident,” 3 “ uncertain,” 4 “somewhat doubtful,” and a score of 5 represented “extremely doubtful.” First-year students felt the least confident in the domain of conducting, referring, and locating clinical trials. Specifically, the lowest confidence was noted in describing the types of sponsorship of cancer clinical trials (M = 3.73, SD = 1.213) and defining the role of the NCI in conducting clinical trials throughout the USA (M = 3.66, SD = 1.189). There was no statistically significant difference in medical students’ pre-intervention confidence in communicating aspects of clinical trials to patients and health providers between the cohort years. First-year medical students felt the most confident describing the purpose of randomization, stratification, and blinding in clinical trials protocols (M = 3.07, SD = 1.262) with no statistical improvement post-intervention.

Table 2 Pre-intervention and post-intervention clinical trials confidence levels

There is an upward trend toward increased medical student confidence in clinical trials knowledge across all the domains assessed by the post-intervention survey, summarized in Table 2. Post-intervention, the third-year medical students were significantly more confident in their overall ability to communicate clinical trials information to patients or other health professionals with a mean score ranging from 2.58 to 3.02 on the same Likert-type scale. There were significant increases in self-reported confidence in the ability to conduct, refer, and locate clinical trials, which was the area of least confidence among medical students prior to the intervention.

Seventy-one percent of respondents agreed or strongly agreed that “it is important to include information about clinical trials in the medical school curriculum.” Medical students’ attitudes toward clinical trials are summarized in Table 3. Student attitudes were on average more positive toward clinical trials, but were not significantly different from pre-intervention, with the unexpected exception that students were more uncertain about whether clinical trials are helpful, and whether subjects are treated as guinea pigs after the curriculum.

Table 3 Pre-intervention and post-intervention clinical trials attitudes

In the free response section, students expressed motivation for learning about clinical trials. An example response was, “I would like more information about clinical trials because I believe that it is usually a viable option for many patients I have come across.” They felt “research is the way into the future of medicine,” and the curriculum allowed them to “appreciate more during tumor board” and that it was “helpful to know about clinical trials to discuss with attendings.” Students felt that “it has been helpful learning about new studies and findings.”

Discussion

Post-curricular intervention, medical student knowledge regarding clinical trials improved significantly. The minimal impact of the curriculum on students’ attitudes toward clinical trials could be attributed to the inherent neutrality of the curriculum, which was designed to present a balanced view of both the benefits and drawbacks of clinical trials. First-year medical students rated themselves uncertain at best with regards to all measured aspects of communicating about clinical trials with patients and colleagues. After an integrated curriculum intervention, there were significant improvements in students’ self-reported ability to communicate the clinical trials process, and confidence in conducting, referring, and locating clinical trials. Significant increases were also seen in self-rated ability to discuss trial design, the clinical research team, describe landmark clinical trials, and discuss the costs and insurance issues regarding clinical trials participation. Improvements on these measures are especially important since an ability to facilitate discussion of clinical trials as a viable treatment option may contribute to higher accrual rates.

While attitudes were generally positive toward clinical research and its importance in the field of medicine, there was a significant increase in students’ perception that research participants are treated like “guinea pigs.” Considering that many physicians still harbor a misconception that clinical trials represent a “last resort,” it is possible that students’ perceptions were skewed by the limited population of clinical trials patients they were exposed to. A contributing factor to this perception may be the historic exclusion and exploitation of ethnic minority groups, especially indigenous persons, in research trials. The medical school studied serves the largest population of Native Hawaiian and Pacific Islanders in the USA and as such is uniquely positioned to change the narrative of historic disenfranchisement among indigenous people and ethnic minorities. Empowering diverse populations is essential to breaking the cycle of low participation leading to poor generalizability and suboptimal treatments for these minority groups. Positive exposures to research, including opportunities for students to see how research can benefit patients and improve the standard of care, may be key components of continued efforts to improve attitudes and understanding of clinical trials.

The pre-clinical and clinical years represent an important opportunity where students are motivated to learn about and engage in clinical research. Our findings indicate that medical students were receptive to the incorporation of comprehensive clinical trials education into the medical school curriculum with the vast majority agreeing that clinical trials education is important during medical school. Since few students will receive formal training in clinical research after medical school, graduating with a solid foundation in clinical trials may impact both residency performance and willingness to engage with clinical research throughout a physician’s career. Understanding the importance of clinical trials may help to ensure more precise medical care options and more confidence in referring patients to clinical trials in the long term. Thus, it is encouraging that post-intervention, students were, on average, “fairly confident” in their abilities to discuss clinical trials by their third year of medical school. These findings suggest that students may benefit from additional pre-clinical education that focuses on initiating physician–patient clinical trials communication or perhaps continued clinical trials curricula during clerkship years.

Limitations

A limitation of the study was the low post-intervention survey response rates in the 2011 cohort which were attributed to a lack of adequate communication and opportunities to complete the survey, since the survey was emailed out instead of administered in person by the research team. Matching of within-subjects pre- and post-intervention data was limited due to incomplete post-intervention data collection as mentioned above, and discrepancies in matching the alphanumeric codes between pre- and post-surveys due to incomplete participant reporting.

Recommendations for Future Research

Further investigation is necessary to determine the durability of this multi-faceted educational intervention using methods to increase post-intervention response rates and allow for a paired, within-subjects design. The degree to which students were involved in clinical research both before and during medical school was beyond the scope of the current project and may be controlled for in future research. Next steps include surveying medical school alumni that completed the program to assess the clinical trials knowledge retention and patient accrual rates into clinical trials in their own medical practice. Although not statistically significant, there were unexpected increases in the belief that clinical trials are only useful for patients who have failed the standard of care, and uncertainty that learning about clinical trials in medical school will influence future practice. A comparison of physicians who received a clinical trials curriculum and those who did not is needed to determine the relationship between medical school clinical trials education and practice patterns. These research findings suggest there is still work to be done to address uncertainty about which patients are appropriate candidates for research, the safety of clinical trials, and who will benefit from participation. A more formal assessment of curriculum impact might utilize a baseline and post-intervention objective structured clinical examination. Furthermore, it would be valuable to collaborate with the School of Nursing in a multidisciplinary team approach to clinical trials discussions with patients.

Conclusion

This study demonstrated that medical students gained confidence in their clinical trials knowledge and felt better equipped to address many aspects of clinical trials after taking part in the intervention. Many medical schools have adopted the problem-based learning curriculum, generating the opportunity to similarly implement a comprehensive clinical trials education into the coursework in an effort to increase medical students’ confidence and ultimately raise clinical trial accrual rates [16]. Participation in the multifaceted clinical trials education curriculum during medical school was associated with increased student understanding and knowledge of clinical trials and medical student attitudes toward clinical trials were overall positive. This evidence-based intervention demonstrated the benefits of a comprehensive curriculum to foster greater medical student appreciation of and patient engagement in cancer clinical trials. Further integration of clinical trials education and opportunities to engage in research during medical school are warranted.