National AOA Society-Level Reforms
The national AOA society has expressed a commitment to support diversity, inclusion, and equity in medical schools.22 Moreover, the AOA constitution states, “No candidate shall be denied election because of race, color, creed, ethnic origin, age, or gender.”22 Nevertheless, the authors are unaware of efforts by the national AOA society to systematically address racial/ethnic disparities among its members. Thus, we propose three reforms.
First, we recommend the national society to consider annually reporting aggregate statistics on a variety of member demographics including race/ethnicity, gender, first-generation college graduate status, disability, and sexual orientation for newly elected members, both in aggregate and by school chapter, on its website in an easily accessible location. Several medical associations, including the Association of American Medical Colleges, already report student demographic data. Social reporting can be an effective instrument to improve transparency, accountability, and even behaviors by institutions subject to reporting, particularly when a third-party intermediary is involved in the reporting.23, 24
Second, the national society could develop transparent criterion-based metrics for selecting members, to provide standardization and transparency while mitigating the potential for bias. Criterion might include automatic selection for students in good academic standing that have held a national or regional leadership office, presented or published peer-reviewed research, and completed a threshold number of community service hours. Alternatively, the society could consider closing the gap allowing for selection subjectivity (the gap between the 25% of students who qualify for membership and the 16% elected). Perhaps only the top 16% of students should qualify and be automatically elected.
Third, the national society could ensure its own leadership contains sufficient diversity encompassing gender diversity, racial/ethnic diversity, diversity by sexual orientation, socioeconomic status, and disability status. Diversity is essential for reducing risks of implicit bias and providing positive role models to current and future students.25, 26
Reforms for AOA Chapters
In the absence of action from the national organization, medical schools have an ethical obligation to take responsibility for their chapters and lead reform efforts. The following actions may help.
First, local AOA chapters could review the composition of their newly elected cohorts for racial/ethnic disparities, at a minimum assessing whether members appropriately represent their medical student body demographics. Medical schools could include in their Medical Student Performance Evaluations (MSPEs) a brief section reporting the medical school student body compositional diversity overall by race/ethnicity and the corresponding compositional diversity of AOA members. Findings from these reviews could be easily accessible and included in the MSPE submitted with student applications to residency programs.
Second, we suggest that medical schools with racial/ethnic differences in AOA membership consider conducting a root cause analysis of this disparity. Racial/ethnic disparities in AOA membership could indicate differential treatment of medical students by race/ethnicity that is pervasive throughout the institution. This type of investigation was recently completed by the University of California, San Francisco School of Medicine (UCSF), which found that racial/ethnic minority medical students were not only historically less likely than White students to be selected as AOA members, but that racial/ethnic minority students were less likely to receive ratings of honors on their clinical clerkship performance evaluations.27 Similar studies have shown that racial/ethnic minority medical students are described less favorably than their White peers in the written comments on performance evaluations, even when controlling for standardized measures of academic performance.28,29,30
Third, chapters could ensure their leadership is appropriately diverse to reduce bias when choosing and mentoring members. We also recommend inviting the institutions’ Chief Diversity Officer to serve on the chapter’s leadership board. In the event that a local AOA chapter’s medical school does not have a chief diversity officer, we recommend AOA chapters to at least identify a “diversity advocate” to serve as a selection committee member.
Fourth, local AOA chapters could use holistic review to select members. Prior literature shows a strong association between honor society membership and USMLE step 1 scores.5 Nevertheless, prior study findings demonstrate no correlation between AOA membership and hours dedicated to community service, leadership activity, or research productivity.5 This suggests an overreliance on standardized test scores by local AOA chapters despite guidance from the national AOA society to use a holistic process to select members. Consequently, we recommend that local chapters develop a mission-driven, holistic assessment when evaluating students for membership that more closely reflects the values of professionalism, leadership, and community service espoused by the national AOA society. Holistic review was recently adopted by UCSF’s AOA chapter, which has since seen a significant reduction in racial/ethnic disparities among students selected for honor society membership.31
Fifth, chapters could consider electing members only in the last year of medical school after the residency match has occurred. While this intervention does not address the racial/ethnic imbalances in membership, it will mitigate the immediate downstream impact of AOA racial/ethnic disparities on residency match outcomes.
Finally, medical schools could collectively suspend new student elections until they have taken the steps outlined or are satisfied sufficient action has been taken on the national level. Chapters could continue providing student scholarships during the suspension by expanding the applicant pool to include all members of the school’s medical student community. Until reforms have been implemented to eliminate racial disparities in membership, it is possible that student selection into AOA will represent a structural barrier to diversity, equity, and inclusion in medicine. In 2018, Mount Sinai stopped AOA student elections after recognizing that Black and Hispanic/Latinx students constituted just 4% of its AOA members despite comprising 18% of the total student body.32
Reforms for Intuitions Serving Graduate Medical Education
Other groups can and could play a role in ameliorating racial/ethnic disparities in AOA membership. For instance, the leadership of the Electronic Residency Application Service (ERAS) could stop integrating AOA status into the standard residency application, until racial/ethnic inequalities have been demonstrably remedied nationally. The incorporation of AOA status as a standard component of the ERAS application could amplify racial disparities in graduate medical education and enable the honor society to function as a structural barrier limiting physician workforce diversity.
Additionally, given prior study findings,5 residency program directors could give measured consideration to AOA status when screening applicants, until remedial action has been taken on a national level. As the number of applications to residency programs continues to grow, program directors understandably must rely on filters to triage applicants. Nevertheless, a screening process dominated by AOA membership could limit opportunities for minority candidates, who may have already encountered structural barriers and biases in applying, qualifying, and being selected for graduate medical education.