Tips for Teachers of Evidence-Based Medicine: Understanding Odds Ratios and Their Relationship to Risk Ratios
- First Online:
- Received:
- Revised:
- Accepted:
DOI: 10.1007/s11606-007-0453-4
- Cite this article as:
- Prasad, K., Jaeschke, R., Wyer, P. et al. J GEN INTERN MED (2008) 23: 635. doi:10.1007/s11606-007-0453-4
- 16 Citations
- 1.9k Downloads
Key words
odds ratios risk ratios evidence-based medicine randomized trials clinical educationINTRODUCTION
Odds ratios (OR) commonly appear in the medical literature summarizing the comparative effects of interventions and exposures in observational studies, randomized trials, and meta-analyses. Clinicians find it difficult to understand odds and odds ratios as measures of association, although they may be comfortable with the parallel concepts of risk and risk ratios. Probably, no one (with the possible exception of certain statisticians) intuitively understands a ratio of odds.1,2 Nevertheless, odds ratios are frequently encountered in research reports as the principal measure of association.3, 4, 5
Odds and risk constitute parallel statistical metrics for measuring frequency and ratios of frequency. Their relationship might be compared to the use of different scales such as Fahrenheit and Centigrade to report absolute values of and relationships between different temperatures. Until recently, the choices between the odds and risk metrics were determined largely on the basis of their statistical properties rather than on the basis of their usefulness as means of communicating the results of research to clinicians and their patients. In a previous article, we have demonstrated approaches to helping teachers and learners to master the concepts of risk, relative risk, and risk reduction as the preferred framework for the purposes of clinical application.6 The content of that article may be regarded as pre-requisite knowledge for the purposes of the present discussion and demonstration.
This article presents an approach in helping clinician understand what odds and odds ratios mean and when can they numerically substitute risk and risk ratio for odds and odds ratios. Odds ratios may be chosen as the measure of association by authors of studies conforming to a variety of designs, only some of which mandate their use in preference to risk ratios. These include randomized trials, systematic reviews, case control studies, and studies involving the use of logistical regression. In teaching clinical learners who are not familiar with this measure of outcome, we have found it important to concentrate initially on the conceptual understanding of odds and odds ratios and to avoid combining this with discussion of study design issues. We have correspondingly not included discussion of these issues in this article.
We will present interactive approaches that educators have developed to overcome ‘stumbling blocks’ among learners. To help the reader envision these approaches, we present sequenced advice for teachers and characteristic learner responses. The “tips” in this article are adapted from approaches developed by educators with experience in teaching evidence-based medicine skills to clinicians. We present a full description of the development of the tips in this series and pertinent background information elsewhere.7
Each tip includes section on “when to use the tip,” “The script,” the “bottom line,” and a “summary card.” The first tip helps learners to understand the relationship between odds and probability (risk) and to define circumstances when odds and risks are similar. The second tip builds on the first and helps learners understand what an odds ratio is and when it is similar to the risk ratio.
TEACHING TIP 1: UNDERSTANDING THE RELATIONSHIP BETWEEN ODDS AND RISK
When to Use this Tip
–Understand the relationship between odds and risk
–Convert odds to risk and vice-versa
–Appreciate that, when risk is less than 10%, odds numerically approximate risk
This tip is useful for learners who are critically appraising an article about therapy or harm and who have already understood the concept of probability and risk.
The Script
First, determine the type of game the audience might be interested in. In the USA and Canada, it might be baseball, in Asia, football (soccer), and in some places like India and Pakistan, it may be cricket. Gambling in general might constitute another option.
Then ask the learners: what do people mean when they say—the odds of your country team winning this match is 1:1? Some learners would say “1 out of 2 chances of winning, the same chance of losing”. Others might reply: “It means your country has 1 out of 2 or 50% chance of winning this match”. You may then choose to propose a more challenging example, such as a 3:1 odds of winning, corresponding to a 75% chance.
Shows 3 different ways of representing odds in relationship to the corresponding risk.
After most of learners are coming up with correct answers for the third column, introduce the fourth column, illustrated using symbols of any sort (e.g., XXXX/X) and point out that the odds is the ratio of the symbols corresponding to those with the outcome to the symbols corresponding to those without the same outcome. Depending on your assessment of the learner’s comfort with the concept, you may ask them to generate formulas going in both directions, i.e., odds = risk/(1-risk) and risk = odds/(odds + 1).
After the figure has been completed, ask the learners: Do you see any pattern here? If there are no answers, ask: when are risk and odds close to each other? Some learners may point out: the smaller the risk, the closer the odds and risks are to one another. Further, when the risk goes below 10%, odds and risk become virtually identical, which is the key to knowing when odds can be treated as a valid estimate of risk.
The Bottom Line
-Risk is a proportion or percentage of an entire population having a given characteristic or outcome. Odds is a ratio of those with and those without the characteristic or outcome within the population.
-As risk falls below 20%, odds and risk become more and more similar and virtually identical below a risk of 10%.
See Appendix 2 for the summary card for this tip.
Addenda to Tip 1
–The formulae to convert risk to odds and vice-versa are not really crucial to move to the next tip. This can be avoided completely if there is time-constraint.
–The main (and if necessary, the only) concept to emphasize in this teaching tip is that the lower the risk, the closer the approximation of odds to risk, and that when risk goes below 10%, odds is almost equal to risk.
TEACHING TIP 2: UNDERSTANDING ODDS RATIOS AND THEIR RELATIONSHIP TO RISK RATIOS
When to Use this Tip
This tip is suitable for all clinicians and clinical trainees who already understand risk and risk ratios (RR) but who do not have a clear understanding of the concept of odds ratios (OR). The objective is to foster this understanding. This tip takes 30 minutes to complete.
Understand what an odds ratio (OR) is.
Understand that OR is an alternative to RR as an effect measure in treatment studies.
Understand that OR = 1 when there is no treatment effect
Understand that, compared to RR, OR makes the effect appear larger.
This tip is useful for learners who are critically appraising an article or a meta-analysis about a therapy or a harmful association and encounter results reported as odds ratios. Characteristically, clinical learners find risk and ratios of risk intuitive but find odds and ratios of odds unfamiliar, non-intuitive, and mystifying. Their confusion revolves around 2 stumbling blocks. Firstly, they do not understand how odds ratios are calculated. Secondly, they do not understand how to interpret the clinical importance of results when they are reported as odds ratios. If learners have worked through tip 1, they are comfortable with the notion of odds as an alternative measure of frequency and its relationship to the more familiar measure, risk. This tip uses that familiarity as a point of departure to demystify the concept of ratios of odds in relationship to the more familiar ratios of risk.
The Script
Shows the calculation of an odds ratio in relationship to the corresponding risk ratio.
The learners now work through the same process for the control group, and you write 0.50 and 1 under the risk and odds columns, respectively. Now ask: What is the relative risk of the outcome? Someone proposes “40% over 50%.” You ask the group to verify the correctness of this response and then write the result in a column below the 2 × 2 grid. You now ask, what is the ratio of the odds of the outcome between the treatment and control groups? After some thought, someone catches on and suggests “0.67 over 1.” You congratulate the group for having grasped the gist of the demonstration and write 0.67 in the bottom row under the ‘odds’ column.
At this point, it is usually appropriate to acknowledge the common inconsistencies in terminology that one encounters in the literature. For example, one characteristically encounters ‘relative risk’ and ‘odds ratio’, although it would be equally appropriate to use the terms ‘risk ratio’ and ‘relative odds’, respectively.
At this stage, some learners may ask, “what does a relative odds of 0.67 mean, and why is this different from the relative risk?” The demonstration has partially demystified odds ratios for the group, but it has not made them any more intuitive.
Returning to the punch line of tip 1, point out that there are two things that a clinician needs to understand about the relationship between risk ratios and odds ratios: (1) when are odds ratios sufficiently close to risk ratios to be considered to be equivalent and (2) when they are not the same, in what direction is the difference? To address the second principle, you point to the two values in Figure 2 and ask the group “Are these two numbers close enough to be considered to be the same?” Most of the group will say no, and after further deliberation, someone will usually suggest that the odds ratio of 0.67 corresponds to an importantly larger treatment effect. Someone else may suggest that, taken as an approximation of the risk ratio, it would imply a risk reduction of 33%, in contrast to the true risk reduction of 20%. You agree with these observations and suggest that, as a general rule, when the two measures yield different numbers, the odds ratio, if taken as identical to the risk ratio, overestimates the treatment effect, sometimes substantially.
To approach the second issue of when can the two measures be taken as interchangeable, you can either give the group a ‘rule of thumb’ that this is appropriate when the event rate in the control group is not higher than 30% or you can demonstrate it quantitatively by working through an additional demonstration using a control event rate of 20%, 25%, and 30%.
Shows how the odds ratio becomes closer to the corresponding risk ratio as the event rate in the control group diminishes and becomes even closer as effect size diminishes.
Even with risk reduction as high as 50%, the OR of 0.44 is closer to the RR of 0.50 than when the control event rate was 50%. If a smaller effect size of 25% risk reduction had been used in this second example, the two estimates become even closer. The resulting relative risk of 0.75 is now quite close to the OR of 0.71.
- 1.
The RR will always be closer to 1.0 than the OR.
- 2.
If the baseline risk (the risk of adverse events in the control group) is low (say, less than 30%), the difference between RR and OR is unlikely to be important. Therefore, the two may be used interchangeably for interpreting results.
- 3.
If the OR is near 1.0, the difference between RR and OR is unlikely to be important.
- 4.
Following directly from the above, the only time you are likely to run into trouble treating the OR as an RR is when the baseline risk is high (over 30%) and the OR is not close to 1.0 (say less than 0.67 or greater than 1.3). Under these circumstances, the RR is likely to be appreciably closer to 1.0 than the OR.
As you can see, here too you need to know the event rate in the control group to be able to do this conversion. There are also published tables that convert OR to RR.1,2
Throughout this demonstration, we have assumed that learners are comfortable with the clinical interpretation of relative risk and that understanding the relationship between odds ratios and relative risk renders the former comprehensible. Helping learners grasp the clinical significance of relative risk requires different demonstrations, which have been described elsewhere.6
The Bottom Line
–Stumbling block: learners are unfamiliar with how odds ratios are calculated and how to interpret their clinical importance.
–Odds ratios are calculated from a 2 × 2 table in a fashion completely analogous to the calculation of risk ratios.
–If the baseline risk is less than 30%, the difference between odds ratios and risk ratios is unlikely to be important.
–When odds ratios are different from the corresponding risk ratios, they are further from 1, implying a greater treatment effect.
–When interpreting the clinical importance of results expressed in OR, treat OR as RR.
See Appendix 2 for the summary card for this tip.
Addendum to Tip 2
–You may want to point out that when the risk of death (or any outcome) with the experimental treatment is the same as that with the control treatment, say 20% in each arm, then RR = 1 and also OR = 1. You may like to take the learners through Figure 2 using 20 in the Outcome + cells and 80 in the Outcome − cells for both treatment and control groups.
–Some learners may mention that they have encountered the use of ‘relative odds reductions’ as measures of therapeutic effectiveness. This is most commonly found in reports of stroke trials8 but also may be encountered in evidence-based summaries.9 To address this, first point out that ‘relative odds reduction’ is an alternative measure of effect to relative risk reduction. Then, remind learners of what they just learned in tip 2, i.e., that, when RR and OR are different, relative risk will always be closer to 1 than OR. From this and learners’ prerequisite knowledge of the relationship between relative risk and relative risk reduction, learners should immediately grasp that, when different, relative odds reduction will always be numerically larger than relative risk reduction. You may also point out that, for this reason, authors seeking to inflate the apparent effectiveness of a study drug may be motivated to report the results as ROR instead of as RRR.
–Interpretation of OR for a case control study and logistic regression follows on similar lines; however, it may be worth noting that case control studies usually address association of a disease with etiologic agents, and a causal association in such studies is usually reported with OR more than 1. The larger the OR, the stronger is the association.
Report on Field Testing
We field test the tips to verify the clarity and practicality of the descriptions. Field testing frequently generates examples of the kinds of variations in approach that occur when an experienced teacher of evidence-based medicine adapts the approaches to their own style, context, and learner level. One of the authors (S.K.), an experienced teacher of evidence-based medicine who was not involved in developing them, field tested the scripts used in this article on two occasions with 10 residents and 15 third year medical students, respectively. Learners ranged from very naive with little exposure to upper level residents with much experience in EBM principles. After initially focusing the learners on the issue of the relationship between odds and risk, S.K. proceeded to engage them with tip 1, using a pre-printed form sheet derived from Figure 1. In tip 1, S.K. handed out a blank table that only had the first column (Risk) filled in. S.K. also had pre-prepared a flip chart with the same blank table and asked the learners if they could provide corresponding odds for any row. Each time there were long periods of silence before someone said that risk of 0.5 was equal to odds of 1:1. Tip 1 required 25 minutes of teaching time, whereas tip 2 took 30 minutes.
Some learners still required other examples (such as pictures) to illustrate the concepts. For retention, the learners voiced that it would have been easier for them to understand the importance of odds if we had discussed it in the context of a particular paper or clinical problem. Of note, at every level, the learners were not comfortable with the concept of odds and at first seemed to not even know why we were reviewing this. For both groups, S.K. needed to teach fundamental concepts. When the discussion of the relationship between odds ratios and risk ratios arises from discussion of an article that has been identified as relevant to a problem arising from a patient encounter, the relevance issue is likely to be much less important, and many of us prefer to avoid this and other statistical topics with clinical learners until such an occasion arises. When this topic must be presented outside of the context of a specific clinical problem, the teacher may find it useful to have on hand one or more examples drawn from current medical literature.3,5
Conflict of Interest
None disclosed.