INTRODUCTION

From 1991 to 2016, the average annual firearm death rate in the USA was 11.4 per 100,000 individuals.1 This amounts to 859,871 lives lost due to a single cause of preventable death over a 26-year period.1 Although numerous studies have evaluated the impact of state firearm laws on homicide or suicide rates (Online Supplemental Tables S1, S2), a major limitation is that most examined the impact of only one type of policy. Because states that enact one type of law are also more likely to enact others,2 it is difficult to isolate the effect of one law without considering the simultaneous impact of other policies.

To improve our ability to draw causal inferences, a stronger study design would examine the relationship between the enactment of multiple types of state firearm laws over time and differences in fatality rates between states. However, we are aware of only one multi-year panel study of homicide rates that examined multiple laws and included data from the past decade; this study was conducted at the level of urban counties, and only 34 states were included.3 We are not aware of any panel study at the state level that used data within the past decade to assess simultaneously the effect of multiple state firearm laws on homicide or suicide death rates.

One reason why many previous studies have focused on a single type of law is the absence of a comprehensive national database of state firearm laws. For most previous studies, researchers had to track down the status of state firearm laws by conducting their own legal research, a painstaking process that precluded a single study of a large range of gun-related policies. We recently created a novel database in which we recorded, quantified, and classified the largest-to-date compilation of firearm provisions by state over a 26-year period.2 In this study, we examine the simultaneous impact of 10 different types of state firearm laws on overall homicide and suicide rates over a 26-year period using the same model specification.

METHODS

Data Sources

We ascertained the annual presence or absence of 10 state firearm laws in all 50 states from 1991 to 2016 using the State Firearm Law Database, which provides a panel of firearm-related laws in each state, for each year.2 The database was compiled using the Thompson Reuters Westlaw database of state statutes and session laws and a database assembled by Everytown for Gun Safety.4

We obtained homicide and suicide mortality data from the Centers for Disease Control and Prevention Web-Based Injury Statistics Query and Reporting System (WISQARS), which are derived from the vital statistics death registry of the National Center for Health Statistics.1 WISQARS reports annual state-specific, age-adjusted fatality rates for homicide and suicide.

Study Population

We assembled annual, state-specific age-adjusted total homicide and suicide rates in each state from 1991 to 2016. We excluded homicides due to legal intervention (1% of firearm deaths), unintentional firearm fatalities (2.5% of firearm deaths), and fatalities of undetermined intent (1% of firearm deaths) from our analysis.

Outcome Measures

The main outcome measures were the annual, age-adjusted homicide rate and age-adjusted suicide rate in each state over the study period. Because there were 50 states and 26 years, the total number of possible observations was 1300. However, the CDC does not report death rates when the absolute number of deaths in a state during a given year is less than 10. For this reason, we did not have a complete panel of homicide data for three states: North Dakota, Vermont, and Wyoming. We therefore excluded these states from the homicide analyses, yielding a total of 1222 observations. There were no missing data for suicide death rates, so there were 1300 observations for analyses involving this outcome.

Main Predictor Variables

From the state law database, we selected 10 laws to analyze based on several considerations: (1) laws that are currently being considered by state legislatures; (2) laws that have been examined in prior research; and (3) laws that were enacted by at least two states during the study period. We analyzed the following 10 laws (defined in detail in Table 1): (1) universal background checks, either through point-of-purchase checks or a permit to purchase requirement; (2) ban on handgun possession for people convicted of a violent misdemeanor; (3) age 21 limit for handgun possession; (4) “shall issue” laws; (5) permitless carry laws; (6) prohibition against gun trafficking; (7) ban on “junk guns”; (8) “stand your ground” laws; (9) assault weapons ban; and (10) ban on large-capacity ammunition magazines. Laws were lagged by 1 year in the analysis; that is, we considered the potential effect of a law only in the full first year after its enactment.

Table 1 Description of State Firearm Laws Examined

Data Analysis

Unlike many earlier analyses in the public health literature, we employed a difference-in-differences approach to the analysis of policy outcomes,5, 6 an approach that is widely used in the econometric and criminology literature on the effect of state firearm laws and was first introduced by Lott and Mustard in their classic 1997 paper.7 Using multivariable linear regression, we evaluated the association between the firearm law provisions in each state (which were time-varying) and the homicide and suicide rates over the study period, while controlling for several other time-varying state-level factors. We included year and state fixed effects and estimated cluster-robust standard errors, which account for the clustering of observations, serial autocorrelation, and heteroskedasticity.8 By including state fixed effects, our analysis focuses on the time series of observations within each state, comparing changes in homicide or suicide rates within a state from before to after the implementation of a particular firearm law, using states without that law as controls. Because the outcome variables are not normally distributed but skewed, we log-transformed the homicide and suicide rates.

Our final model was as follows:

$$ \mathit{\ln}\ \left({\mu}_{st}\right)=\alpha +\left({B}_{\ast }{LAW}_{st}\right)+\left({C}_{\ast }{CONTROL}_{st}\right)+S+T+e, $$

where μst is the homicide or suicide rate in state s in year t, LAWst is a dummy variable for the presence or absence of a particular state firearm law in state s in year t, CONTROLst is a vector of control variables, S represents state fixed effects, and T represents year fixed effects.

We controlled for the following time-varying state-level factors, chosen because of their association with homicide or suicide rates in the published literature and their association with both death rates and the adoption of firearm laws in our data set: (1) the percent of the population that is black; (2) the percent of population ages 15–29 that is male; (3) per capita law enforcement officers; (4) the violent crime rate (excluding homicide); (5) the divorce rate; (6) the unemployment rate; (7) the poverty rate; (8) per capita alcohol consumption; (9) the incarceration rate; (10) population density; (11) log of population; and (12) household gun ownership percentage.

Because annual survey data of household gun ownership at the state level are not available, most previous studies have used the ratio of firearm suicides to all suicides (FS/S) as a proxy for household firearm ownership.9 This proxy is highly correlated (r = 0.80) with state-specific measures of firearm ownership on a cross-sectional basis.10 Recently, we developed a new proxy measure that improves the correlation with survey-measured gun ownership from 0.80 to 0.95.10 This new proxy measure incorporates a state’s hunting license rate in addition to FS/S.10 In this study, we used this new proxy.

Per capita law enforcement officers and violent crime rates were obtained from the FBI Uniform Crime Reports;11 incarceration rates were obtained from the Bureau of Justice Statistics;12 and per capita alcohol consumption was obtained from the National Institute on Alcohol Abuse and Alcoholism (NIAAA) for 1991–201513 and from Statistica14 for 2016. Hunting licensing data were obtained from the U.S. Fish and Wildlife Service.15 The remaining variables were obtained from the U.S. Census. We conducted the analysis using Stata version 15 (StataCorp LP, College Station, TX).

Because the outcome variables are log-transformed, the regression coefficients can be interpreted as the percentage change in the firearm homicide or suicide rate associated with the presence of a particular law by exponentiating the coefficient, subtracting 1, and then multiplying by 100 (i.e., a coefficient of 0.10 for a given law would indicate a 10.5% increase in the mortality rate associated with that law).

To test the plausibility of any observed associations between firearm laws and overall homicide or suicide rates, we conducted a falsification test: we analyzed the relationship between these laws and firearm compared to non-firearm mortality rates. These laws would be expected to primarily affect only the firearm-related rates.

In a final sensitivity analysis, we modeled the secular time trend in firearm homicide or suicide rates by including year as a continuous variable in the model rather than as a fixed effect.

RESULTS

Over the 26-year study period, there was a substantial variation in the violent death rates across states. In 2016, overall homicide rates ranged from a low of 1.3 per 100,000 in Maine and New Hampshire to a high of 14.2 per 100,000 in Louisiana (Table 2). In 2016, overall suicide rates ranged from a low of 7.2 per 100,000 in New Jersey to a high of 26.0 per 100,000 in Montana. Across the study period, there were a total of 93 law changes among the 10 laws studied (Table 1).

Table 2 Status of State Firearm Laws and Violent Death Rates, 2016

When examined individually, universal background checks and violent misdemeanor laws were significantly associated with lower overall homicide rates and “shall issue” laws were significantly associated with higher homicide rates (Table 3). After simultaneously controlling for all 10 firearm laws, universal background checks were associated with 14.9% lower overall homicide rates (95% confidence interval [CI], 5.2%–23.6%); violent misdemeanor laws were associated with 18.1% lower homicide rates (95% CI, 8.1–27.1%); and “shall issue” laws were associated with 9.0% higher homicide rates (95% CI, 1.1%–17.4%). None of the other seven laws were significantly associated with overall homicide rates. In a falsification test, each of these three laws was found to be significantly associated only with the firearm-related homicide rate, not the non-firearm-related homicide rate (Online Supplemental Table S3).

Table 3 Linear Regression Model Results: Factors Affecting Homicide Rates, 1991–2016

In the fully adjusted model, household gun ownership was not associated with overall rates of homicide (Table 3). Factors that were significant positive predictors of overall homicide rates were the percentage of males, the violent crime rate, and population density. Overall population was negatively associated with homicide rates.

When examined individually, four of the 10 firearm laws were significantly associated with overall suicide rates (Table 4). However, after simultaneously controlling for all 10 firearm laws, only two laws were significantly related to suicide rates: bans on junk guns were associated with 6.4% lower suicide rates (95% CI, 3.5–9.2%) and permitless carry laws were associated with 5.1% higher suicide rates (95% CI, 0.2–10.4%). Both laws failed the falsification test, as both were significantly related to non-firearm as well as firearm homicide rates (Online Supplemental Table S4). None of the other laws were significantly associated with overall suicide rates.

Table 4 Linear Regression Model Results: Factors Affecting Suicide Rates, 1991–2016

In the fully adjusted model, household gun ownership was not associated with overall rates of suicide (Table 4). Factors that were significant positive predictors of suicide rates were the violent crime rate, unemployment rate, poverty rate, and per capita alcohol consumption. Overall population was negatively related to suicide rates.

Entering year as a continuous variable instead of as a fixed effect had no appreciable impact on the results (Online Supplemental Table S5).

DISCUSSION

To the best of our knowledge, this is the first study using data from within the past decade to simultaneously model the effect of multiple state firearm laws on homicide and suicide rates at the state level using a multi-year panel design. Using a difference-in-differences analysis, we found that laws requiring universal background checks and those prohibiting firearm possession by people with a conviction for a violent misdemeanor were associated with significant reductions in the overall homicide rate, while “shall issue” laws were associated with a significant increase in the homicide rate. There was no significant association between homicide and the other laws studied, and we did not find consistent relationships between any of the laws and overall suicide rates.

This study has several strengths. First, it is one of the first studies to clearly define each law with attention to the detailed provisions of the law, including its scope, exceptions, and exemptions. One reason for some of the conflicting results of previous studies (Online Supplemental Tables S1, S2) may be the inconsistent definition of state statutes.

Second, using a difference-in-differences approach helps to address the major threat to validity in this type of research: states with lower homicide rates to begin with may be more likely to enact stronger gun laws. By including state and year fixed effects, we are using a “within-estimator” that assesses differences within states over time.5, 6 Studies that do not include state fixed effects are also assessing differences across states at a given time (“between effects”), which may reflect different propensities of states with lower or higher homicide rates to enact laws, rather than law effects. Thus, the difference-in-differences approach is less subject to the possibility of “reverse causation” (i.e., it is the level of the homicide rates that are affecting the law enactment, not the other way around). The inclusion of state fixed effects has the added advantage of controlling for any differences between states in time-invariant factors.

Third, including a large panel of time-varying state factors as independent variables helps address the problem of omitted variable bias. Nevertheless, it is still possible that states which were experiencing large declines in homicide were more likely to enact a particular law; even the within-estimator may not be sufficient to rule out the possibility of reverse causation.

Our finding of a negative association between universal background checks (including permit requirements) and homicide rates is consistent with several other studies.3, 16,17,18,19,20 Our finding of a negative association between violent misdemeanor laws and homicide rates is consistent with one other recent study, which reported a 24% reduction in intimate partner homicide in states with these laws.21 However, caution should be exercised when interpreting this finding because only two states implemented violent misdemeanor laws during the study period. While historically the literature on the impact of concealed carry–permitting laws has been inconsistent and several studies have found an association between “shall issue” laws and reduced murder rates,7, 22,23,24,25,26,27,28,29 the three most recent studies to examine these laws found a positive association with homicide rates.3, 30, 31

Our finding that there was no association between stand your ground laws and homicide rates conflicts with the findings of two previous studies on these laws.32, 33 However, both of these studies examined only the decade of 2000–2010. When we restrict our analysis to that decade, we obtain similar results.

A second important finding of this study is that changes in household gun ownership were not found to be significantly associated with homicide or suicide rates, a result that differs from several previous studies.34, 35 The discrepancy in these results could possibly be due to our inclusion of state fixed effects. It is possible that although there is a strong cross-sectional relationship between the prevalence of firearm ownership and homicide and suicide rates, small changes in firearm ownership that are observed over time are not sufficient enough to result in measurable differences in overall population homicide or suicide rates. Even if we had survey-based measures of household gun ownership, the margin of error is probably greater than the actual change in gun ownership levels from year to year. There is too much noise in our measure of gun ownership and too little variability in true levels of household gun ownership to determine if changes in gun ownership are related to differences in homicide or suicide rates. Few of the previous studies included state fixed effects. Because of the conflict with the existing literature, further study is required before any definitive conclusion is drawn.

It is important to note that the absence of an observed association of a law and overall homicide or suicide rates does not necessarily mean that these laws are ineffective. It may also be that the laws are not broad enough to affect overall population death rates or that the laws are not being adequately enforced.

Several other limitations deserve mention. First, the firearm ownership proxy has been validated with cross-sectional data, but not with longitudinal data.36 It is not clear whether this proxy is able to accurately measure changes in household gun ownership over time.

Second, while we controlled for a range of state-level factors associated with homicide death rates, there may be unidentified omitted variables. For example, in the early 1990s, firearm homicide rates were very high in many cities, seemingly related to the crack cocaine epidemic.37, 38 Nevertheless, when we restrict the analysis to the period 2000–2016, our results remain essentially unchanged, although the precision of the estimates decreases.

Third, we accounted only for the presence or absence of firearm law provisions, not for the implementation and enforcement of these laws. Fourth, trying to incorporate the most important explanatory variables in a large regression almost invariably leads to some multicollinearity. For example, when we use all the other independent variables to explain variations in the gun ownership proxy, the adjusted R2 is 0.69.

Finally, we do not disaggregate homicide rates by the age or other characteristics of either the offender or victim, which could mask the effect of laws intended to affect a particular subpopulation. For example, age restrictions on gun possession would only be expected to affect youth suicide rates, not adult rates.

In conclusion, this study provides evidence that universal background checks and laws prohibiting gun ownership by people with a history of a violent misdemeanor are associated with lower overall homicide rates, while laws that provide no discretion to law enforcement officials in approving concealed carry permits are associated with higher homicide rates. Further research on the impact of state firearm laws is necessary to assess causality and should rely upon detailed definitions of each law.