My empirical approach leverages variation in state-level implementation of insurance mandates. During the study period, two states (MA and NJ) and DC implemented state-level mandates, so uninsured people in these states were subject to a tax penalty even after January 2019 (Porretta, 2021).Footnote 2 The repealed ACA federal mandate imposed a tax penalty on uninsured individuals equal to the greater of $695 or 2.5% of annual income; the penalty was capped at the price of the cheapest bronze plan. Similarly, in Massachusetts, New Jersey, and DC, the amount of the penalty varies by income, age, and family size and is linked to the plan premiums on the ACA health insurance exchanges. For example, in DC, uninsured individuals must pay either 2.5% of the gross family household income or $695 per adult and $348 for child; the maximum penalty is capped at the average premium for bronze-level health plans available on the DC health insurance exchange.
I compare uninsurance in states where the individual mandate was repealed (i.e. the treatment group) to states where the individual mandate was effectively not repealed due to state-level mandates (i.e. the control group). MA, NJ, and DC constitute the control group in this study, as residents of these states were subject to an insurance mandate during the entire study period. People in the remaining 48 states became exempt from any insurance mandate after the federal mandate was repealed in January 2019. These 48 states constitute the treatment group. Because the treatment group did not have state-level mandates in place, the repeal of the federal mandate was essentially binding in these states and residents were free to drop coverage without being subject to a tax penalty. States that implemented insurance mandates in 2020 or later (CA, RI, VT) are included in this set of treatment states (i.e. states where the repeal was binding) because my study period ends in 2019. In sensitivity analyses, I show that results are robust to the use of a smaller subset of treatment states.
I estimate a difference-in-differences (DD) regression model in which the outcome variable is “Newly Uninsured,” and the key independent variable is the interaction of an indicator for whether the respondent lived in a treatment state and an indicator for whether the respondent was interviewed after January 2019, i.e. after the federal mandate was repealed. Equation (1) presents the preferred DD regression model:
$$ Newly\,Uninsure{d_{ist}} = \alpha + \beta MandateRepeale{d_s}XPost{2019_t} + \gamma {{\bf{X}}_{ist}} + \delta Stat{e_s} + \theta Yea{r_t} + \varepsilon $$
(1)
where NewlyUninsured
ist is the probability (ranging from 0 to 100) that respondent i in state s was newly uninsured in the year of interview t; MandateRepealed
s indicates whether the respondent lived in one of the 48 states without a state-level insurance mandate; Post2019
t indicates whether the respondent was interviewed after January 2019, i.e. after the repeal of the federal insurance mandate; X
ist is a vector of socio-demographic controls, including respondent’s age, sex, marital status, household size, race/ethnicity, educational attainment, and employment status; State
s is a vector of state fixed effects; Year
t is a vector of year fixed effects; and ε is an idiosyncratic error term. Robust standard errors are clustered at the state level. Estimates include CPS ASEC survey weights.
Observing the same respondent for two consecutive years helps control for unobserved individual-level characteristics and risk preferences. Controlling for respondents’ state of residence accounted for time-invariant, unobserved differences across states, and controlling for the year of interview differences out nationwide trends in insurance coverage.
In Eq. (1), the coefficient β represents the effect of the mandate repeal on the probability of being newly uninsured, assuming that the two key assumptions of the DD model are met. First, in the absence of the policy change, the treatment and control group would have trended similarly (the parallel trends assumption). Second, the treatment and control states did not undergo other differential changes at the same time of the policy change. I assess the validity of the first assumption by estimating an event study regression that assesses trends between the treatment and control states in the pre-2019 period. If the treatment and control groups followed parallel trends in the pre-repeal period, it would increase our confidence that they would have continued to trend similarly in the post-repeal period, were it not for the repeal. The event study model is similar to Eq. (1) but replaces the MandateRepealed X Post2019 interaction with a vector of terms that interacts MandateRepealed with indicator variables for each year. The year immediately preceding the federal mandate repeal (2018) is omitted as the base year.
To test the validity of the second DD assumption, I conduct two falsification tests by estimating Eq. (1) for groups of adults whose incentive to drop insurance coverage was likely unchanged by the mandate repeal: elderly adults (who were eligible for Medicare both before and after the repeal) and high-income adults (with household income above 600% FPL) who have widespread access to employer-sponsored insurance. Strong effects for either of these two groups could be an indication that simultaneous changes in other policies may be biasing my main set of results.
I conduct several sensitivity analyses and robustness checks. First, I control for state unemployment rate to account for differences in labor market conditions across states over time. I also estimate a set of regressions in which I include those below 138% of the poverty level in the analysis. There may be concern that the treatment group of states is larger and more diverse than the control group (MA, NJ, and DC). To address this concern, I present a specification check which restricts my analysis to states in the New England and mid-Atlantic Census divisions to provide a better geographical match between the treatment and control groups. I also estimate a regression that omits the year 2018 from analysis, as the repeal was announced in 2017 and some people may have falsely believed it would be implemented in 2018 (Fung et al., 2019).
I assess potential heterogeneous treatment effects by estimating the regression model separately for different subgroups of respondents: men and women, married and unmarried adults, parents and childless adults, by employment status, by educational attainment, by race/ethnicity, and by age group.
Next, I conduct placebo tests with outcome variables that should be theoretically unaffected by the mandate repeal—respondents’ unemployment status, self-employment, labor force participation, and household income. Finding statistically significant effects of the mandate repeal on these outcomes implies that other policy changes occurring in the treatment or control group could be biasing the main set of results.
In my baseline model, I compare three control states to 48 treatment states, and I cluster standard errors by state. Because there are many more treated states than control states, over-rejection of the null hypothesis is a concern (Cameron et al., 2008; Ferman & Pinto, 2019). The specification check described above in which I limit my analysis to states in the New England and mid-Atlantic Census divisions partially addresses this concern. As another check, I calculate p-values using the wild cluster bootstrap resampling method with 999 replications, proposed by Cameron et al. (2008). This step produces approximately valid estimates for inference by allowing respondents to be dependent within states, relaxing the ordinary least squares assumption that individuals are independent and identically distributed (Cameron & Miller, 2015).
Finally, I examine the effect of the mandate repeal on two alternate outcomes—(1) the probability of being newly insured, and (2) the overall probability of being currently uninsured. I do this by estimating a version of the DD regression model described in Eq. (1) in which the outcome variable is NewlyInsured
ist, i.e. the probability (ranging from 0 to 100) that respondent i in state s went from being uninsured in the year before the interview t−1 to being insured in the year of interview t. Next, I estimate Eq. (1) for the outcome variable Uninsured
ist, i.e. the probability (ranging from 0 to 100) that respondent i in state s was uninsured in the year of interview t. These estimates help me compare my results to those from previous studies that assessed the effect of the implementation of the mandate penalty on insurance coverage.