Background

The Harvard Medical Practice Study (HMPS) examined the epidemiology of iatrogenic injuries arising from unintended adverse reactions and complications of medical care, termed "adverse events" [1, 2]. The study recruited a random sample of patients discharged from hospitals in New York state in 1984. Adverse events were found to occur in 3.4% of patients undergoing medical management. Of these, 14% died [1].

Apart from raising awareness of the magnitude of the problem [[3–8]], data from the HMPS has been used to estimate rates for the entire US general population [9]. There is concern that the scope of the HMPS might produce inappropriate population estimates, given that it was limited to a single state and collected data for a single year. For instance, a recent hospital-based study conducted in Utah and Colorado [5] reported an adverse event rate of 2.9% following hospitalization. The authors' extrapolation of this data to the general US population produced estimates that were lower that those derived from HMPS.

We present the results of analyses of self-reported complications of medical care using several years of cross-sectional data from a nationwide survey of US adults. We attempted to estimate the population prevalence of medical complications and examine the relationship between the self-reported complications of medical care and selected socio-demographic variables.

Materials and Methods

The US Bureau of Census, under the specifications of the National Center for Health Statistics (NCHS), conducts the National Health Interview Survey (NHIS) to obtain data on the health of the resident, civilian, noninstitutionalized population of the United States. The NHIS, one of the oldest US national health surveys, has a complex multistage probability design that uses clustering and stratification with oversampling of selected population subgroups [10, 11]. The overall response rate has consistently been about 95%.

We evaluated NHIS data from 1987 to 1994 focusing on 313,438 participants aged 18 or older. The main outcome variable of interest was the occurrence of a injury condition reported by the respondent to have been due to (1) acute or chronic conditions associated with disability days, doctor visits and/or hospitalizations in the two weeks preceding the NHIS interview; (2) chronic conditions reported to be the main or secondary cause of activity limitation; or (3) chronic conditions reported in response to a checklist of conditions for each body system.

In the NHIS, this data was collected by asking the subject to identify conditions that impacted on their health ("Is [subject] limited in any activities because of an impairment or health problem?" and "What condition caused this?") and by reading a standard list of chronic conditions and asking the subject whether he or she had any of the listed conditions. Responses were recoded by nosologists according to classifications based on the ninth revision of the International Classification of Diseases (ICD-9) [12]. This study focuses on ICD-9 codes 996 to 999 referring to injuries due to complications of surgical and medical care (subsequently recoded by the NHIS as an "adverse reaction or complication of medical care"). The range of conditions included in these codes are listed in Table 1 and excludes adverse drug reactions.

Table 1 Conditions listed under ICD-9 codes 996-999.
Full size table

Secondary outcomes included the onset of complications; the last time a physician was visited for the condition; the level of restrictions in major, work-related, and personal care activities imposed by medical complications; and the number of total bed-days and days lost from work in the two-week period preceding the NHIS interview. Except for the latter two outcomes, all were coded using indicator variables.

The following socio-demographic variables were considered: age (7 categories), sex, race (white, black, other), region (US Northeast, Midwest, South, West), education (7 categories), annual family income (6 categories), major activity (work, housekeeping, school, other), and health status (excellent, very good, good, fair, poor). All socio-demographic variables were coded using indicator variables.

Race was coded as White, Black, or Other following NHIS data structures. The last category is obviously racially heterogeneous and contributes about 2.5% of the total survey population. Nevertheless, we recognized the paucity of extant information and chose to retain the category in all analyses.

General population estimates of complications of medical care took into account the complex sampling procedure employed by the National Center for Health Statistics. All analyses used methods to account for the sampling design of the study by utilizing weights provided on the NHIS data tapes to yield population estimates. All analyses were conducted using Stata 6.0 (College Station, Texas, USA).

We derived annual estimates of the prevalence of these complications of care from 1987 to 1994 and according to the selected socio-demographic variables. Contingency tables were analysed using chi-square tests corrected for the complex sampling design to test for differences between variables [13, 14]. Univariate prevalence odds ratios of medical complications were calculated for each of the socio-demographic variables previously identified. The two-way interaction between race and age was examined by including the relevant terms into the model. Three multivariable logistic regression models were applied to adjust for potentially confounding factors. Model 1 adjusted for the year of the survey. Model 2 included survey year plus education and annual income. Model 3 adjusted for all the variables in Model 2 plus major activity and self-reported health status. Tests were considered significant at P < 0.05.

Results

From 1987 to 1994, the NHIS sampled a total of 313,438 subjects aged 18 years or older. These subjects provided a total of 618,167 reports of conditions of which 3,740 were complications of medical care.

Annual estimates of the prevalence of the condition in the total population are shown in Figure 1. The results point to a generally increasing trend in both the number and proportion of the total population. In 1987, 830,386 adults reported complications of medical care, increasing by about 40% to 1,174,089 adults in 1994. Based on an extrapolation to the US adult population, rates increased by 25% from 558 to 678 per 100,000 during the same period, although in a non-monotonic manner. The average increase in rates was about 3.38% (95% confidence interval [CI] = 1.85-4.93) annually over the study period.

Figure 1
figure 1

Proportion and number of subjects with self-reported complications of medical care extrapolated to the US adult population, by year, National Health Interview Surveys, 1987 to 1994.

Full size image

The socio-demographic characteristics of the study population and corresponding total population estimates are presented in Table 2. Univariate analyses suggest that there were no statistically significant differences in the risk of an injury due to medical complications by gender (P = 0.581). There was some evidence of an increasing trend by age (P < 0.001). Significant associations in risk according to regional (P = 0.041), racial (P < 0.001), educational (P < 0.001), and annual income (P = 0.001) variables were also present. A statistically significant inverse relationship was seen between health status and the risk for complications (P < 0.001).

Table 2 Descriptive characteristics of the study population according to selected socio-demographic variables, National Health Interview Surveys, 1987-1994.
Full size table

31.6% of all subjects reporting complications of medical care stated it occurred within a year of the interview (Table 3). About 75% said they had visited a doctor within the past year to discuss the condition (about 66% in the past six months). About half said they experienced some degree of limitation in the performance of their major activities and a quarter reported some limitation in performing personal care activities due to their condition.

Table 3 Characteristics of complications of medical care in US adults, National Health Interview Surveys, 1987-1994.
Full size table

Overall, there was an average of 1.72 days of restricted activity, 0.79 days spent in bed, and 0.58 days of work lost due to these complications of medical care. When limited to medical complications occurring in the two weeks prior to the interview, the results are 3.52, 1.90, and 1.51 days, respectively.

The interaction between race and age was found to be statistically significant in the base model (P = 0.016). In whites, Model 1 suggested a steadily increasing trend in the risk of complications of medical care according to age, at least until the middle of the seventh decade of life (Table 4). Full adjustment verified that subjects aged 25 and older were at a statistically significantly increased risk for medical complications. The highest risk corresponded to an 81% increase (95% CI = 38%-138%) compared to the youngest age group. In blacks, adjustment for all variables suggested a 45% greater risk for complications of medical care in persons aged 25 to 35 and those 35 to 44 years compared to those aged 18 to 24. All other age groups did not show statistical significance.

Table 4 Odds ratios for complications of medical care with control for socio-demographic variables, by race and age, in US adults, National HealthInterview Surveys, 1987-1994
Full size table

Results from the base model for other races indicate a bimodal pattern with peaks at 25 to 34 years and above 65 years of age that did not change appreciably with adjustment for all other confounders. For these age groups, the risk for complications of medical care was more than twice that of the youngest age group.

Risk derived after adjustment for all variables are displayed graphically in Figure 2.

Figure 2
figure 2

Multivariably adjusted race- and age-specific odds ratios for complications of medical care in US adults, National Health Interview Surveys, 1987 to 1994.

Full size image

Discussion

While a number of studies have quantified the occurrence of adverse events in health systems [1, 2, 8, 15, 16], none have examined the impact of these events in a population-based sample of the US population. Using eight years of cross-sectional data from an on-going, annual population-based survey of the US adult population, we have attempted to measure the burden of morbidity arising from these events and to determine the relationship between complications of medical care and socio-demographic variables.

Our estimates of prevalence differ from those conducted by other studies. Extrapolations to the US general population of data from HMPS [1, 2] conducted in New York State in 1984 have indicated that over a million hospitalized patients suffered an injury due to medical treatment [9, 16]. Using similar methodology, a more recent study made similar extrapolations from data collected in Utah and Colorado, arriving at a total population figure slightly less than one million [5]. Even when limited to adults, our results point to population numbers averaging about 1 million over the seven-year period, with a suggestion of a generally increasing trend to values above this level.

Our findings are strengthened by the use of data from subjects randomly selected from the total US population over eight years. Previous research has used hospital-based data to reach conclusions about the experience of the total population. The external validity of such inferences are conditioned on the representativeness of the study population on which the results are based. Hospitals often lack clear indications of the catchment populations to which such generalizations are to be made. This progressive hierarchical leap is hard to justify, especially if primary data from the total population of interest is publicly available, as is the NHIS. Furthermore, our data suggest that a statistically significant relationship exists between such injuries and certain US geographical regions, implying that estimates derived from localities may not correctly reflect the total population's experience.

The NHIS lacks both the ability to externally validate the veracity of self-reported claims of complications of medical care and the specificity of classification offered by hospital-based studies. For instance, one cannot measure the extent to which subjects reported conditions that were due to some disease process instead of a particular complication of medical care. In some cases, medical complications are an unavoidable outcome of therapy. In spite of this, our data captures a feature of inquiry that is missed by hospital-based studies: population estimates include injuries that arise from community-based sources. Thus, two different aspects of the same question are addressed.

A recent Australian study attempted to measure such incidents arising from the general practice setting. Of about 1,500 reports of adverse events received, 44% were due to premature or inappropriate use and 26% reported problems occurring during therapeutic use. About 15% of adverse events were due to the use of contraindicated medication and 11 percent were due to unintended medications or use that was not medically indicated at the time [17]. It has been estimated that such incidents give rise to comparable costs to the health system as that due to all other forms of injury combined (including suicide, falls, homicide, etc.) [18].

In this study, injuries arising from complications of medical care were self-reported. This dependence on the subject's self-reported recall of events is problematic only if differential recall is related to the outcome of interest. However, due to a lack of validation from external sources (i.e., medical records, case notes, etc.), we are unable to exclude the possibility that point estimates within populations or specific subgroups are misrepresented, especially since some subjects were asked to recall events that took place up to one year from the interview.

Plausible situations arise that might account for differential reporting or misclassification. These might take the form of differences in awareness that injuries may be related to certain medical complications, or local or nationwide publicity related to high-profile cases of complications of medical care being applied to personal situations. We do not have enough data to speculate as to how, or to what extent, these differences might have affected the results. However, biases arising from misclassification in this setting will tend to attenuate any relationships found, since there is no a priori evidence that one categorization was more likely than another. We propose four situations in which misclassification might be plausible.

Firstly, reporting behaviour, as with medication compliance or dietary recall, is a complex activity affected by numerous external factors [19, 20]. Secondly, subjects may attribute outcomes of the disease to outcomes of therapy, or vice-versa. Thirdly, the litigious character of participants in the US health system (in both providers and consumers of medical care) has been widely recognized [21, 22]. Lastly, increased media publicity about the impact of adverse events is known to make evaluation of symptoms difficult [23].

Prevalence data was used to estimate risk, but its interpretation is relevant only insofar as it is related to the associations with relevant covariates or groups of covariates suggested by the statistical models. Any suggestion that these results imply causality is an inappropriate appreciation of the complexity of the subject matter and the inadequacy of the primary design of the NHIS. For instance, the prevalence odds ratio is an unbiased estimate of the incidence odds ratio only if the exposure is unrelated to prognosis (ie., duration of illness is the same for exposed and unexposed groups). Since self-reported, cross-sectional data were used, we have no direct information about the longitudinal features of the condition. Hence, even the most fundamental criterion in arguing for the presence of causation - temporality - is unfulfilled.

When modelling the risk for injuries due to complications of medical care, we found significant interaction between age and race. The effect of age had been previously examined in the HMPS [2]. In that study, subjects above 64 years of age were more than twice as likely to have complication arising from medical care compared to those under 45 years. We hypothesized that some degree of residual confounding was present when broad age ranges were used. Our unadjusted results mirror those of the HMPS findings. However, after adjustment for multiple variables, differences emerged. To our knowledge, this is the first indication of the presence of such an interaction. We explored the possibility that these results were due to some bias in the design of the study. The NHIS is known for the consistency of its data checks and response rates for the analysis period were consistently above 90%. Selection bias is unlikely in this setting.

We recognize the limitation of the racial classifications used by the NHIS, especially in the category labelled "Others". However, the lack of available information for persons that could potentially be included in this category prompted us to keep the three-category coding. The results are admittedly unstable, given that analyses were based on much smaller sample sizes. Future research could examine this issue more finely.

If present, non-differential misclassification will generally tend to attenuate predicted differences between groups. For instance, this attenuation might have been the cause of the non-significant results seen in the older age groups. However, if present, the results for the younger age groups are expected to be underestimates of the true value.

The potential immediate and long-term research and policy implications of these findings are many and have been discussed previously in other fora [[24–28]]. This study lends support for the development of common definitions and systems for the routine collection and analysis of data from complications of medical care. These information systems should not only have the capacity to exploit the inherently hierarchical nature of specific health service boundaries (ie., hospitals within counties within states within regions), but also provide a means of promoting a systematic method to the strengthening of approaches to quality of care within the larger health care community.

Conclusions

These data suggest that self-reported injuries due to complications of medical care impose heavier morbidity than previously considered with some indication that socio-demographic variables modify the risk for injuries. Further studies are required to better understand these relationships.