Skip to main content
Log in

Evaluation strategies for case series: is Cox regression an alternative to the self controlled case series method for terminal events?

  • Original Paper
  • Published:
AStA Advances in Statistical Analysis Aims and scope Submit manuscript

Abstract

In this paper, we deal with the analysis of case series. The self-controlled case series method (SCCS) was developed to analyse the temporal association between time-varying exposure and an outcome event. We apply the SCCS method to the vaccination data of the German Examination Survey for Children and Adolescents (KiGGS). We illustrate that the standard SCCS method cannot be applied to terminal events such as death. In this situation, an extension of SCCS adjusted for terminal events gives unbiased point estimators. The key question of this paper is whether the general Cox regression model for time-dependent covariates may be an alternative to the adjusted SCCS method for terminal events. In contrast to the SCCS method, Cox regression is included in most software packages (SPSS, SAS, STATA, R, …) and it is easy to use. We can show that Cox regression is applicable to test the null hypothesis. In our KiGGS example without censored data, the Cox regression and the adjusted SCCS method yield point estimates almost identical to the standard SCCS method. We have conducted several simulation studies to complete the comparison of the two methods. The Cox regression shows a tendency to underestimate the true effect with prolonged risk periods and strong effects (Relative Incidence >2). If risk of the event is strongly affected by the age, the adjusted SCCS method slightly overestimates the predefined exposure effect. Cox regression has the same efficiency as the adjusted SCCS method in the simulation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. The age distribution was based on the empirical age distribution of 689 SUD cases which were reported by the German local health authority in the framework of the German TOKEN study (www.token-studie.de) between 2005 and 2008.

  2. Except: RP=3 and RI=0.5; RP=14 and RI=2.

  3. If the event is distributed according to the empirical SUD age distribution, many cases are unvaccinated or receive only the first or second dose, since the highest incidence of SUD is in the third month of life.

References

  • Andrews, N., Miller, E., Waight, P., Farrington, C.P., Crowcroft, N., Stowe, J., Taylor, B.: Does oral polio vaccine cause intussusception in infants? Evidence from a sequence of three self-controlled case series studies in the United Kingdom. Eur. J. Epidemiol. 17, 701–706 (2001)

    Article  Google Scholar 

  • Cox, D.R.: Regression models and life-tables. J. R. Stat. Soc. B 34, 187–220 (1972)

    MATH  Google Scholar 

  • Cox, D.R., Oakes, D.: Analysis of Survival Data. Chapman and Hall, London (1984)

    Google Scholar 

  • Farrington, P.C.: Relative incidence estimation from case series for vaccine safety evaluation. Biometrics 51, 228–235 (1995)

    Article  MathSciNet  MATH  Google Scholar 

  • Farrington, C.P., Pugh, S., Colville, A., Flower, A., Nash, J., Morgan-Capner, P., Rush, M., Miller, E.: A new method for active surveillance of adverse events from diphtheria tetanus pertussis and measles mumps rubella vaccines. Lancet 345, 567–569 (1995)

    Article  Google Scholar 

  • Farrington, C.P., Whitaker, H.J., Hocine, M.N.: Case series analysis for censored, perturbed or curtailed post-event exposures. Biostatistics 10, 3–16 (2009)

    Article  Google Scholar 

  • Hosmer, D.W.J., Lemeshow, S.: Applied Survival Analysis: Regression Modeling of Time to Event Data. Wiley, New York (1999)

    MATH  Google Scholar 

  • Kalbfleisch, J.D., Lawless, J.: Regression models for right truncated data with applications to aids incubation times and reporting lags. Stat. Sin. 1, 19–32 (1991)

    MATH  Google Scholar 

  • Kramarz, P., DeStefano, F., Gargiullo, P.M., Davis, R.L., Chen, R.T., Mullooly, J.P., Black, S.B., Shinefield, H.R., Bohlke, K., Ward, J.I., Marcy, M.S.: Does influenza vaccination exacerbate asthma? Arch. Fam. Med. 9, 617–623 (2000)

    Article  Google Scholar 

  • Kuhnert, R., Hecker, H., Poethko-Müller, C., Schlaud, M., Vennemann, M., Whitaker, H.J., Farrington, C.P.: A modified self-controlled case series method to examine association between multidose vaccinations and death. Stat. Med. 30(6), 666–677 (2011). doi:10.1002/sim.4120

    Article  MathSciNet  Google Scholar 

  • Kurth, B.M., Kamtsiuris, P., Hölling, H., Schlaud, M., Dölle, R., Ellert, U., Kahl, H., Knopf, H., Lange, M., Mensink, G.B., Neuhauser, H., Schaffrath Rosario, A., Scheidt-Nave, C., Schenk, L., Schlack, R., Stolzenberg, H., Thamm, M., Thierfelder, W., Wolf, U.: The challenge of comprehensively mapping children’s health in a nation-wide health survey: design of the German KiGGS-study. BMC Public Health 8, 196 (2008)

    Article  Google Scholar 

  • Miller, E., Waight, P., Farrington, P., Andrews, N., Stowe, J., Taylor, B.: Idiopathic thrombocytopenic purpura and MMR vaccine. Arch. Dis. Child. 84, 227–229 (2001)

    Article  Google Scholar 

  • Murphy, T.V., Gargiullo, P.M., Massoudi, M.S., Nelson, D.B., Jumaan, A.O., Okoro, C.A., Zanardi, L.R., Setia, S., Fair, E., LeBaron, C.W., Wharton, M., Livengood, J.R.: Intussusception among infants given an oral rotavirus vaccine. N. Engl. J. Med. 334(8), 564–572 (2001)

    Article  Google Scholar 

  • Prentice, R.L., Vollmer, W.M., Kalbfleisch, J.D.: On the use of case series to identify disease risk factors. Biometrics 40, 445–458 (1984)

    Article  MATH  Google Scholar 

  • STIKO: Empfehlung der Ständigen Impfkommission (STIKO) am Robert Koch-Institut/Stand Juli 2009. Epidemiol. Bull. 30, 279–298 (2009)

    Google Scholar 

  • Vennemann, M.M.T., Höffgen, M., Bajanowski, T., Hense, H.W., Mitchell, E.A.: Do immunisations reduce the risk for SIDS? A meta-analysis. Vaccine 25, 4875–4879 (2007)

    Article  Google Scholar 

  • von Kries, R., Toschke, A.M., Straßburger, K., Kundi, M., Kalies, H., Nennstiel, U., Jorch, G., Rosenbauer, J., Giani, G.: Sudden and unexpected deaths after the administration of hexavalent vaccines (diphtheria, tetanus, pertussis, poliomyelitis, hepatitis b, Haemophilus influenzae type): is there a signal? Eur. J. Pediatr. 164, 61–69 (2005)

    Article  Google Scholar 

  • Weldeselassie, Y.G., Whitaker, H.J., Farrington, C.P.: Use of the self-controlled case-series method in vaccine safety studies: review and recommendations for best practice. Epidemiol. Infect. 139(12), 1805–1817 (2011). doi:10.1017/S0950268811001531

    Article  Google Scholar 

  • Whitaker, H.J., Farrington, C.P., Spiessens, B., Musonda, P.: Tutorial in biostatistics: the self-controlled case series method. Stat. Med. 25, 1768–1797 (2006)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

R. Kuhnert was supported by a grant from the German Research Foundation. We are very grateful to Paddy Farrington for his helpful comments. We thank our colleague Ben Barnes for the careful reading of this manuscript and for his improvements of this paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ronny Kuhnert.

Appendix

Appendix

1.1 A.1 Application of Cox regression in the context of a case series analysis with SPSS

We used SPSS for our example. The SPSS syntax to compute the general exposure effect is

TIME PROGRAM.

compute risk_T=0.

do if (T_>=vacand T_<(vac1+delta)).

compute risk_T=1.

else if (T_>=vacand T_<(vac2+delta)).

compute risk_T=1.

else if (T_>=vacand T_<(vac3+delta)).

compute risk_T=1.

else if (T_>=vacand T_<(vac4+delta)).

compute risk_T=1.

end if.

COXREG

/death/STATUS=dummy(1)

/METHOD=ENTER risk_T

/PRINT=CI(95)

/CRITERIA=PIN(.05) POUT(.06) ITERATE(20).

The explanations of the variables are:

vac1:

through vac4 are the numbers of days from birth to vaccination 1 through 4.

risk_T :

is the risk status (risk_T=1 at risk, otherwise risk_T=0).

delta :

is the duration of the risk period.

T_:

is the internal time variable.

death :

is the number of days from birth to event.

dummy :

is a dummy variable always equal 1.

1.2 A.2 Definition of the age classes

We derived the age classes from the empirical age distribution of 689 SUD cases which were reported by German local health authorities in the framework of the German TOKEN study (www.token-studie.de) between 2005 and 2008. The 689 cases are divided into 21 age groups. Age class k has as its upper limit the k×4.76th percentile of the distribution. This ensures that each class nearly has the same number of cases. The definition the second interval (41.00–51.00] is 41.00<age i ≤51.00. The round bracket indicates that the 41.00 is not included in the interval.

Definition of the age classes

ID

Age

ID

Age

1

[30.00–41.00]

11

(129.62–140.38]

2

(41.00–51.00]

12

(140.38–159.00]

3

(51.00–59.00]

13

(159.00–179.90]

4

(59.00–67.00]

14

(179.90–206.00]

5

(67.00–73.81]

15

(206.00–231.00]

6

(73.81–78.57]

16

(231.00–257.19]

7

(78.57–88.00]

17

(257.19–286.95]

8

(88.00–101.10]

18

(286.95–347.71]

9

(101.10–117.00]

19

(347.71–421.00]

10

(117.00–129.62]

20

(421.00–512.00]

  

21

(512.00–730.00]

1.3 A.3 COX regression with time-dependent covariates; the Bias of risk estimation

The conditional-hazard function at time t reads

In the following we assume that R(t) is binary, with R(t)=1 indicating the status of risk present and R(t)=0 outside a risk period. We look at the conditional-hazard ratio (HR) of the risk status R(t)=1 versus R(t)=0 and find

That is, the conditional-hazard ratio is no longer a constant. Instead, the unconditional value exp[β] is multiplied by a function

Thus, the application of the COX model to the conditional situation TL will generally introduce a bias into the estimation of β or exp(β). However, it can be shown that the direction of the risk effect is the same for the unconditional and the conditional situation. That is, if the unconditional HRexp(β)>1, then the conditional-hazard ratio HR(tX=x,TL)≥1, too, and exp(β)<1 implies HR(tX=x,TL)≤1. To see this, we first assume β>0, that is, exp(β)>1. In this case

An upper limit is easily obtained as

That is

Similarly, for exp(β)<1

There are three remarks.

  1. 1.

    As a result, although the estimation of β may be biased with regard to its numerical value, it is not biased with respect to its sign. Also, since β=0, the conditional-hazard ratio HR(tX=x,TL) is 1, independently of t and X, significance testing of H 0:β=0 is valid within the COX model.

  2. 2.

    The inequalities held independently of any influences of covariates X on the risk distributions \((\overline{R}\mid R(t)=r(t), X=x)\) after time t.

  3. 3.

    The lower limit of HR(tX=x,TL)=1 for exp[β]>1 is reached, if, for any time point t, R(t)=1 implies R(τ)=1 for all τ>t, and, also, R(t)=0 implies R(τ)=0 for all τ>t. This describes the situation, in which a case is under risk either throughout the observation time or never. Clearly, this is a situation in which β is not estimable.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kuhnert, R., Schlaud, M. & Hecker, H. Evaluation strategies for case series: is Cox regression an alternative to the self controlled case series method for terminal events?. AStA Adv Stat Anal 96, 467–492 (2012). https://doi.org/10.1007/s10182-011-0187-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10182-011-0187-9

Keywords

Navigation