Skip to main content
Log in

The distribution of unobserved heterogeneity in competing risks models

  • Regular Article
  • Published:
Statistical Papers Aims and scope Submit manuscript

Abstract

We show that in a large class of proportional hazard competing risks models, the distribution of the bivariate frailty among survivors converges to a limiting distribution. This generalizes the result of Abbring and van den Berg (Biometrika 94(1):87–99, 2007), who show that in a single spell duration model, the frailty distribution converges to the gamma distribution. The resulting limiting distribution has an interpretation in terms of partition of a gamma distribution, and allows for both positive and negative correlation between the survival variables. This result provides a natural and flexible specification for the frailty in competing risks models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. The conventional approach is to use point mass distributions see e.g., Deng et al. (2000).

  2. The second condition is to ensure that the probability of surviving infinitely is zero, that is, there is no defectors.

  3. Because of the cointegration relation, it is also equivalent to check the potential convergence of \((\Lambda _1(t)U, \Lambda _2(t))|T_1>t, T_2>t\).

  4. This is important since we have (informally) \(\mathbb {1}_{X_t<Y_t} \approx \mathbb {1}_{T_1<T_2}\), namely, the order is (asymptotically) preserved under the time change.

  5. A function F is \(RV_0\) with index \(\alpha >0\) if and only if:

    $$\begin{aligned} \displaystyle \lim _{y \rightarrow 0} \frac{F(y)}{y^{\alpha }L(y)}=1, \end{aligned}$$

    where L is a slowly varying function at zero, that is, \(\lim _{y \rightarrow 0}\frac{L(ay)}{L(y)}=1\) for any \(a>0\).

  6. Indeed, the primary aim of the paper is to argue that the distribution \(dF(u,v) \propto e^{-a_1u-a_2v} \mathrm {d} \nu (u,v)\) is a natural and convenient choice for the initial distribution.

  7. See however the working paper version of Gordon (2002), available at http://www.polmeth.wustl.edu/files/polmeth/gordo00.pdf, for another model with negatively correlated frailties. Gordon assumes \(U=1/V\) with U gamma distributed.

  8. Such as a common heterogeneity term for the two risks.

  9. Such as the mixture of point masses.

References

  • Abbring J, van den Berg G (2003) The identifiability of the mixed proportional hazards competing risks model. J R Stat Soc B 65(3):701–710

    Article  MathSciNet  Google Scholar 

  • Abbring J, van den Berg G (2007) The unobserved heterogeneity distribution in duration analysis. Biometrika 94(1):87–99

    Article  MathSciNet  Google Scholar 

  • Baker M, Melino A (2000) Duration dependence and nonparametric heterogeneity: a Monte–Carlo study. J Econ 96(2):357–393

    Article  Google Scholar 

  • Clayton D (1978) A model for association in bivariate life tables and its application in epidemiological studies of familial tendency in chronic disease incidence. Biometrika 65(1):141–151

    Article  MathSciNet  Google Scholar 

  • Deng Y, Quigley J, Order R (2000) Mortgage terminations, heterogeneity and the exercise of mortgage options. Econometrica 68(2):275–307

    Article  Google Scholar 

  • Feller W (2008) An introduction to probability theory and its applications, vol 2, 2nd edn. Wiley, Hoboken

    MATH  Google Scholar 

  • Gordon SC (2002) Stochastic dependence in competing risks. Am J Polit Sci 46:200–217

    Article  Google Scholar 

  • Hanagal DD (2009) Weibull extension of bivariate exponential regression model with different frailty distributions. Stat Pap 50(1):29–49

    Article  MathSciNet  Google Scholar 

  • Heckman J, Honoré B (1989) The identifiability of the competing risks model. Biometrika 76(2):325–330

    Article  MathSciNet  Google Scholar 

  • Horny G (2009) Inference in mixed proportional hazard models with k random effects. Stat Pap 50(3):481–499

    Article  MathSciNet  Google Scholar 

  • Kayid M, Izadkhah S, Zuo MJ (2015) Some results on the relative ordering of two frailty models. Stat Pap 58:1–15

    MathSciNet  MATH  Google Scholar 

  • Lancaster T (1979) Econometric methods for the duration of unemployment. Econometrica 47(4):939–956

    Article  Google Scholar 

  • Ledford AW, Tawn JA (1996) Statistics for near independence in multivariate extreme values. Biometrika 83(1):169–187

    Article  MathSciNet  Google Scholar 

  • Lukacs E (1955) A characterization of the gamma distribution. Ann Math Stat 26:319–324

    Article  MathSciNet  Google Scholar 

  • Omey E, Willekens E (1989) Abelian and Tauberian theorems for the laplace transform of functions in several variables. J Multivar Anal 30(2):292–306

    Article  MathSciNet  Google Scholar 

  • Xue X, Brookmeyer R (1996) Bivariate frailty model for the analysis of multivariate survival time. Lifetime Data Anal. 2(3):277–289

    Article  Google Scholar 

  • Yashin A, Vaupel J, Iachine I (1995) Correlated individual frailty: an advantageous approach to survival analysis of bivariate data. Math Popul Stud 5(2):145–159

    Article  Google Scholar 

Download references

Acknowledgements

I thank C. Gouriéroux, A. Guillou, G. Stupfler, C. Genest, as well as two referees for insightful comments. All remaining errors are mine.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yang Lu.

Appendices

Appendix 1

Proofs

Proof of Property 2

$$\begin{aligned} \frac{\mathbb {P}[T_1<T_2|\min (T_1, T_2)=t]}{\mathbb {P}[T_1>T_2|\min (T_1, T_2)=t]}= & {} \frac{h_1(t)}{h_2(t)}=\frac{\lambda _1(t)\mathbb {E}[U|T_1>t, T_2>t] }{\lambda _2(t)\mathbb {E}[V|T_1>t, T_2>t]}\\\sim & {} \ell \frac{\mathbb {E}[\Lambda (t)U|T_1>t, T_2>t] }{\mathbb {E}[\Lambda (t)V|T_1>t, T_2>t]}, \end{aligned}$$

which converges to a positive number \(\ell '\) if the distribution \(\Lambda (t)(U, V)| T_1>t, T_2>t\). Thus \(\mathbb {P}[T_1<T_2|\min (T_1, T_2)=t]=\frac{h_1(t)}{h_1(t)+h_2(t)}\) converges to \(\frac{\ell '}{1+\ell '}\).

Proof of Theorem 1

The convergence of the distribution of \((\Lambda (t)U,\Lambda (t)V)|T_1>t, T_2>t\), or equivalently that of \((\Lambda _1(t)U,\Lambda _2(t)V)| T_1>t, T_2>t\), is equivalent to the convergence of the Laplace-Stieltjes transform of the cdf of the latter:

$$\begin{aligned} \mathcal {L}_2(x,y)&= \displaystyle \frac{\mathbb {E}\big [e^{-\Lambda _1(t)Ux-\Lambda _2(t)Vy}e^{-\Lambda _1(t)U-\Lambda _2(t)V}\big ]}{\mathbb {E}\big [e^{-\Lambda _1(t)U-\Lambda _2(t)V}\big ]} = \displaystyle \frac{\mathbb {E}\big [e^{-(x+1)\Lambda _1(t)U-(y+1)\Lambda _2(t)V}\big ]}{\mathbb {E}\big [e^{-\Lambda _1(t)U-\Lambda _2(t)V}\big ]}\\&=\displaystyle \frac{\iint e^{-(1+x)u-(1+y)v}dF(\frac{u}{\Lambda _1(t)}, \frac{v}{\Lambda _2(t)})}{\mathbb {E}\big [e^{-\Lambda _1(t)U-\Lambda _2(t)V}\big ]} \end{aligned}$$

Thus its convergence implies the pointwise convergence of: \(\frac{F(\frac{u}{\Lambda _1(t)}, \frac{v}{\Lambda _2(t)})}{\mathbb {E}\big [e^{-\Lambda _1(t)U-\Lambda _2(t)V}\big ]}\) to a measure k(uv), say. In particular, by taking \(u=v=1\) we also get: \(\displaystyle \frac{F(\frac{u}{\Lambda _1(t)}, \frac{v}{\Lambda _2(t)})}{F(\frac{1}{\Lambda _1(t)}, \frac{1}{\Lambda _2(t)})} \rightarrow \frac{k(u, v)}{k(1, 1)}\), or equivalently (by the monotonic property of F): \(\displaystyle \frac{F(\frac{u}{\Lambda (t)}, \frac{v}{\Lambda (t)})}{F(\frac{1}{\Lambda (t)}, \frac{1}{\Lambda (t)})} \rightarrow \frac{k(u/a_1, v/a_2)}{k(1/a_1, 1/a_2)}\). Thus F is regularly varying at zero.

Conversely, if F is regularly varying at zero, then, under some regularity conditions, the extended continuity theorem (Feller 2008, Theorem 2, Chapter XIII.1) applies and the previous steps can be reversed. \(\square \)

Proof of Property 9

(1) By Feller (2008), Chapter XIII.5, the regular variation at zero of \(a_1 U+a_2 V\) is equivalent to the regular variation of its Laplace transform at infinity. When t goes to infinity, we have:

$$\begin{aligned} \displaystyle \frac{\mathbb {E}[e^{-(a_1U+a_2V)ct}]}{\mathbb {E}[e^{-(a_1U+a_2V)t}]} = \frac{\mathbb {E}[e^{-(a_1U+a_2V)ct}]/\mathbb {E}[e^{-(U+V)t}]}{\mathbb {E}[e^{-(a_1U+a_2V)t}]/\mathbb {E}[e^{-(U+V)t}]} \sim \frac{\mathcal {L}_{\nu }(a_1c, a_2c)}{\mathcal {L}_{\nu }(a_1, a_2)} =c^{-\alpha } \end{aligned}$$

by the homogeneity of \(\nu \). Thus \(a_1 U+a_2 V\) is \(RV_0(\alpha )\).

Proof of Property 5

If (UV) follows (6), then the pdf of \(\Lambda (t)(U, V)\) given \(T_1>t, T_2>t\) is

$$\begin{aligned} f_t(u, v) \propto e^{-\frac{\Lambda _1(t)}{\Lambda (t)}u-\frac{\Lambda _2(t)}{\Lambda (t)}v}l\left( \frac{u}{\Lambda (t)}, \frac{v}{\Lambda (t)}\right) \mu \left( \frac{u}{\Lambda (t)},\frac{v}{\Lambda (t)}\right) . \end{aligned}$$
(19)

Since \(\Lambda _1(t) \sim a_1 \Lambda (t)\), \(\Lambda _2(t) \sim a_2 \Lambda (t)\), \(l(\frac{u}{\Lambda (t)}, \frac{v}{\Lambda (t)}) \sim l(\frac{1}{\Lambda (t)}, \frac{1}{\Lambda (t)})\), and \(\mu \) is homogeneous, the distribution (19) converges to: \(f_{\infty }(u, v) \propto e^{-a_1u-a_2v}\mu (u, v)\). Therefore, (UV) is \(BRV_0(\nu )\) by Theorem 1.

Conversely, if the cdf F is regularly varying at zero with a limit measure \(\nu \), then, under some regularity conditions (see e.g., Omey and Willekens 1989), the pdf f is also regularly varying, with:

$$\begin{aligned} \displaystyle \lim _{a \rightarrow 0} \frac{f(ax, ay)}{f(a, a)}= \frac{\mu (x, y)}{\mu (1, 1)}. \end{aligned}$$
(20)

Let us define \(l(x, y)=\frac{f(x, y)}{\mu (x, y)}\); then by Eq. (20), we can check that l is slowly varying at zero. \(\square \)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lu, Y. The distribution of unobserved heterogeneity in competing risks models. Stat Papers 61, 681–696 (2020). https://doi.org/10.1007/s00362-017-0956-y

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00362-017-0956-y

Keywords

Navigation