Statistics in Biosciences

, Volume 1, Issue 1, pp 65–79

On Analysis of the Difference of Two Exposure-Adjusted Poisson Rates with Stratification: From Asymptotic to Exact Approaches



Long-term studies are frequently conducted to assess the treatment effect on rare diseases or the safety of a new treatment. To account for differential follow-up often encountered in long-term studies, exposure-adjusted incidence rates are used in evaluating the treatment effect. The difference of rates is sometimes used to quantify the treatment’s public health impact because the reciprocal of this difference can be interpreted as “the number needed to treat (or number needed to vaccinate) in order to cure (or prevent) 1 case of disease.” In this paper we focus on the stratified analysis of the difference of two exposure-adjusted rates in the setting of superiority, noninferiority and super-superiority hypothesis testing. After a brief review of asymptotic methods, we derive an exact method that guarantees control of the type I error. But it is conservative for noninferiority and super-superiority testing because of the search of the maximum tail probability over a multidimensional nuisance parameter space. Then, we present an approximate exact method where the p-value is estimated at the maximum likelihood estimates of the nuisance parameter. This method is identical to exact method for superiority testing and reduces the conservatism for noninferiority and super-superiority testing. In addition, a quasi-exact method is discussed. A real-life vaccine clinical trial example is used to illustrate these methods. Finally, we compare the performance of these methods via empirical studies and make some general practical recommendations.


Approximate exact method Constrained maximum likelihood estimate Exact test Poisson rate Risk difference Stratified analysis 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Barnard GA (1947) Significance test for 2×2 tables. Biometrika 34:123–138 MATHMathSciNetGoogle Scholar
  2. 2.
    Basu D (1977) On the elimination of nuisance parameters. J Am Stat Assoc 72:355 MATHCrossRefGoogle Scholar
  3. 3.
    Berger RL, Boos DD (1994) P values maximized over a confidence set for the nuisance parameter. J Am Stat Assoc 89:1012–1016 MATHCrossRefMathSciNetGoogle Scholar
  4. 4.
    Blackwelder WC (1993) Sample size and power for prospective analysis of relative risk. Stat Med 12:691–698 CrossRefGoogle Scholar
  5. 5.
    Chan ISF (1998) Exact tests of equivalence and efficacy with a non-zero lower bound for comparative studies. Stat Med 17:1403–1413 CrossRefGoogle Scholar
  6. 6.
    Chan ISF (2003) Proving non-inferiority or equivalence of two treatments with dichotomous endpoints using exact methods. Stat Methods Med Res 12:37–58 MATHCrossRefMathSciNetGoogle Scholar
  7. 7.
    Chan ISF, Bohidar NR (1998) Exact power and sample size for vaccine efficacy studies. Commun Stat Theory Methods 27:1305–1322 MATHCrossRefGoogle Scholar
  8. 8.
    Chan ISF, Zhang Z (1999) Test-based exact confidence intervals for the difference of two binomial proportions. Biometrics 55:1202–1209 MATHCrossRefGoogle Scholar
  9. 9.
    Coplan PM, Schmader K, Nikas A, Chan ISF, Choo P, Levin MJ, Johnson G, Bauer M, Williams HM, Kaplan KM, Guess HA, Oxman M (2004) Assessing herpes zoster pain using a zoster-specific measure. J Pain 5(6):344–356 CrossRefGoogle Scholar
  10. 10.
    Greenland S, Robins JM (1985) Estimation of a common effect parameter from sparse follow-up data. Biometrics 41:55–68 MATHCrossRefMathSciNetGoogle Scholar
  11. 11.
    Guess HA, Lydick EG, Small RD, Miller LP (1987) Epidemiologic programs for computers and calculators—exact binomial confidence intervals for the relative risk in follow-up studies with sparsely stratified incidence density data. Am J Epidemiol 125:340–347 Google Scholar
  12. 12.
    Kang SH, Chen JJ (2000) An approximate unconditional test of non-inferiority between two proportions. Stat Med 19:2089–2100 CrossRefGoogle Scholar
  13. 13.
    Kelly H, Attia J, Andrews J, Heller JF (2004) The number needed to vaccinate (NNV) and population extensions of the NNV: comparison of influenza and pneumococcal vaccine programmes for people aged 65 years and over. Vaccine 22:2192–2198 CrossRefGoogle Scholar
  14. 14.
    Lachin JM, Foulkes MA (1986) Evaluation of sample size and power for analysis of survival with allowance for nonuniform patient entry, losses to follow-up, noncompliance, and stratification. Biometrics 42:507–519 MATHCrossRefGoogle Scholar
  15. 15.
    Laupacis A, Sackett DL, Roberts DS (1988) An assessment of clinically useful measures of the consequences of treatment. New Engl J Med 318:1728–1733 CrossRefGoogle Scholar
  16. 16.
    Liu GF, Wang J, Liu K, Snavely DB (2006) Confidence intervals for an exposure-adjusted incidence rate difference with application to clinical trials. Stat Med 25:1275–1286 CrossRefMathSciNetGoogle Scholar
  17. 17.
    Martin DO, Austin H (1996) Exact estimates for a rate ratio. Epidemiology 7:29–33 CrossRefGoogle Scholar
  18. 18.
    Mehrotra DV, Chan ISF, Berger RL (2003) A cautionary note on exact unconditional inference for a difference between two independent binomial proportions. Biometrics 59:441–450 CrossRefMathSciNetGoogle Scholar
  19. 19.
    Miettinen O, Nurminen M (1985) Comparative analysis of two rates. Stat Med 4:213–226 CrossRefGoogle Scholar
  20. 20.
    Nam JM (2006) Non-inferiority of new procedure to standard procedure in stratified matched-pair design. Biom J 48:966–977 CrossRefMathSciNetGoogle Scholar
  21. 21.
    Oxman MN, Levin MJ, Johnson GR, Schmader KE, Straus SE, Gelb LD, Arbeit RD, Simberkoff MS, Gershon AA, Davis LE, Weinberg A, Boardman KD, Williams HM, Zhang JH, Peduzzi PN, Beisel CE, Morrison VA, Guatelli JC, Brooks PA, Kauffman CA, Pachucki CT, Neuzil KM, Betts RF, Wright PF, Griffin MR, Brunell P, Soto NE, Marques AR, Keay SK, Goodman RP, Cotton DJ, Gnann JW, Loutit J, Holodniy M, Keitel WA, Crawford GE, Yeh SSY, Lobo Z, Toney JF, Greenberg RN, Keller PM, Harbecke R, Hayward AR, Irwin MR, Kyriakides TC, Chan CY, Chan ISF, Wang WWB, Annunziato PW, Silber JL (2005) A vaccine to prevent herpes zoster and postherpetic neuralgia in older adults. New Engl J Med 352:2271–2284 CrossRefGoogle Scholar
  22. 22.
    Storer BE, Kim C (1990) Exact properties of some exact test statistics for comparing two binomial proportions. J Am Stat Assoc 85:146–155 CrossRefGoogle Scholar
  23. 23.
    Wang WWB, Xu J, Sutradhar S, Chan ISF (2005) On hypothesis testing and confidence intervals for the difference of two independent Poisson rates. Annual Conference of the Eastern North American Region (ENAR) of International Biometric Society, Austin, TX, March 2005 Google Scholar

Copyright information

© International Chinese Statistical Association 2009

Authors and Affiliations

  1. 1.Clinical BiostatisticsMerck Research LaboratoriesNorth WalesUSA
  2. 2.Clinical BiostatisticsMerck Research LaboratoriesShanghaiPeople’s Republic of China

Personalised recommendations