Sensitivity to Hidden Bias

  • Paul R. Rosenbaum
Part of the Springer Series in Statistics book series (SSS)


Cornfield, Haenszel, Hammond, Lilienfeld, Shimkin, and Wynder (1959) first conducted a formal sensitivity analysis in an observational study. Their paper is a survey of the evidence available in 1959 linking smoking with lung cancer. The paper asks whether the association between smoking and lung cancer is an effect caused by smoking or whether it is instead due to a hidden bias. Can lung cancer be prevented by not smoking? Or are the higher rates of lung cancer among smokers due to some other difference between smokers and nonsmokers?


Sensitivity Analysis Hide Bias Vaginal Cancer Concordant Pair Unobserved Covariate 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Armitage, P. (1977). Statistical Methods in Medical Research (fourth printing), Oxford, UK: Blackwell.Google Scholar
  2. Bickel, P. and van Zwet, (1978). Asymptotic expansions for the power of distribution free tests in the two-sample problem. Annals of Statistics, 6, 937–1004.MathSciNetMATHCrossRefGoogle Scholar
  3. Breslow, N. and Day, N. (1980). Statistical Methods in Cancer Research, I: The Analysis of Case-Control Studies. Lyon, France: International Agency for Research on Cancer.Google Scholar
  4. Boston Collaborative Drug Project (1972). Excess of ampicillin rashes associated with allopurinol or hyperuricemia. New England Journal of Medicine, 286, 505–507.CrossRefGoogle Scholar
  5. Bross, I.D.J. (1966). Spurious effects from an extraneous variable. Journal of Chronic Diseases, 19, 637–647.CrossRefGoogle Scholar
  6. Bross, I.D.J. (1967). Pertinency of an extraneous variable. Journal of Chronic Diseases, 20, 487–495.CrossRefGoogle Scholar
  7. Cameron, E. and Pauling, L. (1976). Supplemental ascorbate in the supportive treatment of cancer: Prolongation of survival times in terminal human cancer. Proceedings of the National Academy of Sciences (USA), 73, 3685–3689.CrossRefGoogle Scholar
  8. Cornfield, J., Haenszel, W., Hammond, E., Lilienfeld, A., Shimkin, M., and Wynder, E. (1959). Smoking and lung cancer: Recent evidence and a discussion of some questions. Journal of the National Cancer Institute, 22, 173–203.Google Scholar
  9. Eaton, M. (1987). Lectures on Topics in Probability Inequalities. Amsterdam: Centrum voor Wiskunde en Informatica.MATHGoogle Scholar
  10. Fisher, R.A. (1958). Lung cancer and cigarettes? Nature, 182, July 12, 108.CrossRefGoogle Scholar
  11. Gastwirth, J. (1988). Statistical Reasoning in Law and Public Policy. New York: Academic Press.MATHGoogle Scholar
  12. Gastwirth, J. (1992a). Employment discrimination: A statistician’s look at analysis of disparate impact claims. Law and Inequality, 11, 151–179.Google Scholar
  13. Gastwirth, J. (1992b). Methods for assessing the sensitivity of statistical comparisons used in Title VII cases to omitted variables. Jurimetrics Journal, 19–34.Google Scholar
  14. Gastwirth, J. and Greenhouse, S. (1987). Estimating a common relative risk: Application in equal employment. Journal of the American Statistical Association, 82, 38–45.MathSciNetMATHCrossRefGoogle Scholar
  15. Gibbons, J.D. (1982). Brown-Mood median test. In: Encyclopedia of Statistical Sciences (eds., S. Kotz and N. Johnson), New York: Wiley, Volume 1, pp. 322–324.Google Scholar
  16. Greenhouse, S. (1982). Jerome Cornfield’s contributions to epidemiology. Biometrics, 38S, 33–46.CrossRefGoogle Scholar
  17. Hakulinen, T. (1981). A Mantel-Haenszel statistic for testing the association between a polychotomous exposure and a rare outcome. American Journal of Epidemiology, 113, 192–197.Google Scholar
  18. Hammond, E.C. (1964). Smoking in relation to mortality and morbidity: Findings in first thirty-four months of follow-up in a prospective study started in 1959. Journal of the National Cancer Institute, 32, 1161–1188.Google Scholar
  19. Hannan, J. and Harkness, W. (1963). Normal approximation to the distribution of two independent binomials, conditional on a fixed sum. Annals of Mathematical Statistics, 34, 1593–1595.MathSciNetMATHCrossRefGoogle Scholar
  20. Harkness, W. (1965). Properties of the extended hypergeometric distribution. Annals of Mathematical Statistics, 36, 938–945.MathSciNetMATHCrossRefGoogle Scholar
  21. Hayek, J. and Sidák, Z. (1967). Theory of Rank Tests. New York: Academic Press.Google Scholar
  22. Herbst, A., Ulfelder, H., and Poskanzer, D. (1971). Adenocarcinoma of the vagina: Association of maternal stilbestrol therapy with tumor appearance in young women. New England Journal of Medicine, 284, 878–881.CrossRefGoogle Scholar
  23. Hettmansperger, T. (1984). Statistical Inference Based on Ranks. New York: Wiley.MATHGoogle Scholar
  24. Hodges, J. and Lehmann, E. (1963). Estimates of location based on rank tests. Annals of Mathematical Statistics, 34, 598–611.MathSciNetMATHCrossRefGoogle Scholar
  25. Hollander, M., Proschan, F., and Sethuraman, J. (1977). Functions decreasing in transposition and their applications in ranking problems. Annals of Statistics, 5, 722–733.MathSciNetMATHCrossRefGoogle Scholar
  26. Hollander, M. and Wolfe, D. (1973). Nonparametric Statistical Methods. New York: Wiley.MATHGoogle Scholar
  27. Holley, R. (1974). Remarks on the FKG inequalities. Communications in Mathematical Physics, 36, 227–231.MathSciNetCrossRefGoogle Scholar
  28. Jick, H., Miettinen, O., Neff, R., et al. (1973). Coffee and myocardial infarction. New England Journal of Medicine, 289, 63–77.CrossRefGoogle Scholar
  29. Johnson, N., Kotz, S., and Kemp, A. (1992). Univariate Discrete Distributions. New York: Wiley.MATHGoogle Scholar
  30. Kelsey, J. and Hardy, R. (1975). Driving of motor vehicles as a risk factor for acute herniated lumbar intervertebral disc. American Journal of Epidemiology, 102, 63–73.Google Scholar
  31. Lehmann, E. (1975). Nonparametrics: Statistical Methods Based on Ranks. San Francisco: Holden-Day.MATHGoogle Scholar
  32. Mack, T., Pike, M., Henderson, B., Pfeffer, R., Gerkins, V., Arthur, B., and Brown, S. (1976). Estrogens and endometrial cancer in a retirement community. New England Journal of Medicine, 294, 1262–1267.CrossRefGoogle Scholar
  33. Mann, H. and Whitney, D. (1947). On a test of whether one of two random variables is stochastically larger than the other. Annals of Mathematical Statistics, 18, 50–60.MathSciNetMATHCrossRefGoogle Scholar
  34. Mantel, N. and Haenszel, W. (1959). Statistical aspects of retrospective studies of disease. Journal of the National Cancer Institute, 22, 719–748.Google Scholar
  35. Marshall, A. and Olkin, I. (1979). Inequalities: Theory of Majorization and Its Applications. New York: Academic Press.MATHGoogle Scholar
  36. McNemar, Q. (1947). Note on the sampling error of the differences between correlated proportions or percentages. Psychometrika, 12, 153–157.CrossRefGoogle Scholar
  37. Miettinen, O. (1969). Individual matching with multiple controls in the case of all or none responses. Biometrics, 22, 339–355.MathSciNetCrossRefGoogle Scholar
  38. Moertel, C., Fleming, T., Creagan, E., Rubin, J., O’Connell, M., and Ames, M. (1985). High-dose vitamin C versus placebo in the treatment of patients with advanced cancer who have had no prior chemotherapy: A randomized double-blind comparison. New England Journal of Medicine, 312, 137–141.CrossRefGoogle Scholar
  39. Morton, D., Saah, A., Silberg, S., Owens, W., Roberts, M., and Saah, M. (1982). Lead absorption in children of employees in a lead related industry. American Journal of Epidemiology, 115, 549–555.Google Scholar
  40. Mosteller, F. and Tukey, J. (1977). Data Analysis and Regression. Reading, MA: Addison-Wesley.Google Scholar
  41. Nicholson, W., Selikoff, I., Seidman, H., Lilis, R., and Formby, P. (1979). Long-term mortality experience of chrysotile miners and millers in Thetford Mines, Quebec. Annals of the New York Academy of Sciences, 330, 11–21.CrossRefGoogle Scholar
  42. O’Brien, P.C. and Fleming, T.R. (1987). A paired Prentice-Wilcoxon test for censored paired data. Biometrics, 43, 169–180.CrossRefGoogle Scholar
  43. Plackett, R.L. (1981). The Analysis of Categorical Data (second edition). New York: Macmillan.MATHGoogle Scholar
  44. Rosenbaum, P. (1986). Dropping out of high school in the United States: An observational study. Journal of Educational Statistics, 11, 207–224.CrossRefGoogle Scholar
  45. Rosenbaum, P.R. (1987). Sensitivity analysis for certain permutation inferences in matched observational studies. Biometrika, 74, 13–26.MathSciNetMATHCrossRefGoogle Scholar
  46. Rosenbaum, P.R. (1988). Sensitivity analysis for matching with multiple controls. Biometrika, 75, 577–581.MathSciNetMATHCrossRefGoogle Scholar
  47. Rosenbaum, P.R. (1989). On permutation tests for hidden biases in observational studies: An application of Holley’s inequality to the Savage lattice. Annals of Statistics, 17, 643–653.MathSciNetMATHCrossRefGoogle Scholar
  48. Rosenbaum, P.R. (1991a). Sensitivity analysis for matched case-control studies. Biometrics, 47, 87–100.MathSciNetMATHCrossRefGoogle Scholar
  49. Rosenbaum, P.R. (1991b). Discussing hidden bias in observational studies. Annals of Internal Medicine, 115, 901–905.Google Scholar
  50. Rosenbaum, P.R. (1993). Hodges-Lehmann point estimates of treatment effect in observational studies. Journal of the American Statistical Association, 88, 1250–1253.MathSciNetMATHCrossRefGoogle Scholar
  51. Rosenbaum, P. and Krieger, A. (1990). Sensitivity analysis for two-sample permutation inferences in observational studies. Journal of the American Statistical Association, 85, 493–498.MATHCrossRefGoogle Scholar
  52. Rosenbaum, P. and Rubin, D. (1983). Assessing sensitivity to an unobserved binary covariate in an observational study with binary outcome. Journal of the Royal Statistical Society, Series B, 45, 212–218.Google Scholar
  53. Rubin, D.B. (1978). Bayesian inference for causal effects: The role of randomization. Annals of Statistics, 6, 34–58.MathSciNetMATHCrossRefGoogle Scholar
  54. Savage, I.R. (1964). Contributions to the theory of rank order statistics: Applications of lattice theory. Review of the International Statistical Institute, 32, 52–63.MathSciNetMATHCrossRefGoogle Scholar
  55. Schlesselmann, J.J. (1978). Assessing the effects of confounding variables. American Journal of Epidemiology, 108, 3–8.Google Scholar
  56. Skerfving, S., Hansson, K., Mangs, C., Lindsten, J., and Ryman, N. (1974). Methylmercury-induced chromosome damage in man. Environmental Research, 7, 83–98.CrossRefGoogle Scholar
  57. Stevens, W.L. (1951). Mean and variance of an entry in a contingency table. Biometrika, 38, 468–470.MathSciNetMATHGoogle Scholar
  58. Wilcoxon, F. (1945). Individual comparisons by ranking methods. Biometrics, 1, 80–83.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 1995

Authors and Affiliations

  • Paul R. Rosenbaum
    • 1
  1. 1.Department of StatisticsUniversity of PennsylvaniaPhiladelphiaUSA

Personalised recommendations