Skip to main content
Log in

The Impact of Joint Misclassification of Exposures and Outcomes on the Results of Epidemiologic Research

  • Epidemiologic Methods (R Maclehose, Section Editor)
  • Published:
Current Epidemiology Reports Aims and scope Submit manuscript

Abstract

Purpose of Review

We discuss the causes and impacts of dependent nondifferential misclassification with particular attention to the mechanisms by which dependent misclassification occurs. We also present suggestions for how to reduce the potential for dependent misclassification.

Recent Findings

Misclassification is ubiquitous in associations between exposures and outcomes in epidemiology. While most epidemiologic textbooks cover independent nondifferential misclassification of both exposures and outcomes, the impact of joint misclassification of exposure and outcome is a poorly understood problem.

Summary

Under common scenarios, joint misclassification of exposure and outcome can lead to strong bias (in any direction) even when the misclassification of both variables is nondifferential. The direction and magnitude of the bias will depend on the amount of dependent error and the mechanism by which the dependencies occur, as well as the direction and magnitude of the true effect along with the extent to which additional independent nondifferential misclassification of exposures or outcomes also exists.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

Papers of particular interest have been highlighted as: • Of importance •• Of major importance

  1. Rothman KJ, Poole C. A strengthening programme for weak associations. Int J Epidemiol. 1988;17:955–9.

    Article  PubMed  CAS  Google Scholar 

  2. Jurek AM, Maldonado G, Greenland S, Church TR. Exposure-measurement error is frequently ignored when interpreting epidemiologic study results. Eur J Epidemiol. 2006;21:871–6.

    Article  PubMed  Google Scholar 

  3. Dosemeci M, Wacholder S, Lubin J. Does nondifferential misclassification of exposure always bias a true effect towards the null value? Am J Epidemiol. 1990;132:746–8.

    Article  PubMed  CAS  Google Scholar 

  4. Wacholder S, Dosemeci M, Lubin JH. Blind assignment of exposure does not always prevent differential misclassification. Am J Epidemiol. 1991;134:433–7.

    Article  PubMed  CAS  Google Scholar 

  5. Flegal KM, Keyl PM, Nieto FJ. Differential misclassification arising from nondifferential errors in exposure measurement. Am J Epidemiol. 1991;134:1233–44.

    Article  PubMed  CAS  Google Scholar 

  6. Jurek AM, Greenland S, Maldonado G. How far from non-differential does exposure or disease misclassification have to be to bias measures of association away from the null? Int J Epidemiol. 2008;37:382–5.

    Article  PubMed  Google Scholar 

  7. •• Kristensen P. Bias from nondifferential but dependent misclassification of exposure and outcome. Epidemiology. 1992;3:210–5. This was one of the earliest papers in the epidemiologic literature to draw attention to the problem of dependent misclassificaiton errors. In particular, it showed that under certain mechanisms of dependent error, a truly null finding can appear strongly biased away from the null even if the misclassification is non-differential.

    Article  PubMed  CAS  Google Scholar 

  8. Chavance M, Dellatolas G, Kristensen P. Bias from dependent misclassification. Epidemiology. 1993;4:180–2.

    Article  PubMed  CAS  Google Scholar 

  9. Chavance M, Dellatolas G, Lellouch J. Correlated nondifferential misclassifications of disease and exposure: application to a cross-sectional study of the relation between handedness and immune disorders. Int J Epidemiol. 1992;21:537–46.

    Article  PubMed  CAS  Google Scholar 

  10. Brenner H, Savitz DA, Gefeller O. The effects of joint misclassification of exposure and disease on epidemiologic measures of association exposure and disease on epidemiologic measures of association. J Clin Epidemiol. 1993;46:1195–202.

    Article  PubMed  CAS  Google Scholar 

  11. Höfler M, Lieb R, Wittchen H. Estimating causal effects from observational data with a model for multiple bias. Int J Methods Psychiatr Res. 2007;16:77–87.

    Article  PubMed  Google Scholar 

  12. Brenner H. Inferences on the potential effects of presumed nondifferential exposure misclassification. Ann Epidemiol. 1993;3:289–94.

    Article  PubMed  CAS  Google Scholar 

  13. Vogel C, Brenner H, Pfahlberg A, Gefeller O. The effects of joint misclassification of exposure and disease on the attributable risk. Stat Med. 2005;24:1881–96.

    Article  PubMed  CAS  Google Scholar 

  14. Greenland S, Kleinbaum DG. Correcting for misclassification in two-way tables and matched-pair studies. Int J Epidemiol. 1983;12:93–7.

    Article  PubMed  CAS  Google Scholar 

  15. VanderWeele TJ, Hernán MA. Results on differential and dependent measurement error of the exposure and the outcome using signed directed acyclic graphs. Am J Epidemiol. 2012;175:1303–10.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Assakul K, Proctor CH. Testing independence in two-way contingency tables with data subject to misclassification. Psychometrika. 1967;32:67–76.

    Article  PubMed  CAS  Google Scholar 

  17. Greenland S. Basic methods for sensitivity analysis of biases. Int J Epidemiol. 1996;25:1107–16.

    Article  PubMed  CAS  Google Scholar 

  18. Ioannidis J. Why most discovered true associations are inflated. Epidemiology. 2008;19:640–8.

    Article  PubMed  Google Scholar 

  19. Lash TL, Fox M, Fink AK. Applying quantitative bias analysis to epidemiologic data. New York: Springer; 2009.

    Book  Google Scholar 

  20. Maclure M, Schneeweiss S. Causation of bias: the episcope. Epidemiology. 2001;12:114–22.

    Article  PubMed  CAS  Google Scholar 

  21. Kleinbaum D, Kupper L, Morgenstern H. Epidemiologic research: principles and quantitative methods. New York: John Wiley & Sons; 1982.

    Google Scholar 

  22. • Podsakoff PM, MacKenzie SB, Lee J-Y, Podsakoff NP. Common method biases in behavioral research: a critical review of the literature and recommended remedies. J Appl Psychol. 2003;88:879–903. This paper describes in detail the mechanisms by which dependent misclassification errors can occur. It specifically details the mechanisms and shows how each can lead to strongly biased estimates of the relationship between an exposure and an outcome.

    Article  PubMed  Google Scholar 

  23. Crampton S, Wagner J. Percept-percept inflation in microorganizational research: an investigation of prevalence and effect. J Appl Psychol. 1994;79:67–76.

    Article  Google Scholar 

  24. Williams L, Cote J, Buckley M. Lack of method variance in self-reported affect and perceptions at work: reality or artifact? J Appl Psychol. 1989;74:462–8.

    Article  Google Scholar 

  25. Conway JM, Lance CE. What reviewers should expect from authors regarding common method bias in organizational research. J Bus Psychol. 2010;25:325–34.

    Article  Google Scholar 

  26. Leys A, Kihlberg JK. Effect of misclassification on estimated relative prevalence of a characteristic part I. Two populations infallibility distinguished. Part II. Error in two variables. Am J Public Health Nations Health. 1963;53:1656–65.

    Article  Google Scholar 

  27. Lash TL, Fink AK. Re: ‘Neighborhood environment and loss of physical function in older adults: evidence from the Alameda County study’. Am J Epidemiol. 2003;157:472–3.

    Article  PubMed  Google Scholar 

  28. Drews CD, Greeland S. The impact of differential recall on the results of case-control studies. Int J Epidemiol. 1990;19:1107–12.

    Article  PubMed  CAS  Google Scholar 

  29. Greenland S, Robins J. Confounding and misclassification. Am J Epidemiol. 1985;122:495–506.

    Article  PubMed  CAS  Google Scholar 

  30. Rothman K, Greenland S, Lash T. Modern epidemiology. 3rd ed. Philadelphia: Lippincott Williams and Wilkins; 2008.

    Google Scholar 

  31. Johnson CY, Flanders WD, Strickland MJ, Honein MA, Howards PP. Potential sensitivity of bias analysis results to incorrect assumptions of nondifferential or differential binary exposure misclassification. Epidemiology. 2014;25:902–9.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Pollack AZ, Perkins NJ, Mumford SL, Ye A, Schisterman EF. Correlated biomarker measurement error: an important threat to inference in environmental epidemiology. Am J Epidemiol. 2013;177:84–92.

    Article  PubMed  CAS  Google Scholar 

  33. Murad H, Freedman LS. Estimating and testing interactions in linear regression models when explanatory variables are subject to classical measurement error. Stat Med. 2007;26:4293–310.

    Article  PubMed  Google Scholar 

  34. Wong MY, Day NE, Luan JA, Wareham NJ. Estimation of magnitude in gene–environment interactions in the presence of measurement error. Stat Med. 2004;23:987–98.

    Article  PubMed  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Matthew P. Fox.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Human and Animal Rights and Informed Consent

This article does not contain any studies with human or animal subjects performed by any of the authors.

Additional information

This article is part of the Topical Collection on Epidemiologic Methods

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Brooks, D.R., Getz, K.D., Brennan, A.T. et al. The Impact of Joint Misclassification of Exposures and Outcomes on the Results of Epidemiologic Research. Curr Epidemiol Rep 5, 166–174 (2018). https://doi.org/10.1007/s40471-018-0147-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40471-018-0147-y

Keywords

Navigation