Skip to main content

Modelling Data That Exhibit an Excess Number of Zeros: Zero-Inflated Models and Generic Mixture Models

  • Chapter
  • First Online:
  • 4227 Accesses

Abstract

In biomedical research, data generated as a consequence of the count process can often possess an ‘excess’ of zeros (e.g. geographical incidence rates, hospital death rates). Whilst there are strategies for analysing such data, some can be biased where the underlying data generation process is not carefully considered. This can be exacerbated where the data are also multilevel, since hierarchical extensions to zero-inflated model strategies do not always satisfy underlying model assumptions. We therefore review zero-inflated modelling strategies for single-level data and show why standard Poisson and binomial zero-inflated models (i.e. where one latent class has a central location of zero) require class membership to be predicted by covariates in the standard regression part of the model. We also introduce generic mixture models and reveal limitations in their interpretation in a number of circumstances. With nested or hierarchical count data with an excess of zeros, upper-level distributional assumptions may not be upheld for standard multilevel models, thereby requiring alternative strategies; in Chap. 7 we introduce and illustrate the semi-parametric multilevel model as a solution to this problem.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Blance, A., Tu, Y. K., Baelum, V., & Gilthorpe, M. S. (2007). Statistical issues on the analysis of change in follow-up studies in dental research. Community Dentistry and Oral Epidemiology, 35(6), 412–420. available from: PM:18039282.

    Article  PubMed  Google Scholar 

  • Bland, J. M., & Altman, D. G. (1999). Measuring agreement in method comparison studies. Statistical Methods in Medical Research, 8(2), 135–160. available from: PM:10501650.

    Article  PubMed  CAS  Google Scholar 

  • Böhning, D. (1998). Zero-inflated Poisson models and C.A.MAN: A tutorial collection of evidence. Biometrical Journal, 40(7), 833–843.

    Article  Google Scholar 

  • Böhning, D., Dietz, E., & Schlattmann, P. (1999). The zero-inflated Poisson model and the decayed, missing and filled teeth index in dental epidemiology. Journal of the Royal Statistical Society, Series A, 162, 195–209.

    Google Scholar 

  • Carlos, J. P., & Gittelsohn, A. M. (1965). Longitudinal studies of the natural history of caries. II. A life-table study of caries incidence in the permanent teeth. Archives of Oral Biology, 10(5), 739–751. available from: PM:5226906.

    Article  PubMed  CAS  Google Scholar 

  • Groeneveld, A. (1985). Longitudinal study of prevalence of enamel lesions in a fluoridated and non-fluoridated area. Community Dentistry and Oral Epidemiology, 13(3), 159–163. available from: PM:3860338.

    Article  PubMed  CAS  Google Scholar 

  • Hall, D. B. (2000). Zero-inflated Poisson and binomial regression with random effects: A case study. Biometrics, 56(4), 1030–1039. available from: http://www.blackwell-synergy.com/loi/biom.

    Article  PubMed  CAS  Google Scholar 

  • Holst, D. (2006). The relationship between prevalence and incidence of dental caries. Some observational consequences. Community Dental Health, 23(4), 203–208. available from: PM:17194066.

    PubMed  Google Scholar 

  • Kinlen, L. J., Clarke, K., & Hudson, C. (1990). Evidence from population mixing in British New Towns 1946–85 of an infective basis for childhood leukaemia. Lancet, 336(8715), 577–582. available from: PM:1975376.

    Article  PubMed  CAS  Google Scholar 

  • Lambert, D. (1992). Zero-inflated Poisson regression, with an application to defects in manufacturing. Technometrics, 34(1), 1–14. available from: ISI:A1992GZ77700001.

    Article  Google Scholar 

  • Leroy, R., Bogaerts, K., Lesaffre, E., & Declerck, D. (2005). Multivariate survival analysis for the identification of factors associated with cavity formation in permanent first molars. European Journal of Oral Sciences, 113(2), 145–152. available from: PM:15819821.

    Article  PubMed  Google Scholar 

  • Liang, K. Y., & Zeger, S. L. (1986). Longitudinal data analysis using generalized linear models. Biometrika, 73, 13–22.

    Article  Google Scholar 

  • Lord, F. M. (1967). A paradox in the interpretation of group comparisons. Psychological Bulletin, 68, 304–305.

    Article  PubMed  CAS  Google Scholar 

  • Lord, F. M. (1969). Statistical adjustments when comparing preexisting groups. Psychological Bulletin, 72, 337–338.

    Article  Google Scholar 

  • Macek, M. D., Beltran-Aguilar, E. D., Lockwood, S. A., & Malvitz, D. M. (2003). Updated comparison of the caries susceptibility of various morphological types of permanent teeth. Journal of Public Health Dentistry, 63(3), 174–182. available from: PM:12962471.

    Article  PubMed  Google Scholar 

  • Mullahy, J. (1986). Specification and testing of some modified count data models. Journal of Econometrics, 33(3), 341–365. available from: ISI:A1986F205600002.

    Article  Google Scholar 

  • Parner, E. T., Heidmann, J. M., Vaeth, M., & Poulsen, S. (2007). Surface-specific caries incidence in permanent molars in Danish children. European Journal of Oral Sciences, 115(6), 491–496. available from: PM:18028058.

    Article  PubMed  Google Scholar 

  • Poulsen, S., & Horowitz, H. S. (1974). An evaluation of a hierarchical method of describing the pattern of dental caries attack. Community Dentistry and Oral Epidemiology, 2(1), 7–11. available from: PM:4153274.

    Article  PubMed  CAS  Google Scholar 

  • Poulsen, S., Heidmann, J., & Vaeth, M. (2001). Lorenz curves and their use in describing the distribution of ‘the total burden’ of dental caries in a population. Community Dental Health, 18(2), 68–71. available from: PM:11461061.

    PubMed  CAS  Google Scholar 

  • Ridout, M., Demétrio, C. G. B., & Hinde, J. (1998) Models for count data with many zeros. Proceedings article for an International Biometric Conference (pp. 179–192). Cape Town. http://www.kent.ac.uk/IMS/personal/msr/webfiles/zip/ibc_fin.pdf.

  • Senn, S. (2006). Change from baseline and analysis of covariance revisited. Statistics in Medicine, 25(24), 4334–4344. available from: PM:16921578.

    Article  PubMed  Google Scholar 

  • Skrondal, A., & Rabe-Hesketh, S. (2004). Generalized latent variable modeling: Multilevel, longitudinal and structural equation models. London: Chapman & Hall.

    Book  Google Scholar 

  • Vermunt, J. K., & Magidson, J. (2005a). Latent GOLD 4.0 User’s Guide. Belmont Massachusetts: Statistical Innovations Inc.

    Google Scholar 

  • Vermunt, J. K., & Magidson, J. (2005b). Technical guide for Latent GOLD 4.0: Basic and advanced. Belmont Massachusetts: Statistical Innovations Inc. http://www.statisticalinnovations.com/products/LGtechnical.pdf.

    Google Scholar 

  • Vieira, A. M. C., Hinde, J. P., & Demetrio, C. G. B. (2000). Zero-inflated proportion data models applied to a biological control assay. Journal of Applied Statistics, 27(3), 373–389. available from: ISI:000086354400009.

    Article  Google Scholar 

  • Wong, M. C., Schwarz, E., & Lo, E. C. (1997). Patterns of dental caries severity in Chinese kindergarten children. Community Dentistry and Oral Epidemiology, 25(5), 343–347. available from: PM:9355769.

    Article  PubMed  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mark S. Gilthorpe .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Gilthorpe, M.S., Frydenberg, M., Cheng, Y., Baelum, V. (2012). Modelling Data That Exhibit an Excess Number of Zeros: Zero-Inflated Models and Generic Mixture Models. In: Tu, YK., Greenwood, D. (eds) Modern Methods for Epidemiology. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-3024-3_6

Download citation

Publish with us

Policies and ethics