pp 1–23 | Cite as

Influence diagnostics in mixed effects logistic regression models

  • Alejandra Tapia
  • Victor Leiva
  • Maria del Pilar Diaz
  • Viviana Giampaoli
Original Paper


Correlated binary responses are commonly described by mixed effects logistic regression models. This article derives a diagnostic methodology based on the Q-displacement function to investigate local influence of the responses in the maximum likelihood estimates of the parameters and in the predictive performance of the mixed effects logistic regression model. An appropriate perturbation strategy of the probability of success is established, as a form of assessing the perturbation in the response. The diagnostic methodology is evaluated with Monte Carlo simulations. Illustrations with two real-world data sets (balanced and unbalanced) are conducted to show the potential of the proposed methodology.


Approximation of integrals Correlated binary responses Metropolis–Hastings and Monte Carlo methods Probability of success R software 

Mathematics Subject Classification

62J20 62J12 



The authors thank the Editors and two referees for their constructive comments on an earlier version of this manuscript which resulted in this improved version. This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES) - Finance Code 001, by HPC resources provided by the Information Technology Superintendence of the University of São Paulo, and also by CNPq from Brazil; as well as by the Chilean Council for Scientific and Technology Research (CONICYT) through fellowship “Becas-Chile” (A. Tapia) and FONDECYT 1160868 Grant (V. Leiva) from the Chilean government.


  1. Agresti A (2003) Categorical data analysis, vol 482. Wiley, New YorkzbMATHGoogle Scholar
  2. Assumpção RAB, Uribe-Opazo MA, Galea M (2014) Analysis of local influence in geostatistics using student-\(t\) distribution. J Appl Stat 41:2323–2341MathSciNetCrossRefGoogle Scholar
  3. Breslow NE, Clayton DG (1993) Approximate inference in generalized linear mixed models. J Am Stat Assoc 88(421):9–25zbMATHGoogle Scholar
  4. Capanu M, Gönen M, Begg CB (2013) An assessment of estimation methods for generalized linear mixed models with binary outcomes. Stat Med 32:4550–4566MathSciNetCrossRefGoogle Scholar
  5. Caro-Lopera F, Leiva V, Balakrishnan N (2012) Connection between the Hadamard and matrix products with an application to matrix-variate Birnbaum–Saunders distributions. J Multivar Anal 104:126–139MathSciNetCrossRefGoogle Scholar
  6. Chen F, Zhu H-T, Song X-Y, Lee S-Y (2010) Perturbation selection and local influence analysis for generalized linear mixed models. J Comput Graph Stat 19:826–842MathSciNetCrossRefGoogle Scholar
  7. Cook RD (1986) Assessment of local influence. J R Stat Soc B 48:133–169MathSciNetzbMATHGoogle Scholar
  8. Cook RD, Weisberg S (1982) Residuals and influence in regression. Chapman and Hall, LondonzbMATHGoogle Scholar
  9. Crowder MJ (1978) Beta-binomial ANOVA for proportions. J R Stat Soc C 27:34–37Google Scholar
  10. De Bastiani F, Cysneiros AHMA, Uribe-Opazo MA, Galea M (2015) Influence diagnostics in elliptical spatial linear models. TEST 24:322–340MathSciNetCrossRefGoogle Scholar
  11. Demidenko E (2013) Mixed models: theory and applications with R. Wiley, HobokenzbMATHGoogle Scholar
  12. Dempster AP, Laird NM, Rubin DB (1977) Maximum likelihood from incomplete data via the EM algorithm. J R Stat Soc B 39:1–38MathSciNetzbMATHGoogle Scholar
  13. Díaz-García J, Galea M, Leiva V (2003) Influence diagnostics for elliptical multivariate linear regression models. Commun Stat Theory Methods 32:625–641MathSciNetCrossRefGoogle Scholar
  14. Diggle PJ, Liang K-Y, Zeger SL (1996) Analysis of longitudinal data. Oxford University Press, LondonzbMATHGoogle Scholar
  15. Garcia-Papani F, Leiva V, Uribe-Opazo MA, Aykroyd RG (2018) Birnbaum–Saunders spatial regression models: diagnostics and application to chemical data. Chemom Intell Lab Syst 177:114–128CrossRefGoogle Scholar
  16. Hosmer DW, Lemeshow S, Sturdivant RX (2013) Applied logistic regression. Wiley, HobokenCrossRefGoogle Scholar
  17. Hossain M, Islam MA (2003) Application of local influence diagnostics to the linear logistic regression models. Dhaka Univ J Sci 51:269–278Google Scholar
  18. Ibacache-Pulgar G, Paula GA, Cysneiros FJA (2013) Semiparametric additive models under symmetric distributions. TEST 22:103–121MathSciNetCrossRefGoogle Scholar
  19. Jiang J (2007) Linear and generalized linear mixed models and their applications. Springer, New YorkzbMATHGoogle Scholar
  20. Larsen K, Petersen JH, Budtz-Jørgensen E, Endahl L (2000) Interpreting parameters in the logistic regression model with random effects. Biometrics 56:909–914CrossRefGoogle Scholar
  21. Leão J, Leiva V, Saulo H, Tomazella V (2017) Birnbaum–Saunders frailty regression models: diagnostics and application to medical data. Biomet J 59:291–314MathSciNetCrossRefGoogle Scholar
  22. Leiva V, Santos-Neto M, Cysneiros FJA, Barros M (2014) Birnbaum–Saunders statistical modelling: a new approach. Stat Model 14:21–48MathSciNetCrossRefGoogle Scholar
  23. Lesaffre E, Spiessens B (2001) On the effect of the number of quadrature points in a logistic random-effects model: an example. J R Stat Soc C 50:325–335MathSciNetCrossRefGoogle Scholar
  24. Lesaffre E, Verbeke G (1998) Local influence in linear mixed models. Biometrics 54:570–582CrossRefGoogle Scholar
  25. Liu S (2000) On local influence in elliptical linear regression models. Stat Pap 41:211–224CrossRefGoogle Scholar
  26. Liu S (2004) On diagnostics in conditionally heteroskedastic time series models under elliptical distributions. J Appl Probab 41:393–406MathSciNetCrossRefGoogle Scholar
  27. Liu Y, Ji G, Liu S (2015) Influence diagnostics in a vector autoregressive model. J Stat Comput Simul 85:2632–2655MathSciNetCrossRefGoogle Scholar
  28. Marchant C, Leiva V, Cysneiros FJA, Vivanco JF (2016) Diagnostics in multivariate generalized Birnbaum–Saunders regression models. J Appl Stat 43:2829–2849MathSciNetCrossRefGoogle Scholar
  29. McCullagh P, Nelder JA (1983) Generalized linear models. Chapman and Hall, LondonCrossRefGoogle Scholar
  30. McCulloch CE (1997) Maximum likelihood algorithms for generalized linear mixed models. J Am Stat Assoc 92:162–170MathSciNetCrossRefGoogle Scholar
  31. McCulloch S, Searle S (2001) Generalized, linear and mixed models. Wiley, New YorkzbMATHGoogle Scholar
  32. Molenberghs G, Verbeke G (2005) Models for discrete longitudinal data. Springer, New YorkzbMATHGoogle Scholar
  33. Nyangoma SO, Fung WK, Jansen RC (2006) Identifying influential multinomial observations by perturbation. Comput Stat Data Anal 50:2799–2821MathSciNetCrossRefGoogle Scholar
  34. Ouwens MJNM, Tan FES, Berger MPF (2001) Local influence to detect influential data structures for generalized linear mixed models. Biometrics 57:1166–1172MathSciNetCrossRefGoogle Scholar
  35. Pinheiro JC, Chao EC (2006) Efficient Laplacian and adaptive Gaussian quadrature algorithms for multilevel generalized linear mixed models. J Comput Graph Stat 15:58–81MathSciNetCrossRefGoogle Scholar
  36. Poon WY, Poon YS (1999) Conformal normal curvature and assessment of local influence. J R Stat Soc B 61:51–61MathSciNetCrossRefGoogle Scholar
  37. R Core Team (2016) R: a language and environment for statistical computing. R Foundation for Statistical Computing, ViennaGoogle Scholar
  38. Rakhmawati TW, Molenberghs G, Verbeke G, Faes C (2017) Local influence diagnostics for generalized linear mixed models with overdispersion. J Appl Stat 44:620–641MathSciNetCrossRefGoogle Scholar
  39. Raudenbush SW, Yang M, Yosef M (2000) Maximum likelihood for generalized linear models with nested random effects via high-order, multivariate Laplace approximation. J Comput Graph Stat 9:141–157MathSciNetGoogle Scholar
  40. Robert CP, Casella G (1999) Monte Carlo statistical methods. Springer, New YorkCrossRefGoogle Scholar
  41. Rocha AV, Simas AB (2011) Influence diagnostic in a general class of beta regression models. TEST 20:95–119MathSciNetCrossRefGoogle Scholar
  42. Santos-Neto M, Cysneiros FJA, Leiva V, Barros M (2016) Reparameterized Birnbaum–Saunders regression models with varying precision. Electron J Stat 10:2825–2855MathSciNetCrossRefGoogle Scholar
  43. Stehlík M, Rodríguez-Díaz JM, Müller WG, López-Fidalgo J (2008) Optimal allocation of bioassays in the case of parametrized covariance functions: an application to lung’s retention of radioactive particles. TEST 17:56–68MathSciNetCrossRefGoogle Scholar
  44. Stiratelli R, Laird N, Ware JH (1984) Random effects models for serial observations with binary responses. Biometrics 40:961–971CrossRefGoogle Scholar
  45. Svetliza CF, Paula GA (2001) On diagnostics in log-linear negative binomial models. J Stat Comput Simul 71:231–244MathSciNetCrossRefGoogle Scholar
  46. Wolfinger R, O’Connell M (1993) Generalized linear mixed models: a pseudo-likelihood approach. J Stat Comput Simul 48(3–4):233–243CrossRefGoogle Scholar
  47. Xu L, Lee SY, Poon WY (2006) Deletion measures for generalized linear mixed effects models. Comput Stat Data Anal 51:1131–1146MathSciNetCrossRefGoogle Scholar
  48. Zhu H-T, Lee S-Y (2001) Local influence for incomplete-data models. J R Stat Soc B 63:111–126MathSciNetCrossRefGoogle Scholar
  49. Zhu H-T, Lee S-Y (2003) Local influence for generalized linear mixed models. Can J Stat 31:293–309MathSciNetCrossRefGoogle Scholar
  50. Zhu H, Ibrahim JG, Lee S, Zhang H (2007) Perturbation selection and influence measures in local influence analysis. Ann Stat 35:2565–2588MathSciNetCrossRefGoogle Scholar

Copyright information

© Sociedad de Estadística e Investigación Operativa 2018

Authors and Affiliations

  1. 1.Institute of Statistics, Faculty of Economic and Administration SciencesUniversidad Austral de ChileValdiviaChile
  2. 2.School of Industrial EngineeringPontificia Universidad Católica de ValparaísoValparaísoChile
  3. 3.School of Nutrition, Faculty of Medical Sciences and INICSA-CONICETUniversidad Nacional de CórdobaCórdobaArgentina
  4. 4.Institute of Mathematics and StatisticsUniversidade de São PauloSão PauloBrazil

Personalised recommendations