Skip to main content
SpringerLink
Log in

A Hamiltonian Monte Carlo EM algorithm for generalized linear mixed models with spatial skew latent variables

  • Regular Article
  • Published:
Statistical Papers Aims and scope Submit manuscript

Abstract

Spatial generalized linear mixed models with skew latent variables are usually used to model discrete spatial responses that have some skewness. Since the likelihood function in these models is complex, the Monte Carlo EM algorithms are commonly applied to estimate the model parameters. In this paper, we use an approximately stationary skew Gaussian random field, which is more flexible than the Gaussian one, to analyze the skew discrete spatial responses. We also present a new hybrid EM algorithm using the Hamiltonian Monte Carlo method, which is both faster and more accurate than the Monte Carlo EM algorithm. The performance of the proposed skew model with a hybrid algorithm is evaluated through a simulation study and an application to the earthquake data of Iran. The simulation results indicate that the proposed Hamiltonian algorithm with the skew random field has better performance than the existing models. In addition, spatial prediction is presented through the proposed approach for the earthquake data on the entire map of Iran, where high-risk areas with the probability of large earthquakes are identified.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Alodat MT, Shakhatreh MK (2020) Gaussian process regression with skewed errors. J Comput Appl Math 370:112665

    Article  MathSciNet  Google Scholar 

  • Azzalini A (1985) A class of distributions which includes the normal ones. Scand J Stat 12(2):171–178

    MathSciNet  Google Scholar 

  • Azzalini A, Capitanio A (1999) Statistical applications of the multivariate skew normal distribution. J R Stat Soc Ser B (Stat Methodol) 61(3):579–602

    Article  MathSciNet  Google Scholar 

  • Azzalini A, Dalla-Valle A (1996) The multivariate skew-normal distribution. Biometrika 83:715–726

    Article  MathSciNet  Google Scholar 

  • Betancourt M (2018) A conceptual introduction to Hamiltonian Monte Carlo. arXiv preprint. arXiv:1701.02434

  • Betancourt M, Byrne S, Girolami MA (2014) Optimizing the integrator step size for Hamiltonian Monte Carlo. https://arxiv.org/pdf/1411.6669.pdf

  • Breslow NE, Clayton DG (1993) Approximate inference in generalized linear mixed models. J Am Stat Assoc 88:9–25

    Google Scholar 

  • Diggle P, Tawn JA, Moyeed RA (1998) Model-based geostatistic. J R Stat Soc Ser C Appl Stat 47:299–350

    Article  MathSciNet  Google Scholar 

  • Dominguez-Molina J, Gonzalez-Farias G, Gupta A (2003) The multivariate closed skew normal distribution. Technical Report 03-12, Department of Mathematics and Statistics, Bowling Green State University

  • Duane S, Kennedy AD, Pendleton BJ, Roweth D (1987) Hybrid Monte Carlo. Phys Lett B 195(2):216–222

    Article  ADS  MathSciNet  CAS  Google Scholar 

  • Eidsvik J, Martino S, Rue H (2009) Approximate Bayesian inference in spatial generalized linear mixed models. Scand J Stat 36:1–22

    Article  MathSciNet  Google Scholar 

  • Evangelou E, Zhu Z, Smith RL (2011) Estimation and prediction for spatial generalized linear mixed models using high order Laplace approximation. J Stat Plan Inference 141(11):3564–3577

    Article  MathSciNet  Google Scholar 

  • Gonzalez-Farias G, Dominguez-Molina A, Gupta AK (2004a) The closed skew normal distribution. In: Genton MG (ed) Skew-elliptical distributions and their applications: a journey beyond normality. Chapman and Hall CRC, Boca Raton, p 2542

  • Gonzalez-Farias G, Dominguez-Molina A, Gupta AK (2004b) Additive properties of skew normal random vectors. J Stat Plan Inference 126(2):521–534

  • Gupta AK, Gonzales-Farias G, Dominguez-Molina JA (2003) A multivariate skew normal distribution. J Multivar Anal 89:181–190

    Article  MathSciNet  Google Scholar 

  • Hoffman MD, Gelman A (2014) The No-U-Turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo. J Mach Learn Res 15(1):1593–1623

    MathSciNet  Google Scholar 

  • Hosseini F (2016) A new algorithm for estimating the parameters of the spatial generalized linear mixed models. Environ Ecol Stat 23:205–217

    Article  MathSciNet  Google Scholar 

  • Hosseini F, Karimi O (2019) Approximate composite marginal likelihood inference in spatial generalized linear mixed models. J Appl Stat 46(3):542–558

    Article  MathSciNet  Google Scholar 

  • Hosseini F, Karimi O (2020) Approximate likelihood inference in spatial generalized linear mixed models with closed skew normal latent variables. Commun Stat Simul Comput 49:121–134

    Article  MathSciNet  Google Scholar 

  • Hosseini F, Karimi O (2021) Approximate pairwise likelihood inference in SGLM models with skew normal latent variables. J Comput Appl Math 398:113692

    Article  MathSciNet  Google Scholar 

  • Hosseini F, Mohammadzadeh M (2012) Bayesian prediction for spatial GLMM’s with closed skew normal latent variables. Aust N Z J Stat 54:43–62

    Article  MathSciNet  Google Scholar 

  • Hosseini F, Eidsvik J, Mohammadzadeh M (2011) Approximate Bayesian inference in spatial GLMM with skew normal latent variables. Comput Stat Data Anal 55:1791–1806

    Article  MathSciNet  Google Scholar 

  • Jiang X, Fu Y, Jiang J, Li J (2019) Spatial distribution of the earthquake in Mainland China. Physica A 520:120941

    Article  MathSciNet  Google Scholar 

  • Kim HM, Mallick BK (2004) A Bayesian prediction using the skew Gaussian distribution. J Stat Plan Inference 120:85–101

    Article  MathSciNet  Google Scholar 

  • Karimi O, Mohammadzadeh M (2011) Bayesian spatial prediction for discrete closed skew Gaussian random field. Math Geosci 43:565–582

    Article  Google Scholar 

  • Karimi O, Mohammadzadeh M (2012) Bayesian spatial regression models with closed skew normal correlated errors and missing. Stat Pap 53(1):205–218

    Article  MathSciNet  Google Scholar 

  • Karimi O, Omre H, Mohammadzadeh M (2010) Bayesian closed-skew Gaussian inversion of seismic AVO data for elastic material properties. Geophysics 75:R1–R11

    Article  ADS  Google Scholar 

  • McCullagh P, Nelder JA (1989) Generalized linear models. Chapman and Hall, London

    Book  Google Scholar 

  • Nadarajah S, Li R (2017) The exact density of the sum of independent skew normal random variables. J Comput Appl Math 311:1–10

    Article  MathSciNet  Google Scholar 

  • Neal RM (1992) Bayesian training of backpropagation networks by the hybrid Monte Carlo method. University of Toronto Technical Report CRG-TR-92-1

  • Neal Radford M et al (2011) MCMC using Hamiltonian dynamics. Handb Markov Chain Monte Carlo 2:113–162

    Article  MathSciNet  Google Scholar 

  • Rimstad K, Omre H (2014) Skew-Gaussian random fields. Spat Stat 10:43–62

    Article  MathSciNet  Google Scholar 

  • Schiappapietra E, Douglas J (2020) Modelling the spatial correlation of earthquake ground motion: insights from the literature, data from the 2016–2017 Central Italy earthquake sequence and ground-motion simulations. Earth Sci Rev. https://doi.org/10.1016/j.earscirev.2020.103139

    Article  Google Scholar 

  • Smith LM, Stroup WW, Marx DB (2020) Poisson cokriging as a generalized linear mixed model. Spat Stat 35:100399

    Article  MathSciNet  PubMed  Google Scholar 

  • Torabi M (2013) Likelihood inference in generalized linear mixed measurement error models. Comput Stat Data Anal 57:549–557

    Article  MathSciNet  Google Scholar 

  • Torabi M (2014) Spatial generalized linear mixed models with multivariate CAR models for areal data. Spat Stat 10:12–26

    Article  MathSciNet  Google Scholar 

  • Torabi M (2015) Likelihood inference for spatial generalized linear mixed models. Commun Stat Simul Comput 44:1692–1701

    Article  MathSciNet  Google Scholar 

  • Varin C, Høst G, Skare Ø (2005) Pairwise likelihood inference in spatial generalized linear mixed models. Comput Stat Data Anal 49:1173–1191

    Article  MathSciNet  Google Scholar 

  • Vicente GC, Víctor HL, Edwin MO (2010) A nonlinear regression model with skew-normal errors. Stat Pap 51:547–558

    Article  MathSciNet  Google Scholar 

  • Walder A, Hanks EM (2020) Bayesian analysis of spatial generalized linear mixed models with Laplace moving average random fields. Comput Stat Data Anal 144:106861

    Article  MathSciNet  Google Scholar 

  • Wang J, Zuo R (2021) Spatial modelling of hydrothermal mineralization-related geochemical patterns using INLA+SPDE and local singularity analysis. Comput Geosci 154:104822

    Article  CAS  Google Scholar 

  • Yousefzadeh M, Hosseini SA, Farnaghi M (2021) Spatiotemporally explicit earthquake prediction using deep neural network. Soil Dyn Earthq Eng 144:10663

    Article  Google Scholar 

  • Zhang H (2002) On estimation and prediction for spatial generalized linear mixed models. Biometrics 58:129–136

    Article  MathSciNet  PubMed  Google Scholar 

  • Zhang C, Shahbaba B, Zhao H (2017) Hamiltonian Monte Carlo acceleration using surrogate functions with random bases. Stat Comput 27:1473–1490

    Article  MathSciNet  PubMed  Google Scholar 

  • Zhang C, Shahbaba B, Zhao H (2018) Variational Hamiltonian Monte Carlo via score matching. Bayesian Anal 13(2):485–506

    Article  MathSciNet  PubMed  Google Scholar 

  • Zhu H, Gu M, Peterson B (2007) Maximum likelihood from spatial random effects models via the stochastic approximation Expectation Maximization algorithm. Stat Comput 17:163–177

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Statistics, Faculty of Mathematics, Statistics and Computer Science, Semnan University, Semnan, Iran

    Omid Karimi

Authors
  1. Omid Karimi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Omid Karimi.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Karimi, O. A Hamiltonian Monte Carlo EM algorithm for generalized linear mixed models with spatial skew latent variables. Stat Papers 65, 1065–1084 (2024). https://doi.org/10.1007/s00362-023-01419-y

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00362-023-01419-y

Keywords

Search

Navigation