Skip to main content

Consistency of Maximum Likelihood and Pseudo-Likelihood Estimators for Gibbs Distributions

  • Conference paper
Stochastic Differential Systems, Stochastic Control Theory and Applications

Part of the book series: The IMA Volumes in Mathematics and Its Applications ((IMA,volume 10))

Abstract

We prove that the Maximum Likelihood and Pseudo-likelihood estimators for the parameters of Gibbs distributions (equivalently Markov Random Fields) over ℤd, d≥l, are consistent even at points of “first” or “higher-order” phase transitions. The distributions are parametrized by points in a finite-dimensional Euclidean space ℝm, m≥l, and the single spin state space is either a finite set or a compact metric space. Also, the underlying interactions need not be of finite range.

To appear in Proceedings of the Workshop on Stochastic Differential Systems with Applications in Electrical/Computer Engineering, Control Theory, and Operations Research. June 9–19, 1986, Institute for Mathematics and Its Applications, University of Minnesota.

Partially supported by ARO DAAG-29–83-K-0116, and NSF Grant DMS 85-16230.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Besag, J.: “On the Statistical Analysis of Dirty Pictures”, to appear in J. Roy. Stat. Society, series B, 1986.

    Google Scholar 

  2. Besag, J.: “Spatial Interaction and Statistical Analysis of Lattice Systems”, J. Roy. Stat. Society, series B, 36 (1974) 192–236.

    MathSciNet  MATH  Google Scholar 

  3. Besag, J.: “Statistical Analysis of Non-Lattice Data”, The Statistician 24 (1975) 179–195.

    Article  Google Scholar 

  4. Besag, J.: “Efficiency of Pseudo-likelihood Estimation for Simple Gaussian Fields”, Biometrika 64 (1977) 616–618.

    Article  MathSciNet  MATH  Google Scholar 

  5. Chellappa, R., and R.L. Kashyap: “Digital Image Restoration using Interaction Models”, IEEE Trans. Acoust., Speech, Signal Processing 30 (1982) 461–472.

    Article  Google Scholar 

  6. Cohen, F.S., and D.B. Cooper: “Simple Parallel Hierarchical and Relaxation Algorithms for Segmenting Noncausal Markovian Random Fields”, IEEE PAMI, to appear.

    Google Scholar 

  7. Cross, G.R., and A.K. Jain: “Markov Random Field Texture Models”, IEEE PAMI 5 (1983) 25–40.

    Article  Google Scholar 

  8. Elliott, H., and H. Darin: “Modeling and Segmentation of Noisy and Textured Images using Gibbs Random Fields”, IEEE PAMI, to appear.

    Google Scholar 

  9. Geman, S., and D. Geman: “Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images”, IEEE PAMI 6 (1984) 721–741.

    Article  MATH  Google Scholar 

  10. Geman, D., and S. Geman: “Bayesian Image Analysis”, in Disordered Systems and Biological Organization, Springer-Verlag (1986), eds: E. Bienenstock, et. al.

    Google Scholar 

  11. Geman, D., and S. Geman: “Parameter Estimation for Some Markov Random Fields”, Brown Univ. Tech. Rep. No. 11, August 1983.

    Google Scholar 

  12. Geman, D., S. Geman, and D.E. McClure: in preparation (invited paper, Annals of Statistics).

    Google Scholar 

  13. Geman, S., and C. Graffine: “Markov Random Field Image Models and their Applications to Computer Vision”, Proceedings of the 1986 International Congress of Mathematicians. Ed. A.M. Gleason, AMS, New York, 1987.

    Google Scholar 

  14. Geman, S., and D.E. McClure: “Bayesian Image Analysis: An Application to Single Photon Emission Tomography”, 1985 Proceedings of the American Statistical Association. Statistical Computing Section.

    Google Scholar 

  15. Gidas, B.: “A Renormalization Group Approach to Image Processing Problems” preprint 1986.

    Google Scholar 

  16. Gidas, B.: “Parameter Estimation for Gibbs Distributions”, preprint, November 1986.

    Google Scholar 

  17. Gidas, B.: “Asymptotic Normality and Efficiency of Pseudo-likelihood Estimators”, in preparation.

    Google Scholar 

  18. Graffine, C.: Thesis, Division of Applied Mathematics, Brown University, 1987.

    Google Scholar 

  19. Grenander, U.: Tutorial in Pattern Theory, Division of Applied Mathematics, Brown University, 1983.

    Google Scholar 

  20. Guyon, X.: “Estimation d’un champ par pseudo-rraisemblaine conditionelle: etude asymptotique et application au cas Markovien”, to appear in Actes de la 6eme Recontre Franco-Belge de Staticiens, Bruxelles, Nov. 1985.

    Google Scholar 

  21. Hinton, G.E., and T.J. Sejnowski: “Optimal Perceptual Inference”, in Proceedings IEEE Conference Computer Vision Pattern Recognition 1983.

    Google Scholar 

  22. Hopfield, J.: “Neural Networks and Physical Systems With Emergent Collective Computational Abilities”, in Proceedings of the National Academy of Sciences, U.S.A., Vol. 79 (1982), 2554–2558.

    Article  MathSciNet  Google Scholar 

  23. von der Malsburg, C., and E. Bienenstock: “Statistical Coding and Short Term Synaptic Plasticity: A Scheme for Knowledge Representation in the Brain”, in Disordered Systems and Biological Organization, Springer-Verlag 1986, eds.: E. Bienenstock, et.al.

    Google Scholar 

  24. Marroquin, J., S. Mitter, and T. Poggio: “Probabilistic Solution of Ill-posed Problems in Computational Vision”, Art. Intell. Lab., Tech. Report, M.I.T. 1985.

    Google Scholar 

  25. Passolo, A.: “Estimation of Binary Markov Random Fields”, preprint, Department of Statistics, University of Washington, Seattle (1986).

    Google Scholar 

  26. Pickard, D.K.: “Asymptotic Inference for Ising Lattice III. Non-zero Field and Ferromagnetic States”, J. Appl. Prob. 16 (1979) 12–24.

    Article  MathSciNet  MATH  Google Scholar 

  27. Ripley, B.D.: “Statistics, Images, and Pattern Recognition”, The Canadian Jour. of Stat. 14 (1986) 83–111.

    Article  MathSciNet  MATH  Google Scholar 

  28. Ruelle, D.: Thermodynamic Formalism, Addison-Wesley, 1978.

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1988 Springer-Verlag New York Inc.

About this paper

Cite this paper

Gidas, B. (1988). Consistency of Maximum Likelihood and Pseudo-Likelihood Estimators for Gibbs Distributions. In: Fleming, W., Lions, PL. (eds) Stochastic Differential Systems, Stochastic Control Theory and Applications. The IMA Volumes in Mathematics and Its Applications, vol 10. Springer, New York, NY. https://doi.org/10.1007/978-1-4613-8762-6_10

Download citation

  • DOI: https://doi.org/10.1007/978-1-4613-8762-6_10

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4613-8764-0

  • Online ISBN: 978-1-4613-8762-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics