Skip to main content
Log in

A Bayesian Interpretation of First-Order Phase Transitions

  • Published:
Foundations of Physics Aims and scope Submit manuscript

Abstract

In this work we review the formalism used in describing the thermodynamics of first-order phase transitions from the point of view of maximum entropy inference. We present the concepts of transition temperature, latent heat and entropy difference between phases as emergent from the more fundamental concept of internal energy, after a statistical inference analysis. We explicitly demonstrate this point of view by making inferences on a simple game, resulting in the same formalism as in thermodynamical phase transitions. We show that analogous quantities will inevitably arise in any problem of inferring the result of a yes/no question, given two different states of knowledge and information in the form of expectation values. This exposition may help to clarify the role of these thermodynamical quantities in the context of different first-order phase transitions such as the case of magnetic Hamiltonians (e.g. the Potts model).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

References

  1. Jaynes, E.T.: Information theory and statistical mechanics. Phys. Rev. 106, 620 (1957)

    Article  ADS  MathSciNet  MATH  Google Scholar 

  2. Jaynes, E.T.: Probability Theory: The Logic of Science. Cambridge University Press, Cambridge (2003)

    Book  Google Scholar 

  3. Pressé, S., Ghosh, K., Lee, J., Dill, K.A.: Principles of maximum entropy and maximum caliber in statistical physics. Rev. Mod. Phys. 85, 1115 (2013)

    Article  ADS  Google Scholar 

  4. Uffink, J.: Can the maximum entropy principle be explained as a consistency requirement? Stud. Hist. Philos. Sci. Part B 26, 223–261 (1995)

    Article  MathSciNet  MATH  Google Scholar 

  5. Dias, P.M.C., Shimony, A.: A critique of Jaynes’ maximum entropy principle. Adv. Appl. Math. 2, 172–211 (1981)

    Article  MATH  Google Scholar 

  6. Shannon, C.E.: A mathematical theory of communication. Bell Syst. Tech. J. 27, 379–423 (1948)

    Article  MathSciNet  MATH  Google Scholar 

  7. Tsallis, C.: Possible generalization of Boltzmann-Gibbs statistics. J. Stat. Phys. 52, 479–487 (1988)

  8. Rényi, A.: In: Proceedings of Fourth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 547–561. University of California Press, Berkeley (1961)

  9. Shore, J.E., Johnson, R.W.: Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy. IEEE Trans. Inf. Theory 26, 26–37 (1980)

    Article  ADS  MathSciNet  MATH  Google Scholar 

  10. Skilling, J.: The axioms of maximum entropy. In: Erickson, G.J., Smith, C.R. (eds.) Maximum Entropy and Bayesian methods in Science and Engineering, pp. 173–187. Kluwer Academic Publishers, Dordrecht (1988)

    Chapter  Google Scholar 

  11. Caticha, A., Giffin, A.: Updating probabilities. AIP Conf. Proc. 872, 31 (2006)

    Article  ADS  Google Scholar 

  12. Pressé, S., Ghosh, K., Lee, J., Dill, K.A.: Nonadditive entropies yield probability distributions with biases not warranted by the data. Phys. Rev. Lett. 111, 180604 (2013)

    Article  ADS  Google Scholar 

  13. Callen, H.: Thermodynamics and an Introduction to Thermostatistics. Wiley, New York (1985)

    MATH  Google Scholar 

Download references

Acknowledgments

SD and JP gratefully acknowledge funding from FONDECYT grant 1140514. JP acknowledges partial support from FONDECYT 11130501. GG acknowledges partial support from FONDECYT 1120603. DG acknowledges funding from CONICYT PhD fellowship 21140914.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sergio Davis.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Davis, S., Peralta, J., Navarrete, Y. et al. A Bayesian Interpretation of First-Order Phase Transitions. Found Phys 46, 350–359 (2016). https://doi.org/10.1007/s10701-015-9967-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10701-015-9967-5

Keywords

Navigation