Skip to main content
Log in

Dynamics and performance of susceptibility propagation on synthetic data

  • Published:
The European Physical Journal B Aims and scope Submit manuscript

Abstract.

We study the performance and convergence properties of the susceptibility propagation (SusP) algorithm for solving the Inverse Ising problem. We first study how the temperature parameter (T) in a Sherrington-Kirkpatrick model generating the data influences the performance and convergence of the algorithm. We find that at the high temperature regime (T > 4), the algorithm performs well and its quality is only limited by the quality of the supplied data. In the low temperature regime (T < 4), we find that the algorithm typically does not converge, yielding diverging values for the couplings. However, we show that by stopping the algorithm at the right time before divergence becomes serious, good reconstruction can be achieved down to T 2. We then show that dense connectivity, loopiness of the connectivity, and high absolute magnetization all have deteriorating effects on the performance of the algorithm. When absolute magnetization is high, we show that other methods can be work better than SusP. Finally, we show that for neural data with high absolute magnetization, SusP performs less well than TAP inversion.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. M. Mézard, A. Montanari, Information, Physics and Computation (Oxford University Press, 2009)

  2. S. Cocco, S. Leibler, R. Monasson, Proc. Natl. Acad. Sci. USA 106, 14058 (2009)

    Article  ADS  Google Scholar 

  3. Y. Roudi, J.A. Hertz, E. Aurell, Front. Comput. Neurosci. 3, 22 (2009)

    Article  Google Scholar 

  4. Y. Roudi, J. Tyrcha, J. Hertz, Phys. Rev. E 79, 051915 (2009)

    Article  ADS  Google Scholar 

  5. E. Schneidman, M. Berry, R. Segev, W. Bialek, Nature 440, 1007 (2006)

    Article  ADS  Google Scholar 

  6. T.R. Lezon, J.R. Banavar, M. Cieplak, A. Maritan, N. Fedoroff, Proc. Natl. Acad. Sci. 103, 19033 (2006)

    Article  ADS  Google Scholar 

  7. D.H. Ackley, G.E. Hinton, T.J. Sejnowski, Cog. Sci. 9, 147 (1985)

    Article  Google Scholar 

  8. H.J. Kappen, F.B. Rodriguez, Neur. Comp. 10, 1137 (1998)

    Article  Google Scholar 

  9. T. Tanaka, Phys. Rev. E 58, 2302 (1998)

    Article  ADS  Google Scholar 

  10. V. Sessak, R. Monasson, J. Phys. A: Math. Theor. 42, 1 (2009)

    Article  MathSciNet  Google Scholar 

  11. P. Ravikumar, M. Wainwright, J.D. Lafferty, Ann. Stat. 38, 1287 (2010)

    Article  MATH  MathSciNet  Google Scholar 

  12. M. Mézard, T. Mora, J. Physiol. Paris 103, 107 (2009)

    Article  Google Scholar 

  13. J.S. Yedidia, W.T. Freeman, Y. Weiss, Understanding Belief Propagation and its Generalizations (Science & Technology Books, 2003), pp. 239–269

  14. E. Marinari, V.V. Kerrebroeck, J. Stat. Mech. P02008 (2010)

  15. C. Ollion, Susceptibility Propagation for the inverse Ising Problem (2010)

  16. D. Sherrington, S. Kirkpatrick, Phys. Rev. Lett. 35, 1792 (1975)

    Article  ADS  Google Scholar 

  17. J. Shlens, G. Field, J. Gauthier, M. Grivich, D. Petrusca, A. Sher, A. Litke, E. Chichilnisky, J. Neurosci. 26, 8254 (2006)

    Article  Google Scholar 

  18. Y. Roudi, S. Nirenberg, P.E. Latham, PLoS Comp. Biol. 5, e1000380 (2009)

  19. J.M. Mooij, H.J. Kappen, J. Mach. Learn. Res. 8, 1113 (2007)

    MathSciNet  Google Scholar 

  20. M. Weigt, R.A. White, H. Szurmant, J.A. Hoch, T. Hwa, PNAS 106, 67 (2009)

    Article  ADS  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Y. Roudi.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Aurell, E., Ollion, C. & Roudi, Y. Dynamics and performance of susceptibility propagation on synthetic data. Eur. Phys. J. B 77, 587–595 (2010). https://doi.org/10.1140/epjb/e2010-00277-0

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1140/epjb/e2010-00277-0

Keywords

Navigation