Abstract.
We study the performance and convergence properties of the susceptibility propagation (SusP) algorithm for solving the Inverse Ising problem. We first study how the temperature parameter (T) in a Sherrington-Kirkpatrick model generating the data influences the performance and convergence of the algorithm. We find that at the high temperature regime (T > 4), the algorithm performs well and its quality is only limited by the quality of the supplied data. In the low temperature regime (T < 4), we find that the algorithm typically does not converge, yielding diverging values for the couplings. However, we show that by stopping the algorithm at the right time before divergence becomes serious, good reconstruction can be achieved down to T ≈ 2. We then show that dense connectivity, loopiness of the connectivity, and high absolute magnetization all have deteriorating effects on the performance of the algorithm. When absolute magnetization is high, we show that other methods can be work better than SusP. Finally, we show that for neural data with high absolute magnetization, SusP performs less well than TAP inversion.
Similar content being viewed by others
References
M. Mézard, A. Montanari, Information, Physics and Computation (Oxford University Press, 2009)
S. Cocco, S. Leibler, R. Monasson, Proc. Natl. Acad. Sci. USA 106, 14058 (2009)
Y. Roudi, J.A. Hertz, E. Aurell, Front. Comput. Neurosci. 3, 22 (2009)
Y. Roudi, J. Tyrcha, J. Hertz, Phys. Rev. E 79, 051915 (2009)
E. Schneidman, M. Berry, R. Segev, W. Bialek, Nature 440, 1007 (2006)
T.R. Lezon, J.R. Banavar, M. Cieplak, A. Maritan, N. Fedoroff, Proc. Natl. Acad. Sci. 103, 19033 (2006)
D.H. Ackley, G.E. Hinton, T.J. Sejnowski, Cog. Sci. 9, 147 (1985)
H.J. Kappen, F.B. Rodriguez, Neur. Comp. 10, 1137 (1998)
T. Tanaka, Phys. Rev. E 58, 2302 (1998)
V. Sessak, R. Monasson, J. Phys. A: Math. Theor. 42, 1 (2009)
P. Ravikumar, M. Wainwright, J.D. Lafferty, Ann. Stat. 38, 1287 (2010)
M. Mézard, T. Mora, J. Physiol. Paris 103, 107 (2009)
J.S. Yedidia, W.T. Freeman, Y. Weiss, Understanding Belief Propagation and its Generalizations (Science & Technology Books, 2003), pp. 239–269
E. Marinari, V.V. Kerrebroeck, J. Stat. Mech. P02008 (2010)
C. Ollion, Susceptibility Propagation for the inverse Ising Problem (2010)
D. Sherrington, S. Kirkpatrick, Phys. Rev. Lett. 35, 1792 (1975)
J. Shlens, G. Field, J. Gauthier, M. Grivich, D. Petrusca, A. Sher, A. Litke, E. Chichilnisky, J. Neurosci. 26, 8254 (2006)
Y. Roudi, S. Nirenberg, P.E. Latham, PLoS Comp. Biol. 5, e1000380 (2009)
J.M. Mooij, H.J. Kappen, J. Mach. Learn. Res. 8, 1113 (2007)
M. Weigt, R.A. White, H. Szurmant, J.A. Hoch, T. Hwa, PNAS 106, 67 (2009)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Aurell, E., Ollion, C. & Roudi, Y. Dynamics and performance of susceptibility propagation on synthetic data. Eur. Phys. J. B 77, 587–595 (2010). https://doi.org/10.1140/epjb/e2010-00277-0
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1140/epjb/e2010-00277-0