Abstract
We study the optimal learning capacity for neural networks withQ-state clock neurons, i.e. the states arecomplex numbers with magnitude 1 and azimuthal anglesn·2π/Q, withn=0, 1, ...,Q−1. Performing a phase space analysis, the learning capacity α c for given stability κ can be expressed by means of a double-integral with a simple geometrical interpretation, which for vanishing κ reduces to α c (Q) = 4Q/(3Q−4), forQ≧3. Then we define a training algorithm, which generalizes the well-known AdaTron algorithm fromQ=2 toQ≧3 and converges very fast to the network with optimal stability, if the numberp of random patterns to be learned is smaller than α c (Q). Finally, in the conclusions, we also give hints on applications for image recognition and in a „note added in proof” we generalize some results to Potts model networks.
Similar content being viewed by others
References
Yedidia, J.S.: J. Phys. A22, 2265 (1989)
Meunier, C., Hansel, D., Varga, A.: J. Stat. Phys.55, 589 (1989)
Rieger, H.: J. Phys. A23, L1273 (1990)
Mertens, S., Köhler, H.M., Bös, S.: J. Phys. A24, 4941 (1991)
Hopfield, J.J.: Proc. Natl. Acad. Sci. USA81, 3088 (1984)
Treves, A.: Phys. Rev. A42, 2418 (1990)
Shiino, M., Fukai, T.: J. Phys. A23, L1009 (1990)
Marcus, C.M., Waugh, F.R., Westervelt, R.M.: Phys. Rev. A41 (1990)
Bouten, M., Engel, A.: Preprint
Mertens, S.: J. Phys. A24, 337 (1991)
Kanter, I.: Phys. Rev. B37, 2739 (1988)
Bollé, Dupont, P., van Mourik, J.: J. Phys. A24, 1065 (1991)
Noest, A.J.: Phys. Rev. A38, 2196 (1988)
Cook, J.: J. Phys. A22, 2057 (1989)
Gerl, F.: Diploma thesis, Regensburg 1991 (unpublished)
Anlauf, J.K., Biehl, M.: Europhys. Lett.10, 687 (1989)
Gardner, E.: Europhys. Lett.4, 481 (1987)
One of the first steps in the derivation involves the transformation\(\int\limits_\kappa ^\infty {d\lambda } \int\limits_\kappa ^\infty {d\lambda \prime \ldots = \int\limits_{\sqrt 2 \kappa } {d\omega _1 } } \int\limits_{ - \omega _1 + \sqrt 2 \kappa }^{\omega - \sqrt 2 \kappa } {d\omega _2 \ldots } \) with\(\omega _{1, 2} = (\lambda \pm \lambda \prime )/\sqrt 2 \)
Bauer, K., Krey, U.: Z. Phys. B-Condensed Matter84, 131 (1991)
Nadal, J.P., Rau, A.: J. Phys. I (France)1, 1109 (1991)
Krauth, W., Mézard, M.: J. Phys. A20, L745 (1987)
Fletscher, R.: Practical methods of optimization. Vol. 2. New York: Wiley 1987
Biehl, M., Anlauf, J.K., Kinzel, W.: In: Neurodynamics 90. Proceedings of the IX. ASI summer Workshop on Mathematical Physics, Clausthal 1990. Berlin, Heidelberg, New York: Springer 1991
Pöppel, G., Krey, U.: Europhys. Lett.4, 131 (1991)
Schmitz, H.J.: (unpublished)
Schmitz, H.J., Pöppel, G., Wünsch, F., Krey, U.: J. Phys. (Paris)51, 167 (1990)
Abramowitz, M., Stegun, I.: Handbook of mathematical functions. New York: Dover 1965
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Gerl, F., Bauer, K. & Krey, U. Learning withQ-state clock neurons. Z. Physik B - Condensed Matter 88, 339–347 (1992). https://doi.org/10.1007/BF01470923
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF01470923