Automatic generation of C++ code for neural network simulation
Coding neural network simulators by hand is often a tedious and error-prone task. In this paper, we seek to remedy this situation by presenting a code generator that produces efficient C++ simulation code for a wide variety of backpropagation networks. We define a high-level, Maple-like language that allows the specification of such networks. This language is compiled to C++ code segments that in turn are executable in link with an already given generic code for backpropagation networks. Our generator allows the specification of arbitrary network topologies (with the restriction of full connections between layers) and weightchange formulae, while the activation rule and error propagation rule remain fixed. With this tool, future research on learning rules for backpropagation networks can be made more efficient by eliminating routine work and producing code that is guaranteed to be error-free.
Unable to display preview. Download preview PDF.
- [APR90]J. A. Anderson, A. Pellionisz and E. Rosenfeld (eds.) Neurocomputing 2: Directions for Research, The MIT Press, Cambridge, 1990.Google Scholar
- [AR88]J. A. Anderson and E. Rosenfeld (eds.) Neurocomputing: Foundations of Research, The MIT Press, Cambridge, 1988.Google Scholar
- [Bie85]A. W. Biermann. Automatic Programming: A Tutorial on Formal Methodologies, J. Symbolic Computation, 1 (1985), 119–142.Google Scholar
- [CGG+88]B. W. Char, K. O. Geddes, G. H. Gonnet, B. L. Leong, M. B. Monagan and S. P. Watt. Maple: Reference Manual, 5th Ed., WATCOM Publications Limited, Waterloo, 1988.Google Scholar
- [Dre92]S. Dreiseitl. Accelerating the Backpropagation Algorithm by Local Methods, diploma thesis preprint, RISC-Linz, Johannes Kepler University, Austria, 1992.Google Scholar
- [Gat90]K. Gatermann. Symbolic Solution of Polynomial Equation Systems with Symmetry, Proc. ISSAC'90 (Tokyo, August 20–24, 1990), 112–119.Google Scholar
- [LW91]R. Leighton and A. Wieland. The Aspirin/MIGRAINES Software Tools: User's Manual, Release V4.0, The MITRE Corporation, McLean, USA, 1991.Google Scholar
- [RS90]U. Ramacher and B. Schürmann. Unified Description of Neural Algorithms for Time Independent Pattern Recognition, VLSI Design of Neural Networks (U. Ramacher and U. Rückert, eds.), Kluwer Academic Publishers, 1990, 255–270.Google Scholar
- [RHW86]D. E. Rumelhart, G. E. Hinton, and R. J. Williams. Learning internal representations by error propagation. In Parallel Distributed Processing, volume 1, chapter 8. MIT Press, Cambridge, 1986.Google Scholar
- [Wan91]D. M. Wang. A Toolkit for Manipulating Indefinite Summations with Application to Neural Networks, Proc. ISSAC'91 (Bonn, July 15–17, 1991), 462–463; ACM SIGSAM Bulletin, 25(3)(1991), 18–27.Google Scholar
- [WS91a]D. M. Wang and B. Schürmann. Computer Aided Investigations of Artificial Neural Systems, Proc. IJCNN'91 (Singapore, November 18–21, 1991), 2325–2330.Google Scholar
- [WS91b]D. M. Wang and B. Schürmann. Computer Aided Analysis and Derivation for Artificial Neural Systems, IEEE Trans. Software Eng. to appear.Google Scholar
- [WS91c]D. M. Wang and B. Schürmann. Computer Algebra and Neurodynamics, Proc. Arbeitsgespräch Physik und Informatik — Informatik und Physik (Munich, November 21–22, 1991).Google Scholar