Analog Computation

  • Bruce J. MacLennanEmail author
Reference work entry
Part of the Encyclopedia of Complexity and Systems Science Series book series (ECSSS)



The closeness of a computation to the corresponding primary system


The theory of computation over the real numbers defined by Blum, Shub, and Smale

Church–Turing (CT) computation

The model of computation based on the Turing machine and other equivalent abstract computing machines commonly accepted as defining the limits of digital computation


Extended analog computer defined by Rubel


General-purpose analog computer


A device for the graphical solution of equations by means of a family of curves and a straightedge


Ordinary differential equation


Partial differential equation


A variable resistance adjustable by the computer operator, used in electronic analog computing as an attenuator for setting constants and parameters in a computation


The quality of an analog representation or computation which depends on both resolution and stability

Primary system

The system being simulated, modeled, analyzed, or controlled by...


Primary Literature

  1. Anderson JA (1995) An introduction to neural networks. MIT Press, CambridgezbMATHGoogle Scholar
  2. Ashley JR (1963) Introduction to analog computing. Wiley, New YorkzbMATHGoogle Scholar
  3. Aspray W (1993) Edwin L. Harder and the Anacom: analog computing at Westinghouse. IEEE Ann Hist Comput 15(2):35–52MathSciNetCrossRefGoogle Scholar
  4. Basford DA, Smith JM, Connor RJ, MacLennan BJ, Holleman J (2016) The impact of analog computational error on an analog Boolean satisfiability solver. IEEE international symposium on circuits & systems 2016, MontrealGoogle Scholar
  5. Basu A, Brink S, Schlottmann C, Ramakrishnan S, Petre C, Koziol S, Baskaya F, Twigg CM, Hasler P (2010) A floating-gate-based field-programmable analog array. IEEE J Solid State Circuits 45:1781–1794CrossRefGoogle Scholar
  6. Ben-Hur A, Siegelmann HT, Fishman S (2002) A theory of complexity for continuous time systems. J Complex 18:51–86MathSciNetCrossRefGoogle Scholar
  7. Bissell CC (2004) A great disappearing act: the electronic analogue computer. In: IEEE conference on the history of electronics, Bletchley, June 2004. pp 28–30Google Scholar
  8. Blum L, Shub M, Smale S (1988) On a theory of computation and complexity over the real numbers: NP completeness, recursive functions and universal machines. Bull Am Math Soc 21:1–46MathSciNetCrossRefGoogle Scholar
  9. Blum L, Cucker F, Shub M, Smale S (1998) Complexity and real computation. Springer, BerlinCrossRefGoogle Scholar
  10. Bournez O, Cosnard M (1996) On the computational power of dynamical systems and hybrid systems. Theor Comput Sci 168(2):417–459MathSciNetCrossRefGoogle Scholar
  11. Bournez O, Campagnolo ML, Graça DS, Hainry E (2006) The general purpose analog computer and computable analysis are two equivalent paradigms of analog computation. In: Theory and applications of models of computation (TAMC 2006). Lectures notes in computer science, vol 3959. Springer, Berlin, pp 631–643Google Scholar
  12. Bowles MD (1996) US technological enthusiasm and British technological skepticism in the age of the analog brain. Ann Hist Comput 18(4):5–15CrossRefGoogle Scholar
  13. Branicky MS (1994) Analog computation with continuous ODEs. In: Proceedings IEEE workshop on physics and computation, Dallas, pp 265–274Google Scholar
  14. Brockett RW (1988) Dynamical systems that sort lists, diagonalize matrices and solve linear programming problems. In: Proceedings 27th IEEE conference decision and control, Austin, Dec 1988, pp 799–803Google Scholar
  15. Camazine S, Deneubourg J-L, Franks NR, Sneyd G, Theraulaz J, Bonabeau E (2001) Self-organization in biological systems. Princeton University Press, New YorkzbMATHGoogle Scholar
  16. Clymer AB (1993) The mechanical analog computers of Hannibal Ford and William Newell. IEEE Ann Hist Comput 15(2):19–34CrossRefGoogle Scholar
  17. Collins CE, Airey DC, Young NA, Leitch DB, Kaas JH (2010) Neuron densities vary across and within cortical areas in primates. Proc Natl Acad Sci 107(36):15927–15932CrossRefGoogle Scholar
  18. Davidson EH (2006) The regulatory genome: gene regulatory networks in development and evolution. Academic, AmsterdamGoogle Scholar
  19. Davies JA (2005) Mechanisms of morphogenesis. Elsevier, AmsterdamGoogle Scholar
  20. Davis M (2004) The myth of hypercomputation. In: Teuscher C (ed) Alan turing: life and legacy of a great thinker. Springer, Berlin, pp 195–212CrossRefGoogle Scholar
  21. Davis M (2006) Why there is no such discipline as hypercomputation. Appl Math Comput 178:4–7MathSciNetzbMATHGoogle Scholar
  22. Ercsey-Ravasz M, Toroczkai Z (2011) Optimization hardness as transient chaos in an analog approach to constraint satisfaction. Nat Phys 7(12):966–970CrossRefGoogle Scholar
  23. Fakhraie SM, Smith KC (1997) VLSI-compatible implementation for artificial neural networks. Kluwer, BostonCrossRefGoogle Scholar
  24. Franklin S, Garzon M (1990) Neural computability. In: Omidvar OM (ed) Progress in neural networks, vol 1. Ablex, Norwood, pp 127–145zbMATHGoogle Scholar
  25. Freeth T, Bitsakis Y, Moussas X, Seiradakis JH, Tselikas A, Mangou H, Zafeiropoulou M, Hadland R, Bate D, Ramsey A, Allen M, Crawley A, Hockley P, Malzbender T, Gelb D, Ambrisco W, Edmunds MG (2006) Decoding the ancient Greek astronomical calculator known as the Antikythera mechanism. Nature 444:587–591CrossRefGoogle Scholar
  26. Garzon M, Franklin S (1989) Neural computability II (extended abstract). In: Proceedings, IJCNN international joint conference on neural networks, vol 1. Institute of Electrical and Electronic Engineers, New York, pp 631–637Google Scholar
  27. Garzon M, Franklin S (1990) Computation on graphs. In: Omidvar OM (ed) Progress in neural networks, vol 2. Ablex, NorwoodzbMATHGoogle Scholar
  28. van Gelder T (1997) Dynamics and cognition. In: Haugeland J (ed) Mind design II: philosophy, psychology and artificial intelligence. MIT Press, Cambridge, MA, pp 421–450. Revised & enlarged edition, Chap 16Google Scholar
  29. Goldstine HH (1972) The computer from Pascal to von Neumann. Princeton University Press, PrincetonzbMATHGoogle Scholar
  30. Grossberg S (1967) Nonlinear difference-differential equations in prediction and learning theory. Proc Natl Acad Sci U S A 58(4):1329–1334MathSciNetCrossRefGoogle Scholar
  31. Grossberg S (1973) Contour enhancement, short term memory, and constancies in reverberating neural networks. Stud Appl Math LII:213–257MathSciNetCrossRefGoogle Scholar
  32. Grossberg S (1976) Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors. Biol Cybern 23:121–134MathSciNetCrossRefGoogle Scholar
  33. Hartl DL (1994) Genetics, 3rd edn. Jones & Bartlett, BostonGoogle Scholar
  34. Hopfield JJ (1984) Neurons with graded response have collective computational properties like those of two-state neurons. Proc Natl Acad Sci U S A 81:3088–3092CrossRefGoogle Scholar
  35. Howe RM (1961) Design fundamentals of analog computer components. Van Nostrand, PrincetonGoogle Scholar
  36. Khatib O (1986) Real-time obstacle avoidance for manipulators and mobile robots. Int J Robot Res 5:90–99CrossRefGoogle Scholar
  37. Kirchhoff G (1845) Ueber den Durchgang eines elektrischen Stromes durch eine Ebene, insbesondere durch eine kreisförmige. Ann Phys Chem 140(4):497–514CrossRefGoogle Scholar
  38. Lang GF (2000) Analog was not a computer trademark! Why would anyone write about analog computers in year 2000? Sound Vib 34(8):16–24Google Scholar
  39. Lipshitz L, Rubel LA (1987) A differentially algebraic replacement theorem. Proc Am Math Soc 99(2):367–372CrossRefGoogle Scholar
  40. Maass W, Sontag ED (1999) Analog neural nets with Gaussian or other common noise distributions cannot recognize arbitrary regular languages. Neural Comput 11(3):771–782CrossRefGoogle Scholar
  41. MacLennan BJ (1987) Technology-independent design of neurocomputers: the universal field computer. In: Caudill M, Butler C (eds) Proceedings of the IEEE first international conference on neural networks, vol 3. IEEE Press, New York. pp 39–49Google Scholar
  42. MacLennan BJ (1990) Field computation: a theoretical framework for massively parallel analog computation, parts I–IV. Technical report UT-CS-90-100, Department of Computer Science, University of Tennessee, Knoxville. Available from Accessed 20 May 2008
  43. MacLennan BJ (1991) Gabor representations of spatiotemporal visual images. Technical report UT-CS-91-144, Department of Computer Science, University of Tennessee, Knoxville. Available from Accessed 20 May 2008
  44. MacLennan BJ (1994b) Continuous computation and the emergence of the discrete. In: Pribram KH (ed) Origins: brain & self-organization. Lawrence Erlbaum, Hillsdale, pp 121–151Google Scholar
  45. MacLennan BJ (1994a) Words lie in our way. Minds Mach 4(4):421–437CrossRefGoogle Scholar
  46. MacLennan BJ (1995) Continuous formal systems: a unifying model in language and cognition. In: Proceedings of the IEEE workshop on architectures for semiotic modeling and situation analysis in large complex systems, Monterey, Aug 1995. IEEE Press, New York. pp 161–172. Also available from Accessed 20 May 2008
  47. MacLennan BJ (1999) Field computation in natural and artificial intelligence. Inf Sci 119:73–89MathSciNetCrossRefGoogle Scholar
  48. MacLennan BJ (2001) Can differential equations compute? Technical report UT-CS-01–459, Department of Computer Science, University of Tennessee, Knoxville. Available from Accessed 20 May 2008
  49. MacLennan BJ (2003) Transcending Turing computability. Minds Mach 13:3–22CrossRefGoogle Scholar
  50. MacLennan BJ (2004) Natural computation and non-Turing models of computation. Theor Comput Sci 317:115–145MathSciNetCrossRefGoogle Scholar
  51. MacLennan BJ (2009) Super-Turing or non-Turing? Extending the concept of computation. Int J Unconv Comput 5:369–387Google Scholar
  52. Maini PK, Othmer HG (eds) (2001) Mathematical models for biological pattern formation. Springer, New YorkzbMATHGoogle Scholar
  53. Maziarz EA, Greenwood T (1968) Greek mathematical philosophy. Frederick Ungar, New YorkzbMATHGoogle Scholar
  54. McClelland JL, Rumelhart DE, the PDP Research Group (1986) Parallel distributed processing: explorations in the microstructure of cognition, vol 2, Psychological and biological models. MIT Press, CambridgeGoogle Scholar
  55. Mead C (1987) Silicon models of neural computation. In: Caudill M, Butler C (eds) Proceedings, IEEE first international conference on neural networks, vol I. IEEE Press, Piscataway, pp 91–106Google Scholar
  56. Mead C (1989) Analog VLSI and neural systems. Addison-Wesley, ReadingzbMATHGoogle Scholar
  57. Mills JW (1996) The continuous retina: image processing with a single-sensor artificial neural field network. In: Proceedings IEEE conference on neural networks. IEEE Press, PiscatawayGoogle Scholar
  58. Mills JW, Himebaugh B, Kopecky B, Parker M, Shue C, Weilemann C (2006) “Empty space” computes: the evolution of an unconventional supercomputer. In: Proceedings of the 3rd conference on computing frontiers, New York, May 2006. ACM Press, pp 115–126Google Scholar
  59. Molnár B, Ercsey-Ravasz M (2013) Asymmetric continuous-time neural networks without local traps for solving constraint satisfaction problems. PLoS One 8(9):e73400CrossRefGoogle Scholar
  60. Moore GE (1965) Cramming more components onto integrated circuits. Electronics 38(8):114–117Google Scholar
  61. Moore C (1996) Recursion theory on the reals and continuous-time computation. Theor Comput Sci 162:23–44MathSciNetCrossRefGoogle Scholar
  62. Murray JD (1977) Lectures on nonlinear differential-equation models in biology. Clarendon Press, OxfordzbMATHGoogle Scholar
  63. Omohundro S (1984) Modeling cellular automata with partial differential equations. Physica D 10:128–134MathSciNetCrossRefGoogle Scholar
  64. Orponen P (1997) A survey of continuous-time computation theory. In: Advances in algorithms, languages, and complexity. Kluwer, Dordrecht, pp 209–224Google Scholar
  65. Orponen P, Matamala M (1996) Universal computation by finite two-dimensional coupled map lattices. In: Proceedings, physics and computation 1996. New England Complex Systems Institute, Cambridge, pp 243–7Google Scholar
  66. Owens L (1986) Vannevar Bush and the differential analyzer: the text and context of an early computer. Technol Cult 27(1):63–95CrossRefGoogle Scholar
  67. Peterson GR (1967) Basic analog computation. Macmillan, New YorkGoogle Scholar
  68. Pour-El MB (1974) Abstract computability and its relation to the general purpose analog computer (some connections between logic, differential equations and analog computers). Trans Am Math Soc 199:1–29MathSciNetCrossRefGoogle Scholar
  69. Pour-El MB, Richards I (1979) A computable ordinary differential equation which possesses no computable solution. Ann Math Log 17:61–90MathSciNetCrossRefGoogle Scholar
  70. Pour-EL MB, Richards I (1981) The wave equation with computable initial data such that its unique solution is not computable. Adv Math 39:215–239MathSciNetCrossRefGoogle Scholar
  71. Pour-El MB, Richards I (1982) Noncomputability in models of physical phenomena. Int J Theor Phys 21:553–555CrossRefGoogle Scholar
  72. Puchta S (1996) On the role of mathematics and mathematical knowledge in the invention of Vannevar Bush’s early analog computers. IEEE Ann Hist Comput 18(4):49–59MathSciNetCrossRefGoogle Scholar
  73. Reiner JM (1968) The organism as an adaptive control system. Prentice-Hall, Englewood CliffsGoogle Scholar
  74. Rimon E, Koditschek DE (1989) The construction of analytic diffeomorphisms for exact robot navigation on star worlds. In: Proceedings of the 1989 I.E. international conference on robotics and automation, Scottsdale. IEEE Press, New York, pp 21–26Google Scholar
  75. Rogers AE, Connolly TW (1960) Analog computation in engineering design. McGraw-Hill, New YorkGoogle Scholar
  76. Rubel LA (1985) The brain as an analog computer. J Theor Neurobiol 4:73–81Google Scholar
  77. Rubel LA (1988) Some mathematical limitations of the general-purpose analog computer. Adv Appl Math 9:22–34MathSciNetCrossRefGoogle Scholar
  78. Rubel LA (1993) The extended analog computer. Adv Appl Math 14:39–50MathSciNetCrossRefGoogle Scholar
  79. Rumelhart DE, McClelland JL, The PDP Research Group (1986) Parallel distributed processing: explorations in the microstructure of cognition, Foundations, vol 1. MIT Press, CambridgeGoogle Scholar
  80. Sanger TD (1996) Probability density estimation for the interpretation of neural population codes. J Neurophysiol 76:2790–2793CrossRefGoogle Scholar
  81. Shannon CE (1941) Mathematical theory of the differential analyzer. J Math Phys Mass Inst Technol 20:337–354MathSciNetzbMATHGoogle Scholar
  82. Shannon CE (1993) Mathematical theory of the differential analyzer. In: Sloane NJA, Wyner AD (eds) Claude Elwood Shannon: collected papers. IEEE Press, New York, pp 496–513zbMATHGoogle Scholar
  83. Siegelmann HT (1999) Neural networks and analog computation: beyond the Turing limit. Birkhäuser, BostonCrossRefGoogle Scholar
  84. Siegelmann HT, Sontag ED (1994) Analog computation via neural networks. Theor Comput Sci 131:331–360MathSciNetCrossRefGoogle Scholar
  85. Siegelmann HT, Ben-Hur A, Fishman S (1999) Computational complexity for continuous time dynamics. Phys Rev Lett 83(7):1463–1466CrossRefGoogle Scholar
  86. Small JS (1993) General-purpose electronic analog computing. IEEE Ann Hist Comput 15(2):8–18CrossRefGoogle Scholar
  87. Small JS (2001) The analogue alternative: the electronic analogue computer in Britain and the USA, 1930–1975. Routledge, London/New YorkGoogle Scholar
  88. Stannett M (1990) X-machines and the halting problem: building a super-Turing machine. Form Asp Comput 2:331–341CrossRefGoogle Scholar
  89. Teo JJY, Woo SS, Sarpeshkar R (2015) Synthetic biology: a unifying view and review using analog circuits. IEEE Trans Biomed Circ Syst 9(4):453–474CrossRefGoogle Scholar
  90. Thomson W (Lord Kelvin) (1876) Mechanical integration of the general linear differential equation of any order with variable coefficients. Proc R Soc 24:271–275Google Scholar
  91. Thomson W (Lord Kelvin) (1878) Harmonic analyzer. Proc R Soc 27:371–373Google Scholar
  92. Thomson W (Lord Kelvin) (1938) The tides. In: The Harvard classics, vol 30, Scientific papers. Collier, New York, pp 274–307Google Scholar
  93. Truitt TD, Rogers AE (1960) Basics of analog computers. John F Rider, New YorkGoogle Scholar
  94. Weyrick RC (1969) Fundamentals of analog computers. Prentice-Hall, Englewood CliffszbMATHGoogle Scholar
  95. Wolpert DH (1991) A computationally universal field computer which is purely linear. Technical report LA-UR-91-2937. Los Alamos National Laboratory, Loa AlamosGoogle Scholar
  96. Wolpert DH, MacLennan BJ (1993) A computationally universal field computer that is purely linear. Technical report UT-CS-93-206. Department of Computer Science, University of Tennessee, KnoxvilleGoogle Scholar
  97. Yin X, Sedighi B, Varga M, Ercsey-Ravasz M, Toroczkai Z, Hu XS (2016) Efficient analog circuits for Boolean satisfiability. arXiv:1606.07467Google Scholar

Books and Reviews

  1. Bissell CC (2004) A great disappearing act: the electronic analogue computer. In: IEEE conference on the history of electronics, Bletchley, June 2004Google Scholar
  2. Fifer S (1961) Analog computation: theory, techniques and applications, vol 4. McGraw-Hill, New YorkGoogle Scholar
  3. Lipka J (1918) Graphical and mechanical computation. Wiley, New YorkzbMATHGoogle Scholar
  4. Mead C (1989) Analog VLSI and neural systems. Addison-Wesley, ReadingzbMATHGoogle Scholar
  5. Siegelmann HT (1999b) Neural networks and analog computation: beyond the Turing limit. Birkhäuser, BostonCrossRefGoogle Scholar
  6. Small JS (1993) General-purpose electronic analog computing: 1945–1965. IEEE Ann Hist Comput 15(2):8–18CrossRefGoogle Scholar
  7. Small JS (2001) The analogue alternative: the electronic analogue computer in Britain and the USA, 1930–1975. Routledge, London/New YorkGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of Electrical Engineering and Computer ScienceUniversity of TennesseeKnoxvilleUSA

Personalised recommendations