AWOC 1986: VLSI Algorithms and Architectures pp 108-120 | Cite as
Nonsequential computation and laws of nature
Abstract
Traditionally, computational complexity theory deals with sequential computations. In the computational models the underlying physics is hardly accounted for. This attitude has persisted in common models for parallel computations. Wrongly, as we shall argue, since the laws of physics intrude forcefully when we want to obtain realistic estimates of the performance of parallel or distributed algorithms. First, we shall explain why it is reasonable to abstract away from the physical details in sequential computations. Second, we show why certain common approaches in the theory of parallel complexity do not give useful information about the actual complexity of the parallel computation. Third, we give some examples of the interplay between physical considerations and actual complexity of distributed computations.
Keywords
Communication Delay Memory Hierarchy Wire Length Sequential Computation Defense Advance Research Project AgencyPreview
Unable to display preview. Download preview PDF.
References
- Burks1946.Burks, A.W., H.H. Goldstine, and J. von Neumann, “Preliminary discussion of the logical design of an electronic computing instrument,” Report, Princeton Institute for Advanced Study, June, 1946. (Second Edition, September 1947)Google Scholar
- Goldstine1972.Goldstine, H.H., The Computer: from Pascal to von Neumann, Princeton University Press, Princeton, N.J., 1972.Google Scholar
- Lamport1978.Lamport, L., “Time, clocks, and the ordering of events in a distributed system,” Communications of the Assoc. Comp. Mach., vol. 21, pp. 558–565, 1978.Google Scholar
- Mead1980.Mead, C. and L. Conway, Introduction to VLSI Systems, Addisson-Wesley, Reading, Mass., 1980.Google Scholar
- Mullender1985.Mullender, S.J. and P.M.B. Vitányi, “Distributed match-making for processes in computer networks,” in Proceedings 4th Annual ACM Symposium on Principles of Distributed Computing, pp. 261–271, 1985.Google Scholar
- Neumann1945.Neumann, J. von, “First draft of a report on the EDVAC,” Draft Report, Moore School of Electrical Engineering, University of Pennsylvania, Philadelphia, May, 1945.Google Scholar
- Turing1936.Turing, A.M., “On computable numbers with an application to the Entscheidungsproblem,” Proc. London Math. Soc., vol. 42, pp. 230–265, 1936. Correction, Ibid, 43 pp. 544–546 (1937).Google Scholar
- Vitányi1984.Vitányi, P.M.B., “Distributed elections in an Archimedean ring of processors,” in Proceedings 16th Annual ACM Symposium on Theory of Computing, pp. 542–547, 1984.Google Scholar
- Vitányi1985.Vitányi, P.M.B., “Time-driven algorithms for distributed control,” Report CS-R8510, Centre for Mathematics and Computer Science, Amsterdam, April, 1985.Google Scholar
- Vitányi1985.bVitányi, P.M.B., “Area penalty for sublinear signal propagation delay on chip,” in Proceedings 26th Annual IEEE Symposium on Foundations of Computer Science, 1985.Google Scholar
- Mead1982.Mead, C. and M. Rem, “Minimum propagation delays in VLSI,” IEEE J. on Solid State Circuits, vol. SC-17, pp. 773–775, 1982. Correction: Ibid, SC-19 (1984) 162.Google Scholar
- Ullman1984.Ullman, J.D., Computational Aspects of VLSI, Computer Science Press, Rockville, Maryland, 1984.Google Scholar
- Donat1981.Donat, W.E., “Wire length distribution for placement of computer logic,” IBM J. Res. Develop., vol. 25, pp. 152–155, 1981.Google Scholar