Theory of Computing Systems

, Volume 48, Issue 1, pp 150–169 | Cite as

Parallelizing Time with Polynomial Circuits



We study the problem of asymptotically reducing the runtime of serial computations with circuits of polynomial size. We give an algorithmic size-depth tradeoff for parallelizing time t random access Turing machines, a model at least as powerful as logarithmic cost RAMs. Our parallel simulation yields logspace-uniform t O(1) size, O(t/log t)-depth Boolean circuits having semi-unbounded fan-in gates. In fact, for appropriate d, uniform t O(1)2O(t/d) size circuits of depth O(d) can simulate time t. One corollary is that every log-cost time t RAM can be simulated by a log-cost CRCW PRAM using t O(1) processors and O(t/log t) time. This improves over previous parallel speedups, which only guaranteed an Ω(log t)-speedup with an exponential number of processors for weaker models of computation. These results are obtained by generalizing the well-known result that \(\textsf{DTIME}[t]\subseteq \textsf{ASPACE}[\log t]\).


Circuit complexity Alternation Parallel speedup 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Borodin, A.: On relating time and space to size and depth. SIAM J. Comput. 6(4), 733–744 (1977) MATHCrossRefMathSciNetGoogle Scholar
  2. 2.
    Chandra, A.K., Kozen, D., Stockmeyer, L.J.: Alternation. J. ACM 28(1), 114–133 (1981) MATHMathSciNetGoogle Scholar
  3. 3.
    Chandra, A.K., Stockmeyer, L., Vishkin, U.: Constant depth reducibility. SIAM J. Comput. 13(2), 423–439 (1984) MATHCrossRefMathSciNetGoogle Scholar
  4. 4.
    Dymond, P.W., Tompa, M.: Speedups of deterministic machines by synchronous parallel machines. J. Comput. Syst. Sci. 30(2), 149–161 (1985) MATHCrossRefMathSciNetGoogle Scholar
  5. 5.
    Greenlaw, R., Hoover, H.J., Ruzzo, W.L.: Limits to Parallel Computation: P-Completeness Theory. Oxford University Press, Oxford (1995) MATHGoogle Scholar
  6. 6.
    Halpern, J.Y., Loui, M.C., Meyer, A.R., Weise, D.: On time versus space III. Math. Syst. Theory 19(1), 13–28 (1986) MATHCrossRefMathSciNetGoogle Scholar
  7. 7.
    Hopcroft, J., Paul, W.J., Valiant, L.G.: On Time vs. Space. J. ACM 24(2), 332–337 (1977) MATHMathSciNetGoogle Scholar
  8. 8.
    Immerman, N.: Nondeterministic space is closed under complement. SIAM J. Comput. 17, 935–938 (1988) MATHCrossRefMathSciNetGoogle Scholar
  9. 9.
    Immerman, N.: Descriptive Complexity. Springer, Berlin (1999) MATHGoogle Scholar
  10. 10.
    Karp, R.M., Ramachandran, V.: Parallel algorithms for shared-memory machines. In: van Leeuwen, J. (ed.) Handbook of Theoretical Computer Science. Elsevier, Amsterdam (1990) Google Scholar
  11. 11.
    Lengauer, T., Tarjan, R.E.: Asymptotically tight bounds on time-space trade-offs in a pebble game. J. ACM 29(4), 1087–1130 (1982) MATHMathSciNetGoogle Scholar
  12. 12.
    Lipton, R.J., Viglas, A.: Non-uniform depth of polynomial time and space simulations. In: Fundamentals of Computation Theory. LNCS, vol. 2451, pp. 311–320. Springer, Berlin (2003) CrossRefGoogle Scholar
  13. 13.
    Mak, L.: Are parallel machines always faster than sequential machines? (preliminary version). In: Proceedings of STACS. LNCS, vol. 775, pp. 137–148. Springer, Berlin (1994) Google Scholar
  14. 14.
    Mak, L.: Parallelism always helps. SIAM J. Comput. 26(1), 153–172 (1997) MATHCrossRefMathSciNetGoogle Scholar
  15. 15.
    Meyer auf der Heide, F.: Speeding up random access machines by few processors. In: Proceedings of STACS. LNCS, vol. 210, pp. 142–152. Springer, Berlin (1986) Google Scholar
  16. 16.
    Papadimitriou, C.: Computational Complexity. Addison-Wesley, Reading (1994) MATHGoogle Scholar
  17. 17.
    Paterson, M., Valiant, L.G.: Circuit size is nonlinear in depth. Theor. Comput. Sci. 2(3), 397–400 (1976) MATHCrossRefMathSciNetGoogle Scholar
  18. 18.
    Paul, W.J., Reischuk, R.: On alternation II. A graph theoretic approach to determinism versus nondeterminism. Acta Inf. 14, 391–403 (1980) MATHMathSciNetGoogle Scholar
  19. 19.
    Paul, W.J., Reischuk, R.: On time versus space II. J. Comput. Syst. Sci. 22(3), 312–327 (1981) MATHCrossRefMathSciNetGoogle Scholar
  20. 20.
    Ruzzo, W.: On uniform circuit complexity. J. Comput. Syst. Sci. 22, 365–383 (1981) MATHCrossRefMathSciNetGoogle Scholar
  21. 21.
    Sipser, M.: Introduction to the Theory of Computation, 2nd edn. PWS, Boston (2005) Google Scholar
  22. 22.
    Stockmeyer, L., Vishkin, U.: Simulation of parallel random access machines by circuits. SIAM J. Comput. 13(2), 409–422 (1984) MATHCrossRefMathSciNetGoogle Scholar
  23. 23.
    Szelepcsenyi, R.: The method of forcing for nondeterministic automata. Bull. EATCS 33, 96–100 (1987) MATHGoogle Scholar
  24. 24.
    Venkateswaran, H.: Properties that characterize LOGCFL. J. Comput. Syst. Sci. 43(2), 380–404 (1991) MATHCrossRefMathSciNetGoogle Scholar
  25. 25.
    Williams, R.: Parallelizing time with polynomial circuits. In: Proc. of ACM Symposium on Parallelism in Algorithms and Architectures (SPAA’05), pp. 171–175 (2005) Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  1. 1.Institute for Advanced StudyPrincetonUSA

Personalised recommendations