Skip to main content

Squeezing Feasibility

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9709))

Abstract

This note explores an often overlooked question about the characterization of the notion model of computation which was originally identified by Cobham [5]. A simple formulation is as follows: what primitive operations are allowable in the definition of a model such that its time and space complexity measures provide accurate gauges of practical computational difficulty? After exploring the significance of this question in the context of subsequent work on machine models and simulations, an adaptation of Kreisel’s squeezing argument [17] for Church’s Thesis involving Gandy machines [11] is sketched which potentially bears on this question.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Cobham characterized the class \(\mathcal {L}\) of feasibly computable functions as those computable by an informal algorithm in “a number of steps \(\ldots \) bounded by polynomials in the lengths of the numbers involved”. He proposed that \(\mathcal {L}\) coincided with the functions definable using a restricted recursion scheme known as limited recursion on notation. He then conjectured that the class of functions definable in this manner coincided with \(\mathbf {FP}\) under its contemporary definition – i.e. the class of functions computable in polynomial time by a deterministic Turing machine. This was later demonstrated by Rose [20].

  2. 2.

    “Is it harder to multiply than to add? \(\ldots \) I grant I have put [this] question loosely; nevertheless, I think the answer ought to be yes” [5], p. 24. By the mid-1960s it was already possible to marshall a good deal of evidence in favor of this hypothesis – e.g., [7].

  3. 3.

    See [27] for full definitions of \(\mathfrak {T}\) and \(\mathfrak {R}\) and references for the simulation results just summarized.

  4. 4.

    Considerable inductive support for this claim is supplied by Knuth’s [15] detailed implementations of a wide range of algorithms using a variant of \(\mathfrak {R}\) which satisfies the Invariance Thesis when its multiplication and division operations are removed.

  5. 5.

    I.e. for all \(N_0 \in \mathfrak {N}_0\) there exists \(N_1 \in \mathfrak {N}_1\) computing the same function such that \(\text {time}_{N_1}(|x|) \in O(\text {time}_{N_0}(|x|)^k)\) and \(\text {space}_{N_1}(|x|) \in O(\text {space}_{N_0}(|x|))\) and conversely.

  6. 6.

    See [27] for discussion of caveats pertaining both to how the relevant time and space measures must be formulated and the status of the requirement that the relevant overheads be achieved with respect to the same simulation.

  7. 7.

    Hartmanis and Simon showed this originally with respect to a variant of the MRAM model which allows parallel bit-wise Boolean operations in the manner described above. Bertoni et al. showed that such operations were not necessary in the presence of both addition and multiplication.

  8. 8.

    For if \(\mathfrak {M}\) satisfied the Invariance Thesis with respect to \(\mathfrak {R}\), this would also entail that there was a time and space efficient simulation of MRAM machines by multi-tape Turing machines from which \(\mathbf {P}_{\mathfrak {T}} = \mathbf {PSPACE}_{\mathfrak {T}}\) would follow.

  9. 9.

    Schönhage and Strassen [23] showed that the \(O(n^2)\) time complexity of the “naive” carry multiplication algorithm can be improved to \(O(n \log (n) \log (\log n))\), while also conjecturing a lower bound of \(\varOmega (n \log (n))\). The Schönhage-Strassen bound has recently been improved by Fürer [10] who presented an \(n \log n 2^{O(\log ^*(n))}\) algorithm.

  10. 10.

    Although I will put aside such issues here, rejoinders to these objections can be found in textbooks such as [1]. See also [9].

  11. 11.

    For instance, while \(\mathbf {FP}\) coincides with the provably recursive functions of Buss’s system \(\mathsf {S}^1_2\), similar characterizations of the Linear Time Hierarchy or Polynomial Hierarchy arise as the provably recursive functions of similar theories [3]. And while \(\mathbf {P}_{\mathfrak {T}}\) is characterizable as the set of languages describable in first-order logic with a least fixed point operator in the presence of a linear order, similar (and in many instances simpler) characterizations of narrower classes (like \(\mathsf {AC}^0\)) or broader classes (like \(\mathbf {NP}_{\mathfrak {T}}\)) are also available [14]. See [4] for function algebra descriptions of additional complexity classes such as \(\mathbf {PSPACE}_{\mathfrak {T}}\).

  12. 12.

    The graph-theoretic models of Kolomogorv and Uspensky [16] and Schönhage [22] are inspired by similar considerations. However Gandy’s model differs not only defining states in defining states more abstractly – i.e. as hereditarily finite sets (which may contain unboundedly many labels which are treated as urelements) of bounded rank – but also in that it allows for parallelism in the sense that machines may locally transform discontiguous parts of states in a single step.

  13. 13.

    In fact it seems likely that \(\mathfrak {G}\) is a not a reasonable model. For it is easy to see that Gandy machines can simulate Schönage’s storage modification machines with constant factor time overhead. As the latter model admits a linear time (i.e. O(n)) multiplication algorithm, Gandy machines do as well. And as Cook [6] (p. 403) observes, “we are forced to conclude that either multiplication is easier than we thought or that Schönhage’s machines cheat”. See Schöngage [22] (pp. 506–507) and van Emde Boas [26] (p. 110) for similar observations.

References

  1. Arora, S., Barak, B.: Computational Complexity: A Modern Approach. University Press, Cambridge (2009)

    Book  MATH  Google Scholar 

  2. Bertoni, A., Mauri, G., Sabadini, N.: Simulations among classes of random access machines and equivalence among numbers succinctly represented. In: Annals of Discrete Mathematics. North-Holland Mathematics Studies, vol. 109, pp. 65–89. Elsevier (1985)

    Google Scholar 

  3. Buss, R.: Bounded Arithmetic. Bibliopolis, Naples (1986)

    MATH  Google Scholar 

  4. Clote, P.: Boolean Functions and Computation Models. Springer, Heidelberg (2002)

    Book  MATH  Google Scholar 

  5. Cobham, A.: The intrinsic computational difficulty of functions. In: Proceedings of the Third International Congress for Logic, Methodology and Philosophy of Science, Amsterdam, pp. 24–30. North-Holland (1965)

    Google Scholar 

  6. Cook, S.: An overview of computational complexity. Commun. ACM 26, 401–408 (1983)

    Article  MathSciNet  MATH  Google Scholar 

  7. Cook, S., Aanderaa, S.: On the minimum computation time of functions. Trans. Am. Math. Soc. 142, 291–314 (1969)

    Article  MathSciNet  MATH  Google Scholar 

  8. Cook, S., Reckhow, R.: Time bounded random access machines. J. Comput. Syst. Sci. 7(4), 354–375 (1973)

    Article  MathSciNet  MATH  Google Scholar 

  9. Dean, W.: Computational complexity theory. In: Zalta, E.N. (ed.) The Stanford Encyclopedia of Philosophy. Fall 2015 Ed. (2015)

    Google Scholar 

  10. Fürer, M.: Faster integer multiplication. SIAM J. Comput. 39(3), 979–1005 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  11. Gandy, R.: Church’s thesis and principles for mechanisms. In: Barwise, H.K.J., Kunen, K. (eds.) The Kleene Symposium, vol. 101, pp. 123–148. North Holland, Amsterdam (1980)

    Chapter  Google Scholar 

  12. Hartmanis, J., Simon, J.: On the power of multiplication in random access machines. In: 1974 IEEE Conference Record of 15th Annual Symposium on Switching and Automata Theory, pp. 13–23. IEEE (1974)

    Google Scholar 

  13. Hartmanis, J., Stearns, R.: On the computational complexity of algorithms. Trans. Am. Math. Soc. 117(5), 285–306 (1965)

    Article  MathSciNet  MATH  Google Scholar 

  14. Immerman, N.: Descriptive Complexity. Springer, Heidelberg (1999)

    Book  MATH  Google Scholar 

  15. Knuth, D.: The Art of Computer Programming, vol. I–III. Addison Wesley, Boston (1973)

    Google Scholar 

  16. Kolmogorov, A., Uspensky, V.: To the definition of algorithms. Uspekhi Mat. Nauk 13(4), 3–28 (1958)

    Google Scholar 

  17. Kreisel, G.: Informal rigour and completeness proofs. In: Problems in the Philosophy of Mathematics, pp. 138–186 (1967)

    Google Scholar 

  18. Kreisel, G.: Which number theoretic problems can be solved in recursive progressions on \(\Pi ^1_1\)-paths through \(\cal {O}\)? J. Symbolic Logic 37(2), 311–334 (1972)

    Article  MathSciNet  MATH  Google Scholar 

  19. Kreisel, G.: Church’s thesis and the ideal of informal rigour. Notre Dame J. Formal Logic 28(4), 499–519 (1987)

    Article  MathSciNet  MATH  Google Scholar 

  20. Rose, H.: Subrecursion: Functions and Hierarchies. Clarendon Press, Oxford (1984)

    MATH  Google Scholar 

  21. Savitch, W., Stimson, M.: Time bounded random access machines with parallel processing. J. ACM 26(1), 103–118 (1979)

    Article  MathSciNet  MATH  Google Scholar 

  22. Schönhage, A.: Storage modification machines. SIAM J. Comput. 9(3), 490–508 (1980)

    Article  MathSciNet  MATH  Google Scholar 

  23. Schönhage, A., Strassen, V.: Schnelle Multiplikation großer Zahlen. Computing 7(3–4), 281–292 (1971)

    Article  MathSciNet  MATH  Google Scholar 

  24. Sieg, W.: On computability. In: Irvine, A. (ed.) Philosophy of Mathematics, Handbook of the Philosophy of Science, vol. 4, pp. 549–630. North Holland, Amsterdam (2009)

    Google Scholar 

  25. Turing, A.: On computable numbers, with an application to the Entscheidungsproblem. Proc. Lond. Math. Soc. 42(2), 230–265 (1936)

    MathSciNet  MATH  Google Scholar 

  26. van Emde Boas, P.: Space measures for storage modification machines. Inf. Process. Lett. 30(2), 103–110 (1989)

    Article  MathSciNet  MATH  Google Scholar 

  27. van Emde Boas, P.: Machine models and simulations. In: Van Leeuwen, J. (ed.) Handbook of Theoretical Computer Science (vol. A): Algorithms and Complexity. MIT Press, Cambridge (1990)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Walter Dean .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Dean, W. (2016). Squeezing Feasibility. In: Beckmann, A., Bienvenu, L., Jonoska, N. (eds) Pursuit of the Universal. CiE 2016. Lecture Notes in Computer Science(), vol 9709. Springer, Cham. https://doi.org/10.1007/978-3-319-40189-8_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-40189-8_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-40188-1

  • Online ISBN: 978-3-319-40189-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics