Abstract
This note explores an often overlooked question about the characterization of the notion model of computation which was originally identified by Cobham [5]. A simple formulation is as follows: what primitive operations are allowable in the definition of a model such that its time and space complexity measures provide accurate gauges of practical computational difficulty? After exploring the significance of this question in the context of subsequent work on machine models and simulations, an adaptation of Kreisel’s squeezing argument [17] for Church’s Thesis involving Gandy machines [11] is sketched which potentially bears on this question.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
Cobham characterized the class \(\mathcal {L}\) of feasibly computable functions as those computable by an informal algorithm in “a number of steps \(\ldots \) bounded by polynomials in the lengths of the numbers involved”. He proposed that \(\mathcal {L}\) coincided with the functions definable using a restricted recursion scheme known as limited recursion on notation. He then conjectured that the class of functions definable in this manner coincided with \(\mathbf {FP}\) under its contemporary definition – i.e. the class of functions computable in polynomial time by a deterministic Turing machine. This was later demonstrated by Rose [20].
- 2.
- 3.
See [27] for full definitions of \(\mathfrak {T}\) and \(\mathfrak {R}\) and references for the simulation results just summarized.
- 4.
Considerable inductive support for this claim is supplied by Knuth’s [15] detailed implementations of a wide range of algorithms using a variant of \(\mathfrak {R}\) which satisfies the Invariance Thesis when its multiplication and division operations are removed.
- 5.
I.e. for all \(N_0 \in \mathfrak {N}_0\) there exists \(N_1 \in \mathfrak {N}_1\) computing the same function such that \(\text {time}_{N_1}(|x|) \in O(\text {time}_{N_0}(|x|)^k)\) and \(\text {space}_{N_1}(|x|) \in O(\text {space}_{N_0}(|x|))\) and conversely.
- 6.
See [27] for discussion of caveats pertaining both to how the relevant time and space measures must be formulated and the status of the requirement that the relevant overheads be achieved with respect to the same simulation.
- 7.
Hartmanis and Simon showed this originally with respect to a variant of the MRAM model which allows parallel bit-wise Boolean operations in the manner described above. Bertoni et al. showed that such operations were not necessary in the presence of both addition and multiplication.
- 8.
For if \(\mathfrak {M}\) satisfied the Invariance Thesis with respect to \(\mathfrak {R}\), this would also entail that there was a time and space efficient simulation of MRAM machines by multi-tape Turing machines from which \(\mathbf {P}_{\mathfrak {T}} = \mathbf {PSPACE}_{\mathfrak {T}}\) would follow.
- 9.
Schönhage and Strassen [23] showed that the \(O(n^2)\) time complexity of the “naive” carry multiplication algorithm can be improved to \(O(n \log (n) \log (\log n))\), while also conjecturing a lower bound of \(\varOmega (n \log (n))\). The Schönhage-Strassen bound has recently been improved by Fürer [10] who presented an \(n \log n 2^{O(\log ^*(n))}\) algorithm.
- 10.
- 11.
For instance, while \(\mathbf {FP}\) coincides with the provably recursive functions of Buss’s system \(\mathsf {S}^1_2\), similar characterizations of the Linear Time Hierarchy or Polynomial Hierarchy arise as the provably recursive functions of similar theories [3]. And while \(\mathbf {P}_{\mathfrak {T}}\) is characterizable as the set of languages describable in first-order logic with a least fixed point operator in the presence of a linear order, similar (and in many instances simpler) characterizations of narrower classes (like \(\mathsf {AC}^0\)) or broader classes (like \(\mathbf {NP}_{\mathfrak {T}}\)) are also available [14]. See [4] for function algebra descriptions of additional complexity classes such as \(\mathbf {PSPACE}_{\mathfrak {T}}\).
- 12.
The graph-theoretic models of Kolomogorv and Uspensky [16] and Schönhage [22] are inspired by similar considerations. However Gandy’s model differs not only defining states in defining states more abstractly – i.e. as hereditarily finite sets (which may contain unboundedly many labels which are treated as urelements) of bounded rank – but also in that it allows for parallelism in the sense that machines may locally transform discontiguous parts of states in a single step.
- 13.
In fact it seems likely that \(\mathfrak {G}\) is a not a reasonable model. For it is easy to see that Gandy machines can simulate Schönage’s storage modification machines with constant factor time overhead. As the latter model admits a linear time (i.e. O(n)) multiplication algorithm, Gandy machines do as well. And as Cook [6] (p. 403) observes, “we are forced to conclude that either multiplication is easier than we thought or that Schönhage’s machines cheat”. See Schöngage [22] (pp. 506–507) and van Emde Boas [26] (p. 110) for similar observations.
References
Arora, S., Barak, B.: Computational Complexity: A Modern Approach. University Press, Cambridge (2009)
Bertoni, A., Mauri, G., Sabadini, N.: Simulations among classes of random access machines and equivalence among numbers succinctly represented. In: Annals of Discrete Mathematics. North-Holland Mathematics Studies, vol. 109, pp. 65–89. Elsevier (1985)
Buss, R.: Bounded Arithmetic. Bibliopolis, Naples (1986)
Clote, P.: Boolean Functions and Computation Models. Springer, Heidelberg (2002)
Cobham, A.: The intrinsic computational difficulty of functions. In: Proceedings of the Third International Congress for Logic, Methodology and Philosophy of Science, Amsterdam, pp. 24–30. North-Holland (1965)
Cook, S.: An overview of computational complexity. Commun. ACM 26, 401–408 (1983)
Cook, S., Aanderaa, S.: On the minimum computation time of functions. Trans. Am. Math. Soc. 142, 291–314 (1969)
Cook, S., Reckhow, R.: Time bounded random access machines. J. Comput. Syst. Sci. 7(4), 354–375 (1973)
Dean, W.: Computational complexity theory. In: Zalta, E.N. (ed.) The Stanford Encyclopedia of Philosophy. Fall 2015 Ed. (2015)
Fürer, M.: Faster integer multiplication. SIAM J. Comput. 39(3), 979–1005 (2009)
Gandy, R.: Church’s thesis and principles for mechanisms. In: Barwise, H.K.J., Kunen, K. (eds.) The Kleene Symposium, vol. 101, pp. 123–148. North Holland, Amsterdam (1980)
Hartmanis, J., Simon, J.: On the power of multiplication in random access machines. In: 1974 IEEE Conference Record of 15th Annual Symposium on Switching and Automata Theory, pp. 13–23. IEEE (1974)
Hartmanis, J., Stearns, R.: On the computational complexity of algorithms. Trans. Am. Math. Soc. 117(5), 285–306 (1965)
Immerman, N.: Descriptive Complexity. Springer, Heidelberg (1999)
Knuth, D.: The Art of Computer Programming, vol. I–III. Addison Wesley, Boston (1973)
Kolmogorov, A., Uspensky, V.: To the definition of algorithms. Uspekhi Mat. Nauk 13(4), 3–28 (1958)
Kreisel, G.: Informal rigour and completeness proofs. In: Problems in the Philosophy of Mathematics, pp. 138–186 (1967)
Kreisel, G.: Which number theoretic problems can be solved in recursive progressions on \(\Pi ^1_1\)-paths through \(\cal {O}\)? J. Symbolic Logic 37(2), 311–334 (1972)
Kreisel, G.: Church’s thesis and the ideal of informal rigour. Notre Dame J. Formal Logic 28(4), 499–519 (1987)
Rose, H.: Subrecursion: Functions and Hierarchies. Clarendon Press, Oxford (1984)
Savitch, W., Stimson, M.: Time bounded random access machines with parallel processing. J. ACM 26(1), 103–118 (1979)
Schönhage, A.: Storage modification machines. SIAM J. Comput. 9(3), 490–508 (1980)
Schönhage, A., Strassen, V.: Schnelle Multiplikation großer Zahlen. Computing 7(3–4), 281–292 (1971)
Sieg, W.: On computability. In: Irvine, A. (ed.) Philosophy of Mathematics, Handbook of the Philosophy of Science, vol. 4, pp. 549–630. North Holland, Amsterdam (2009)
Turing, A.: On computable numbers, with an application to the Entscheidungsproblem. Proc. Lond. Math. Soc. 42(2), 230–265 (1936)
van Emde Boas, P.: Space measures for storage modification machines. Inf. Process. Lett. 30(2), 103–110 (1989)
van Emde Boas, P.: Machine models and simulations. In: Van Leeuwen, J. (ed.) Handbook of Theoretical Computer Science (vol. A): Algorithms and Complexity. MIT Press, Cambridge (1990)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Dean, W. (2016). Squeezing Feasibility. In: Beckmann, A., Bienvenu, L., Jonoska, N. (eds) Pursuit of the Universal. CiE 2016. Lecture Notes in Computer Science(), vol 9709. Springer, Cham. https://doi.org/10.1007/978-3-319-40189-8_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-40189-8_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-40188-1
Online ISBN: 978-3-319-40189-8
eBook Packages: Computer ScienceComputer Science (R0)