In computability theory, computational complexity theory and proof theory, a fast-growing hierarchy (also called an extended Grzegorczyk hierarchy, or a SchwichtenbergâÂÂWainer hierarchy) is an ordinal-indexed family of rapidly increasing functions f<sub>ñ</sub>: N â N (where N is the set of natural numbers {0, 1, ...}, and ñ ranges up to some large countable ordinal). A primary example is the Wainer hierarchy, or LöbâÂÂWainer hierarchy, which is an extension to all ñ < õ<sub>0</sub>. Such hierarchies provide a natural way to classify computable functions according to rate-of-growth and computational complexity.
Definition
Let ü be a large countable ordinal such that to every limit ordinal ñ < ü there is assigned a fundamental sequence (a strictly increasing sequence of ordinals whose supremum is ñ). A fast-growing hierarchy of functions f<sub>ñ</sub>: N â N, for ñ < ü, is then defined as follows:
- if ñ is a limit ordinal.
Here f<sub>ñ</sub><sup>n</sup>(n) = f<sub>ñ</sub>(f<sub>ñ</sub>(...(f<sub>ñ</sub>(n))...)) denotes the n<sup>th</sup> iterate of f<sub>ñ</sub> applied to n, and ñ[n] denotes the n<sup>th</sup> element of the fundamental sequence assigned to the limit ordinal ñ. (An alternative definition takes the number of iterations to be n+1, rather than n, in the second line above.)
The initial part of this hierarchy, comprising the functions f<sub>ñ</sub> with finite index (i.e., ñ < ÃÂ), is often called the Grzegorczyk hierarchy because of its close relationship to the Grzegorczyk hierarchy; note, however, that the former is here an indexed family of functions f<sub>n</sub>, whereas the latter is an indexed family of sets of functions . (See Points of interest below.)
Generalizing the above definition even further, a fast iteration hierarchy is obtained by taking f<sub>0</sub> to be any non-decreasing function g: N â N.
For limit ordinals not greater than õ<sub>0</sub>, there is a straightforward natural definition of the fundamental sequences (see the Wainer hierarchy below), but beyond õ<sub>0</sub> the definition is more complicated. However, this is possible well beyond the FefermanâÂÂSchütte ordinal, ÃÂ<sub>0</sub>, up to at least the BachmannâÂÂHoward ordinal. Using Buchholz psi functions one can extend this definition to the ordinal of transfinitely iterated -comprehension (see Analytical hierarchy).
A fully specified extension beyond the computable ordinals is thought to be unlikely; e.g., Prçmel and others note that in such an attempt "there would even arise problems in ordinal notation".
The Wainer hierarchy
The Wainer hierarchy is the particular fast-growing hierarchy of functions f<sub>ñ</sub> (ñ ⤠õ<sub>0</sub>) obtained by defining the fundamental sequences as follows:
For limit ordinals û < õ<sub>0</sub>, written in Cantor normal form,
- if û = ÃÂ<sup>ñ<sub>1</sub></sup> + ... + ÃÂ<sup>ñ<sub>kâÂÂ1</sub></sup> + ÃÂ<sup>ñ<sub>k</sub></sup> for ñ<sub>1</sub> âÂÂ¥ ... âÂÂ¥ ñ<sub>kâÂÂ1</sub> âÂÂ¥ ñ<sub>k</sub>, then û[n] = ÃÂ<sup>ñ<sub>1</sub></sup> + ... + ÃÂ<sup>ñ<sub>kâÂÂ1</sub></sup> + ÃÂ<sup>ñ<sub>k</sub></sup>[n],
- if û = ÃÂ<sup>ñ+1</sup>, then û[n] = ÃÂ<sup>ñ</sup>n,
- if û = ÃÂ<sup>ñ</sup> for a limit ordinal ñ, then û[n] = ÃÂ<sup>ñ[n]</sup>,
and
- if û = õ<sub>0</sub>, take û[0] = 0 and û[n + 1] = ÃÂ<sup>û[n]</sup>; alternatively, take the same sequence except starting with û[0] = 1. <br>For n > 0, the alternative version has one additional àin the resulting exponential tower, i.e. û[n] = ÃÂ<sup>ÃÂ<sup>â°<sup>ω</sup></sup></sup> with n appearances of ω.
Some authors use slightly different definitions (e.g., ÃÂ<sup>ñ+1</sup>[n] = ÃÂ<sup>ñ</sup>(n+1), instead of ÃÂ<sup>ñ</sup>n), and some define this hierarchy only for ñ < õ<sub>0</sub> (thus excluding f<sub>õ<sub>0</sub></sub> from the hierarchy).
To continue beyond õ<sub>0</sub> the fundamental sequences for the Veblen hierarchy can be used.
Points of interest
Following are some relevant points of interest about fast-growing hierarchies:
- Every f<sub>ñ</sub> is a total function. If the fundamental sequences are computable (e.g., as in the Wainer hierarchy), then every f<sub>ñ</sub> is a total computable function.
- In the Wainer hierarchy, f<sub>ñ</sub> is dominated by f<sub>ò</sub> if ñ < ò. (For any two functions f, g: N â N, f is said to dominate g if f(n) > g(n) for all sufficiently large n.) The same property holds in any fast-growing hierarchy with fundamental sequences satisfying the so-called Bachmann property. (This property holds for most natural well orderings.)
- In the Grzegorczyk hierarchy, every primitive recursive function is dominated by some f<sub>ñ</sub> with ñ < ÃÂ. Hence, in the Wainer hierarchy, every primitive recursive function is dominated by f<sub>ÃÂ</sub>, which is a variant of the Ackermann function.
- For n âÂÂ¥ 3, the set in the Grzegorczyk hierarchy is composed of just those total multi-argument functions which, for sufficiently large arguments, are computable within time bounded by some fixed iterate f<sub>n-1</sub><sup>k</sup> evaluated at the maximum argument.
- In the Wainer hierarchy, every f<sub>ñ</sub> with ñ < õ<sub>0</sub> is computable and provably total in Peano arithmetic.
- Every computable function that is provably total in Peano arithmetic is dominated by some f<sub>ñ</sub> with ñ < õ<sub>0</sub> in the Wainer hierarchy. Hence f<sub>õ<sub>0</sub></sub> in the Wainer hierarchy is not provably total in Peano arithmetic.
- The Goodstein function has approximately the same growth rate (i.e. each is dominated by some fixed iterate of the other) as f<sub>õ<sub>0</sub></sub> in the Wainer hierarchy, dominating every f<sub>ñ</sub> for which ñ < õ<sub>0</sub>, and hence is not provably total in Peano Arithmetic.
- In the Wainer hierarchy, if ñ < ò < õ<sub>0</sub>, then f<sub>ò</sub> dominates every computable function within time and space bounded by some fixed iterate f<sub>ñ</sub><sup>k</sup>.
- Friedman's TREE function dominates f<sub>ÃÂ<sub>0</sub></sub> in a fast-growing hierarchy.
- The Wainer hierarchy of functions f<sub>ñ</sub> and the Hardy hierarchy of functions h<sub>ñ</sub> are related by f<sub>ñ</sub> = h<sub>ÃÂ<sup>ñ</sup></sub> for all ñ < õ<sub>0</sub>. The Hardy hierarchy "catches up" to the Wainer hierarchy at ñ = õ<sub>0</sub>, such that f<sub>õ<sub>0</sub></sub> and h<sub>õ<sub>0</sub></sub> have the same growth rate, in the sense that f<sub>õ<sub>0</sub></sub>(n-1) ⤠h<sub>õ<sub>0</sub></sub>(n) ⤠f<sub>õ<sub>0</sub></sub>(n+1) for all n âÂÂ¥ 1.
- The slow-growing hierarchy of functions g<sub>ñ</sub> attains the same growth rate as the function f<sub>õ<sub>0</sub></sub> in the Wainer hierarchy when ñ is the BachmannâÂÂHoward ordinal. Furthermore, the slow-growing hierarchy g<sub>ñ</sub> attains the same growth rate as f<sub>ñ</sub> (in a particular fast-growing hierarchy) when ñ is the ordinal of the theory ID<sub><ÃÂ</sub> of arbitrary finite iterations of an inductive definition.
Functions in fast-growing hierarchies
The functions at finite levels (ñ < ÃÂ) of any fast-growing hierarchy coincide with those of the Grzegorczyk hierarchy: (using hyperoperation)
- f<sub>0</sub>(n) = n + 1 = 2[1]n â 1
- f<sub>1</sub>(n) = f<sub>0</sub><sup>n</sup>(n) = n + n = 2n = 2[2]n
- f<sub>2</sub>(n) = f<sub>1</sub><sup>n</sup>(n) = 2<sup>n</sup> ÷ n > 2<sup>n</sup> = 2[3]n for n âÂÂ¥ 2
- f<sub>k+1</sub>(n) = f<sub>k</sub><sup>n</sup>(n) > (2[k + 1])<sup>n</sup> n âÂÂ¥ 2[k + 2]n for n âÂÂ¥ 2, k < ÃÂ.
Beyond the finite levels are the functions of the Wainer hierarchy (à⤠ñ ⤠õ<sub>0</sub>):
- f<sub>ÃÂ</sub>(n) = f<sub>n</sub>(n) > 2[n + 1]n > 2[n](n + 3) â 3 = A(n, n) for n âÂÂ¥ 4, where A is the Ackermann function (of which f<sub>ÃÂ</sub> is a unary version).
- f<sub>ÃÂ+1</sub>(n) = f<sub>ÃÂ</sub><sup>n</sup>(n) âÂÂ¥ f<sub>n[n + 2]n</sub>(n) for all n > 0, where n[n + 2]n is the n<sup>th</sup> Ackermann number.
- f<sub>ÃÂ+1</sub>(64) = f<sub>ÃÂ</sub><sup>64</sup>(64) > Graham's number (= g<sub>64</sub> in the sequence defined by g<sub>0</sub> = 4, g<sub>k+1</sub> = 3[g<sub>k</sub> + 2]3). This follows by noting f<sub>ÃÂ</sub>(n) > 2[n + 1]n > 3[n]3 + 2, and hence f<sub>ÃÂ</sub>(g<sub>k</sub> + 2) > g<sub>k+1</sub> + 2.
- f<sub>õ<sub>0</sub></sub>(n) is the first function in the Wainer hierarchy that dominates the Goodstein function.
Notes
References