Original proof of Gödel's completeness theorem

From HandWiki
Kurt Gödel (1925)

The proof of Gödel's completeness theorem given by Kurt Gödel in his doctoral dissertation of 1929 (and a shorter version of the proof, published as an article in 1930, titled "The completeness of the axioms of the functional calculus of logic" (in German)) is not easy to read today; it uses concepts and formalisms that are no longer used and terminology that is often obscure. The version given below attempts to represent all the steps in the proof and all the important ideas faithfully, while restating the proof in the modern language of mathematical logic. This outline should not be considered a rigorous proof of the theorem.

Assumptions

We work with first-order predicate calculus. Our languages allow constant, function and relation symbols. Structures consist of (non-empty) domains and interpretations of the relevant symbols as constant members, functions or relations over that domain.

We assume classical logic (as opposed to intuitionistic logic for example).

We fix some axiomatization (i.e. a syntax-based, machine-manageable proof system) of the predicate calculus: logical axioms and rules of inference. Any of the several well-known equivalent axiomatizations will do. Gödel's original proof assumed the Hilbert-Ackermann proof system.

We assume without proof all the basic well-known results about our formalism that we need, such as the normal form theorem or the soundness theorem.

We axiomatize predicate calculus without equality (sometimes confusingly called without identity), i.e. there are no special axioms expressing the properties of (object) equality as a special relation symbol. After the basic form of the theorem has been proved, it will be easy to extend it to the case of predicate calculus with equality.

Statement of the theorem and its proof

In the following, we state two equivalent forms of the theorem, and show their equivalence.

Later, we prove the theorem. This is done in the following steps:

  1. Reducing the theorem to sentences (formulas with no free variables) in prenex form, i.e. with all quantifiers ( and ) at the beginning. Furthermore, we reduce it to formulas whose first quantifier is . This is possible because for every sentence, there is an equivalent one in prenex form whose first quantifier is .
  2. Reducing the theorem to sentences of the form x1 ∀x2 ... ∀xk  ∃y1 ∃y2 ... ∃ym φ(x1 ... xk, y1 ... ym). While we cannot do this by simply rearranging the quantifiers, we show that it is yet enough to prove the theorem for sentences of that form.
  3. Finally we prove the theorem for sentences of that form.
    • This is done by first noting that a sentence such as B = ∀x1x2...∀xky1y2...∃ym φ(x1...xk, y1...ym) is either refutable (its negation is always true) or satisfiable, i.e. there is some model in which it holds (it might even be always true, i.e. a tautology); this model is simply assigning truth values to the subpropositions from which B is built. The reason for that is the completeness of propositional logic, with the existential quantifiers playing no role.
    • We extend this result to more and more complex and lengthy sentences, Dn (n = 1,2...), built out from B, so that either any of them is refutable and therefore so is φ, or all of them are not refutable and therefore each holds in some model.
    • We finally use the models in which the Dn hold (in case all are not refutable) in order to build a model in which φ holds.

Theorem 1. Every valid formula (true in all structures) is provable.

This is the most basic form of the completeness theorem. We immediately restate it in a form more convenient for our purposes: When we say "all structures", it is important to specify that the structures involved are classical (Tarskian) interpretations I, where I = <U,F> (U is a non-empty (possibly infinite) set of objects, whereas F is a set of functions from expressions of the interpreted symbolism into U). [By contrast, so-called "free logics" countenance possibly empty sets for U. For more regarding free logics, see the work of Karel Lambert.]

Theorem 2. Every formula φ is either refutable or satisfiable in some structure.

"φ is refutable" means by definitionφ is provable".

Equivalence of both theorems

If Theorem 1 holds, and φ is not satisfiable in any structure, then ¬φ is valid in all structures and therefore provable, thus φ is refutable and Theorem 2 holds. If on the other hand Theorem 2 holds and φ is valid in all structures, then ¬φ is not satisfiable in any structure and therefore refutable; then ¬¬φ is provable and then so is φ, thus Theorem 1 holds.

Proof of theorem 2: first step

We approach the proof of Theorem 2 by successively restricting the class of all formulas φ for which we need to prove "φ is either refutable or satisfiable". At the beginning we need to prove this for all possible formulas φ in our language. However, suppose that for every formula φ there is some formula ψ taken from a more restricted class of formulas C, such that "ψ is either refutable or satisfiable" → "φ is either refutable or satisfiable". Then, once this claim (expressed in the previous sentence) is proved, it will suffice to prove "φ is either refutable or satisfiable" only for φ's belonging to the class C. If φ is provably equivalent to ψ (i.e., (φ ≡ ψ) is provable), then it is indeed the case that "ψ is either refutable or satisfiable" → "φ is either refutable or satisfiable" (the soundness theorem is needed to show this).

There are standard techniques for rewriting an arbitrary formula into one that does not use function or constant symbols, at the cost of introducing additional quantifiers; we will therefore assume that all formulas are free of such symbols. Gödel's paper uses a version of first-order predicate calculus that has no function or constant symbols to begin with.

Next we consider a generic formula φ (which no longer uses function or constant symbols) and apply the prenex form theorem to find a formula ψ in normal form such that φ ≡ ψ (ψ being in normal form means that all the quantifiers in ψ, if there are any, are found at the very beginning of ψ). It follows now that we need only prove Theorem 2 for formulas φ in normal form.

Next, we eliminate all free variables from φ by quantifying them existentially: if, say, x1...xn are free in φ, we form [math]\displaystyle{ \psi = \exists x_1 \cdots \exists x_n \varphi }[/math]. If ψ is satisfiable in a structure M, then certainly so is φ and if ψ is refutable, then [math]\displaystyle{ \neg \psi = \forall x_1 \cdots \forall x_n \neg \varphi }[/math] is provable, and then so is ¬φ, thus φ is refutable. We see that we can restrict φ to be a sentence, that is, a formula with no free variables.

Finally, we would like, for reasons of technical convenience, that the prefix of φ (that is, the string of quantifiers at the beginning of φ, which is in normal form) begin with a universal quantifier and end with an existential quantifier. To achieve this for a generic φ (subject to restrictions we have already proved), we take some one-place relation symbol F unused in φ, and two new variables y and z.. If φ = (P)Φ, where (P) stands for the prefix of φ and Φ for the matrix (the remaining, quantifier-free part of φ) we form [math]\displaystyle{ \psi = \forall y (P) \exists z ( \Phi \wedge [ F(y) \vee \neg F(z) ] ) }[/math]. Since [math]\displaystyle{ \forall y \exists z ( F(y) \vee \neg F(z) ) }[/math] is clearly provable, it is easy to see that [math]\displaystyle{ \varphi=\psi }[/math] is provable.

Reducing the theorem to formulas of degree 1

Our generic formula φ now is a sentence, in normal form, and its prefix starts with a universal quantifier and ends with an existential quantifier. Let us call the class of all such formulas R. We are faced with proving that every formula in R is either refutable or satisfiable. Given our formula φ, we group strings of quantifiers of one kind together in blocks:

[math]\displaystyle{ \varphi = (\forall x_1 \cdots \forall x_{k_1})(\exists x_{k_1+1} \cdots \exists x_{k_2}) \cdots (\forall x_{k_{n-2}+1} \cdots \forall x_{k_{n-1}})(\exists x_{k_{n-1}+1} \cdots \exists x_{k_n}) (\Phi) }[/math]

We define the degree of [math]\displaystyle{ \varphi }[/math] to be the number of universal quantifier blocks, separated by existential quantifier blocks as shown above, in the prefix of [math]\displaystyle{ \varphi }[/math]. The following lemma, which Gödel adapted from Skolem's proof of the Löwenheim–Skolem theorem, lets us sharply reduce the complexity of the generic formula [math]\displaystyle{ \varphi }[/math] we need to prove the theorem for:

Lemma. Let k ≥ 1. If every formula in R of degree k is either refutable or satisfiable, then so is every formula in R of degree k + 1.

Comment: Take a formula φ of degree k + 1 of the form [math]\displaystyle{ \varphi = (\forall x)(\exists y)(\forall u)(\exist v) (P) \psi }[/math], where [math]\displaystyle{ (P)\psi }[/math] is the remainder of [math]\displaystyle{ \varphi }[/math] (it is thus of degree k − 1). φ states that for every x there is a y such that... (something). It would have been nice to have a predicate Q' so that for every x, Q′(x,y) would be true if and only if y is the required one to make (something) true. Then we could have written a formula of degree k, which is equivalent to φ, namely [math]\displaystyle{ (\forall x')(\forall x)(\forall y)(\forall u)(\exist v)(\exist y') (P) Q'(x',y') \wedge (Q'(x,y) \rightarrow \psi) }[/math]. This formula is indeed equivalent to φ because it states that for every x, if there is a y that satisfies Q'(x,y), then (something) holds, and furthermore, we know that there is such a y, because for every x', there is a y' that satisfies Q'(x',y'). Therefore φ follows from this formula. It is also easy to show that if the formula is false, then so is φ. Unfortunately, in general there is no such predicate Q'. However, this idea can be understood as a basis for the following proof of the Lemma.

Proof. Let φ be a formula of degree k + 1; then we can write it as

[math]\displaystyle{ \varphi = (\forall x)(\exists y)(\forall u)(\exist v) (P) \psi }[/math]

where (P) is the remainder of the prefix of [math]\displaystyle{ \varphi }[/math] (it is thus of degree k – 1) and [math]\displaystyle{ \psi }[/math] is the quantifier-free matrix of [math]\displaystyle{ \varphi }[/math]. x, y, u and v denote here tuples of variables rather than single variables; e.g. [math]\displaystyle{ (\forall x) }[/math] really stands for [math]\displaystyle{ \forall x_1 \forall x_2 \cdots \forall x_n }[/math] where [math]\displaystyle{ x_1 \ldots x_n }[/math] are some distinct variables.

Let now x' and y' be tuples of previously unused variables of the same length as x and y respectively, and let Q be a previously unused relation symbol that takes as many arguments as the sum of lengths of x and y; we consider the formula

[math]\displaystyle{ \Phi = (\forall x')(\exists y') Q(x',y') \wedge (\forall x)(\forall y)( Q(x,y) \rightarrow (\forall u)(\exist v)(P)\psi ) }[/math]

Clearly, [math]\displaystyle{ \Phi \rightarrow \varphi }[/math] is provable.

Now since the string of quantifiers [math]\displaystyle{ (\forall u)(\exists v)(P) }[/math] does not contain variables from x or y, the following equivalence is easily provable with the help of whatever formalism we're using:

[math]\displaystyle{ ( Q(x,y) \rightarrow (\forall u )(\exists v)(P) \psi) \equiv (\forall u)(\exists v)(P) ( Q(x,y) \rightarrow \psi ) }[/math]

And since these two formulas are equivalent, if we replace the first with the second inside Φ, we obtain the formula Φ' such that Φ≡Φ':

[math]\displaystyle{ \Phi' = (\forall x')(\exist y') Q(x',y') \wedge (\forall x)(\forall y) (\forall u)(\exists v)(P) ( Q(x,y) \rightarrow \psi ) }[/math]

Now Φ' has the form [math]\displaystyle{ (S)\rho \wedge (S')\rho' }[/math], where (S) and (S') are some quantifier strings, ρ and ρ' are quantifier-free, and, furthermore, no variable of (S) occurs in ρ' and no variable of (S') occurs in ρ. Under such conditions every formula of the form [math]\displaystyle{ (T)(\rho \wedge \rho') }[/math], where (T) is a string of quantifiers containing all quantifiers in (S) and (S') interleaved among themselves in any fashion, but maintaining the relative order inside (S) and (S'), will be equivalent to the original formula Φ'(this is yet another basic result in first-order predicate calculus that we rely on). To wit, we form Ψ as follows:

[math]\displaystyle{ \Psi = (\forall x')(\forall x)(\forall y) (\forall u)(\exists y')(\exists v)(P)Q(x',y') \wedge (Q(x,y) \rightarrow \psi ) }[/math]

and we have [math]\displaystyle{ \Phi' \equiv \Psi }[/math].

Now [math]\displaystyle{ \Psi }[/math] is a formula of degree k and therefore by assumption either refutable or satisfiable. If [math]\displaystyle{ \Psi }[/math] is satisfiable in a structure M, then, considering [math]\displaystyle{ \Psi \equiv \Phi' \equiv \Phi \wedge \Phi \rightarrow \varphi }[/math], we see that [math]\displaystyle{ \varphi }[/math] is satisfiable as well. If [math]\displaystyle{ \Psi }[/math] is refutable, then so is [math]\displaystyle{ \Phi }[/math], which is equivalent to it; thus [math]\displaystyle{ \neg \Phi }[/math] is provable.

In this particular case, we replace Q(x',y') in [math]\displaystyle{ \neg \Phi }[/math] with the formula [math]\displaystyle{ (\forall u)(\exists v)(P)\psi(x,y\mid x',y') }[/math]. Here (x,y | x',y') means that instead of ψ we are writing a different formula, in which x and y are replaced with x' and y'. Q(x,y) is simply replaced by [math]\displaystyle{ (\forall u)(\exists v)(P)\psi }[/math].

[math]\displaystyle{ \neg \Phi }[/math] then becomes

[math]\displaystyle{ \neg ( (\forall x')(\exists y') (\forall u)(\exists v)(P)\psi(x,y\mid x',y') \wedge (\forall x)(\forall y) ( (\forall u)(\exists v)(P)\psi \rightarrow (\forall u)(\exists v)(P) \psi ) ) }[/math]

and this formula is provable; since the part under negation and after the [math]\displaystyle{ \wedge }[/math] sign is obviously provable, and the part under negation and before the [math]\displaystyle{ \wedge }[/math] sign is obviously φ, just with x and y replaced by x' and y', we see that [math]\displaystyle{ \neg \varphi }[/math] is provable, and φ is refutable. We have proved that φ is either satisfiable or refutable, and this concludes the proof of the Lemma.

Notice that we could not have used [math]\displaystyle{ (\forall u)(\exists v)(P)\psi(x,y\mid x',y') }[/math] instead of Q(x',y') from the beginning, because [math]\displaystyle{ \Psi }[/math] would not have been a well-formed formula in that case. This is why we cannot naively use the argument appearing at the comment that precedes the proof.

Proving the theorem for formulas of degree 1

As shown by the Lemma above, we only need to prove our theorem for formulas φ in R of degree 1. φ cannot be of degree 0, since formulas in R have no free variables and don't use constant symbols. So the formula φ has the general form:

[math]\displaystyle{ (\forall x_1\ldots x_k)(\exists y_1\ldots y_m) \varphi(x_1\ldots x_k, y_1\ldots y_m). }[/math]

Now we define an ordering of the k-tuples of natural numbers as follows: [math]\displaystyle{ (x_1\ldots x_k) \lt (y_1\ldots y_k) }[/math] should hold if either [math]\displaystyle{ \Sigma_k (x_1\ldots x_k) \lt \Sigma_k (y_1\ldots y_k) }[/math], or [math]\displaystyle{ \Sigma_k (x_1\ldots x_k) = \Sigma_k (y_1\ldots y_k) }[/math], and [math]\displaystyle{ (x_1\ldots x_k) }[/math] precedes [math]\displaystyle{ (y_1...y_k) }[/math] in lexicographic order. [Here [math]\displaystyle{ \Sigma_k (x_1\ldots x_k) }[/math] denotes the sum of the terms of the tuple.] Denote the nth tuple in this order by [math]\displaystyle{ (a^n_1\ldots a^n_k) }[/math].

Set the formula [math]\displaystyle{ B_n }[/math] as [math]\displaystyle{ \varphi(z_{a^n_1}\ldots z_{a^n_k}, z_{(n-1)m+2}, z_{(n-1)m+3}\ldots z_{nm+1}) }[/math]. Then put [math]\displaystyle{ D_n }[/math] as

[math]\displaystyle{ (\exists z_1\ldots z_{nm+1}) (B_1 \wedge B_2 \wedge \cdots \wedge B_n). }[/math]

Lemma: For every n, [math]\displaystyle{ \varphi \rightarrow D_n }[/math].

Proof: By induction on n; we have [math]\displaystyle{ D_n \Leftarrow D_{n-1} \wedge (\forall z_1\ldots z_{(n-1)m+1})(\exists z_{(n-1)m+2}\ldots z_{nm+1}) B_n \Leftarrow D_{n-1} \wedge (\forall z_{a^n_1}\ldots z_{a^n_k})(\exists y_1\ldots y_m) \varphi(z_{a^n_1}\ldots z_{a^n_k}, y_1\ldots y_m) }[/math], where the latter implication holds by variable substitution, since the ordering of the tuples is such that [math]\displaystyle{ (\forall k)(a^n_1 \ldots a^n_k) \lt (n-1)m + 2 }[/math]. But the last formula is equivalent to [math]\displaystyle{ D_{n-1} \wedge }[/math]φ.

For the base case, [math]\displaystyle{ D_1 \equiv (\exists z_1\ldots z_{m+1}) \varphi(z_{a^1_1}\ldots z_{a^1_k}, z_2, z_3\ldots z_{m+1}) \equiv (\exists z_1\ldots z_{m+1}) \varphi(z_1\ldots z_1, z_2, z_3\ldots z_{m+1}) }[/math] is obviously a corollary of φ as well. So the Lemma is proven.

Now if [math]\displaystyle{ D_n }[/math] is refutable for some n, it follows that φ is refutable. On the other hand, suppose that [math]\displaystyle{ D_n }[/math] is not refutable for any n. Then for each n there is some way of assigning truth values to the distinct subpropositions [math]\displaystyle{ E_h }[/math] (ordered by their first appearance in [math]\displaystyle{ D_n }[/math]; "distinct" here means either distinct predicates, or distinct bound variables) in [math]\displaystyle{ B_k }[/math], such that [math]\displaystyle{ D_n }[/math] will be true when each proposition is evaluated in this fashion. This follows from the completeness of the underlying propositional logic.

We will now show that there is such an assignment of truth values to [math]\displaystyle{ E_h }[/math], so that all [math]\displaystyle{ D_n }[/math] will be true: The [math]\displaystyle{ E_h }[/math] appear in the same order in every [math]\displaystyle{ D_n }[/math]; we will inductively define a general assignment to them by a sort of "majority vote": Since there are infinitely many assignments (one for each [math]\displaystyle{ D_n }[/math]) affecting [math]\displaystyle{ E_1 }[/math], either infinitely many make [math]\displaystyle{ E_1 }[/math] true, or infinitely many make it false and only finitely many make it true. In the former case, we choose [math]\displaystyle{ E_1 }[/math] to be true in general; in the latter we take it to be false in general. Then from the infinitely many n for which [math]\displaystyle{ E_1 }[/math] through [math]\displaystyle{ E_{h-1} }[/math] are assigned the same truth value as in the general assignment, we pick a general assignment to [math]\displaystyle{ E_h }[/math] in the same fashion.

This general assignment must lead to every one of the [math]\displaystyle{ B_k }[/math] and [math]\displaystyle{ D_k }[/math] being true, since if one of the [math]\displaystyle{ B_k }[/math] were false under the general assignment, [math]\displaystyle{ D_n }[/math] would also be false for every n > k. But this contradicts the fact that for the finite collection of general [math]\displaystyle{ E_h }[/math] assignments appearing in [math]\displaystyle{ D_k }[/math], there are infinitely many n where the assignment making [math]\displaystyle{ D_n }[/math] true matches the general assignment.

From this general assignment, which makes all of the [math]\displaystyle{ D_k }[/math] true, we construct an interpretation of the language's predicates that makes φ true. The universe of the model will be the natural numbers. Each i-ary predicate [math]\displaystyle{ \Psi }[/math] should be true of the naturals [math]\displaystyle{ (u_1\ldots u_i) }[/math] precisely when the proposition [math]\displaystyle{ \Psi(z_{u_1}\ldots z_{u_i}) }[/math] is either true in the general assignment, or not assigned by it (because it never appears in any of the [math]\displaystyle{ D_k }[/math]).

In this model, each of the formulas [math]\displaystyle{ (\exists y_1\ldots y_m) \varphi(a^n_1\ldots a^n_k, y_1...y_m) }[/math] is true by construction. But this implies that φ itself is true in the model, since the [math]\displaystyle{ a^n }[/math] range over all possible k-tuples of natural numbers. So φ is satisfiable, and we are done.

Intuitive explanation

We may write each Bi as Φ(x1...xk,y1...ym) for some xs, which we may call "first arguments" and ys that we may call "last arguments".

Take B1 for example. Its "last arguments" are z2,z3...zm+1, and for every possible combination of k of these variables there is some j so that they appear as "first arguments" in Bj. Thus for large enough n1, Dn1 has the property that the "last arguments" of B1 appear, in every possible combinations of k of them, as "first arguments" in other Bjs within Dn. For every Bi there is a Dni with the corresponding property.

Therefore in a model that satisfies all the Dns, there are objects corresponding to z1, z2... and each combination of k of these appear as "first arguments" in some Bj, meaning that for every k of these objects zp1...zpk there are zq1...zqm, which makes Φ(zp1...zpk,zq1...zqm) satisfied. By taking a submodel with only these z1, z2... objects, we have a model satisfying φ.

Extensions

Extension to first-order predicate calculus with equality

Gödel reduced a formula containing instances of the equality predicate to ones without it in an extended language. His method involves replacing a formula φ containing some instances of equality with the formula

[math]\displaystyle{ (\forall x) Eq(x, x) \wedge (\forall x,y,z) [Eq(x, y) \rightarrow (Eq(x, z) \rightarrow Eq(y, z))] }[/math] [math]\displaystyle{ \wedge (\forall x,y,z) [Eq(x, y) \rightarrow (Eq(z, x) \rightarrow Eq(z, y))] }[/math]
[math]\displaystyle{ \wedge }[/math]
[math]\displaystyle{ (\forall x_1\ldots x_k, y_1\ldots x_k) [(Eq(x_1, y_1) \wedge \cdots \wedge Eq(x_k, y_k)) \rightarrow (A(x_1\ldots x_k) \equiv A(y_1\ldots y_k))] }[/math]
[math]\displaystyle{ \wedge \cdots \wedge }[/math]
[math]\displaystyle{ (\forall x_1\ldots x_m, y_1\ldots x_m) [(Eq(x_1, y_1) \wedge \cdots \wedge Eq(x_m, y_m)) \rightarrow (Z(x_1\ldots x_m) \equiv Z(y_1\ldots y_m))] }[/math]
[math]\displaystyle{ \wedge }[/math]
[math]\displaystyle{ \varphi'. }[/math]

Here [math]\displaystyle{ A \ldots Z }[/math] denote the predicates appearing in φ (with [math]\displaystyle{ k \ldots m }[/math] their respective arities), and φ' is the formula φ with all occurrences of equality replaced with the new predicate Eq. If this new formula is refutable, the original φ was as well; the same is true of satisfiability, since we may take a quotient of satisfying model of the new formula by the equivalence relation representing Eq. This quotient is well-defined with respect to the other predicates, and therefore will satisfy the original formula φ.

Extension to countable sets of formulas

Gödel also considered the case where there are a countably infinite collection of formulas. Using the same reductions as above, he was able to consider only those cases where each formula is of degree 1 and contains no uses of equality. For a countable collection of formulas [math]\displaystyle{ \varphi^i }[/math] of degree 1, we may define [math]\displaystyle{ B^i_k }[/math] as above; then define [math]\displaystyle{ D_k }[/math] to be the closure of [math]\displaystyle{ B^1_1\ldots B^1_k, \ldots , B^k_1\ldots B^k_k }[/math]. The remainder of the proof then went through as before.

Extension to arbitrary sets of formulas

When there is an uncountably infinite collection of formulas, the Axiom of Choice (or at least some weak form of it) is needed. Using the full AC, one can well-order the formulas, and prove the uncountable case with the same argument as the countable one, except with transfinite induction. Other approaches can be used to prove that the completeness theorem in this case is equivalent to the Boolean prime ideal theorem, a weak form of AC.

References

  • Über die Vollständigkeit des Logikkalküls. Doctoral dissertation. University Of Vienna.. 1929.  The first proof of the completeness theorem.
  • "Die Vollständigkeit der Axiome des logischen Funktionenkalküls" (in de). Monatshefte für Mathematik 37 (1): 349–360. 1930. doi:10.1007/BF01696781.  The same material as the dissertation, except with briefer proofs, more succinct explanations, and omitting the lengthy introduction.

External links