Signal reconstruction

Short description: Important subject of signal processing and engineering

In signal processing, reconstruction usually means the determination of an original continuous signal from a sequence of equally spaced samples.

This article takes a generalized abstract mathematical approach to signal sampling and reconstruction. For a more practical approach based on band-limited signals, see Whittaker–Shannon interpolation formula.

General principle

Let F be any sampling method, i.e. a linear map from the Hilbert space of square-integrable functions [math]\displaystyle{ L^2 }[/math] to complex space [math]\displaystyle{ \mathbb C^n }[/math].

In our example, the vector space of sampled signals [math]\displaystyle{ \mathbb C^n }[/math] is n-dimensional complex space. Any proposed inverse R of F (reconstruction formula, in the lingo) would have to map [math]\displaystyle{ \mathbb C^n }[/math] to some subset of [math]\displaystyle{ L^2 }[/math]. We could choose this subset arbitrarily, but if we're going to want a reconstruction formula R that is also a linear map, then we have to choose an n-dimensional linear subspace of [math]\displaystyle{ L^2 }[/math].

This fact that the dimensions have to agree is related to the Nyquist–Shannon sampling theorem.

The elementary linear algebra approach works here. Let [math]\displaystyle{ d_k:=(0,...,0,1,0,...,0) }[/math] (all entries zero, except for the kth entry, which is a one) or some other basis of [math]\displaystyle{ \mathbb C^n }[/math]. To define an inverse for F, simply choose, for each k, an [math]\displaystyle{ e_k \in L^2 }[/math] so that [math]\displaystyle{ F(e_k)=d_k }[/math]. This uniquely defines the (pseudo-)inverse of F.

Of course, one can choose some reconstruction formula first, then either compute some sampling algorithm from the reconstruction formula, or analyze the behavior of a given sampling algorithm with respect to the given formula.

Ideally, the reconstruction formula is derived by minimizing the expected error variance. This requires that either the signal statistics is known or a prior probability for the signal can be specified. Information field theory is then an appropriate mathematical formalism to derive an optimal reconstruction formula.

Popular reconstruction formulae

Perhaps the most widely used reconstruction formula is as follows. Let [math]\displaystyle{ \{ e_k \} }[/math] be a basis of [math]\displaystyle{ L^2 }[/math] in the Hilbert space sense; for instance, one could use the eikonal

[math]\displaystyle{ e_k(t):=e^{2\pi i k t}\, }[/math],

although other choices are certainly possible. Note that here the index k can be any integer, even negative.

Then we can define a linear map R by

[math]\displaystyle{ R(d_k)=e_k\, }[/math]

for each [math]\displaystyle{ k=\lfloor -n/2 \rfloor,...,\lfloor (n-1)/2 \rfloor }[/math], where [math]\displaystyle{ (d_k) }[/math] is the basis of [math]\displaystyle{ \mathbb C^n }[/math] given by

[math]\displaystyle{ d_k(j)=e^{2 \pi i j k \over n} }[/math]

(This is the usual discrete Fourier basis.)

The choice of range [math]\displaystyle{ k=\lfloor -n/2 \rfloor,...,\lfloor (n-1)/2 \rfloor }[/math] is somewhat arbitrary, although it satisfies the dimensionality requirement and reflects the usual notion that the most important information is contained in the low frequencies. In some cases, this is incorrect, so a different reconstruction formula needs to be chosen.

A similar approach can be obtained by using wavelets instead of Hilbert bases. For many applications, the best approach is still not clear today.

See also

• Aliasing
• Nyquist–Shannon sampling theorem
• Whittaker–Shannon interpolation formula