Multiresolution analysis

Short description: Design method of discrete wavelet transforms

A multiresolution analysis (MRA) or multiscale approximation (MSA) is the design method of most of the practically relevant discrete wavelet transforms (DWT) and the justification for the algorithm of the fast wavelet transform (FWT). It was introduced in this context in 1988/89 by Stephane Mallat and Yves Meyer and has predecessors in the microlocal analysis in the theory of differential equations (the ironing method) and the pyramid methods of image processing as introduced in 1981/83 by Peter J. Burt, Edward H. Adelson and James L. Crowley.

Definition

A multiresolution analysis of the Lebesgue space [math]\displaystyle{ L^2(\mathbb{R}) }[/math] consists of a sequence of nested subspaces

[math]\displaystyle{ \{0\}\dots\subset V_1\subset V_0\subset V_{-1}\subset\dots\subset V_{-n}\subset V_{-(n+1)}\subset\dots\subset L^2(\R) }[/math]

that satisfies certain self-similarity relations in time-space and scale-frequency, as well as completeness and regularity relations.

• Self-similarity in time demands that each subspace V_k is invariant under shifts by integer multiples of 2^k. That is, for each [math]\displaystyle{ f\in V_k,\; m\in\Z }[/math] the function g defined as [math]\displaystyle{ g(x)=f(x-m2^{k}) }[/math] also contained in [math]\displaystyle{ V_k }[/math].
• Self-similarity in scale demands that all subspaces [math]\displaystyle{ V_k\subset V_l,\; k\gt l, }[/math] are time-scaled versions of each other, with scaling respectively dilation factor 2^k-l. I.e., for each [math]\displaystyle{ f\in V_k }[/math] there is a [math]\displaystyle{ g\in V_l }[/math] with [math]\displaystyle{ \forall x\in\R:\;g(x)=f(2^{k-l}x) }[/math].
• In the sequence of subspaces, for k>l the space resolution 2^l of the l-th subspace is higher than the resolution 2^k of the k-th subspace.
• Regularity demands that the model subspace V₀ be generated as the linear hull (algebraically or even topologically closed) of the integer shifts of one or a finite number of generating functions [math]\displaystyle{ \phi }[/math] or [math]\displaystyle{ \phi_1,\dots,\phi_r }[/math]. Those integer shifts should at least form a frame for the subspace [math]\displaystyle{ V_0\subset L^2(\R) }[/math], which imposes certain conditions on the decay at infinity. The generating functions are also known as scaling functions or father wavelets. In most cases one demands of those functions to be piecewise continuous with compact support.
• Completeness demands that those nested subspaces fill the whole space, i.e., their union should be dense in [math]\displaystyle{ L^2(\R) }[/math], and that they are not too redundant, i.e., their intersection should only contain the zero element.

Important conclusions

In the case of one continuous (or at least with bounded variation) compactly supported scaling function with orthogonal shifts, one may make a number of deductions. The proof of existence of this class of functions is due to Ingrid Daubechies.

Assuming the scaling function has compact support, then [math]\displaystyle{ V_0\subset V_{-1} }[/math] implies that there is a finite sequence of coefficients [math]\displaystyle{ a_k=2 \langle\phi(x),\phi(2x-k)\rangle }[/math] for [math]\displaystyle{ |k|\leq N }[/math], and [math]\displaystyle{ a_k=0 }[/math] for [math]\displaystyle{ |k|\gt N }[/math], such that

[math]\displaystyle{ \phi(x)=\sum_{k=-N}^N a_k\phi(2x-k). }[/math]

Defining another function, known as mother wavelet or just the wavelet

[math]\displaystyle{ \psi(x):=\sum_{k=-N}^N (-1)^k a_{1-k}\phi(2x-k), }[/math]

one can show that the space [math]\displaystyle{ W_0\subset V_{-1} }[/math], which is defined as the (closed) linear hull of the mother wavelet's integer shifts, is the orthogonal complement to [math]\displaystyle{ V_0 }[/math] inside [math]\displaystyle{ V_{-1} }[/math]. Or put differently, [math]\displaystyle{ V_{-1} }[/math] is the orthogonal sum (denoted by [math]\displaystyle{ \oplus }[/math]) of [math]\displaystyle{ W_0 }[/math] and [math]\displaystyle{ V_0 }[/math]. By self-similarity, there are scaled versions [math]\displaystyle{ W_k }[/math] of [math]\displaystyle{ W_0 }[/math] and by completeness one has

[math]\displaystyle{ L^2(\R)=\mbox{closure of }\bigoplus_{k\in\Z}W_k, }[/math]

thus the set

[math]\displaystyle{ \{\psi_{k,n}(x)=\sqrt2^{-k}\psi(2^{-k}x-n):\;k,n\in\Z\} }[/math]

is a countable complete orthonormal wavelet basis in [math]\displaystyle{ L^2(\R) }[/math].

See also

• Multigrid method
• Multiscale modeling
• Scale space
• Time–frequency analysis
• Wavelet

References

• Chui, Charles K. (1992). An Introduction to Wavelets. San Diego: Academic Press. ISBN 0-585-47090-1. 
• Akansu, A.N.; Haddad, R.A. (1992). Multiresolution signal decomposition: transforms, subbands, and wavelets. Academic Press. ISBN 978-0-12-047141-6. 
• Crowley, J. L., (1982). A Representations for Visual Information, Doctoral Thesis, Carnegie-Mellon University, 1982.
• Burrus, C.S.; Gopinath, R.A.; Guo, H. (1997). Introduction to Wavelets and Wavelet Transforms: A Primer. Prentice-Hall. ISBN 0-13-489600-9. 
• Mallat, S.G. (1999). A Wavelet Tour of Signal Processing. Academic Press. ISBN 0-12-466606-X. http://www.cmap.polytechnique.fr/~mallat/book.html.