Multiresolution Expansions

Multiresolution expansions form a powerful mathematical framework for analyzing, approximating, and representing functions or signals at varying levels of detail. Rooted in the theory of wavelets and functional analysis, they provide a systematic way to decompose a signal into components that capture features at different scales. This multiscale representation is particularly valuable in applications where data exhibits both global and local characteristics, such as image processing, signal compression, and numerical solutions of differential equations.

The essence of multiresolution expansions lies in constructing a hierarchy of spaces, each corresponding to a different resolution level. These spaces are typically spanned by functions derived from a mother wavelet and its dilations and translations. By leveraging these spaces, one can achieve both efficient data representation and precise control over the trade-off between resolution and computational complexity.

Applications of multiresolution expansions span numerous domains, including image compression techniques like JPEG2000, denoising methods, and multi-scale simulations in physics and engineering. Their adaptability and computational efficiency make them indispensable tools in modern scientific and technological contexts.

1. Series Expansions and Function Spaces

A multiresolution analysis (MRA) constructs a signal through a sequence of function spaces, each representing a different resolution. Consider a function f(x)f(x), which can be approximated as a linear combination of basis functions:

f(x)=kakϕk(x)f(x) = \sum_{k} a_k \phi_k(x)

where ϕk(x)\phi_k(x) are the basis functions and aka_k are the expansion coefficients. This expansion enables the representation of the function in various resolutions, typically from coarser to finer.

The space of functions that can be expressed this way is referred to as a function space, typically denoted by VjV_j, where jj corresponds to the level of resolution. For a finer resolution, you get smaller details, while for coarser resolutions, only the broad features of the function are captured.

2. Nested Subspaces and Multiresolution Property

MRE uses nested subspaces where each finer resolution contains the coarser one:

V1V0V1\dots \subset V_{-1} \subset V_0 \subset V_1 \subset \dots

This nesting property means that functions in a higher-resolution space can approximate finer details. At each level jj, the approximation space VjV_j contains the approximation at the previous level Vj1V_{j-1}, along with additional detail captured in a wavelet space WjW_j.

The relationship between these spaces is fundamental:

Vj+1=VjWjV_{j+1} = V_j \oplus W_j

where \oplus denotes the direct sum, meaning that Vj+1V_{j+1} contains both the approximation at resolution jj and the details at resolution j+1j+1.

3. Scaling Functions and Wavelet Functions

In MRA, two types of functions are essential: scaling functions ϕ(x)\phi(x) and wavelet functions ψ(x)\psi(x).

  • The scaling function ϕ(x)\phi(x) generates the approximation spaces VjV_j through integer translations and dyadic scalings:

    ϕj,k(x)=2j/2ϕ(2jxk)\phi_{j,k}(x) = 2^{j/2} \phi(2^j x – k)

    where kk translates the function, and jj controls the resolution.

  • The wavelet function ψ(x)\psi(x) is used to represent the detail spaces WjW_j. It captures the differences between consecutive levels of resolution:

    ψj,k(x)=2j/2ψ(2jxk)\psi_{j,k}(x) = 2^{j/2} \psi(2^j x – k)

The scaling function ϕ(x)\phi(x) approximates the signal at a coarse level, while the wavelet function ψ(x)\psi(x) refines this approximation by adding details.

4. Orthonormal and Biorthogonal Bases

In many cases, the basis functions ϕ(x)\phi(x) and ψ(x)\psi(x) form an orthonormal basis, meaning they are orthogonal and normalized:

ϕ(xk),ϕ(xl)=δkl\langle \phi(x – k), \phi(x – l) \rangle = \delta_{kl}

where δkl\delta_{kl} is the Kronecker delta, equal to 1 if k=lk = l, and 0 otherwise. This property simplifies the computation of coefficients in the series expansion.

In other cases, wavelets can form biorthogonal bases, where the basis functions are not orthonormal, but they still allow signal reconstruction. The dual functions, denoted ϕ~(x)\tilde{\phi}(x) and ψ~(x)\tilde{\psi}(x), form a basis for reconstruction, while the original functions are used for decomposition.

5. Refinement Equation

A critical part of MRA is the refinement equation, which defines the scaling function in terms of a sum of scaled and translated versions of itself:

ϕ(x)=khkϕ(2xk)\phi(x) = \sum_{k} h_k \phi(2x – k)

where hkh_k are the scaling coefficients, which act as low-pass filters. This equation reflects how a function at one resolution can be built from finer resolution components. Similarly, the wavelet function can be defined as:

ψ(x)=kgkϕ(2xk)\psi(x) = \sum_{k} g_k \phi(2x – k)

where gkg_k are the wavelet coefficients, often corresponding to high-pass filtering.

6. Wavelet Transform

The Discrete Wavelet Transform (DWT) is a key application of multiresolution analysis, used to decompose a signal into approximation and detail components at various scales. The DWT recursively applies the scaling and wavelet functions, resulting in a hierarchical, multiscale representation.

A signal f(x)f(x) can be expressed using both scaling and wavelet coefficients:

f(x)=kaj,kϕj,k(x)+j=0kdj,kψj,k(x)f(x) = \sum_{k} a_{j,k} \phi_{j,k}(x) + \sum_{j=0}^{\infty} \sum_{k} d_{j,k} \psi_{j,k}(x)

where aj,ka_{j,k} are the approximation coefficients at scale jj, and dj,kd_{j,k} are the detail coefficients. The higher the resolution, the more detailed the information that wavelets capture.

7. Wavelet Decomposition and Reconstruction

MRE provides a framework for wavelet decomposition, where a signal is broken down into its approximation and detail components at various scales. This process can be inverted through reconstruction, allowing the original signal to be recovered from its multiresolution components.

In image processing, for instance, this decomposition allows images to be stored and transmitted efficiently by keeping only the essential approximation and detail coefficients.

Example: Haar Wavelet

The Haar wavelet is one of the simplest wavelets used in MRA. The Haar scaling function ϕ(x)\phi(x) and wavelet function ψ(x)\psi(x) are defined as:

ϕ(x)={10x<10otherwise\phi(x) = \begin{cases} 1 & 0 \leq x < 1 \\ 0 & \text{otherwise} \end{cases} ψ(x)={10x<0.510.5x<10otherwise\psi(x) = \begin{cases} 1 & 0 \leq x < 0.5 \\ -1 & 0.5 \leq x < 1 \\ 0 & \text{otherwise} \end{cases}

These functions decompose a signal into coarse and fine components, making them suitable for fast computation, though more advanced wavelets (like Daubechies wavelets) provide smoother decompositions.

References

  • Gonzalez, Rafael C., and Richard E. Woods. Digital Image Processing, 3rd Edition. Pearson, 2008. Chapter 7: “Wavelets and Multiresolution Processing”.

Leave a Comment