Local pixel grouping

In image Noise reduction, local pixel grouping is the algorithm to remove noise from images using principal component analysis (PCA).

Image denoising

Sensors such as CCD, CMOS or ultrasonic probe may encapsulate noise signal. Noise reduction is commonly used to improve quality of the image. However, techniques such as smoothing filters and many other algorithms may lose local structure of image while denoising the image. More over, efficiency is also taken into consideration.

Principal component analysis

PCA was invented in 1901 by Karl Pearson, to transform original dataset into linearly uncorrelated PCA domain. PCA works in the way that principal components with larger possible variance are preserved while discarding low variance components.

Image denoising by principal component analysis with local pixel grouping(LPG-PCA) was developed by Lei et. in 2010. It is based on the assumption that the energy of a signal will concentrate on a small subset of the PCA transformed dataset, while the energy of noise will evenly spread over the whole dataset. Assume original image is denoted by [math]\displaystyle{ I }[/math] and noise is denoted by [math]\displaystyle{ v }[/math], then the measured image will be [math]\displaystyle{ I_{v} = I + v }[/math]. In order to denoising [math]\displaystyle{ I_{v} }[/math], first a train dataset [math]\displaystyle{ X_{v} }[/math] must be constructed using local pixel group. Using this [math]\displaystyle{ X_{v} }[/math] and apply PCA the noise in the image can be reduced.

Construct local pixel group

For each pixel [math]\displaystyle{ px }[/math] in the image, select a [math]\displaystyle{ K\times K }[/math] window centered at [math]\displaystyle{ px }[/math] denoted by

[math]\displaystyle{ x=[x_{1} ... x_{m}]^{\rm T}, m=K^{2} }[/math]

and a training window centered at [math]\displaystyle{ px }[/math]. The training window is [math]\displaystyle{ L\times L, L\gt K }[/math]. Take the pixels in each possible [math]\displaystyle{ K\times K }[/math] block within the [math]\displaystyle{ L\times L }[/math] training block yields [math]\displaystyle{ (L-K+1)^{2} }[/math] samples [math]\displaystyle{ \overrightarrow{x_{i}}^{\rm v} }[/math]. If the distance between a sample and the center window [math]\displaystyle{ \overrightarrow{x_{0}}^{\rm v} }[/math] is smaller than some threshold, then accept the sample. So the train dataset [math]\displaystyle{ X_{v} }[/math] is acquired by put all the accepted sample together as column vectors into a matrix.

Denoising using local pixel group

First step of this part is centralize [math]\displaystyle{ X_{v} }[/math] and [math]\displaystyle{ \overline{X_{v}} }[/math] is obtained. By computing the covariance matrix of [math]\displaystyle{ \overline{X_{v}} }[/math] denoted by [math]\displaystyle{ \Omega_{\overline{x}} }[/math], the PCA transformation matrix [math]\displaystyle{ P_{\overline{x}} }[/math] can be obtained. Apply [math]\displaystyle{ P_{\overline{x}} }[/math] to [math]\displaystyle{ \overline{X_{v}} }[/math] we have

[math]\displaystyle{ \overline{Y_{v}} = P_{\overline{x}} \overline{X_{v}} }[/math]

The covariance matrix of [math]\displaystyle{ \overline{Y_{v}} }[/math] can also be calculated by

[math]\displaystyle{ \Omega_{\overline{y_{v}}} = \frac{1}{n}\overline{Y_{v}}\ \overline{Y_{v}}^{\rm T} }[/math]

Shrink the coefficient of [math]\displaystyle{ \Omega_{\overline{y}_{v}} }[/math] by

[math]\displaystyle{ \hat{\overrightarrow{\overline{Y}}}_{k} = w_{k}\ \overrightarrow{\overline{Y}}_{v}^{k} }[/math]

[math]\displaystyle{ w_{k} = \frac{\Omega_{\overline{y}}(k,k)}{\Omega_{\overline{y}}(k,k) + \Omega_{v_{y}}(k,k)} }[/math]

and transform back to [math]\displaystyle{ \hat{\overline{X}} }[/math], the noise in that pixel is reduced. Apply this to all the pixels in the image and the denoised image can be obtained. Experiments by Lei show that LGP-PCA can effectively preserve the image fine structures while smoothing noise. The solution is competitive compared with other algorithms such as Block-matching algorithm.

External links

• Lei's homepage and matlab code of LPG-PCA