Velocity Moments
In the field of computer vision, velocity moments are weighted averages of the intensities of pixels in a sequence of images, similar to image moments but in addition to describing an object's shape also describe its motion through the sequence of images. Velocity moments can be used to aid automated identification of a shape in an image when information about the motion is significant in its description. There are currently two established versions of velocity moments: Cartesian[1] and Zernike.[2]
Cartesian velocity moments
Cartesian moments for single images
A Cartesian moment of a single image is calculated by
- [math]\displaystyle{ m_{pq} = \sum_{x=1}^M \sum_{y=1}^N x^p y^q P_{xy} }[/math]
where [math]\displaystyle{ M }[/math] and [math]\displaystyle{ N }[/math] are the dimensions of the image, [math]\displaystyle{ P_{xy} }[/math] is the intensity of the pixel at the point [math]\displaystyle{ (x,y) }[/math] in the image, and [math]\displaystyle{ x^p y^q }[/math] is the basis function.
Cartesian velocity moments for sequences of images
Cartesian velocity moments are based on these Cartesian moments. A Cartesian velocity moment [math]\displaystyle{ vm_{pq\mu\gamma} }[/math] is defined by
- [math]\displaystyle{ vm_{pq\mu\gamma} = \sum_{i=2}^{images} \sum_{x=1}^M \sum_{y=1}^N U(i,\mu,\gamma) C(i,p,g) P_{i_{xy}} }[/math]
where [math]\displaystyle{ M }[/math] and [math]\displaystyle{ N }[/math] are again the dimensions of the image, [math]\displaystyle{ images }[/math] is the number of images in the sequence, and [math]\displaystyle{ P_{i_{xy}} }[/math] is the intensity of the pixel at the point [math]\displaystyle{ (x,y) }[/math] in image [math]\displaystyle{ i }[/math].
[math]\displaystyle{ C(i,p,q) }[/math] is taken from Central moments, added so the equation is translation invariant, defined as
- [math]\displaystyle{ C(i,p,q) = (x-\overline{x_i})^p (y-\overline{y_i})^q }[/math]
where [math]\displaystyle{ \overline{x_i} }[/math] is the [math]\displaystyle{ x }[/math] coordinate of the centre of mass for image [math]\displaystyle{ i }[/math], and similarly for [math]\displaystyle{ y }[/math].
[math]\displaystyle{ U(i,\mu,\gamma) }[/math] introduces velocity into the equation as
- [math]\displaystyle{ U(i,\mu,\gamma) = (\overline{x_i}-\overline{x_{i-1}})^\mu (\overline{y_i}-\overline{y_{i-1}})^\gamma }[/math]
where [math]\displaystyle{ \overline{x_{i-1}} }[/math] is the [math]\displaystyle{ x }[/math] coordinate of the centre of mass for the previous image, [math]\displaystyle{ i-1 }[/math], and again similarly for [math]\displaystyle{ y }[/math].
After the Cartesian velocity moment is calculated, it can be normalised by
- [math]\displaystyle{ \overline{vm_{pq\mu\gamma}} = \frac {vm_{pq\mu\gamma}}{A * I} }[/math]
where [math]\displaystyle{ A }[/math] is the average area of the object, in pixels, and [math]\displaystyle{ I }[/math] is the number of images. Now the value is not affected by the number of images in the sequence or the size of the object.
As Cartesian moments are non-orthogonal, so are Cartesian velocity moments, so different moments can be closely correlated. These velocity moments do however provide translation and scale invariance (unless the scale changes within the sequence of images).
Zernike velocity moments
Zernike moments for single images
A Zernike moment of a single image is calculated by
- [math]\displaystyle{ A_{mn} = \frac {m + 1}\pi \sum_x \sum_y [V_{mn}(r,\theta)]^* P_{xy} }[/math]
where [math]\displaystyle{ ^* }[/math] denotes the complex conjugate, [math]\displaystyle{ m }[/math] is an integer between [math]\displaystyle{ 0 }[/math] and [math]\displaystyle{ \infty }[/math], and [math]\displaystyle{ n }[/math] is an integer such that [math]\displaystyle{ m - |n| }[/math] is even and [math]\displaystyle{ |n| \lt m }[/math]. For calculating Zernike moments, the image, or section of the image which is of interest is mapped to the unit disc, then [math]\displaystyle{ P_{xy} }[/math] is the intensity of the pixel at the point [math]\displaystyle{ (x,y) }[/math] on the disc and [math]\displaystyle{ x^2 + y^2 \le 1 }[/math] is a restriction on values of [math]\displaystyle{ x }[/math] and [math]\displaystyle{ y }[/math]. The coordinates are then mapped to polar coordinates, and [math]\displaystyle{ r }[/math] and [math]\displaystyle{ \theta }[/math] are the polar coordinates of the point [math]\displaystyle{ (x,y) }[/math] on the unit disc map.
[math]\displaystyle{ V_{mn}(r,\theta) }[/math] is derived from Zernike polynomials and is defined by
- [math]\displaystyle{ V_{mn}(r,\theta) = R_{mn}(r)e^{jn\theta} }[/math]
- [math]\displaystyle{ R_{mn}(r) = \sum_{s=0}^{\frac {m-|n|}2} (-1)^s F(m,n,s,r) }[/math]
- [math]\displaystyle{ F(m,n,s,r) = \frac {(m-s)!} {s! (\frac {m+|n|}2-s)! (\frac {m-|n|}2-s)!} r^{m-2s} }[/math]
Zernike velocity moments for sequences of images
Zernike velocity moments are based on these Zernike moments. A Zernike velocity moment [math]\displaystyle{ A_{mn\mu\gamma} }[/math] is defined by
- [math]\displaystyle{ A_{mn\mu\gamma} = \frac {m + 1}\pi \sum_{i=2}^{images} \sum_{x=1} \sum_{y=1} U(i,\mu,\gamma) [V_{mn}(r,\theta)]^* P_{i_{xy}} }[/math]
where [math]\displaystyle{ images }[/math] is again the number of images in the sequence, and [math]\displaystyle{ P_{i_{xy}} }[/math] is the intensity of the pixel at the point [math]\displaystyle{ (x,y) }[/math] on the unit disc mapped from image [math]\displaystyle{ i }[/math].
[math]\displaystyle{ U(i,\mu,\gamma) }[/math] introduces velocity into the equation in the same way as in the Cartesian velocity moments and [math]\displaystyle{ [V_{mn}(r,\theta)]^* }[/math] is from the Zernike moments equation above.
Like the Cartesian velocity moments, Zernike velocity moments can be normalised by
- [math]\displaystyle{ \overline{A_{mn\mu\gamma}} = \frac {A_{mn\mu\gamma}}{A * I} }[/math]
where [math]\displaystyle{ A }[/math] is the average area of the object, in pixels, and [math]\displaystyle{ I }[/math] is the number of images.
As Zernike velocity moments are based on the orthogonal Zernike moments, they produce less correlated and more compact descriptions than Cartesian velocity moments. Zernike velocity moments also provide translation and scale invariance (even when the scale changes within the sequence).
Comparison of methods
| Velocity moment type | Translation invariance | Scale invariance | Orthogonal |
|---|---|---|---|
| Cartesian | Yes | Yes (if the object does not change scale within the sequence) | No |
| Zernike | Yes | Yes | Yes |
References
- ↑ J. D. Shutler, M. S. Nixon, C. J. Harris, "Statistical Gait Description via Temporal Moments", Proc. SSIAI 2000 - Austin, Texas, :pp. 291-295, 2000
- ↑ J. D. Shutler and M. S. Nixon, "Zernike Velocity Moments for Description and Recognition of Moving Shapes", Proc. BMVC 2001, Manchester, UK, 2:pp. 705-714, 2001
External links
 |  |
