Smith normal form

Short description: Matrix normal form

In mathematics, the Smith normal form (sometimes abbreviated SNF) is a normal form that can be defined for any matrix (not necessarily square) with entries in a principal ideal domain (PID). The Smith normal form of a matrix is diagonal, and can be obtained from the original matrix by multiplying on the left and right by invertible square matrices. In particular, the integers are a PID, so one can always calculate the Smith normal form of an integer matrix. The Smith normal form is very useful for working with finitely generated modules over a PID, and in particular for deducing the structure of a quotient of a free module. It is named after the Irish mathematician Henry John Stephen Smith.

Definition

Let A be a nonzero m×n matrix over a principal ideal domain R. There exist invertible [math]\displaystyle{ m \times m }[/math] and [math]\displaystyle{ n \times n }[/math]-matrices S, T (with coefficients in R) such that the product S A T is

[math]\displaystyle{ \begin{pmatrix} \alpha_1 & 0 & 0 & \cdots & 0 & \cdots & 0 \\ 0 & \alpha_2 & 0 & & & & \\ 0 & 0 & \ddots & & \vdots & & \vdots\\ \vdots & & & \alpha_r & & & \\ 0 & & \cdots & & 0 & \cdots & 0 \\ \vdots & & & & \vdots & & \vdots \\ 0 & & \cdots & & 0 & \cdots & 0 \end{pmatrix}. }[/math]

and the diagonal elements [math]\displaystyle{ \alpha_i }[/math] satisfy [math]\displaystyle{ \alpha_i \mid \alpha_{i+1} }[/math] for all [math]\displaystyle{ 1 \le i \lt r }[/math]. This is the Smith normal form of the matrix A. The elements [math]\displaystyle{ \alpha_i }[/math] are unique up to multiplication by a unit and are called the elementary divisors, invariants, or invariant factors. They can be computed (up to multiplication by a unit) as

[math]\displaystyle{ \alpha_i = \frac{d_i(A)}{d_{i-1}(A)}, }[/math]

where [math]\displaystyle{ d_i(A) }[/math] (called i-th determinant divisor) equals the greatest common divisor of the determinants of all [math]\displaystyle{ i\times i }[/math] minors of the matrix A and [math]\displaystyle{ d_0(A):=1 }[/math].

Example : For a [math]\displaystyle{ 2\times2 }[/math] matrix, [math]\displaystyle{ {\rm SNF}{a~~b\choose c~~d} = {\rm diag}(d_1, d_2/d_1) }[/math] with [math]\displaystyle{ d_1 = \gcd(a,b,c,d) }[/math] and [math]\displaystyle{ d_2 = ad-bc }[/math].

Algorithm

The first goal is to find invertible square matrices [math]\displaystyle{ S }[/math] and [math]\displaystyle{ T }[/math] such that the product [math]\displaystyle{ S A T }[/math] is diagonal. This is the hardest part of the algorithm. Once diagonality is achieved, it becomes relatively easy to put the matrix into Smith normal form. Phrased more abstractly, the goal is to show that, thinking of [math]\displaystyle{ A }[/math] as a map from [math]\displaystyle{ R^n }[/math] (the free [math]\displaystyle{ R }[/math]-module of rank [math]\displaystyle{ n }[/math]) to [math]\displaystyle{ R^m }[/math] (the free [math]\displaystyle{ R }[/math]-module of rank [math]\displaystyle{ m }[/math]), there are isomorphisms [math]\displaystyle{ S:R^m \to R^m }[/math] and [math]\displaystyle{ T:R^n \to R^n }[/math] such that [math]\displaystyle{ S \cdot A \cdot T }[/math] has the simple form of a diagonal matrix. The matrices [math]\displaystyle{ S }[/math] and [math]\displaystyle{ T }[/math] can be found by starting out with identity matrices of the appropriate size, and modifying [math]\displaystyle{ S }[/math] each time a row operation is performed on [math]\displaystyle{ A }[/math] in the algorithm by the corresponding column operation (for example, if row [math]\displaystyle{ i }[/math] is added to row [math]\displaystyle{ j }[/math] of [math]\displaystyle{ A }[/math], then column [math]\displaystyle{ j }[/math] should be subtracted from column [math]\displaystyle{ i }[/math] of [math]\displaystyle{ S }[/math] to retain the product invariant), and similarly modifying [math]\displaystyle{ T }[/math] for each column operation performed. Since row operations are left-multiplications and column operations are right-multiplications, this preserves the invariant [math]\displaystyle{ A'=S'\cdot A\cdot T' }[/math] where [math]\displaystyle{ A',S',T' }[/math] denote current values and [math]\displaystyle{ A }[/math] denotes the original matrix; eventually the matrices in this invariant become diagonal. Only invertible row and column operations are performed, which ensures that [math]\displaystyle{ S }[/math] and [math]\displaystyle{ T }[/math] remain invertible matrices.

For [math]\displaystyle{ a \in R\setminus \{0\} }[/math], write [math]\displaystyle{ \delta(a) }[/math] for the number of prime factors of [math]\displaystyle{ a }[/math] (these exist and are unique since any PID is also a unique factorization domain). In particular, [math]\displaystyle{ R }[/math] is also a Bézout domain, so it is a gcd domain and the gcd of any two elements satisfies a Bézout's identity.

To put a matrix into Smith normal form, one can repeatedly apply the following, where [math]\displaystyle{ t }[/math] loops from 1 to [math]\displaystyle{ m }[/math].

Step I: Choosing a pivot

Choose [math]\displaystyle{ j_t }[/math] to be the smallest column index of [math]\displaystyle{ A }[/math] with a non-zero entry, starting the search at column index [math]\displaystyle{ j_{t-1}+1 }[/math] if [math]\displaystyle{ t\gt 1 }[/math].

We wish to have [math]\displaystyle{ a_{t,j_t}\neq0 }[/math]; if this is the case this step is complete, otherwise there is by assumption some [math]\displaystyle{ k }[/math] with [math]\displaystyle{ a_{k,j_t} \neq 0 }[/math], and we can exchange rows [math]\displaystyle{ t }[/math] and [math]\displaystyle{ k }[/math], thereby obtaining [math]\displaystyle{ a_{t,j_t}\neq0 }[/math].

Our chosen pivot is now at position [math]\displaystyle{ (t, j_t) }[/math].

Step II: Improving the pivot

If there is an entry at position (k,j_t) such that [math]\displaystyle{ a_{t,j_t} \nmid a_{k,j_t} }[/math], then, letting [math]\displaystyle{ \beta =\gcd\left(a_{t,j_t}, a_{k,j_t}\right) }[/math], we know by the Bézout property that there exist σ, τ in R such that

[math]\displaystyle{ a_{t,j_t} \cdot \sigma + a_{k,j_t} \cdot \tau=\beta. }[/math]

By left-multiplication with an appropriate invertible matrix L, it can be achieved that row t of the matrix product is the sum of σ times the original row t and τ times the original row k, that row k of the product is another linear combination of those original rows, and that all other rows are unchanged. Explicitly, if σ and τ satisfy the above equation, then for [math]\displaystyle{ \alpha=a_{t,j_t}/\beta }[/math] and [math]\displaystyle{ \gamma=a_{k,j_t}/\beta }[/math] (which divisions are possible by the definition of β) one has

[math]\displaystyle{ \sigma\cdot \alpha + \tau \cdot \gamma=1, }[/math]

so that the matrix

[math]\displaystyle{ L_0= \begin{pmatrix} \sigma & \tau \\ -\gamma & \alpha \\ \end{pmatrix} }[/math]

is invertible, with inverse

[math]\displaystyle{ \begin{pmatrix} \alpha & -\tau \\ \gamma & \sigma \\ \end{pmatrix} . }[/math]

Now L can be obtained by fitting [math]\displaystyle{ L_0 }[/math] into rows and columns t and k of the identity matrix. By construction the matrix obtained after left-multiplying by L has entry β at position (t,j_t) (and due to our choice of α and γ it also has an entry 0 at position (k,j_t), which is useful though not essential for the algorithm). This new entry β divides the entry [math]\displaystyle{ a_{t,j_t} }[/math] that was there before, and so in particular [math]\displaystyle{ \delta(\beta) \lt \delta(a_{t,j_t}) }[/math]; therefore repeating these steps must eventually terminate. One ends up with a matrix having an entry at position (t,j_t) that divides all entries in column j_t.

Step III: Eliminating entries

Finally, adding appropriate multiples of row t, it can be achieved that all entries in column j_t except for that at position (t,j_t) are zero. This can be achieved by left-multiplication with an appropriate matrix. However, to make the matrix fully diagonal we need to eliminate nonzero entries on the row of position (t,j_t) as well. This can be achieved by repeating the steps in Step II for columns instead of rows, and using multiplication on the right by the transpose of the obtained matrix L. In general this will result in the zero entries from the prior application of Step III becoming nonzero again.

However, notice that each application of Step II for either rows or columns must continue to reduce the value of [math]\displaystyle{ \delta(a_{t,j_t}) }[/math], and so the process must eventually stop after some number of iterations, leading to a matrix where the entry at position (t,j_t) is the only non-zero entry in both its row and column.

At this point, only the block of A to the lower right of (t,j_t) needs to be diagonalized, and conceptually the algorithm can be applied recursively, treating this block as a separate matrix. In other words, we can increment t by one and go back to Step I.

Final step

Applying the steps described above to the remaining non-zero columns of the resulting matrix (if any), we get an [math]\displaystyle{ m \times n }[/math]-matrix with column indices [math]\displaystyle{ j_1 \lt \ldots \lt j_r }[/math] where [math]\displaystyle{ r \le \min(m,n) }[/math]. The matrix entries [math]\displaystyle{ (l,j_l) }[/math] are non-zero, and every other entry is zero.

Now we can move the null columns of this matrix to the right, so that the nonzero entries are on positions [math]\displaystyle{ (i,i) }[/math] for [math]\displaystyle{ 1 \le i\le r }[/math]. For short, set [math]\displaystyle{ \alpha_i }[/math] for the element at position [math]\displaystyle{ (i,i) }[/math].

The condition of divisibility of diagonal entries might not be satisfied. For any index [math]\displaystyle{ i\lt r }[/math] for which [math]\displaystyle{ \alpha_i\nmid\alpha_{i+1} }[/math], one can repair this shortcoming by operations on rows and columns [math]\displaystyle{ i }[/math] and [math]\displaystyle{ i+1 }[/math] only: first add column [math]\displaystyle{ i+1 }[/math] to column [math]\displaystyle{ i }[/math] to get an entry [math]\displaystyle{ \alpha_{i+1} }[/math] in column i without disturbing the entry [math]\displaystyle{ \alpha_i }[/math] at position [math]\displaystyle{ (i,i) }[/math], and then apply a row operation to make the entry at position [math]\displaystyle{ (i,i) }[/math] equal to [math]\displaystyle{ \beta=\gcd(\alpha_i,\alpha_{i+1}) }[/math] as in Step II; finally proceed as in Step III to make the matrix diagonal again. Since the new entry at position [math]\displaystyle{ (i+1,i+1) }[/math] is a linear combination of the original [math]\displaystyle{ \alpha_i,\alpha_{i+1} }[/math], it is divisible by β.

The value [math]\displaystyle{ \delta(\alpha_1)+\cdots+\delta(\alpha_r) }[/math] does not change by the above operation (it is δ of the determinant of the upper [math]\displaystyle{ r\times r }[/math] submatrix), whence that operation does diminish (by moving prime factors to the right) the value of

[math]\displaystyle{ \sum_{j=1}^r(r-j)\delta(\alpha_j). }[/math]

So after finitely many applications of this operation no further application is possible, which means that we have obtained [math]\displaystyle{ \alpha_1\mid\alpha_2\mid\cdots\mid\alpha_r }[/math] as desired.

Since all row and column manipulations involved in the process are invertible, this shows that there exist invertible [math]\displaystyle{ m \times m }[/math] and [math]\displaystyle{ n \times n }[/math]-matrices S, T so that the product S A T satisfies the definition of a Smith normal form. In particular, this shows that the Smith normal form exists, which was assumed without proof in the definition.

Applications

The Smith normal form is useful for computing the homology of a chain complex when the chain modules of the chain complex are finitely generated. For instance, in topology, it can be used to compute the homology of a finite simplicial complex or CW complex over the integers, because the boundary maps in such a complex are just integer matrices. It can also be used to determine the invariant factors that occur in the structure theorem for finitely generated modules over a principal ideal domain, which includes the fundamental theorem of finitely generated abelian groups.

The Smith normal form is also used in control theory to compute transmission and blocking zeros of a transfer function matrix.

Example

As an example, we will find the Smith normal form of the following matrix over the integers.

[math]\displaystyle{ \begin{pmatrix} 2 & 4 & 4 \\ -6 & 6 & 12 \\ 10 & 4 & 16 \end{pmatrix} }[/math]

The following matrices are the intermediate steps as the algorithm is applied to the above matrix.

[math]\displaystyle{ \to \begin{pmatrix} 2 & 0 & 0 \\ -6 & 18 & 24 \\ 10 & -16 & -4 \end{pmatrix} \to \begin{pmatrix} 2 & 0 & 0 \\ 0 & 18 & 24 \\ 0 & -16 & -4 \end{pmatrix} }[/math]

[math]\displaystyle{ \to \begin{pmatrix} 2 & 0 & 0 \\ 0 & 2 & 20 \\ 0 & -16 & -4 \end{pmatrix} \to \begin{pmatrix} 2 & 0 & 0 \\ 0 & 2 & 20 \\ 0 & 0 & 156 \end{pmatrix} }[/math]

[math]\displaystyle{ \to \begin{pmatrix} 2 & 0 & 0 \\ 0 & 2 & 0 \\ 0 & 0 & 156 \end{pmatrix} }[/math]

So the Smith normal form is

[math]\displaystyle{ \begin{pmatrix} 2 & 0 & 0 \\ 0 & 2 & 0 \\ 0 & 0 & 156 \end{pmatrix} }[/math]

and the invariant factors are 2, 2 and 156.

Similarity

The Smith normal form can be used to determine whether or not matrices with entries over a common field [math]\displaystyle{ K }[/math] are similar. Specifically two matrices A and B are similar if and only if the characteristic matrices [math]\displaystyle{ xI-A }[/math] and [math]\displaystyle{ xI-B }[/math] have the same Smith normal form (working in the PID [math]\displaystyle{ K[x] }[/math]).

For example, with

[math]\displaystyle{ \begin{align} A & {} =\begin{bmatrix} 1 & 2 \\ 0 & 1 \end{bmatrix}, & & \mbox{SNF}(xI-A) =\begin{bmatrix} 1 & 0 \\ 0 & (x-1)^2 \end{bmatrix} \\ B & {} =\begin{bmatrix} 3 & -4 \\ 1 & -1 \end{bmatrix}, & & \mbox{SNF}(xI-B) =\begin{bmatrix} 1 & 0 \\ 0 & (x-1)^2 \end{bmatrix} \\ C & {} =\begin{bmatrix} 1 & 0 \\ 1 & 2 \end{bmatrix}, & & \mbox{SNF}(xI-C) =\begin{bmatrix} 1 & 0 \\ 0 & (x-1)(x-2) \end{bmatrix}. \end{align} }[/math]

A and B are similar because the Smith normal form of their characteristic matrices match, but are not similar to C because the Smith normal form of the characteristic matrices do not match.

See also

• Canonical form
• Diophantine equation
• Elementary divisors
• Frobenius normal form (also called Rational canonical form)
• Hermite normal form
• Invariant factor
• Structure theorem for finitely generated modules over a principal ideal domain
• Singular value decomposition

References

• Smith, Henry J. Stephen (1861). "On systems of linear indeterminate equations and congruences". Phil. Trans. R. Soc. Lond. 151 (1): 293–326. doi:10.1098/rstl.1861.0016.  Reprinted (pp. 367–409) in The Collected Mathematical Papers of Henry John Stephen Smith, Vol. I, edited by J. W. L. Glaisher. Oxford: Clarendon Press (1894), xcv+603 pp.
• Smith normal form at PlanetMath.org.
• Example of Smith normal form at PlanetMath.org.
• K. R. Matthews, Smith normal form. MP274: Linear Algebra, Lecture Notes, University of Queensland, 1991.

External links

• An animated example of computation of Smith normal form.