Characteristic polynomial

Short description: Polynomial whose roots are the eigenvalues of a matrix

In linear algebra, the characteristic polynomial of a square matrix is a polynomial which is invariant under matrix similarity and has the eigenvalues as roots. It has the determinant and the trace of the matrix among its coefficients. The characteristic polynomial of an endomorphism of a finite-dimensional vector space is the characteristic polynomial of the matrix of that endomorphism over any base (that is, the characteristic polynomial does not depend on the choice of a basis). The characteristic equation, also known as the determinantal equation, is the equation obtained by equating the characteristic polynomial to zero.

In spectral graph theory, the characteristic polynomial of a graph is the characteristic polynomial of its adjacency matrix.

Motivation

In linear algebra, eigenvalues and eigenvectors play a fundamental role, since, given a linear transformation, an eigenvector is a vector whose direction is not changed by the transformation, and the corresponding eigenvalue is the measure of the resulting change of magnitude of the vector.

More precisely, if the transformation is represented by a square matrix [math]\displaystyle{ A, }[/math] an eigenvector [math]\displaystyle{ \mathbf{v}, }[/math] and the corresponding eigenvalue [math]\displaystyle{ \lambda }[/math] must satisfy the equation [math]\displaystyle{ A \mathbf{v} = \lambda \mathbf{v}, }[/math] or, equivalently, [math]\displaystyle{ (\lambda I - A) \mathbf{v} =\mathbf 0 }[/math] where [math]\displaystyle{ I }[/math] is the identity matrix, and [math]\displaystyle{ \mathbf{v}\ne \mathbf{0} }[/math] (although the zero vector satisfies this equation for every [math]\displaystyle{ \lambda, }[/math] it is not considered an eigenvector).

It follows that the matrix [math]\displaystyle{ (\lambda I - A) }[/math] must be singular, and its determinant [math]\displaystyle{ \det(\lambda I - A) = 0 }[/math] must be zero.

In other words, the eigenvalues of A are the roots of [math]\displaystyle{ \det(xI - A), }[/math] which is a monic polynomial in x of degree n if A is a n×n matrix. This polynomial is the characteristic polynomial of A.

Formal definition

Consider an [math]\displaystyle{ n \times n }[/math] matrix [math]\displaystyle{ A. }[/math] The characteristic polynomial of [math]\displaystyle{ A, }[/math] denoted by [math]\displaystyle{ p_A(t), }[/math] is the polynomial defined by [math]\displaystyle{ p_A(t) = \det (t I - A) }[/math] where [math]\displaystyle{ I }[/math] denotes the [math]\displaystyle{ n \times n }[/math] identity matrix.

Some authors define the characteristic polynomial to be [math]\displaystyle{ \det(A - t I). }[/math] That polynomial differs from the one defined here by a sign [math]\displaystyle{ (-1)^n, }[/math] so it makes no difference for properties like having as roots the eigenvalues of [math]\displaystyle{ A }[/math]; however the definition above always gives a monic polynomial, whereas the alternative definition is monic only when [math]\displaystyle{ n }[/math] is even.

Examples

To compute the characteristic polynomial of the matrix [math]\displaystyle{ A = \begin{pmatrix} 2 & 1\\ -1& 0 \end{pmatrix}. }[/math] the determinant of the following is computed: [math]\displaystyle{ t I-A = \begin{pmatrix} t-2&-1\\ 1&t-0 \end{pmatrix} }[/math] and found to be [math]\displaystyle{ (t-2)t - 1(-1) = t^2-2t+1 \,\!, }[/math] the characteristic polynomial of [math]\displaystyle{ A. }[/math]

Another example uses hyperbolic functions of a hyperbolic angle φ. For the matrix take [math]\displaystyle{ A = \begin{pmatrix} \cosh(\varphi) & \sinh(\varphi)\\ \sinh(\varphi)& \cosh(\varphi) \end{pmatrix}. }[/math] Its characteristic polynomial is [math]\displaystyle{ \det (tI - A) = (t - \cosh(\varphi))^2 - \sinh^2(\varphi) = t^2 - 2 t \ \cosh(\varphi) + 1 = (t - e^\varphi) (t - e^{-\varphi}). }[/math]

Properties

The characteristic polynomial [math]\displaystyle{ p_A(t) }[/math] of a [math]\displaystyle{ n \times n }[/math] matrix is monic (its leading coefficient is [math]\displaystyle{ 1 }[/math]) and its degree is [math]\displaystyle{ n. }[/math] The most important fact about the characteristic polynomial was already mentioned in the motivational paragraph: the eigenvalues of [math]\displaystyle{ A }[/math] are precisely the roots of [math]\displaystyle{ p_A(t) }[/math] (this also holds for the minimal polynomial of [math]\displaystyle{ A, }[/math] but its degree may be less than [math]\displaystyle{ n }[/math]). All coefficients of the characteristic polynomial are polynomial expressions in the entries of the matrix. In particular its constant coefficient of [math]\displaystyle{ t^0 }[/math] is [math]\displaystyle{ \det(-A) = (-1)^n \det(A), }[/math] the coefficient of [math]\displaystyle{ t^n }[/math] is one, and the coefficient of [math]\displaystyle{ t^{n-1} }[/math] is tr(−A) = −tr(A), where tr(A) is the trace of [math]\displaystyle{ A. }[/math] (The signs given here correspond to the formal definition given in the previous section; for the alternative definition these would instead be [math]\displaystyle{ \det(A) }[/math] and (−1)^{n – 1} tr(A) respectively.)

For a [math]\displaystyle{ 2 \times 2 }[/math] matrix [math]\displaystyle{ A, }[/math] the characteristic polynomial is thus given by [math]\displaystyle{ t^2 - \operatorname{tr}(A) t + \det(A). }[/math]

Using the language of exterior algebra, the characteristic polynomial of an [math]\displaystyle{ n \times n }[/math] matrix [math]\displaystyle{ A }[/math] may be expressed as [math]\displaystyle{ p_A (t) = \sum_{k=0}^n t^{n-k} (-1)^k \operatorname{tr}\left(\textstyle\bigwedge^k A\right) }[/math] where [math]\displaystyle{ \operatorname{tr}\left(\bigwedge^k A\right) }[/math] is the trace of the [math]\displaystyle{ k }[/math]th exterior power of [math]\displaystyle{ A, }[/math] which has dimension [math]\displaystyle{ \binom {n}{k}. }[/math] This trace may be computed as the sum of all principal minors of [math]\displaystyle{ A }[/math] of size [math]\displaystyle{ k. }[/math] The recursive Faddeev–LeVerrier algorithm computes these coefficients more efficiently.

When the characteristic of the field of the coefficients is [math]\displaystyle{ 0, }[/math] each such trace may alternatively be computed as a single determinant, that of the [math]\displaystyle{ k \times k }[/math] matrix, [math]\displaystyle{ \operatorname{tr}\left(\textstyle\bigwedge^k A\right) = \frac{1}{k!} \begin{vmatrix} \operatorname{tr}A & k-1 &0&\cdots &0 \\ \operatorname{tr}A^2 &\operatorname{tr}A& k-2 &\cdots &0 \\ \vdots & \vdots & & \ddots & \vdots \\ \operatorname{tr}A^{k-1} &\operatorname{tr}A^{k-2}& & \cdots & 1 \\ \operatorname{tr}A^k &\operatorname{tr}A^{k-1}& & \cdots & \operatorname{tr}A \end{vmatrix} ~. }[/math]

The Cayley–Hamilton theorem states that replacing [math]\displaystyle{ t }[/math] by [math]\displaystyle{ A }[/math] in the characteristic polynomial (interpreting the resulting powers as matrix powers, and the constant term [math]\displaystyle{ c }[/math] as [math]\displaystyle{ c }[/math] times the identity matrix) yields the zero matrix. Informally speaking, every matrix satisfies its own characteristic equation. This statement is equivalent to saying that the minimal polynomial of [math]\displaystyle{ A }[/math] divides the characteristic polynomial of [math]\displaystyle{ A. }[/math]

Two similar matrices have the same characteristic polynomial. The converse however is not true in general: two matrices with the same characteristic polynomial need not be similar.

The matrix [math]\displaystyle{ A }[/math] and its transpose have the same characteristic polynomial. [math]\displaystyle{ A }[/math] is similar to a triangular matrix if and only if its characteristic polynomial can be completely factored into linear factors over [math]\displaystyle{ K }[/math] (the same is true with the minimal polynomial instead of the characteristic polynomial). In this case [math]\displaystyle{ A }[/math] is similar to a matrix in Jordan normal form.

Characteristic polynomial of a product of two matrices

If [math]\displaystyle{ A }[/math] and [math]\displaystyle{ B }[/math] are two square [math]\displaystyle{ n \times n }[/math] matrices then characteristic polynomials of [math]\displaystyle{ AB }[/math] and [math]\displaystyle{ BA }[/math] coincide: [math]\displaystyle{ p_{AB}(t)=p_{BA}(t).\, }[/math]

When [math]\displaystyle{ A }[/math] is non-singular this result follows from the fact that [math]\displaystyle{ AB }[/math] and [math]\displaystyle{ BA }[/math] are similar: [math]\displaystyle{ BA = A^{-1} (AB) A. }[/math]

For the case where both [math]\displaystyle{ A }[/math] and [math]\displaystyle{ B }[/math] are singular, the desired identity is an equality between polynomials in [math]\displaystyle{ t }[/math] and the coefficients of the matrices. Thus, to prove this equality, it suffices to prove that it is verified on a non-empty open subset (for the usual topology, or, more generally, for the Zariski topology) of the space of all the coefficients. As the non-singular matrices form such an open subset of the space of all matrices, this proves the result.

More generally, if [math]\displaystyle{ A }[/math] is a matrix of order [math]\displaystyle{ m \times n }[/math] and [math]\displaystyle{ B }[/math] is a matrix of order [math]\displaystyle{ n \times m, }[/math] then [math]\displaystyle{ AB }[/math] is [math]\displaystyle{ m \times m }[/math] and [math]\displaystyle{ BA }[/math] is [math]\displaystyle{ n \times n }[/math] matrix, and one has [math]\displaystyle{ p_{BA}(t) = t^{n-m} p_{AB}(t).\, }[/math]

To prove this, one may suppose [math]\displaystyle{ n \gt m, }[/math] by exchanging, if needed, [math]\displaystyle{ A }[/math] and [math]\displaystyle{ B. }[/math] Then, by bordering [math]\displaystyle{ A }[/math] on the bottom by [math]\displaystyle{ n - m }[/math] rows of zeros, and [math]\displaystyle{ B }[/math] on the right, by, [math]\displaystyle{ n - m }[/math] columns of zeros, one gets two [math]\displaystyle{ n \times n }[/math] matrices [math]\displaystyle{ A^{\prime} }[/math] and [math]\displaystyle{ B^{\prime} }[/math] such that [math]\displaystyle{ B^{\prime}A^{\prime} = BA }[/math] and [math]\displaystyle{ A^{\prime}B^{\prime} }[/math] is equal to [math]\displaystyle{ AB }[/math] bordered by [math]\displaystyle{ n - m }[/math] rows and columns of zeros. The result follows from the case of square matrices, by comparing the characteristic polynomials of [math]\displaystyle{ A^{\prime}B^{\prime} }[/math] and [math]\displaystyle{ AB. }[/math]

Characteristic polynomial of A^k

If [math]\displaystyle{ \lambda }[/math] is an eigenvalue of a square matrix [math]\displaystyle{ A }[/math] with eigenvector [math]\displaystyle{ \mathbf{v}, }[/math] then [math]\displaystyle{ \lambda^k }[/math] is an eigenvalue of [math]\displaystyle{ A^k }[/math] because [math]\displaystyle{ A^k \textbf{v} = A^{k-1} A \textbf{v} = \lambda A^{k-1} \textbf{v} = \dots = \lambda^k \textbf{v}. }[/math]

The multiplicities can be shown to agree as well, and this generalizes to any polynomial in place of [math]\displaystyle{ x^k }[/math]:

Theorem —  Let [math]\displaystyle{ A }[/math] be a square [math]\displaystyle{ n \times n }[/math] matrix and let [math]\displaystyle{ f(t) }[/math] be a polynomial. If the characteristic polynomial of [math]\displaystyle{ A }[/math] has a factorization [math]\displaystyle{ p_A(t) = (t - \lambda_1) (t - \lambda_2) \cdots (t-\lambda_n) }[/math] then the characteristic polynomial of the matrix [math]\displaystyle{ f(A) }[/math] is given by [math]\displaystyle{ p_{f(A)}(t) = (t - f(\lambda_1)) (t - f(\lambda_2)) \cdots (t-f(\lambda_n)). }[/math]

That is, the algebraic multiplicity of [math]\displaystyle{ \lambda }[/math] in [math]\displaystyle{ f(A) }[/math] equals the sum of algebraic multiplicities of [math]\displaystyle{ \lambda' }[/math] in [math]\displaystyle{ A }[/math] over [math]\displaystyle{ \lambda' }[/math] such that [math]\displaystyle{ f(\lambda') = \lambda. }[/math] In particular, [math]\displaystyle{ \operatorname{tr}(f(A)) = \textstyle\sum_{i=1}^n f(\lambda_i) }[/math] and [math]\displaystyle{ \operatorname{det}(f(A)) = \textstyle\prod_{i=1}^n f(\lambda_i). }[/math] Here a polynomial [math]\displaystyle{ f(t) = t^3+1, }[/math] for example, is evaluated on a matrix [math]\displaystyle{ A }[/math] simply as [math]\displaystyle{ f(A) = A^3+I. }[/math]

The theorem applies to matrices and polynomials over any field or commutative ring. However, the assumption that [math]\displaystyle{ p_A(t) }[/math] has a factorization into linear factors is not always true, unless the matrix is over an algebraically closed field such as the complex numbers.

Proof

This proof only applies to matrices and polynomials over complex numbers (or any algebraically closed field). In that case, the characteristic polynomial of any square matrix can be always factorized as [math]\displaystyle{ p_A(t) = \left(t - \lambda_1\right) \left(t - \lambda_2\right) \cdots \left(t - \lambda_n\right) }[/math] where [math]\displaystyle{ \lambda_1, \lambda_2, \ldots, \lambda_n }[/math] are the eigenvalues of [math]\displaystyle{ A, }[/math] possibly repeated. Moreover, the Jordan decomposition theorem guarantees that any square matrix [math]\displaystyle{ A }[/math] can be decomposed as [math]\displaystyle{ A = S^{-1} U S, }[/math] where [math]\displaystyle{ S }[/math] is an invertible matrix and [math]\displaystyle{ U }[/math] is upper triangular with [math]\displaystyle{ \lambda_1, \ldots, \lambda_n }[/math] on the diagonal (with each eigenvalue repeated according to its algebraic multiplicity). (The Jordan normal form has stronger properties, but these are sufficient; alternatively the Schur decomposition can be used, which is less popular but somewhat easier to prove).

Let [math]\displaystyle{ f(t) = \sum_i \alpha_i t^i. }[/math] Then [math]\displaystyle{ f(A) = \textstyle\sum \alpha_i (S^{-1} U S)^i = \textstyle\sum \alpha_i S^{-1} U S S^{-1} U S \cdots S^{-1} U S = \textstyle\sum \alpha_i S^{-1} U^i S = S^{-1} (\textstyle\sum \alpha_i U^i) S = S^{-1} f(U) S. }[/math] For an upper triangular matrix [math]\displaystyle{ U }[/math] with diagonal [math]\displaystyle{ \lambda_1, \dots, \lambda_n, }[/math] the matrix [math]\displaystyle{ U^i }[/math] is upper triangular with diagonal [math]\displaystyle{ \lambda_1^i,\dots,\lambda_n^i }[/math] in [math]\displaystyle{ U^i, }[/math] and hence [math]\displaystyle{ f(U) }[/math] is upper triangular with diagonal [math]\displaystyle{ f\left(\lambda_1\right), \dots, f\left(\lambda_n\right). }[/math] Therefore, the eigenvalues of [math]\displaystyle{ f(U) }[/math] are [math]\displaystyle{ f(\lambda_1),\dots,f(\lambda_n). }[/math] Since [math]\displaystyle{ f(A) = S^{-1} f(U) S }[/math] is similar to [math]\displaystyle{ f(U), }[/math] it has the same eigenvalues, with the same algebraic multiplicities.

Secular function and secular equation

Secular function

The term secular function has been used for what is now called characteristic polynomial (in some literature the term secular function is still used). The term comes from the fact that the characteristic polynomial was used to calculate secular perturbations (on a time scale of a century, that is, slow compared to annual motion) of planetary orbits, according to Lagrange's theory of oscillations.

Secular equation

Secular equation may have several meanings.

• In linear algebra it is sometimes used in place of characteristic equation.
• In astronomy it is the algebraic or numerical expression of the magnitude of the inequalities in a planet's motion that remain after the inequalities of a short period have been allowed for.

• In molecular orbital calculations relating to the energy of the electron and its wave function it is also used instead of the characteristic equation.

For general associative algebras

The above definition of the characteristic polynomial of a matrix [math]\displaystyle{ A \in M_n(F) }[/math] with entries in a field [math]\displaystyle{ F }[/math] generalizes without any changes to the case when [math]\displaystyle{ F }[/math] is just a commutative ring. (Garibaldi 2004) defines the characteristic polynomial for elements of an arbitrary finite-dimensional (associative, but not necessarily commutative) algebra over a field [math]\displaystyle{ F }[/math] and proves the standard properties of the characteristic polynomial in this generality.

See also

• Characteristic equation (disambiguation)
• Invariants of tensors
• Companion matrix
• Faddeev–LeVerrier algorithm
• Cayley–Hamilton theorem
• Samuelson–Berkowitz algorithm

References

• T.S. Blyth & E.F. Robertson (1998) Basic Linear Algebra, p 149, Springer ISBN:3-540-76122-5 .
• John B. Fraleigh & Raymond A. Beauregard (1990) Linear Algebra 2nd edition, p 246, Addison-Wesley ISBN:0-201-11949-8 .
• Garibaldi, Skip (2004), "The characteristic polynomial and determinant are not ad hoc constructions", American Mathematical Monthly 111 (9): 761–778, doi:10.2307/4145188 
• Werner Greub (1974) Linear Algebra 4th edition, pp 120–5, Springer, ISBN:0-387-90110-8 .
• Paul C. Shields (1980) Elementary Linear Algebra 3rd edition, p 274, Worth Publishers ISBN:0-87901-121-1 .
• Gilbert Strang (1988) Linear Algebra and Its Applications 3rd edition, p 246, Brooks/Cole ISBN:0-15-551005-3 .