Matrix analysis
In mathematics, particularly in linear algebra and applications, matrix analysis is the study of matrices and their algebraic properties.[1] Some particular topics out of many include; operations defined on matrices (such as matrix addition, matrix multiplication and operations derived from these), functions of matrices (such as matrix exponentiation and matrix logarithm, and even sines and cosines etc. of matrices), and the eigenvalues of matrices (eigendecomposition of a matrix, eigenvalue perturbation theory).[2]
Matrix spaces
The set of all m × n matrices over a field F denoted in this article Mmn(F) form a vector space. Examples of F include the set of rational numbers [math]\displaystyle{ \mathbb{Q} }[/math], the real numbers [math]\displaystyle{ \mathbb{R} }[/math], and set of complex numbers [math]\displaystyle{ \mathbb{C} }[/math]. The spaces Mmn(F) and Mpq(F) are different spaces if m and p are unequal, and if n and q are unequal; for instance M32(F) ≠ M23(F). Two m × n matrices A and B in Mmn(F) can be added together to form another matrix in the space Mmn(F):
- [math]\displaystyle{ \mathbf{A},\mathbf{B} \in M_{mn}(F)\,,\quad \mathbf{A} + \mathbf{B} \in M_{mn}(F) }[/math]
and multiplied by a α in F, to obtain another matrix in Mmn(F):
- [math]\displaystyle{ \alpha \in F \,,\quad \alpha \mathbf{A} \in M_{mn}(F) }[/math]
Combining these two properties, a linear combination of matrices A and B are in Mmn(F) is another matrix in Mmn(F):
- [math]\displaystyle{ \alpha \mathbf{A} + \beta\mathbf{B} \in M_{mn}(F) }[/math]
where α and β are numbers in F.
Any matrix can be expressed as a linear combination of basis matrices, which play the role of the basis vectors for the matrix space. For example, for the set of 2 × 2 matrices over the field of real numbers, [math]\displaystyle{ M_{22}(\mathbb{R}) }[/math], one legitimate basis set of matrices is:
- [math]\displaystyle{ \begin{pmatrix}1&0\\0&0\end{pmatrix}\,,\quad \begin{pmatrix}0&1\\0&0\end{pmatrix}\,,\quad \begin{pmatrix}0&0\\1&0\end{pmatrix}\,,\quad \begin{pmatrix}0&0\\0&1\end{pmatrix}\,, }[/math]
because any 2 × 2 matrix can be expressed as:
- [math]\displaystyle{ \begin{pmatrix}a&b\\c&d\end{pmatrix}=a \begin{pmatrix}1&0\\0&0\end{pmatrix} +b\begin{pmatrix}0&1\\0&0\end{pmatrix} +c\begin{pmatrix}0&0\\1&0\end{pmatrix} +d\begin{pmatrix}0&0\\0&1\end{pmatrix}\,, }[/math]
where a, b, c,d are all real numbers. This idea applies to other fields and matrices of higher dimensions.
Determinants
The determinant of a square matrix is an important property. The determinant indicates if a matrix is invertible (i.e. the inverse of a matrix exists when the determinant is nonzero). Determinants are used for finding eigenvalues of matrices (see below), and for solving a system of linear equations (see Cramer's rule).
Eigenvalues and eigenvectors of matrices
Definitions
An n × n matrix A has eigenvectors x and eigenvalues λ defined by the relation:
- [math]\displaystyle{ \mathbf{A}\mathbf{x} = \lambda \mathbf{x} }[/math]
In words, the matrix multiplication of A followed by an eigenvector x (here an n-dimensional column matrix), is the same as multiplying the eigenvector by the eigenvalue. For an n × n matrix, there are n eigenvalues. The eigenvalues are the roots of the characteristic polynomial:
- [math]\displaystyle{ p_\mathbf{A}(\lambda) = \det(\mathbf{A} - \lambda \mathbf{I}) = 0 }[/math]
where I is the n × n identity matrix.
Roots of polynomials, in this context the eigenvalues, can all be different, or some may be equal (in which case eigenvalue has multiplicity, the number of times an eigenvalue occurs). After solving for the eigenvalues, the eigenvectors corresponding to the eigenvalues can be found by the defining equation.
Perturbations of eigenvalues
Matrix similarity
Two n × n matrices A and B are similar if they are related by a similarity transformation:
- [math]\displaystyle{ \mathbf{B} = \mathbf{P}\mathbf{A}\mathbf{P}^{-1} }[/math]
The matrix P is called a similarity matrix, and is necessarily invertible.
Unitary similarity
Canonical forms
Row echelon form
Jordan normal form
Weyr canonical form
Frobenius normal form
Triangular factorization
LU decomposition
LU decomposition splits a matrix into a matrix product of an upper triangular matrix and a lower triangle matrix.
Matrix norms
Since matrices form vector spaces, one can form axioms (analogous to those of vectors) to define a "size" of a particular matrix. The norm of a matrix is a positive real number.
Definition and axioms
For all matrices A and B in Mmn(F), and all numbers α in F, a matrix norm, delimited by double vertical bars || ... ||, fulfills:[note 1]
- Nonnegative:
- [math]\displaystyle{ \| \mathbf{A} \| \ge 0 }[/math]
- with equality only for A = 0, the zero matrix.
- [math]\displaystyle{ \|\alpha \mathbf{A}\|=|\alpha| \|\mathbf{A}\| }[/math]
- The triangular inequality:
- [math]\displaystyle{ \|\mathbf{A}+\mathbf{B}\| \leq \|\mathbf{A}\|+\|\mathbf{B}\| }[/math]
Frobenius norm
The Frobenius norm is analogous to the dot product of Euclidean vectors; multiply matrix elements entry-wise, add up the results, then take the positive square root:
- [math]\displaystyle{ \|\mathbf{A}\| = \sqrt{\mathbf{A}:\mathbf{A}} = \sqrt{\sum_{i=1}^m \sum_{j=1}^n (A_{ij})^2} }[/math]
It is defined for matrices of any dimension (i.e. no restriction to square matrices).
Positive definite and semidefinite matrices
Functions
Matrix elements are not restricted to constant numbers, they can be mathematical variables.
Functions of matrices
A functions of a matrix takes in a matrix, and return something else (a number, vector, matrix, etc...).
Matrix-valued functions
A matrix valued function takes in something (a number, vector, matrix, etc...) and returns a matrix.
See also
Other branches of analysis
- Mathematical analysis
- Tensor analysis
- Matrix calculus
- Numerical analysis
Other concepts of linear algebra
- Tensor product
- Spectrum of an operator
- Matrix geometrical series
Types of matrix
- Orthogonal matrix, unitary matrix
- Symmetric matrix, antisymmetric matrix
- Stochastic matrix
Matrix functions
Footnotes
- ↑ Some authors, e.g. Horn and Johnson, use triple vertical bars instead of double: |||A|||.
References
Notes
- ↑ R. A. Horn, C. R. Johnson (2012). Matrix Analysis (2nd ed.). Cambridge University Press. ISBN 978-052-183-940-2. https://books.google.com/books?id=5I5AYeeh0JUC&q=matrix+analysis.
- ↑ N. J. Higham (2000). Functions of Matrices: Theory and Computation. SIAM. ISBN 089-871-777-9. https://books.google.com/books?id=S6gpNn1JmbgC&q=matrix+functions.
Further reading
- C. Meyer (2000). Matrix Analysis and Applied Linear Algebra Book and Solutions Manual. 2. SIAM. ISBN 089-871-454-0. https://books.google.com/books?id=Zg4M0iFlbGcC&q=Matrix+Analysis.
- T. S. Shores (2007). Applied Linear Algebra and Matrix Analysis. Undergraduate Texts in Mathematics. Springer. ISBN 978-038-733-195-9. https://books.google.com/books?id=8qwTb9P-iW8C&q=Matrix+Analysis.
- Rajendra Bhatia (1997). Matrix Analysis. Matrix Analysis Series. 169. Springer. ISBN 038-794-846-5. https://books.google.com/books?id=F4hRy1F1M6QC&q=matrix+analysis.
- Alan J. Laub (2012). Computational Matrix Analysis. SIAM. ISBN 978-161-197-221-4. https://books.google.com/books?id=RJBZBuHpVjEC&q=Matrix+Analysis.
 |  |
