Change of basis

Short description: Coordinate change in linear algebra

A linear combination of one basis of vectors (purple) obtains new vectors (red). If they are linearly independent, these form a new basis. The linear combinations relating the first basis to the other extend to a linear transformation, called the change of basis.

A vector represented by two different bases (purple and red arrows).

In mathematics, an ordered basis of a vector space of finite dimension $n$ allows representing uniquely any element of the vector space by a coordinate vector, which is a sequence of $n$ scalars called coordinates. If two different bases are considered, the coordinate vector that represents a vector $v$ on one basis is, in general, different from the coordinate vector that represents $v$ on the other basis. A change of basis consists of converting every assertion expressed in terms of coordinates relative to one basis into an assertion expressed in terms of coordinates relative to the other basis.^[1]^[2]^[3]

Such a conversion results from the change-of-basis formula which expresses the coordinates relative to one basis in terms of coordinates relative to the other basis. Using matrices, this formula can be written

[math]\displaystyle{ \mathbf x_\mathrm{old} = A \,\mathbf x_\mathrm{new}, }[/math]

where "old" and "new" refer respectively to the firstly defined basis and the other basis, [math]\displaystyle{ \mathbf x_\mathrm{old} }[/math] and [math]\displaystyle{ \mathbf x_\mathrm{new} }[/math] are the column vectors of the coordinates of the same vector on the two bases, and [math]\displaystyle{ A }[/math] is the change-of-basis matrix (also called transition matrix), which is the matrix whose columns are the coordinates of the new basis vectors on the old basis.

This article deals mainly with finite-dimensional vector spaces. However, many of the principles are also valid for infinite-dimensional vector spaces.

Change of basis formula

Let [math]\displaystyle{ B_\mathrm {old}=(v_1, \ldots, v_n) }[/math] be a basis of a finite-dimensional vector space $V$ over a field $F$ .^{[lower-alpha 1]}

For $j = 1, ..., n$ , one can define a vector $w j$ by its coordinates [math]\displaystyle{ a_{i,j} }[/math] over [math]\displaystyle{ B_\mathrm {old}\colon }[/math]

[math]\displaystyle{ w_j=\sum_{i=1}^n a_{i,j}v_i. }[/math]

Let

[math]\displaystyle{ A=\left(a_{i,j}\right)_{i,j} }[/math]

be the matrix whose $j$ th column is formed by the coordinates of $w j$ . (Here and in what follows, the index $i$ refers always to the rows of $A$ and the [math]\displaystyle{ v_i, }[/math] while the index $j$ refers always to the columns of $A$ and the [math]\displaystyle{ w_j; }[/math] such a convention is useful for avoiding errors in explicit computations.)

Setting [math]\displaystyle{ B_\mathrm {new}=(w_1, \ldots, w_n), }[/math] one has that [math]\displaystyle{ B_\mathrm {new} }[/math] is a basis of $V$ if and only if the matrix $A$ is invertible, or equivalently if it has a nonzero determinant. In this case, $A$ is said to be the change-of-basis matrix from the basis [math]\displaystyle{ B_\mathrm {old} }[/math] to the basis [math]\displaystyle{ B_\mathrm {new}. }[/math]

Given a vector [math]\displaystyle{ z\in V, }[/math] let [math]\displaystyle{ (x_1, \ldots, x_n) }[/math] be the coordinates of [math]\displaystyle{ z }[/math] over [math]\displaystyle{ B_\mathrm {old}, }[/math] and [math]\displaystyle{ (y_1, \ldots, y_n) }[/math] its coordinates over [math]\displaystyle{ B_\mathrm {new}; }[/math] that is

[math]\displaystyle{ z=\sum_{i=1}^nx_iv_i = \sum_{j=1}^ny_jw_j. }[/math]

(One could take the same summation index for the two sums, but choosing systematically the indexes $i$ for the old basis and $j$ for the new one makes clearer the formulas that follows, and helps avoiding errors in proofs and explicit computations.)

The change-of-basis formula expresses the coordinates over the old basis in term of the coordinates over the new basis. With above notation, it is

[math]\displaystyle{ x_i = \sum_{j=1}^n a_{i,j}y_j\qquad\text{for } i=1, \ldots, n. }[/math]

In terms of matrices, the change of basis formula is

[math]\displaystyle{ \mathbf x = A\,\mathbf y, }[/math]

where [math]\displaystyle{ \mathbf x }[/math] and [math]\displaystyle{ \mathbf y }[/math] are the column vectors of the coordinates of $z$ over [math]\displaystyle{ B_\mathrm {old} }[/math] and [math]\displaystyle{ B_\mathrm {new}, }[/math] respectively.

Proof: Using the above definition of the change-of basis matrix, one has

[math]\displaystyle{ \begin{align} z&=\sum_{j=1}^n y_jw_j\\ &=\sum_{j=1}^n \left(y_j\sum_{i=1}^n a_{i,j}v_i\right)\\ &=\sum_{i=1}^n \left(\sum_{j=1}^n a_{i,j} y_j \right) v_i. \end{align} }[/math]

As [math]\displaystyle{ z=\textstyle \sum_{i=1}^n x_iv_i, }[/math] the change-of-basis formula results from the uniqueness of the decomposition of a vector over a basis.

Example

Consider the Euclidean vector space [math]\displaystyle{ \mathbb R^2. }[/math] Its standard basis consists of the vectors [math]\displaystyle{ v_1= (1,0) }[/math] and [math]\displaystyle{ v_2= (0,1). }[/math] If one rotates them by an angle of $t$ , one gets a new basis formed by [math]\displaystyle{ w_1=(\cos t, \sin t) }[/math] and [math]\displaystyle{ w_2=(-\sin t, \cos t). }[/math]

So, the change-of-basis matrix is [math]\displaystyle{ \begin{bmatrix} \cos t& -\sin t\\ \sin t& \cos t \end{bmatrix}. }[/math]

The change-of-basis formula asserts that, if [math]\displaystyle{ y_1, y_2 }[/math] are the new coordinates of a vector [math]\displaystyle{ (x_1, x_2), }[/math] then one has

[math]\displaystyle{ \begin{bmatrix}x_1\\x_2\end{bmatrix}=\begin{bmatrix} \cos t& -\sin t\\ \sin t& \cos t \end{bmatrix}\,\begin{bmatrix}y_1\\y_2\end{bmatrix}. }[/math]

That is,

[math]\displaystyle{ x_1=y_1\cos t - y_2\sin t \qquad\text{and}\qquad x_2=y_1\sin t + y_2\cos t. }[/math]

This may be verified by writing

[math]\displaystyle{ \begin{align} x_1v_1+x_2v_2 &= (y_1\cos t - y_2\sin t) v_1 + (y_1\sin t + y_2\cos t) v_2\\ &= y_1 (\cos (t) v_1 + \sin(t)v_2) + y_2 (-\sin(t) v_1 +\cos(t) v_2)\\ &=y_1w_1+y_2w_2. \end{align} }[/math]

In terms of linear maps

Normally, a matrix represents a linear map, and the product of a matrix and a column vector represents the function application of the corresponding linear map to the vector whose coordinates form the column vector. The change-of-basis formula is a specific case of this general principle, although this is not immediately clear from its definition and proof.

When one says that a matrix represents a linear map, one refers implicitly to bases of implied vector spaces, and to the fact that the choice of a basis induces an isomorphism between a vector space and $F n$ , where $F$ is the field of scalars. When only one basis is considered for each vector space, it is worth to leave this isomorphism implicit, and to work up to an isomorphism. As several bases of the same vector space are considered here, a more accurate wording is required.

Let $F$ be a field, the set [math]\displaystyle{ F^n }[/math] of the $n$ -tuples is a $F$ -vector space whose addition and scalar multiplication are defined component-wise. Its standard basis is the basis that has as its $i$ th element the tuple with all components equal to $0$ except the $i$ th that is $1$ .

A basis [math]\displaystyle{ B=(v_1, \ldots, v_n) }[/math] of a $F$ -vector space $V$ defines a linear isomorphism [math]\displaystyle{ \phi\colon F^n\to V }[/math] by

[math]\displaystyle{ \phi(x_1,\ldots,x_n)=\sum_{i=1}^n x_i v_i. }[/math]

Conversely, such a linear isomorphism defines a basis, which is the image by [math]\displaystyle{ \phi }[/math] of the standard basis of [math]\displaystyle{ F^n. }[/math]

Let [math]\displaystyle{ B_\mathrm {old}=(v_1, \ldots, v_n) }[/math] be the "old basis" of a change of basis, and [math]\displaystyle{ \phi_\mathrm {old} }[/math] the associated isomorphism. Given a change-of basis matrix $A$ , let consider it as the matrix of an endomorphism [math]\displaystyle{ \psi_A }[/math] of [math]\displaystyle{ F^n. }[/math] Finally, let define

[math]\displaystyle{ \phi_\mathrm{new}=\phi_\mathrm{old}\circ\psi_A }[/math]

(where [math]\displaystyle{ \circ }[/math] denotes function composition), and

[math]\displaystyle{ B_\mathrm{new}= \phi_\mathrm{new}(\phi_\mathrm{old}^{-1}(B_\mathrm{old})). }[/math]

A straightforward verification, allows showing that this definition of [math]\displaystyle{ B_\mathrm{new} }[/math] is the same as that of the preceding section.

Now, by composing the equation [math]\displaystyle{ \phi_\mathrm{new}=\phi_\mathrm{old}\circ\psi_A }[/math] with [math]\displaystyle{ \phi_\mathrm{old}^{-1} }[/math] on the left and [math]\displaystyle{ \phi_\mathrm{new}^{-1} }[/math] on the right, one gets

[math]\displaystyle{ \phi_\mathrm{old}^{-1} = \psi_A \circ \phi_\mathrm{new}^{-1}. }[/math]

It follows that, for [math]\displaystyle{ v\in V, }[/math] one has

[math]\displaystyle{ \phi_\mathrm{old}^{-1}(v)= \psi_A(\phi_\mathrm{new}^{-1}(v)), }[/math]

which is the change-of-basis formula expressed in terms of linear maps instead of coordinates.

Function defined on a vector space

A function that has a vector space as its domain is commonly specified as a multivariate function whose variables are the coordinates on some basis of the vector on which the function is applied.

When the basis is changed, the expression of the function is changed. This change can be computed by substituting the "old" coordinates for their expressions in terms of the "new" coordinates. More precisely, if $f (x)$ is the expression of the function in terms of the old coordinates, and if $x = A y$ is the change-of-base formula, then $f (A y)$ is the expression of the same function in terms of the new coordinates.

The fact that the change-of-basis formula expresses the old coordinates in terms of the new one may seem unnatural, but appears as useful, as no matrix inversion is needed here.

As the change-of-basis formula involves only linear functions, many function properties are kept by a change of basis. This allows defining these properties as properties of functions of a variable vector that are not related to any specific basis. So, a function whose domain is a vector space or a subset of it is

a linear function,
a polynomial function,
a continuous function,
a differentiable function,
a smooth function,
an analytic function,

if the multivariate function that represents it on some basis—and thus on every basis—has the same property.

This is specially useful in the theory of manifolds, as this allows extending the concepts of continuous, differentiable, smooth and analytic functions to functions that are defined on a manifold.

Linear maps

Consider a linear map $T : W \to V$ from a vector space $W$ of dimension $n$ to a vector space $V$ of dimension $m$ . It is represented on "old" bases of $V$ and $W$ by a $m \times n$ matrix $M$ . A change of bases is defined by an $m \times m$ change-of-basis matrix $P$ for $V$ , and an $n \times n$ change-of-basis matrix $Q$ for $W$ .

On the "new" bases, the matrix of $T$ is

[math]\displaystyle{ P^{-1}MQ. }[/math]

This is a straightforward consequence of the change-of-basis formula.

Endomorphisms

Endomorphisms, are linear maps from a vector space $V$ to itself. For a change of basis, the formula of the preceding section applies, with the same change-of-basis matrix on both sides of the formula. That is, if $M$ is the square matrix of an endomorphism of $V$ over an "old" basis, and $P$ is a change-of-basis matrix, then the matrix of the endomorphism on the "new" basis is

[math]\displaystyle{ P^{-1}MP. }[/math]

As every invertible matrix can be used as a change-of-basis matrix, this implies that two matrices are similar if and only if they represent the same endomorphism on two different bases.

Bilinear forms

A bilinear form on a vector space V over a field $F$ is a function $V \times V \to F$ which is linear in both arguments. That is, $B : V \times V \to F$ is bilinear if the maps [math]\displaystyle{ v \mapsto B(v, w) }[/math] and [math]\displaystyle{ v \mapsto B(w, v) }[/math] are linear for every fixed [math]\displaystyle{ w\in V. }[/math]

The matrix $B$ of a bilinear form $B$ on a basis [math]\displaystyle{ (v_1, \ldots, v_n) }[/math] (the "old" basis in what follows) is the matrix whose entry of the $i$ th row and $j$ th column is $B (i, j)$ . It follows that if $v$ and $w$ are the column vectors of the coordinates of two vectors $v$ and $w$ , one has

[math]\displaystyle{ B(v, w)=\mathbf v^{\mathsf T}\mathbf B\mathbf w, }[/math]

where [math]\displaystyle{ \mathbf v^{\mathsf T} }[/math] denotes the transpose of the matrix $v$ .

If $P$ is a change of basis matrix, then a straightforward computation shows that the matrix of the bilinear form on the new basis is

[math]\displaystyle{ P^{\mathsf T}\mathbf B P. }[/math]

A symmetric bilinear form is a bilinear form $B$ such that [math]\displaystyle{ B(v,w)=B(w,v) }[/math] for every $v$ and $w$ in $V$ . It follows that the matrix of $B$ on any basis is symmetric. This implies that the property of being a symmetric matrix must be kept by the above change-of-base formula. One can also check this by noting that the transpose of a matrix product is the product of the transposes computed in the reverse order. In particular,

[math]\displaystyle{ (P^{\mathsf T}\mathbf B P)^{\mathsf T} = P^{\mathsf T}\mathbf B^{\mathsf T} P, }[/math]

and the two members of this equation equal [math]\displaystyle{ P^{\mathsf T} \mathbf B P }[/math] if the matrix $B$ is symmetric.

If the characteristic of the ground field $F$ is not two, then for every symmetric bilinear form there is a basis for which the matrix is diagonal. Moreover, the resulting nonzero entries on the diagonal are defined up to the multiplication by a square. So, if the ground field is the field [math]\displaystyle{ \mathbb R }[/math] of the real numbers, these nonzero entries can be chosen to be either $1$ or $-1$ . Sylvester's law of inertia is a theorem that asserts that the numbers of $1$ and of $-1$ depends only on the bilinear form, and not of the change of basis.

Symmetric bilinear forms over the reals are often encountered in geometry and physics, typically in the study of quadrics and of the inertia of a rigid body. In these cases, orthonormal bases are specially useful; this means that one generally prefer to restrict changes of basis to those that have an orthogonal change-of-base matrix, that is, a matrix such that [math]\displaystyle{ P^{\mathsf T}=P^{-1}. }[/math] Such matrices have the fundamental property that the change-of-base formula is the same for a symmetric bilinear form and the endomorphism that is represented by the same symmetric matrix. The Spectral theorem asserts that, given such a symmetric matrix, there is an orthogonal change of basis such that the resulting matrix (of both the bilinear form and the endomorphism) is a diagonal matrix with the eigenvalues of the initial matrix on the diagonal. It follows that, over the reals, if the matrix of an endomorphism is symmetric, then it is diagonalizable.

Notes

↑ Although a basis is generally defined as a set of vectors (for example, as a spanning set that is linearly independent), the tuple notation is convenient here, since the indexing by the first positive integers makes the basis an ordered basis.

References

↑ (Anton 1987)
↑ (Beauregard Fraleigh)
↑ (Nering 1970)

Bibliography

Anton, Howard (1987), Elementary Linear Algebra (5th ed.), New York: John Wiley & Sons, ISBN 0-471-84819-0
Beauregard, Raymond A.; Fraleigh, John B. (1973), A First Course In Linear Algebra: with Optional Introduction to Groups, Rings, and Fields, Boston: Houghton Mifflin Company, ISBN 0-395-14017-X, https://archive.org/details/firstcourseinlin0000beau
Nering, Evar D. (1970), Linear Algebra and Matrix Theory (2nd ed.), New York: John Wiley & Sons

External links

MIT Linear Algebra Lecture on Change of Basis, from MIT OpenCourseWare
Khan Academy Lecture on Change of Basis, from Khan Academy

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/Change of basis. Read more

[4] Although a basis is generally defined as a set of vectors (for example, as a spanning set that is linearly independent), the tuple notation is convenient here, since the indexing by the first positive integers makes the basis an ordered basis.

[1] (Anton 1987)

[2] (Beauregard Fraleigh)

[3] (Nering 1970)

[1]

[2]

[3]

[lower-alpha 1]

v t e Linear algebra
Basic concepts	Scalar Vector Vector space Scalar multiplication Vector projection Linear span Linear map Linear projection Linear independence Linear combination Basis Change of basis Row and column vectors Row and column spaces Orthogonality Kernel Eigenvalues and eigenvectors Outer product Inner product space Dot product Transpose Gram–Schmidt process Linear equations Fundamental theorem
Vector algebra	Cross product Triple product Seven-dimensional cross product
Multilinear algebra	Geometric algebra Exterior algebra Bivector Multivector Tensor Outermorphism
Matrices	Block Decomposition Invertible Minor Multiplication Rank Transformation Cramer's rule Gaussian elimination Determinant
Algebraic constructions	Dual Direct sum Function space Quotient Subspace Tensor product
Numerical	Floating-point MATLAB Numerical stability Basic Linear Algebra Subprograms (BLAS) Sparse matrix Comparison of linear algebra libraries Comparison of numerical analysis software
Category Outline Mathematics portal Wikibook Wikiversity

Anonymous

Search

Change of basis

Namespaces

More

Page actions

Contents

Change of basis formula

Example

In terms of linear maps

Function defined on a vector space

Linear maps

Endomorphisms

Bilinear forms

See also

Notes

References

Bibliography

External links

Navigation

Navigation

Help

Translate

Wiki tools

Wiki tools

Anonymous

Search

Change of basis

Change of basis formula

Example

In terms of linear maps

Function defined on a vector space

Linear maps

Endomorphisms

Bilinear forms

See also

Notes

References

Bibliography

External links

Navigation

Wiki tools

Page tools

Other projects

Categories