Tensor contraction

Short description: Operation in mathematics and physics

In multilinear algebra, a tensor contraction is an operation on a tensor that arises from the canonical pairing of a vector space and its dual. In components, it is expressed as a sum of products of scalar components of the tensor(s) caused by applying the summation convention to a pair of dummy indices that are bound to each other in an expression. The contraction of a single mixed tensor occurs when a pair of literal indices (one a subscript, the other a superscript) of the tensor are set equal to each other and summed over. In Einstein notation this summation is built into the notation. The result is another tensor with order reduced by 2.

Tensor contraction can be seen as a generalization of the trace.

Abstract formulation

Let V be a vector space over a field k. The core of the contraction operation, and the simplest case, is the canonical pairing of V with its dual vector space V^∗. The pairing is the linear map from the tensor product of these two spaces to the field k:

[math]\displaystyle{ C : V \otimes V^* \rightarrow k }[/math]

corresponding to the bilinear form

[math]\displaystyle{ \langle v, f \rangle = f(v) }[/math]

where f is in V^∗ and v is in V. The map C defines the contraction operation on a tensor of type (1, 1), which is an element of [math]\displaystyle{ V \otimes V^* }[/math]. Note that the result is a scalar (an element of k). In finite dimensions, using the natural isomorphism between [math]\displaystyle{ V \otimes V^* }[/math] and the space of linear map from V to V, one obtains a basis-free definition of the trace.

In general, a tensor of type (m, n) (with m ≥ 1 and n ≥ 1) is an element of the vector space

[math]\displaystyle{ V \otimes \cdots \otimes V \otimes V^{*} \otimes \cdots \otimes V^{*} }[/math]

(where there are m factors V and n factors V^∗). Applying the canonical pairing to the kth V factor and the lth V^∗ factor, and using the identity on all other factors, defines the (k, l) contraction operation, which is a linear map that yields a tensor of type (m − 1, n − 1). By analogy with the (1, 1) case, the general contraction operation is sometimes called the trace.

Contraction in index notation

In tensor index notation, the basic contraction of a vector and a dual vector is denoted by

[math]\displaystyle{ \tilde f (\vec v) = f_\gamma v^\gamma, }[/math]

which is shorthand for the explicit coordinate summation

[math]\displaystyle{ f_\gamma v^\gamma = f_1 v^1 + f_2 v^2 + \cdots + f_n v^n }[/math]

(where vⁱ are the components of v in a particular basis and f_i are the components of f in the corresponding dual basis).

Since a general mixed dyadic tensor is a linear combination of decomposable tensors of the form [math]\displaystyle{ f \otimes v }[/math], the explicit formula for the dyadic case follows: let

[math]\displaystyle{ \mathbf{T} = T_{j}^i \mathbf{e}_i \otimes \mathbf{e}^j }[/math]

be a mixed dyadic tensor. Then its contraction is

[math]\displaystyle{ T_{j}^i \mathbf{e}_i \cdot \mathbf{e}^j = T_{j}^i \delta_i {}^j = T_{j}^j= T_{1}^1 + \cdots + T_{n}^n }[/math].

A general contraction is denoted by labeling one covariant index and one contravariant index with the same letter, summation over that index being implied by the summation convention. The resulting contracted tensor inherits the remaining indices of the original tensor. For example, contracting a tensor T of type (2,2) on the second and third indices to create a new tensor U of type (1,1) is written as

[math]\displaystyle{ T^{ab} {}_{bc} = \sum_{b}{T^{ab}{}_{bc}} = T^{a1} {}_{1c} + T^{a2} {}_{2c} + \cdots + T^{an} {}_{nc} = U^a {}_c . }[/math]

By contrast, let

[math]\displaystyle{ \mathbf{T} = \mathbf{e}^i \otimes \mathbf{e}^j }[/math]

be an unmixed dyadic tensor. This tensor does not contract; if its base vectors are dotted, the result is the contravariant metric tensor,

[math]\displaystyle{ g^{ij} = \mathbf{e}^i \cdot \mathbf{e}^j }[/math],

whose rank is 2.

Metric contraction

As in the previous example, contraction on a pair of indices that are either both contravariant or both covariant is not possible in general. However, in the presence of an inner product (also known as a metric) g, such contractions are possible. One uses the metric to raise or lower one of the indices, as needed, and then one uses the usual operation of contraction. The combined operation is known as metric contraction.

Application to tensor fields

Contraction is often applied to tensor fields over spaces (e.g. Euclidean space, manifolds, or schemes). Since contraction is a purely algebraic operation, it can be applied pointwise to a tensor field, e.g. if T is a (1,1) tensor field on Euclidean space, then in any coordinates, its contraction (a scalar field) U at a point x is given by

[math]\displaystyle{ U(x) = \sum_{i} T^{i}_{i}(x) }[/math]

Since the role of x is not complicated here, it is often suppressed, and the notation for tensor fields becomes identical to that for purely algebraic tensors.

Over a Riemannian manifold, a metric (field of inner products) is available, and both metric and non-metric contractions are crucial to the theory. For example, the Ricci tensor is a non-metric contraction of the Riemann curvature tensor, and the scalar curvature is the unique metric contraction of the Ricci tensor.

One can also view contraction of a tensor field in the context of modules over an appropriate ring of functions on the manifold or the context of sheaves of modules over the structure sheaf; see the discussion at the end of this article.

Tensor divergence

As an application of the contraction of a tensor field, let V be a vector field on a Riemannian manifold (for example, Euclidean space). Let [math]\displaystyle{ V^\alpha {}_{\beta} }[/math] be the covariant derivative of V (in some choice of coordinates). In the case of Cartesian coordinates in Euclidean space, one can write

[math]\displaystyle{ V^\alpha {}_{\beta} = {\partial V^\alpha \over \partial x^\beta}. }[/math]

Then changing index β to α causes the pair of indices to become bound to each other, so that the derivative contracts with itself to obtain the following sum:

[math]\displaystyle{ V^\alpha {}_{\alpha} = V^0 {}_{0} + \cdots + V^n {}_{n}, }[/math]

which is the divergence div V. Then

[math]\displaystyle{ \operatorname{div} V = V^\alpha {}_{\alpha} = 0 }[/math]

is a continuity equation for V.

In general, one can define various divergence operations on higher-rank tensor fields, as follows. If T is a tensor field with at least one contravariant index, taking the covariant differential and contracting the chosen contravariant index with the new covariant index corresponding to the differential results in a new tensor of rank one lower than that of T.

Contraction of a pair of tensors

One can generalize the core contraction operation (vector with dual vector) in a slightly different way, by considering a pair of tensors T and U. The tensor product [math]\displaystyle{ T \otimes U }[/math] is a new tensor, which, if it has at least one covariant and one contravariant index, can be contracted. The case where T is a vector and U is a dual vector is exactly the core operation introduced first in this article.

In tensor index notation, to contract two tensors with each other, one places them side by side (juxtaposed) as factors of the same term. This implements the tensor product, yielding a composite tensor. Contracting two indices in this composite tensor implements the desired contraction of the two tensors.

For example, matrices can be represented as tensors of type (1,1) with the first index being contravariant and the second index being covariant. Let [math]\displaystyle{ \Lambda^\alpha {}_\beta }[/math] be the components of one matrix and let [math]\displaystyle{ \Mu^\beta {}_\gamma }[/math] be the components of a second matrix. Then their multiplication is given by the following contraction, an example of the contraction of a pair of tensors:

[math]\displaystyle{ \Lambda^\alpha {}_\beta \Mu^\beta {}_\gamma = \Nu^\alpha {}_\gamma }[/math].

Also, the interior product of a vector with a differential form is a special case of the contraction of two tensors with each other.

More general algebraic contexts

Let R be a commutative ring and let M be a finite free module over R. Then contraction operates on the full (mixed) tensor algebra of M in exactly the same way as it does in the case of vector spaces over a field. (The key fact is that the canonical pairing is still perfect in this case.)

More generally, let O_X be a sheaf of commutative rings over a topological space X, e.g. O_X could be the structure sheaf of a complex manifold, analytic space, or scheme. Let M be a locally free sheaf of modules over O_X of finite rank. Then the dual of M is still well-behaved and contraction operations make sense in this context.

See also

• Tensor product
• Partial trace
• Interior product
• Raising and lowering indices
• Musical isomorphism
• Ricci calculus

References

• Bishop, Richard L.; Goldberg, Samuel I. (1980). Tensor Analysis on Manifolds. New York: Dover. ISBN 0-486-64039-6. https://archive.org/details/tensoranalysison00bish. 
• Menzel, Donald H. (1961). Mathematical Physics. New York: Dover. ISBN 0-486-60056-4.