Compact operator

Short description: Type of continuous linear operator

In functional analysis, a branch of mathematics, a compact operator is a linear operator [math]\displaystyle{ T: X \to Y }[/math], where [math]\displaystyle{ X,Y }[/math] are normed vector spaces, with the property that [math]\displaystyle{ T }[/math] maps bounded subsets of [math]\displaystyle{ X }[/math] to relatively compact subsets of [math]\displaystyle{ Y }[/math] (subsets with compact closure in [math]\displaystyle{ Y }[/math]). Such an operator is necessarily a bounded operator, and so continuous. Some authors require that [math]\displaystyle{ X,Y }[/math] are Banach, but the definition can be extended to more general spaces.

Any bounded operator [math]\displaystyle{ T }[/math] that has finite rank is a compact operator; indeed, the class of compact operators is a natural generalization of the class of finite-rank operators in an infinite-dimensional setting. When [math]\displaystyle{ Y }[/math] is a Hilbert space, it is true that any compact operator is a limit of finite-rank operators, so that the class of compact operators can be defined alternatively as the closure of the set of finite-rank operators in the norm topology. Whether this was true in general for Banach spaces (the approximation property) was an unsolved question for many years; in 1973 Per Enflo gave a counter-example, building on work by Grothendieck and Banach.

The origin of the theory of compact operators is in the theory of integral equations, where integral operators supply concrete examples of such operators. A typical Fredholm integral equation gives rise to a compact operator K on function spaces; the compactness property is shown by equicontinuity. The method of approximation by finite-rank operators is basic in the numerical solution of such equations. The abstract idea of Fredholm operator is derived from this connection.

Equivalent formulations

A linear map [math]\displaystyle{ T: X \to Y }[/math] between two topological vector spaces is said to be compact if there exists a neighborhood [math]\displaystyle{ U }[/math] of the origin in [math]\displaystyle{ X }[/math] such that [math]\displaystyle{ T(U) }[/math] is a relatively compact subset of [math]\displaystyle{ Y }[/math].

Let [math]\displaystyle{ X,Y }[/math] be normed spaces and [math]\displaystyle{ T: X \to Y }[/math] a linear operator. Then the following statements are equivalent, and some of them are used as the principal definition by different authors

• [math]\displaystyle{ T }[/math] is a compact operator;
• the image of the unit ball of [math]\displaystyle{ X }[/math] under [math]\displaystyle{ T }[/math] is relatively compact in [math]\displaystyle{ Y }[/math];
• the image of any bounded subset of [math]\displaystyle{ X }[/math] under [math]\displaystyle{ T }[/math] is relatively compact in [math]\displaystyle{ Y }[/math];
• there exists a neighbourhood [math]\displaystyle{ U }[/math] of the origin in [math]\displaystyle{ X }[/math] and a compact subset [math]\displaystyle{ V\subseteq Y }[/math] such that [math]\displaystyle{ T(U)\subseteq V }[/math];
• for any bounded sequence [math]\displaystyle{ (x_n)_{n\in \N} }[/math] in [math]\displaystyle{ X }[/math], the sequence [math]\displaystyle{ (Tx_n)_{n\in\N} }[/math] contains a converging subsequence.

If in addition [math]\displaystyle{ Y }[/math] is Banach, these statements are also equivalent to:

• the image of any bounded subset of [math]\displaystyle{ X }[/math] under [math]\displaystyle{ T }[/math] is totally bounded in [math]\displaystyle{ Y }[/math].

If a linear operator is compact, then it is continuous.

Important properties

In the following, [math]\displaystyle{ X, Y, Z, W }[/math] are Banach spaces, [math]\displaystyle{ B(X,Y) }[/math] is the space of bounded operators [math]\displaystyle{ X \to Y }[/math] under the operator norm, and [math]\displaystyle{ K(X,Y) }[/math] denotes the space of compact operators [math]\displaystyle{ X \to Y }[/math]. [math]\displaystyle{ \operatorname{Id}_X }[/math] denotes the identity operator on [math]\displaystyle{ X }[/math], [math]\displaystyle{ B(X) = B(X,X) }[/math], and [math]\displaystyle{ K(X) = K(X,X) }[/math].

• [math]\displaystyle{ K(X,Y) }[/math] is a closed subspace of [math]\displaystyle{ B(X,Y) }[/math] (in the norm topology). Equivalently,
  • given a sequence of compact operators [math]\displaystyle{ (T_n)_{n \in \mathbf{N}} }[/math] mapping [math]\displaystyle{ X \to Y }[/math] (where [math]\displaystyle{ X,Y }[/math]are Banach) and given that [math]\displaystyle{ (T_n)_{n \in \mathbf{N}} }[/math] converges to [math]\displaystyle{ T }[/math] with respect to the operator norm, [math]\displaystyle{ T }[/math] is then compact.
• Conversely, if [math]\displaystyle{ X,Y }[/math] are Hilbert spaces, then every compact operator from [math]\displaystyle{ X \to Y }[/math] is the limit of finite rank operators. Notably, this "approximation property" is false for general Banach spaces X and Y.
• [math]\displaystyle{ B(Y,Z)\circ K(X,Y)\circ B(W,X)\subseteq K(W,Z). }[/math]  In particular, [math]\displaystyle{ K(X) }[/math] forms a two-sided ideal in [math]\displaystyle{ B(X) }[/math].
• Any compact operator is strictly singular, but not vice versa.
• A bounded linear operator between Banach spaces is compact if and only if its adjoint is compact (Schauder's theorem).
  • If [math]\displaystyle{ T: X \to Y }[/math] is bounded and compact, then:
    • the closure of the range of [math]\displaystyle{ T }[/math] is separable.
    • if the range of [math]\displaystyle{ T }[/math] is closed in Y, then the range of [math]\displaystyle{ T }[/math] is finite-dimensional.
• If [math]\displaystyle{ X }[/math] is a Banach space and there exists an invertible bounded compact operator [math]\displaystyle{ T: X \to X }[/math] then [math]\displaystyle{ X }[/math] is necessarily finite-dimensional.

Now suppose that [math]\displaystyle{ X }[/math] is a Banach space and [math]\displaystyle{ T: X \to X }[/math] is a compact linear operator, and [math]\displaystyle{ T^* : X^* \to X^* }[/math] is the adjoint or transpose of T.

• For any [math]\displaystyle{ T\in K(X) }[/math], then [math]\displaystyle{ {\operatorname{Id}_X} - T }[/math]  is a Fredholm operator of index 0. In particular, [math]\displaystyle{ \operatorname{Im}\,({\operatorname{Id}_X} - T) }[/math]  is closed. This is essential in developing the spectral properties of compact operators. One can notice the similarity between this property and the fact that, if [math]\displaystyle{ M }[/math] and [math]\displaystyle{ N }[/math] are subspaces of [math]\displaystyle{ X }[/math] where [math]\displaystyle{ M }[/math] is closed and [math]\displaystyle{ N }[/math] is finite-dimensional, then [math]\displaystyle{ M+N }[/math] is also closed.
• If [math]\displaystyle{ S: X \to X }[/math] is any bounded linear operator then both [math]\displaystyle{ S \circ T }[/math] and [math]\displaystyle{ T \circ S }[/math] are compact operators.
• If [math]\displaystyle{ \lambda \neq 0 }[/math] then the range of [math]\displaystyle{ T - \lambda \operatorname{Id}_X }[/math] is closed and the kernel of [math]\displaystyle{ T - \lambda \operatorname{Id}_X }[/math] is finite-dimensional.
• If [math]\displaystyle{ \lambda \neq 0 }[/math] then the following are finite and equal: [math]\displaystyle{ \dim \ker \left( T - \lambda \operatorname{Id}_X \right) = \dim X / \operatorname{Im}\left( T - \lambda \operatorname{Id}_X \right) = \dim \ker \left( T^* - \lambda \operatorname{Id}_{X^*} \right) = \dim X^* / \operatorname{Im}\left( T^* - \lambda \operatorname{Id}_{X^*} \right) }[/math]
• The spectrum [math]\displaystyle{ \sigma(T) }[/math] of [math]\displaystyle{ T }[/math], is compact, countable, and has at most one limit point, which would necessarily be the origin.
• If [math]\displaystyle{ X }[/math] is infinite-dimensional then [math]\displaystyle{ 0 \in \sigma(T) }[/math].
• If [math]\displaystyle{ \lambda \neq 0 }[/math] and [math]\displaystyle{ \lambda \in \sigma(T) }[/math] then [math]\displaystyle{ \lambda }[/math] is an eigenvalue of both [math]\displaystyle{ T }[/math] and [math]\displaystyle{ T^{*} }[/math].
• For every [math]\displaystyle{ r \gt 0 }[/math] the set [math]\displaystyle{ E_r = \left\{ \lambda \in \sigma(T) : | \lambda | \gt r \right\} }[/math] is finite, and for every non-zero [math]\displaystyle{ \lambda \in \sigma(T) }[/math] the range of [math]\displaystyle{ T - \lambda \operatorname{Id}_X }[/math] is a proper subset of X.

Origins in integral equation theory

A crucial property of compact operators is the Fredholm alternative, which asserts that the existence of solution of linear equations of the form

[math]\displaystyle{ (\lambda K + I)u = f }[/math]

(where K is a compact operator, f is a given function, and u is the unknown function to be solved for) behaves much like as in finite dimensions. The spectral theory of compact operators then follows, and it is due to Frigyes Riesz (1918). It shows that a compact operator K on an infinite-dimensional Banach space has spectrum that is either a finite subset of C which includes 0, or the spectrum is a countably infinite subset of C which has 0 as its only limit point. Moreover, in either case the non-zero elements of the spectrum are eigenvalues of K with finite multiplicities (so that K − λI has a finite-dimensional kernel for all complex λ ≠ 0).

An important example of a compact operator is compact embedding of Sobolev spaces, which, along with the Gårding inequality and the Lax–Milgram theorem, can be used to convert an elliptic boundary value problem into a Fredholm integral equation. Existence of the solution and spectral properties then follow from the theory of compact operators; in particular, an elliptic boundary value problem on a bounded domain has infinitely many isolated eigenvalues. One consequence is that a solid body can vibrate only at isolated frequencies, given by the eigenvalues, and arbitrarily high vibration frequencies always exist.

The compact operators from a Banach space to itself form a two-sided ideal in the algebra of all bounded operators on the space. Indeed, the compact operators on an infinite-dimensional separable Hilbert space form a maximal ideal, so the quotient algebra, known as the Calkin algebra, is simple. More generally, the compact operators form an operator ideal.

Compact operator on Hilbert spaces

For Hilbert spaces, another equivalent definition of compact operators is given as follows.

An operator [math]\displaystyle{ T }[/math] on an infinite-dimensional Hilbert space [math]\displaystyle{ \mathcal{H} }[/math]

[math]\displaystyle{ T:\mathcal{H} \to \mathcal{H} }[/math]

is said to be compact if it can be written in the form

[math]\displaystyle{ T = \sum_{n=1}^\infty \lambda_n \langle f_n, \cdot \rangle g_n\,, }[/math]

where [math]\displaystyle{ \{f_1,f_2,\ldots\} }[/math] and [math]\displaystyle{ \{g_1,g_2,\ldots\} }[/math] are orthonormal sets (not necessarily complete), and [math]\displaystyle{ \lambda_1,\lambda_2,\ldots }[/math] is a sequence of positive numbers with limit zero, called the singular values of the operator. The singular values can accumulate only at zero. If the sequence becomes stationary at zero, that is [math]\displaystyle{ \lambda_{N+k}=0 }[/math] for some [math]\displaystyle{ N \in \N, }[/math] and every [math]\displaystyle{ k = 1,2,\dots }[/math], then the operator has finite rank, i.e, a finite-dimensional range and can be written as

[math]\displaystyle{ T = \sum_{n=1}^N \lambda_n \langle f_n, \cdot \rangle g_n\,. }[/math]

The bracket [math]\displaystyle{ \langle\cdot,\cdot\rangle }[/math] is the scalar product on the Hilbert space; the sum on the right hand side converges in the operator norm.

An important subclass of compact operators is the trace-class or nuclear operators, i.e., such that [math]\displaystyle{ \operatorname{Tr}(|T|)\lt \infty }[/math]. While all trace-class operators are compact operators, the converse is not necessarily true. For example [math]\displaystyle{ \lambda_n = \frac{1}{n} }[/math] tends to zero for [math]\displaystyle{ n \to \infty }[/math] while [math]\displaystyle{ \sum_{n=1}^{\infty} |\lambda_n| = \infty }[/math].

Completely continuous operators

Let X and Y be Banach spaces. A bounded linear operator T : X → Y is called completely continuous if, for every weakly convergent sequence [math]\displaystyle{ (x_n) }[/math] from X, the sequence [math]\displaystyle{ (Tx_n) }[/math] is norm-convergent in Y (Conway 1985). Compact operators on a Banach space are always completely continuous. If X is a reflexive Banach space, then every completely continuous operator T : X → Y is compact.

Somewhat confusingly, compact operators are sometimes referred to as "completely continuous" in older literature, even though they are not necessarily completely continuous by the definition of that phrase in modern terminology.

Examples

• Every finite rank operator is compact.
• For [math]\displaystyle{ \ell^p }[/math] and a sequence (t_n) converging to zero, the multiplication operator (Tx)_n = t_n x_n is compact.
• For some fixed g ∈ C([0, 1]; R), define the linear operator T from C([0, 1]; R) to C([0, 1]; R) by [math]\displaystyle{ (Tf)(x) = \int_0^x f(t)g(t) \, \mathrm{d} t. }[/math]That the operator T is indeed compact follows from the Ascoli theorem.
• More generally, if Ω is any domain in Rⁿ and the integral kernel k : Ω × Ω → R is a Hilbert–Schmidt kernel, then the operator T on L²(Ω; R) defined by [math]\displaystyle{ (T f)(x) = \int_{\Omega} k(x, y) f(y) \, \mathrm{d} y }[/math] is a compact operator.
• By Riesz's lemma, the identity operator is a compact operator if and only if the space is finite-dimensional.

See also

• Compact embedding
• Compact operator on Hilbert space
• Fredholm alternative
• Fredholm integral equation
• Fredholm operator
• Strictly singular operator
• Spectral theory of compact operators

References

• Conway, John B. (1985). A course in functional analysis. Springer-Verlag. Section 2.4. ISBN 978-3-540-96042-3. 
• Conway, John B. (1990). A Course in Functional Analysis. Graduate Texts in Mathematics. 96 (2nd ed.). New York: Springer-Verlag. ISBN 978-0-387-97245-9. OCLC 21195908. 
• Enflo, P. (1973). "A counterexample to the approximation problem in Banach spaces". Acta Mathematica 130 (1): 309–317. doi:10.1007/BF02392270. ISSN 0001-5962. 
• Kreyszig, Erwin (1978). Introductory functional analysis with applications. John Wiley & Sons. ISBN 978-0-471-50731-4. 
• Kutateladze, S.S. (1996). Fundamentals of Functional Analysis. Texts in Mathematical Sciences. 12 (2nd ed.). New York: Springer-Verlag. p. 292. ISBN 978-0-7923-3898-7. 
• Lax, Peter (2002). Functional Analysis. New York: Wiley-Interscience. ISBN 978-0-471-55604-6. OCLC 47767143. 
• Narici, Lawrence; Beckenstein, Edward (2011). Topological Vector Spaces. Pure and applied mathematics (Second ed.). Boca Raton, FL: CRC Press. ISBN 978-1584888666. OCLC 144216834. 
• Renardy, M.; Rogers, R. C. (2004). An introduction to partial differential equations. Texts in Applied Mathematics. 13 (2nd ed.). New York: Springer-Verlag. p. 356. ISBN 978-0-387-00444-0.  (Section 7.5)
• Rudin, Walter (January 1, 1991). Functional Analysis. International Series in Pure and Applied Mathematics. 8 (Second ed.). New York, NY: McGraw-Hill Science/Engineering/Math. ISBN 978-0-07-054236-5. OCLC 21163277. https://archive.org/details/functionalanalys00rudi. 
• Schaefer, Helmut H.; Wolff, Manfred P. (1999). Topological Vector Spaces. GTM. 8 (Second ed.). New York, NY: Springer New York Imprint Springer. ISBN 978-1-4612-7155-0. OCLC 840278135. 
• Trèves, François (August 6, 2006). Topological Vector Spaces, Distributions and Kernels. Mineola, N.Y.: Dover Publications. ISBN 978-0-486-45352-1. OCLC 853623322.