Arzelà–Ascoli theorem
The Arzelà–Ascoli theorem is a fundamental result of mathematical analysis giving necessary and sufficient conditions to decide whether every sequence of a given family of real-valued continuous functions defined on a closed and bounded interval has a uniformly convergent subsequence. The main condition is the equicontinuity of the family of functions. The theorem is the basis of many proofs in mathematics, including that of the Peano existence theorem in the theory of ordinary differential equations, Montel's theorem in complex analysis, and the Peter–Weyl theorem in harmonic analysis and various results concerning compactness of integral operators.
The notion of equicontinuity was introduced in the late 19th century by the Italian mathematicians Cesare Arzelà and Giulio Ascoli. A weak form of the theorem was proven by (Ascoli 1883–1884), who established the sufficient condition for compactness, and by (Arzelà 1895), who established the necessary condition and gave the first clear presentation of the result. A further generalization of the theorem was proven by (Fréchet 1906), to sets of real-valued continuous functions with domain a compact metric space (Dunford Schwartz). Modern formulations of the theorem allow for the domain to be compact Hausdorff and for the range to be an arbitrary metric space. More general formulations of the theorem exist that give necessary and sufficient conditions for a family of functions from a compactly generated Hausdorff space into a uniform space to be compact in the compact-open topology; see (Kelley 1991).
Statement and first consequences
By definition, a sequence [math]\displaystyle{ \{f_n\}_{n \in \mathbb{N}} }[/math] of continuous functions on an interval I = [a, b] is uniformly bounded if there is a number M such that
- [math]\displaystyle{ \left|f_n(x)\right| \le M }[/math]
for every function fn belonging to the sequence, and every x ∈ [a, b]. (Here, M must be independent of n and x.)
The sequence is said to be uniformly equicontinuous if, for every ε > 0, there exists a δ > 0 such that
- [math]\displaystyle{ \left|f_n(x)-f_n(y)\right| \lt \varepsilon }[/math]
whenever |x − y| < δ for all functions fn in the sequence. (Here, δ may depend on ε, but not x, y or n.)
One version of the theorem can be stated as follows:
- Consider a sequence of real-valued continuous functions { fn }n ∈ N defined on a closed and bounded interval [a, b] of the real line. If this sequence is uniformly bounded and uniformly equicontinuous, then there exists a subsequence { fnk }k ∈ N that converges uniformly.
- The converse is also true, in the sense that if every subsequence of { fn } itself has a uniformly convergent subsequence, then { fn } is uniformly bounded and equicontinuous.
The proof is essentially based on a diagonalization argument. The simplest case is of real-valued functions on a closed and bounded interval:
- Let I = [a, b] ⊂ R be a closed and bounded interval. If F is an infinite set of functions f : I → R which is uniformly bounded and equicontinuous, then there is a sequence fn of elements of F such that fn converges uniformly on I.
Fix an enumeration {xi}i ∈N of rational numbers in I. Since F is uniformly bounded, the set of points {f(x1)}f∈F is bounded, and hence by the Bolzano–Weierstrass theorem, there is a sequence {fn1} of distinct functions in F such that {fn1(x1)} converges. Repeating the same argument for the sequence of points {fn1(x2)}, there is a subsequence {fn2} of {fn1} such that {fn2(x2)} converges.
By induction this process can be continued forever, and so there is a chain of subsequences
- [math]\displaystyle{ \left \{f_{n_1} \right \} \supseteq \left \{f_{n_2} \right \} \supseteq \cdots }[/math]
such that, for each k = 1, 2, 3, ..., the subsequence {fnk} converges at x1, ..., xk. Now form the diagonal subsequence {f} whose mth term fm is the mth term in the mth subsequence {fnm}. By construction, fm converges at every rational point of I.
Therefore, given any ε > 0 and rational xk in I, there is an integer N = N(ε, xk) such that
- [math]\displaystyle{ |f_n(x_k) - f_m(x_k)| \lt \tfrac{\varepsilon}{3}, \qquad n, m \ge N. }[/math]
Since the family F is equicontinuous, for this fixed ε and for every x in I, there is an open interval Ux containing x such that
- [math]\displaystyle{ |f(s)-f(t)| \lt \tfrac{\varepsilon}{3} }[/math]
for all f ∈ F and all s, t in I such that s, t ∈ Ux.
The collection of intervals Ux, x ∈ I, forms an open cover of I. Since I is closed and bounded, by the Heine–Borel theorem I is compact, implying that this covering admits a finite subcover U1, ..., UJ. There exists an integer K such that each open interval Uj, 1 ≤ j ≤ J, contains a rational xk with 1 ≤ k ≤ K. Finally, for any t ∈ I, there are j and k so that t and xk belong to the same interval Uj. For this choice of k,
- [math]\displaystyle{ \begin{align} \left |f_n(t)-f_m(t) \right| &\le \left|f_n(t) - f_n(x_k) \right| + |f_n(x_k) - f_m(x_k)| + |f_m(x_k) - f_m(t)| \\ &\lt \tfrac{\varepsilon}{3} + \tfrac{\varepsilon}{3} + \tfrac{\varepsilon}{3} \end{align} }[/math]
for all n, m > N = max{N(ε, x1), ..., N(ε, xK)}. Consequently, the sequence {fn} is uniformly Cauchy, and therefore converges to a continuous function, as claimed. This completes the proof.
Immediate examples
Differentiable functions
The hypotheses of the theorem are satisfied by a uniformly bounded sequence { fn } of differentiable functions with uniformly bounded derivatives. Indeed, uniform boundedness of the derivatives implies by the mean value theorem that for all x and y,
- [math]\displaystyle{ \left|f_n(x) - f_n(y)\right| \le K |x-y|, }[/math]
where K is the supremum of the derivatives of functions in the sequence and is independent of n. So, given ε > 0, let δ = ε/2K to verify the definition of equicontinuity of the sequence. This proves the following corollary:
- Let {fn} be a uniformly bounded sequence of real-valued differentiable functions on [a, b] such that the derivatives {fn′} are uniformly bounded. Then there exists a subsequence {fnk} that converges uniformly on [a, b].
If, in addition, the sequence of second derivatives is also uniformly bounded, then the derivatives also converge uniformly (up to a subsequence), and so on. Another generalization holds for continuously differentiable functions. Suppose that the functions fn are continuously differentiable with derivatives f′n. Suppose that fn′ are uniformly equicontinuous and uniformly bounded, and that the sequence { fn }, is pointwise bounded (or just bounded at a single point). Then there is a subsequence of the { fn } converging uniformly to a continuously differentiable function.
The diagonalization argument can also be used to show that a family of infinitely differentiable functions, whose derivatives of each order are uniformly bounded, has a uniformly convergent subsequence, all of whose derivatives are also uniformly convergent. This is particularly important in the theory of distributions.
Lipschitz and Hölder continuous functions
The argument given above proves slightly more, specifically
- If { fn } is a uniformly bounded sequence of real valued functions on [a, b] such that each f is Lipschitz continuous with the same Lipschitz constant K:
- [math]\displaystyle{ \left|f_n(x) - f_n(y)\right| \le K|x-y| }[/math]
- for all x, y ∈ [a, b] and all fn , then there is a subsequence that converges uniformly on [a, b].
The limit function is also Lipschitz continuous with the same value K for the Lipschitz constant. A slight refinement is
- A set F of functions f on [a, b] that is uniformly bounded and satisfies a Hölder condition of order α, 0 < α ≤ 1, with a fixed constant M,
- [math]\displaystyle{ \left|f(x) - f(y)\right| \le M \, |x - y|^\alpha, \qquad x, y \in [a, b] }[/math]
- is relatively compact in C([a, b]). In particular, the unit ball of the Hölder space C0,α([a, b]) is compact in C([a, b]).
This holds more generally for scalar functions on a compact metric space X satisfying a Hölder condition with respect to the metric on X.
Generalizations
Euclidean spaces
The Arzelà–Ascoli theorem holds, more generally, if the functions fn take values in d-dimensional Euclidean space Rd, and the proof is very simple: just apply the R-valued version of the Arzelà–Ascoli theorem d times to extract a subsequence that converges uniformly in the first coordinate, then a sub-subsequence that converges uniformly in the first two coordinates, and so on. The above examples generalize easily to the case of functions with values in Euclidean space.
Compact metric spaces and compact Hausdorff spaces
The definitions of boundedness and equicontinuity can be generalized to the setting of arbitrary compact metric spaces and, more generally still, compact Hausdorff spaces. Let X be a compact Hausdorff space, and let C(X) be the space of real-valued continuous functions on X. A subset F ⊂ C(X) is said to be equicontinuous if for every x ∈ X and every ε > 0, x has a neighborhood Ux such that
- [math]\displaystyle{ \forall y \in U_x, \forall f \in \mathbf{F} : \qquad |f(y) - f(x)| \lt \varepsilon. }[/math]
A set F ⊂ C(X, R) is said to be pointwise bounded if for every x ∈ X,
- [math]\displaystyle{ \sup \{ | f(x) | : f \in \mathbf{F} \} \lt \infty. }[/math]
A version of the Theorem holds also in the space C(X) of real-valued continuous functions on a compact Hausdorff space X (Dunford Schwartz):
- Let X be a compact Hausdorff space. Then a subset F of C(X) is relatively compact in the topology induced by the uniform norm if and only if it is equicontinuous and pointwise bounded.
The Arzelà–Ascoli theorem is thus a fundamental result in the study of the algebra of continuous functions on a compact Hausdorff space.
Various generalizations of the above quoted result are possible. For instance, the functions can assume values in a metric space or (Hausdorff) topological vector space with only minimal changes to the statement (see, for instance, (Kelley Namioka), (Kelley 1991)):
- Let X be a compact Hausdorff space and Y a metric space. Then F ⊂ C(X, Y) is compact in the compact-open topology if and only if it is equicontinuous, pointwise relatively compact and closed.
Here pointwise relatively compact means that for each x ∈ X, the set Fx = { f (x) : f ∈ F} is relatively compact in Y.
In the case that Y is complete, the proof given above can be generalized in a way that does not rely on the separability of the domain. On a compact Hausdorff space X, for instance, the equicontinuity is used to extract, for each ε = 1/n, a finite open covering of X such that the oscillation of any function in the family is less than ε on each open set in the cover. The role of the rationals can then be played by a set of points drawn from each open set in each of the countably many covers obtained in this way, and the main part of the proof proceeds exactly as above. A similar argument is used as a part of the proof for the general version which does not assume completeness of Y.
Functions on non-compact spaces
The Arzela-Ascoli theorem generalises to functions [math]\displaystyle{ X \rightarrow Y }[/math] where [math]\displaystyle{ X }[/math] is not compact. Particularly important are cases where [math]\displaystyle{ X }[/math] is a topological vector space. Recall that if [math]\displaystyle{ X }[/math] is a topological space and [math]\displaystyle{ Y }[/math] is a uniform space (such as any metric space or any topological group, metrisable or not), there is the topology of compact convergence on the set [math]\displaystyle{ \mathfrak{F}(X,Y) }[/math] of functions [math]\displaystyle{ X \rightarrow Y }[/math]; it is set up so that a sequence (or more generally a filter or net) of functions converges if and only if it converges uniformly on each compact subset of [math]\displaystyle{ X }[/math]. Let [math]\displaystyle{ \mathcal{C}_c(X,Y) }[/math] be the subspace of [math]\displaystyle{ \mathfrak{F}(X,Y) }[/math] consisting of continuous functions, equipped with the topology of compact convergence. Then one form of the Arzèla-Ascoli theorem is the following:
- Let [math]\displaystyle{ X }[/math] be a topological space, [math]\displaystyle{ Y }[/math] a Hausdorff uniform space and [math]\displaystyle{ H\subset\mathcal{C}_c(X,Y) }[/math] an equicontinuous set of continuous functions such that [math]\displaystyle{ H(x) }[/math] is relatively compact in [math]\displaystyle{ Y }[/math] for each [math]\displaystyle{ x\in X }[/math]. Then [math]\displaystyle{ H }[/math] is relatively compact in [math]\displaystyle{ H\subset\mathcal{C}_c(X,Y) }[/math].
This theorem immediately gives the more specialised statements above in cases where [math]\displaystyle{ X }[/math] is compact and the uniform structure of [math]\displaystyle{ Y }[/math] is given by a metric. There are a few other variants in terms of the topology of precompact convergence or other related topologies on [math]\displaystyle{ \mathfrak{F}(X,Y) }[/math]. It is also possible to extend the statement to functions that are only continuous when restricted to the sets of a covering of [math]\displaystyle{ X }[/math] by compact subsets. For details one can consult Bourbaki (1998), Chapter X, § 2, nr 5.
Non-continuous functions
Solutions of numerical schemes for parabolic equations are usually piecewise constant, and therefore not continuous, in time. As their jumps nevertheless tend to become small as the time step goes to [math]\displaystyle{ 0 }[/math], it is possible to establish uniform-in-time convergence properties using a generalisation to non-continuous functions of the classical Arzelà–Ascoli theorem (see e.g. (Droniou Eymard)).
Denote by [math]\displaystyle{ S(X,Y) }[/math] the space of functions from [math]\displaystyle{ X }[/math] to [math]\displaystyle{ Y }[/math] endowed with the uniform metric
- [math]\displaystyle{ d_S(v,w)=\sup_{t\in X}d_Y(v(t),w(t)). }[/math]
Then we have the following:
- Let [math]\displaystyle{ X }[/math] be a compact metric space and [math]\displaystyle{ Y }[/math] a complete metric space. Let [math]\displaystyle{ \{v_n\}_{n\in\mathbb{N}} }[/math] be a sequence in [math]\displaystyle{ S(X,Y) }[/math] such that there exists a function [math]\displaystyle{ \omega:X\times X\to[0,\infty] }[/math] and a sequence [math]\displaystyle{ \{\delta_n\}_{n\in\mathbb{N}}\subset[0,\infty) }[/math] satisfying
- [math]\displaystyle{ \lim_{d_X(t,t')\to0}\omega(t,t')=0,\quad\lim_{n\to\infty}\delta_n=0, }[/math]
- [math]\displaystyle{ \forall(t,t')\in X\times X,\quad \forall n\in\mathbb{N},\quad d_Y(v_n(t),v_n(t'))\leq \omega(t,t')+\delta_n. }[/math]
- Assume also that, for all [math]\displaystyle{ t\in X }[/math], [math]\displaystyle{ \{v_n(t):n\in\mathbb{N}\} }[/math] is relatively compact in [math]\displaystyle{ Y }[/math]. Then [math]\displaystyle{ \{v_n\}_{n\in\mathbb{N}} }[/math] is relatively compact in [math]\displaystyle{ S(X,Y) }[/math], and any limit of [math]\displaystyle{ \{v_n\}_{n\in\mathbb{N}} }[/math] in this space is in [math]\displaystyle{ C(X,Y) }[/math].
Necessity
Whereas most formulations of the Arzelà–Ascoli theorem assert sufficient conditions for a family of functions to be (relatively) compact in some topology, these conditions are typically also necessary. For instance, if a set F is compact in C(X), the Banach space of real-valued continuous functions on a compact Hausdorff space with respect to its uniform norm, then it is bounded in the uniform norm on C(X) and in particular is pointwise bounded. Let N(ε, U) be the set of all functions in F whose oscillation over an open subset U ⊂ X is less than ε:
- [math]\displaystyle{ N(\varepsilon, U) = \{f \mid \operatorname{osc}_U f \lt \varepsilon\}. }[/math]
For a fixed x∈X and ε, the sets N(ε, U) form an open covering of F as U varies over all open neighborhoods of x. Choosing a finite subcover then gives equicontinuity.
Further examples
- To every function g that is p-integrable on [0, 1], with 1 < p ≤ ∞, associate the function G defined on [0, 1] by
- [math]\displaystyle{ G(x) = \int_0^x g(t) \, \mathrm{d}t. }[/math]
- Let F be the set of functions G corresponding to functions g in the unit ball of the space Lp([0, 1]). If q is the Hölder conjugate of p, defined by 1/p + 1/q = 1, then Hölder's inequality implies that all functions in F satisfy a Hölder condition with α = 1/q and constant M = 1.
- It follows that F is compact in C([0, 1]). This means that the correspondence g → G defines a compact linear operator T between the Banach spaces Lp([0, 1]) and C([0, 1]). Composing with the injection of C([0, 1]) into Lp([0, 1]), one sees that T acts compactly from Lp([0, 1]) to itself. The case p = 2 can be seen as a simple instance of the fact that the injection from the Sobolev space [math]\displaystyle{ H^1_0(\Omega) }[/math] into L2(Ω), for Ω a bounded open set in Rd, is compact.
- When T is a compact linear operator from a Banach space X to a Banach space Y, its transpose T ∗ is compact from the (continuous) dual Y ∗ to X ∗. This can be checked by the Arzelà–Ascoli theorem.
- Indeed, the image T(B) of the closed unit ball B of X is contained in a compact subset K of Y. The unit ball B∗ of Y ∗ defines, by restricting from Y to K, a set F of (linear) continuous functions on K that is bounded and equicontinuous. By Arzelà–Ascoli, for every sequence {y∗n}, in B∗, there is a subsequence that converges uniformly on K, and this implies that the image [math]\displaystyle{ T^*(y^*_{n_k}) }[/math] of that subsequence is Cauchy in X ∗.
- When f is holomorphic in an open disk D1 = B(z0, r), with modulus bounded by M, then (for example by Cauchy's formula) its derivative f ′ has modulus bounded by 2M/r in the smaller disk D2 = B(z0, r/2). If a family of holomorphic functions on D1 is bounded by M on D1, it follows that the family F of restrictions to D2 is equicontinuous on D2. Therefore, a sequence converging uniformly on D2 can be extracted. This is a first step in the direction of Montel's theorem.
- Let [math]\displaystyle{ C([0,T],L^1(\mathbb{R}^N)) }[/math] be endowed with the uniform metric [math]\displaystyle{ \textstyle\sup_{t\in [0,T]}\|v(\cdot,t)-w(\cdot,t)\|_{L^1(\mathbb{R}^N)}. }[/math] Assume that [math]\displaystyle{ u_n=u_n(x,t)\subset C([0,T];L^1(\mathbb{R}^N)) }[/math] is a sequence of solutions of a certain partial differential equation (PDE), where the PDE ensures the following a priori estimates: [math]\displaystyle{ x\mapsto u_n(x,t) }[/math] is equicontinuous for all [math]\displaystyle{ t }[/math], [math]\displaystyle{ x\mapsto u_n(x,t) }[/math] is equitight for all [math]\displaystyle{ t }[/math], and, for all [math]\displaystyle{ (t,t')\in [0,T]\times[0,T] }[/math] and all [math]\displaystyle{ n\in\mathbb{N} }[/math], [math]\displaystyle{ \|u_n(\cdot,t)-u_n(\cdot,t')\|_{L^1(\mathbb{R}^N)} }[/math] is small enough when [math]\displaystyle{ |t-t'| }[/math] is small enough. Then by the Fréchet–Kolmogorov theorem, we can conclude that [math]\displaystyle{ \{x\mapsto u_n(x,t):n\in\mathbb{N}\} }[/math] is relatively compact in [math]\displaystyle{ L^1(\mathbb{R}^N) }[/math]. Hence, we can, by (a generalization of) the Arzelà–Ascoli theorem, conclude that [math]\displaystyle{ \{u_n:n\in\mathbb{N}\} }[/math] is relatively compact in [math]\displaystyle{ C([0,T],L^1(\mathbb{R}^N)). }[/math]
See also
References
- Arzelà, Cesare (1895), "Sulle funzioni di linee", Mem. Accad. Sci. Ist. Bologna Cl. Sci. Fis. Mat. 5 (5): 55–74.
- Arzelà, Cesare (1882–1883), "Un'osservazione intorno alle serie di funzioni", Rend. Dell' Accad. R. Delle Sci. dell'Istituto di Bologna: 142–159.
- Ascoli, G. (1883–1884), "Le curve limite di una varietà data di curve", Atti della R. Accad. Dei Lincei Memorie della Cl. Sci. Fis. Mat. Nat. 18 (3): 521–586.
- Bourbaki, Nicolas (1998), General topology. Chapters 5–10, Elements of Mathematics, Berlin, New York: Springer-Verlag, ISBN 978-3-540-64563-4.
- Dieudonné, Jean (1988), Foundations of modern analysis, Academic Press, ISBN 978-0-12-215507-9
- Droniou, Jérôme; Eymard, Robert (2016), "Uniform-in-time convergence of numerical methods for non-linear degenerate parabolic equations", Numer. Math. 132 (4): 721–766, doi:10.1007/s00211-015-0733-6.
- Dunford, Nelson; Schwartz, Jacob T. (1958), Linear operators, volume 1, Wiley-Interscience.
- Fréchet, Maurice (1906), "Sur quelques points du calcul fonctionnel", Rend. Circ. Mat. Palermo 22: 1–74, doi:10.1007/BF03018603, https://zenodo.org/record/1428464.
- Arzelà-Ascoli theorem at Encyclopaedia of Mathematics
- Kelley, J. L. (1991), General topology, Springer-Verlag, ISBN 978-0-387-90125-1
- Kelley, J. L.; Namioka, I. (1982), Linear Topological Spaces, Springer-Verlag, ISBN 978-0-387-90169-5
- Rudin, Walter (1976), Principles of mathematical analysis, McGraw-Hill, ISBN 978-0-07-054235-8
Original source: https://en.wikipedia.org/wiki/Arzelà–Ascoli theorem.
Read more |