Epigraph (mathematics)

From HandWiki
Epigraph of a function
A function (in black) is convex if and only if the region above its graph (in green) is a convex set. This region is the function's epigraph.

In mathematics, the epigraph or supergraph,[1] denoted by [math]\displaystyle{ \operatorname{epi} f, }[/math] of a function [math]\displaystyle{ f(X) }[/math] valued in the extended real numbers, [math]\displaystyle{ f : X \to [-\infty, \infty] = \R \cup \{ \pm \infty \} }[/math], is the set of all points in the Cartesian product [math]\displaystyle{ X \times \R }[/math] lying on or above its graph.[2] The strict epigraph [math]\displaystyle{ \operatorname{epi}_S f }[/math] is the set of points in [math]\displaystyle{ X \times \R }[/math] lying strictly above its graph.

Importantly, although both the graph and epigraph of [math]\displaystyle{ f }[/math] consists of points in [math]\displaystyle{ X \times [-\infty, \infty], }[/math] the epigraph consists entirely of points in the subset [math]\displaystyle{ X \times \R, }[/math] which is not necessarily true of the graph of [math]\displaystyle{ f. }[/math] If the function takes [math]\displaystyle{ \pm \infty }[/math] as a value then [math]\displaystyle{ \operatorname{graph} f }[/math] will not be a subset of its epigraph [math]\displaystyle{ \operatorname{epi} f. }[/math] For example, if [math]\displaystyle{ f\left(x_0\right) = \infty }[/math] then the point [math]\displaystyle{ \left(x_0, f\left(x_0\right)\right) = \left(x_0, \infty\right) }[/math] will belong to [math]\displaystyle{ \operatorname{graph} f }[/math] but not to [math]\displaystyle{ \operatorname{epi} f. }[/math] These two sets are nevertheless closely related because the graph can always be reconstructed from the epigraph, and vice versa.

The study of continuous real-valued functions in real analysis has traditionally been closely associated with the study of their graphs, which are sets that provide geometric information (and intuition) about these functions.[2] Epigraphs serve this same purpose in the fields of convex analysis and variational analysis, in which the primary focus is on convex functions valued in [math]\displaystyle{ [-\infty, \infty] }[/math] instead of continuous functions valued in a vector space (such as [math]\displaystyle{ \R }[/math] or [math]\displaystyle{ \R^2 }[/math]).[2] This is because in general, for such functions, geometric intuition is more readily obtained from a function's epigraph than from its graph.[2] Similarly to how graphs are used in real analysis, the epigraph can often be used to give geometrical interpretations of a convex function's properties, to help formulate or prove hypotheses, or to aid in constructing counterexamples.

Definition

The definition of the epigraph was inspired by that of the graph of a function, where the graph of [math]\displaystyle{ f : X \to Y }[/math] is defined to be the set

[math]\displaystyle{ \operatorname{graph} f := \left\{ (x, y) \in X \times Y ~:~ y = f(x) \right\}. }[/math]

The epigraph or supergraph of a function [math]\displaystyle{ f : X \to [-\infty, \infty] }[/math] valued in the extended real numbers [math]\displaystyle{ [-\infty, \infty] = \R \cup \{ \pm \infty \} }[/math] is the set[2]

[math]\displaystyle{ \begin{alignat}{4} \operatorname{epi} f &= \left\{ (x, r) \in X \times \R ~:~ r \geq f(x) \right\} \\ &= \left[ f^{-1}(- \infty) \times \R \right] \cup \bigcup_{x \in f^{-1}(\R)} \{ x \} \times [f(x), \infty) ~~~ \text{ (all sets being unioned are pairwise disjoint). } \end{alignat} }[/math]

In the union over [math]\displaystyle{ x \in f^{-1}(\R) }[/math] that appears above on the right hand side of the last line, the set [math]\displaystyle{ \{ x \} \times [f(x), \infty) }[/math] may be interpreted as being a "vertical ray" consisting of [math]\displaystyle{ (x, f(x)) }[/math] and all points in [math]\displaystyle{ X \times \R }[/math] "directly above" it. Similarly, the set of points on or below the graph of a function is its hypograph.

The strict epigraph is the epigraph with the graph removed:

[math]\displaystyle{ \begin{alignat}{4} \operatorname{epi}_S f &= \left\{ (x, r) \in X \times \R ~:~ r \gt f(x) \right\} \\ &= \operatorname{epi} f \setminus \operatorname{graph} f \\ &= \bigcup_{x \in X} \{ x \} \times (f(x), \infty) ~~~ \text{ (all sets being unioned are pairwise disjoint, some may be empty). } \end{alignat} }[/math]

Relationships with other sets

Despite the fact that [math]\displaystyle{ f }[/math] might take one (or both) of [math]\displaystyle{ \pm \infty }[/math] as a value (in which case its graph would not be a subset of [math]\displaystyle{ X \times \R }[/math]), the epigraph of [math]\displaystyle{ f }[/math] is nevertheless defined to be a subset of [math]\displaystyle{ X \times \R }[/math] rather than of [math]\displaystyle{ X \times [-\infty, \infty]. }[/math] This is intentional because when [math]\displaystyle{ X }[/math] is a vector space then so is [math]\displaystyle{ X \times \R }[/math] but [math]\displaystyle{ X \times [-\infty, \infty] }[/math] is never a vector space[2] (since the extended real number line [math]\displaystyle{ [-\infty, \infty] }[/math] is not a vector space). More generally, if [math]\displaystyle{ X }[/math] is only a non-empty subset of some vector space then [math]\displaystyle{ X \times [-\infty, \infty] }[/math] is never even a subset of any vector space. The epigraph being a subset of a vector space allows for tools related to real analysis and functional analysis (and other fields) to be more readily applied.

The domain (rather than the codomain) of the function is not particularly important for this definition; it can be any linear space[1] or even an arbitrary set[3] instead of [math]\displaystyle{ \R^n }[/math].

The strict epigraph [math]\displaystyle{ \operatorname{epi}_S f }[/math] and the graph [math]\displaystyle{ \operatorname{graph} f }[/math] are always disjoint.

The epigraph of a function [math]\displaystyle{ f : X \to [-\infty, \infty] }[/math] is related to its graph and strict epigraph by

[math]\displaystyle{ \,\operatorname{epi} f \,\subseteq\, \operatorname{epi}_S f \,\cup\, \operatorname{graph} f }[/math]

where set equality holds if and only if [math]\displaystyle{ f }[/math] is real-valued. However,

[math]\displaystyle{ \operatorname{epi} f = \left[ \operatorname{epi}_S f \,\cup\, \operatorname{graph} f\right] \,\cap\, \left[ X \times \R \right] }[/math]

always holds.

Reconstructing functions from epigraphs

The epigraph is empty if and only if the function is identically equal to infinity.

Just as any function can be reconstructed from its graph, so too can any extended real-valued function [math]\displaystyle{ f }[/math] on [math]\displaystyle{ X }[/math] be reconstructed from its epigraph [math]\displaystyle{ E := \operatorname{epi} f }[/math] (even when [math]\displaystyle{ f }[/math] takes on [math]\displaystyle{ \pm \infty }[/math] as a value). Given [math]\displaystyle{ x \in X, }[/math] the value [math]\displaystyle{ f(x) }[/math] can be reconstructed from the intersection [math]\displaystyle{ E \cap \left( \{ x \} \times \R \right) }[/math] of [math]\displaystyle{ E }[/math] with the "vertical line" [math]\displaystyle{ \{ x \} \times \R }[/math] passing through [math]\displaystyle{ x }[/math] as follows:

  • case 1: [math]\displaystyle{ E \cap \left( \{ x \} \times \R \right) = \varnothing }[/math] if and only if [math]\displaystyle{ f(x) = \infty, }[/math]
  • case 2: [math]\displaystyle{ E \cap \left( \{ x \} \times \R \right) = \{ x \} \times \R }[/math] if and only if [math]\displaystyle{ f(x) = -\infty, }[/math]
  • case 3: otherwise, [math]\displaystyle{ E \cap \left( \{ x \} \times \R \right) }[/math] is necessarily of the form [math]\displaystyle{ \{ x \} \times [f(x), \infty), }[/math] from which the value of [math]\displaystyle{ f(x) }[/math] can be obtained by taking the infimum of the interval.

The above observations can be combined to give a single formula for [math]\displaystyle{ f(x) }[/math] in terms of [math]\displaystyle{ E := \operatorname{epi} f. }[/math] Specifically, for any [math]\displaystyle{ x \in X, }[/math]

[math]\displaystyle{ f(x) = \inf_{} \{ r \in \R ~:~ (x, r) \in E \} }[/math]

where by definition, [math]\displaystyle{ \inf_{} \varnothing := \infty. }[/math] This same formula can also be used to reconstruct [math]\displaystyle{ f }[/math] from its strict epigraph [math]\displaystyle{ E := \operatorname{epi}_S f. }[/math]

Relationships between properties of functions and their epigraphs

A function is convex if and only if its epigraph is a convex set. The epigraph of a real affine function [math]\displaystyle{ g : \R^n \to \R }[/math] is a halfspace in [math]\displaystyle{ \R^{n+1}. }[/math]

A function is lower semicontinuous if and only if its epigraph is closed.

See also

Citations

References