Convex combination

From HandWiki
Short description: Linear combination of points where all coefficients are non-negative and sum to 1
Given three points [math]\displaystyle{ x_1, x_2, x_3 }[/math] in a plane as shown in the figure, the point [math]\displaystyle{ P }[/math] is a convex combination of the three points, while [math]\displaystyle{ Q }[/math] is not.
([math]\displaystyle{ Q }[/math] is however an affine combination of the three points, as their affine hull is the entire plane.)
Convex combination of two points [math]\displaystyle{ v_1,v_2 \in \mathbb{R}^2 }[/math] in a two dimensional vector space [math]\displaystyle{ \mathbb{R}^2 }[/math] as animation in Geogebra with [math]\displaystyle{ t \in [0,1] }[/math] and [math]\displaystyle{ K(t) := (1-t)\cdot v_1 + t \cdot v_2 }[/math]
Convex combination of three points [math]\displaystyle{ v_{0},v_{1},v_{2} \text{ of } 2\text{-simplex} \in \mathbb{R}^{2} }[/math] in a two dimensional vector space [math]\displaystyle{ \mathbb{R}^{2} }[/math] as shown in animation with [math]\displaystyle{ \alpha^{0}+\alpha^{1}+\alpha^{2}=1 }[/math], [math]\displaystyle{ P( \alpha^{0},\alpha^{1},\alpha^{2} ) }[/math] [math]\displaystyle{ := \alpha^{0} v_{0} + \alpha^{1} v_{1} + \alpha^{2} v_{2} }[/math] . When P is inside of the triangle [math]\displaystyle{ \alpha_{i}\ge 0 }[/math]. Otherwise, when P is outside of the triangle, at least one of the [math]\displaystyle{ \alpha_{i} }[/math] is negative.
Convex combination of four points [math]\displaystyle{ A_{1},A_{2},A_{3},A_{4} \in \mathbb{R}^{3} }[/math] in a three dimensional vector space [math]\displaystyle{ \mathbb{R}^{3} }[/math] as animation in Geogebra with [math]\displaystyle{ \sum_{i=1}^{4} \alpha_{i}=1 }[/math] and [math]\displaystyle{ \sum_{i=1}^{4} \alpha_{i}\cdot A_{i}=P }[/math]. When P is inside of the tetrahedron [math]\displaystyle{ \alpha_{i}\gt =0 }[/math]. Otherwise, when P is outside of the tetrahedron, at least one of the [math]\displaystyle{ \alpha_{i} }[/math] is negative.
Convex combination of two functions as vectors in a vector space of functions - visualized in Open Source Geogebra with [math]\displaystyle{ [a,b]=[-4,7] }[/math] and as the first function [math]\displaystyle{ f:[a,b]\to \mathbb{R} }[/math] a polynomial is defined. [math]\displaystyle{ f(x):= \frac{3}{10} \cdot x^2 - 2 }[/math] A trigonometric function [math]\displaystyle{ g:[a,b]\to \mathbb{R} }[/math] was chosen as the second function. [math]\displaystyle{ g(x):= 2 \cdot \cos(x) + 1 }[/math] The figure illustrates the convex combination [math]\displaystyle{ K(t):= (1-t)\cdot f + t \cdot g }[/math] of [math]\displaystyle{ f }[/math] and [math]\displaystyle{ g }[/math] as graph in red color.

In convex geometry and vector algebra, a convex combination is a linear combination of points (which can be vectors, scalars, or more generally points in an affine space) where all coefficients are non-negative and sum to 1.[1] In other words, the operation is equivalent to a standard weighted average, but whose weights are expressed as a percent of the total weight, instead of as a fraction of the count of the weights as in a standard weighted average.

More formally, given a finite number of points [math]\displaystyle{ x_1, x_2, \dots, x_n }[/math] in a real vector space, a convex combination of these points is a point of the form

[math]\displaystyle{ \alpha_1x_1+\alpha_2x_2+\cdots+\alpha_nx_n }[/math]

where the real numbers [math]\displaystyle{ \alpha_i }[/math] satisfy [math]\displaystyle{ \alpha_i\ge 0 }[/math] and [math]\displaystyle{ \alpha_1+\alpha_2+\cdots+\alpha_n=1. }[/math][1]

As a particular example, every convex combination of two points lies on the line segment between the points.[1]

A set is convex if it contains all convex combinations of its points. The convex hull of a given set of points is identical to the set of all their convex combinations.[1]

There exist subsets of a vector space that are not closed under linear combinations but are closed under convex combinations. For example, the interval [math]\displaystyle{ [0,1] }[/math] is convex but generates the real-number line under linear combinations. Another example is the convex set of probability distributions, as linear combinations preserve neither nonnegativity nor affinity (i.e., having total integral one).

Other objects

  • A random variable [math]\displaystyle{ X }[/math] is said to have an [math]\displaystyle{ n }[/math]-component finite mixture distribution if its probability density function is a convex combination of [math]\displaystyle{ n }[/math] so-called component densities.

Related constructions

  • A conical combination is a linear combination with nonnegative coefficients. When a point [math]\displaystyle{ x }[/math] is to be used as the reference origin for defining displacement vectors, then [math]\displaystyle{ x }[/math] is a convex combination of [math]\displaystyle{ n }[/math] points [math]\displaystyle{ x_1, x_2, \dots, x_n }[/math] if and only if the zero displacement is a non-trivial conical combination of their [math]\displaystyle{ n }[/math] respective displacement vectors relative to [math]\displaystyle{ x }[/math].
  • Weighted means are functionally the same as convex combinations, but they use a different notation. The coefficients (weights) in a weighted mean are not required to sum to 1; instead the weighted linear combination is explicitly divided by the sum of the weights.
  • Affine combinations are like convex combinations, but the coefficients are not required to be non-negative. Hence affine combinations are defined in vector spaces over any field.

See also

References

  1. Jump up to: 1.0 1.1 1.2 1.3 Rockafellar, R. Tyrrell (1970), Convex Analysis, Princeton Mathematical Series, 28, Princeton University Press, Princeton, N.J., pp. 11–12 

External links

de:Linearkombination#Konvexkombination