Greedoid

Short description: Set system used in greedy optimization

In combinatorics, a greedoid is a type of set system. It arises from the notion of the matroid, which was originally introduced by Whitney in 1935 to study planar graphs and was later used by Edmonds to characterize a class of optimization problems that can be solved by greedy algorithms. Around 1980, Korte and Lovász introduced the greedoid to further generalize this characterization of greedy algorithms; hence the name greedoid. Besides mathematical optimization, greedoids have also been connected to graph theory, language theory, order theory, and other areas of mathematics.

Definitions

A set system (F, E) is a collection F of subsets of a ground set E (i.e. F is a subset of the power set of E). When considering a greedoid, a member of F is called a feasible set. When considering a matroid, a feasible set is also known as an independent set.

An accessible set system (F, E) is a set system in which every nonempty feasible set X contains an element x such that [math]\displaystyle{ X \setminus \{x\} }[/math] is feasible. This implies that any nonempty, finite, accessible set system necessarily contains the empty set ∅.

A greedoid (F, E) is an accessible set system that satisfies the exchange property:

• for all [math]\displaystyle{ X, Y \in F }[/math] with [math]\displaystyle{ |X|\gt |Y|, }[/math] there is some [math]\displaystyle{ x \in X \setminus Y }[/math] such that [math]\displaystyle{ Y \cup \{x\} \in F. }[/math]

(Note: Some people reserve the term exchange property for a condition on the bases of a greedoid, and prefer to call the above condition the “augmentation property”.)

A basis of a greedoid is a maximal feasible set, meaning it is a feasible set but not contained in any other one. A basis of a subset X of E is a maximal feasible set contained in X.

The rank of a greedoid is the size of a basis. By the exchange property, all bases have the same size. Thus, the rank function is well defined. The rank of a subset X of E is the size of a basis of X. Just as with matroids, greedoids have a cryptomorphism in terms of rank functions. A function [math]\displaystyle{ r:2^E \to \Z }[/math] is the rank function of a greedoid on the ground set E if and only if r is subcardinal, monotonic, and locally semimodular, that is, for any [math]\displaystyle{ X,Y \subseteq E }[/math] and any [math]\displaystyle{ e,f \in E }[/math] we have:

• subcardinality: [math]\displaystyle{ r(X)\le|X| }[/math]
• monotonicity: [math]\displaystyle{ r(X)\le r(Y) }[/math] whenever [math]\displaystyle{ X \subseteq Y \subseteq E }[/math]
• local semimodularity: [math]\displaystyle{ r(X) = r(X\cup\{e,f\}) }[/math] whenever [math]\displaystyle{ r(X) = r(X \cup \{e\}) = r(X \cup \{f\}) }[/math]

Classes

Most classes of greedoids have many equivalent definitions in terms of set system, language, poset, simplicial complex, and so on. The following description takes the traditional route of listing only a couple of the more well-known characterizations.

An interval greedoid (F, E) is a greedoid that satisfies the Interval Property:

• if [math]\displaystyle{ A,B,C \in F }[/math] with [math]\displaystyle{ A \subseteq B \subseteq C, }[/math] then, for all [math]\displaystyle{ x \in E \setminus C: }[/math]

[math]\displaystyle{ \begin{matrix} A \cup \{x\} \in F \\ C \cup \{x\} \in F \end{matrix} \implies B \cup \{x\} \in F. }[/math]

Equivalently, an interval greedoid is a greedoid such that the union of any two feasible sets is feasible if it is contained in another feasible set.

An antimatroid (F, E) is a greedoid that satisfies the Interval Property without Upper Bounds:

• if [math]\displaystyle{ A,B \in F }[/math] with [math]\displaystyle{ A \subseteq B, }[/math] then, for all [math]\displaystyle{ x \in E \setminus B, }[/math] [math]\displaystyle{ A \cup \{x\} \in F }[/math] implies [math]\displaystyle{ B \cup \{x\} \in F. }[/math]

Equivalently, an antimatroid is (i) a greedoid with a unique basis; or (ii) an accessible set system closed under union. It is easy to see that an antimatroid is also an interval greedoid.

A matroid (F, E) is a non-empty greedoid that satisfies the Interval Property without Lower Bounds:

• if [math]\displaystyle{ B,C \in F }[/math] with [math]\displaystyle{ B \subseteq C, }[/math] then, for all [math]\displaystyle{ x \in E \setminus C, }[/math] [math]\displaystyle{ C \cup \{x\} \in F }[/math] implies [math]\displaystyle{ B \cup \{x\} \in F. }[/math]

It is easy to see that a matroid is also an interval greedoid.

Examples

• Consider an undirected graph G. Let the ground set be the edges of G and the feasible sets be the edge set of each forest (i.e. subgraph containing no cycle) of G. This set system is called the cycle matroid. A set system is said to be a graphic matroid if it is the cycle matroid of some graph. (Originally cycle matroid was defined on circuits, or minimal dependent sets. Hence the name cycle.)
• Consider a finite, undirected graph G rooted at the vertex r. Let the ground set be the vertices of G and the feasible sets be the vertex subsets containing r that induce connected subgraphs of G. This is called the vertex search greedoid and is a kind of antimatroid.
• Consider a finite, directed graph D rooted at r. Let the ground set be the (directed) edges of D and the feasible sets be the edge sets of each directed subtree rooted at r with all edges pointing away from r. This is called the line search greedoid, or directed branching greedoid. It is an interval greedoid, but neither an antimatroid nor a matroid.
• Consider an m × n matrix M. Let the ground set E be the indices of the columns from 1 to n and the feasible sets be [math]\displaystyle{ F = \{X \subseteq E: \text{ submatrix } M_{\{1,\ldots,|X|\},X} \text{ is an invertible matrix}\}. }[/math] This is called the Gaussian elimination greedoid because this structure underlies the Gaussian elimination algorithm. It is a greedoid, but not an interval greedoid.

Greedy algorithm

In general, a greedy algorithm is just an iterative process in which a locally best choice, usually an input of maximum weight, is chosen each round until all available choices have been exhausted. In order to describe a greedoid-based condition in which a greedy algorithm is optimal (i.e., obtains a basis of maximum value), we need some more common terminologies in greedoid theory. Without loss of generality, we consider a greedoid G = (F, E) with E finite.

A subset X of E is rank feasible if the largest intersection of X with any feasible set has size equal to the rank of X. In a matroid, every subset of E is rank feasible. But the equality does not hold for greedoids in general.

A function [math]\displaystyle{ w: E \to \R }[/math] is R-compatible if [math]\displaystyle{ \{x \in E: w(x) \geq c\} }[/math] is rank feasible for all real numbers c.

An objective function [math]\displaystyle{ f: 2^S \to \R }[/math] is linear over a set S if, for all [math]\displaystyle{ X \subseteq S, }[/math] we have [math]\displaystyle{ f(X) = \sum_{x \in X} w(x) }[/math] for some weight function [math]\displaystyle{ w: S \to \Re. }[/math]

Proposition. A greedy algorithm is optimal for every R-compatible linear objective function over a greedoid.

The intuition behind this proposition is that, during the iterative process, each optimal exchange of minimum weight is made possible by the exchange property, and optimal results are obtainable from the feasible sets in the underlying greedoid. This result guarantees the optimality of many well-known algorithms. For example, a minimum spanning tree of a weighted graph may be obtained using Kruskal's algorithm, which is a greedy algorithm for the cycle matroid. Prim's algorithm can be explained by taking the vertex search greedoid instead.

See also

• Matroid
• Polymatroid

References

• Björner, Anders; Ziegler, Günter M. (1992), "8. Introduction to greedoids", in White, Neil, Matroid Applications, Encyclopedia of Mathematics and its Applications, 40, Cambridge: Cambridge University Press, pp. 284–357, doi:10.1017/CBO9780511662041.009, ISBN 0-521-38165-7, https://archive.org/details/matroidapplicati0000unse/page/284 
• Edmonds, Jack (1971), "Matroids and the greedy algorithm", Mathematical Programming 1: 127–136, doi:10.1007/BF01584082 .
• Helman, Paul; Moret, Bernard M. E.; Shapiro, Henry D. (1993), "An exact characterization of greedy structures", SIAM Journal on Discrete Mathematics 6 (2): 274–283, doi:10.1137/0406021 .
• Korte, Bernhard; Lovász, László (1981), "Mathematical structures underlying greedy algorithms", in Gecseg, Ferenc, Fundamentals of Computation Theory: Proceedings of the 1981 International FCT-Conference, Szeged, Hungaria, August 24–28, 1981, Lecture Notes in Computer Science, 117, Berlin: Springer-Verlag, pp. 205–209, doi:10.1007/3-540-10854-8_22 .
• Korte, Bernhard; Lovász, László; Schrader, Rainer (1991), Greedoids, Algorithms and Combinatorics, 4, New York, Berlin: Springer-Verlag, ISBN 3-540-18190-3 .
• Oxley, James G. (1992), Matroid theory, Oxford Science Publications, Oxford: Oxford University Press, ISBN 0-19-853563-5 .
• Whitney, Hassler (1935), "On the abstract properties of linear independence", American Journal of Mathematics 57 (3): 509–533, doi:10.2307/2371182 .

External links

• Introduction to Greedoids
• Theory of Greedy Algorithms
• Submodular Functions and Optimization
• Matchings, Matroids and Submodular Functions