Erdős–Rényi model

From HandWiki
Short description: Two closely related models for generating random graphs
An Erdős–Rényi–Gilbert graph with 1000 vertices at the critical edge probability [math]\displaystyle{ p=1/(n-1) }[/math], showing a large component and many small ones

In the mathematical field of graph theory, the Erdős–Rényi model refers to one of two closely related models for generating random graphs or the evolution of a random network. These models are named after Hungarian mathematicians Paul Erdős and Alfréd Rényi, who introduced one of the models in 1959.[1][2] Edgar Gilbert introduced the other model contemporaneously with and independently of Erdős and Rényi.[3] In the model of Erdős and Rényi, all graphs on a fixed vertex set with a fixed number of edges are equally likely. In the model introduced by Gilbert, also called the Erdős–Rényi–Gilbert model,[4] each edge has a fixed probability of being present or absent, independently of the other edges. These models can be used in the probabilistic method to prove the existence of graphs satisfying various properties, or to provide a rigorous definition of what it means for a property to hold for almost all graphs.

Definition

There are two closely related variants of the Erdős–Rényi random graph model.

A graph generated by the binomial model of Erdős and Rényi (p = 0.01)
  • In the [math]\displaystyle{ G(n,M) }[/math] model, a graph is chosen uniformly at random from the collection of all graphs which have [math]\displaystyle{ n }[/math] nodes and [math]\displaystyle{ M }[/math] edges. The nodes are considered to be labeled, meaning that graphs obtained from each other by permuting the vertices are considered to be distinct. For example, in the [math]\displaystyle{ G(3,2) }[/math] model, there are three two-edge graphs on three labeled vertices (one for each choice of the middle vertex in a two-edge path), and each of these three graphs is included with probability [math]\displaystyle{ \tfrac{1}{3} }[/math].
  • In the [math]\displaystyle{ G(n,p) }[/math] model, a graph is constructed by connecting labeled nodes randomly. Each edge is included in the graph with probability [math]\displaystyle{ p }[/math], independently from every other edge. Equivalently, the probability for generating each graph that has [math]\displaystyle{ n }[/math] nodes and [math]\displaystyle{ M }[/math] edges is [math]\displaystyle{ p^M (1-p)^{ {n \choose 2}-M}. }[/math] The parameter [math]\displaystyle{ p }[/math] in this model can be thought of as a weighting function; as [math]\displaystyle{ p }[/math] increases from [math]\displaystyle{ 0 }[/math] to [math]\displaystyle{ 1 }[/math], the model becomes more and more likely to include graphs with more edges and less and less likely to include graphs with fewer edges. In particular, the case [math]\displaystyle{ p=\tfrac{1}{2} }[/math] corresponds to the case where all [math]\displaystyle{ 2^\binom{n}{2} }[/math] graphs on [math]\displaystyle{ n }[/math] vertices are chosen with equal probability.

The behavior of random graphs are often studied in the case where [math]\displaystyle{ n }[/math], the number of vertices, tends to infinity. Although [math]\displaystyle{ p }[/math] and [math]\displaystyle{ M }[/math] can be fixed in this case, they can also be functions depending on [math]\displaystyle{ n }[/math]. For example, the statement that almost every graph in [math]\displaystyle{ G(n,2\ln(n)/n) }[/math] is connected means that, as [math]\displaystyle{ n }[/math] tends to infinity, the probability that a graph on [math]\displaystyle{ n }[/math] vertices with edge probability [math]\displaystyle{ 2\ln(n)/n }[/math] is connected tends to [math]\displaystyle{ 1 }[/math].

Comparison between the two models

The expected number of edges in G(n, p) is [math]\displaystyle{ \tbinom{n}{2}p }[/math], and by the law of large numbers any graph in G(n, p) will almost surely have approximately this many edges (provided the expected number of edges tends to infinity). Therefore, a rough heuristic is that if pn2 → ∞, then G(n,p) should behave similarly to G(n, M) with [math]\displaystyle{ M=\tbinom{n}{2} p }[/math] as n increases.

For many graph properties, this is the case. If P is any graph property which is monotone with respect to the subgraph ordering (meaning that if A is a subgraph of B and B satisfies P, then A will satisfy P as well), then the statements "P holds for almost all graphs in G(np)" and "P holds for almost all graphs in [math]\displaystyle{ G(n, \tbinom{n}{2} p) }[/math]" are equivalent (provided pn2 → ∞). For example, this holds if P is the property of being connected, or if P is the property of containing a Hamiltonian cycle. However, this will not necessarily hold for non-monotone properties (e.g. the property of having an even number of edges).

In practice, the G(n, p) model is the one more commonly used today, in part due to the ease of analysis allowed by the independence of the edges.

Properties of G(n, p)

With the notation above, a graph in G(n, p) has on average [math]\displaystyle{ \tbinom{n}{2} p }[/math] edges. The distribution of the degree of any particular vertex is binomial:[5]

[math]\displaystyle{ P(\deg(v) = k) = {n-1\choose k}p^k(1-p)^{n-1-k}, }[/math]

where n is the total number of vertices in the graph. Since

[math]\displaystyle{ P(\deg(v) = k) \to \frac{(np)^k \mathrm{e}^{-np}}{k!} \quad \text{ as } n \to \infty \text{ and } np = \text{constant}, }[/math]

this distribution is Poisson for large n and np = const.

In a 1960 paper, Erdős and Rényi[6] described the behavior of G(np) very precisely for various values of p. Their results included that:

  • If np < 1, then a graph in G(np) will almost surely have no connected components of size larger than O(log(n)).
  • If np = 1, then a graph in G(np) will almost surely have a largest component whose size is of order n2/3.
  • If npc > 1, where c is a constant, then a graph in G(np) will almost surely have a unique giant component containing a positive fraction of the vertices. No other component will contain more than O(log(n)) vertices.
  • If [math]\displaystyle{ p\lt \tfrac{(1-\varepsilon)\ln n} n }[/math], then a graph in G(n, p) will almost surely contain isolated vertices, and thus be disconnected.
  • If [math]\displaystyle{ p\gt \tfrac{(1+\varepsilon) \ln n} n }[/math], then a graph in G(n, p) will almost surely be connected.

Thus [math]\displaystyle{ \tfrac{\ln n} n }[/math] is a sharp threshold for the connectedness of G(n, p).

Further properties of the graph can be described almost precisely as n tends to infinity. For example, there is a k(n) (approximately equal to 2log2(n)) such that the largest clique in G(n, 0.5) has almost surely either size k(n) or k(n) + 1.[7]

Thus, even though finding the size of the largest clique in a graph is NP-complete, the size of the largest clique in a "typical" graph (according to this model) is very well understood.

Edge-dual graphs of Erdos-Renyi graphs are graphs with nearly the same degree distribution, but with degree correlations and a significantly higher clustering coefficient.[8]

Relation to percolation

In percolation theory one examines a finite or infinite graph and removes edges (or links) randomly. Thus the Erdős–Rényi process is in fact unweighted link percolation on the complete graph. (One refers to percolation in which nodes and/or links are removed with heterogeneous weights as weighted percolation). As percolation theory has much of its roots in physics, much of the research done was on the lattices in Euclidean spaces. The transition at np = 1 from giant component to small component has analogs for these graphs, but for lattices the transition point is difficult to determine. Physicists often refer to study of the complete graph as a mean field theory. Thus the Erdős–Rényi process is the mean-field case of percolation.

Some significant work was also done on percolation on random graphs. From a physicist's point of view this would still be a mean-field model, so the justification of the research is often formulated in terms of the robustness of the graph, viewed as a communication network. Given a random graph of n ≫ 1 nodes with an average degree [math]\displaystyle{ \langle k \rangle }[/math]. Remove randomly a fraction [math]\displaystyle{ 1 - p' }[/math] of nodes and leave only a fraction [math]\displaystyle{ p' }[/math] from the network. There exists a critical percolation threshold [math]\displaystyle{ p'_c=\tfrac{1}{\langle k\rangle} }[/math] below which the network becomes fragmented while above [math]\displaystyle{ p'_c }[/math] a giant connected component of order n exists. The relative size of the giant component, P, is given by[6][1][2][9]

[math]\displaystyle{ P_\infty= p'[1-\exp(-\langle k \rangle P_\infty)]. \, }[/math]

Caveats

Both of the two major assumptions of the G(n, p) model (that edges are independent and that each edge is equally likely) may be inappropriate for modeling certain real-life phenomena. Erdős–Rényi graphs have low clustering, unlike many social networks.[10] Some modeling alternatives include Barabási–Albert model and Watts and Strogatz model. These alternative models are not percolation processes, but instead represent a growth and rewiring model, respectively. Another alternative family of random graph models, capable of reproducing many real-life phenomena, are exponential random graph models.

History

The G(np) model was first introduced by Edgar Gilbert in a 1959 paper studying the connectivity threshold mentioned above.[3] The G(n, M) model was introduced by Erdős and Rényi in their 1959 paper. As with Gilbert, their first investigations were as to the connectivity of G(nM), with the more detailed analysis following in 1960.

Continuum limit representation of critical G(n, p)

The Brownian motion with quadratic negative drift is decomposed into Brownian excursions of decreasing sizes.

A continuum limit of the graph was obtained when [math]\displaystyle{ p }[/math] is of order [math]\displaystyle{ 1/n }[/math].[11] Specifically, consider the sequence of graphs [math]\displaystyle{ G_n:=G(n,1/n+\lambda n^{-\frac{4}{3}}) }[/math] for [math]\displaystyle{ \lambda\in \R }[/math]. The limit object can be constructed as follows:

  • First, generate a diffusion [math]\displaystyle{ W^\lambda(t):=W(t)+\lambda t - \frac{t^2}{2} }[/math] where [math]\displaystyle{ W }[/math] is a standard Brownian motion.
  • From this process, we define the reflected process [math]\displaystyle{ R^\lambda(t):= W^\lambda(t) - \inf\limits_{s\in[0,t]}W^\lambda(s) }[/math]. This process can be seen as containing many successive excursion (not quite a Brownian excursion, see [12]). Because the drift of [math]\displaystyle{ W^\lambda }[/math] is dominated by [math]\displaystyle{ -\frac{t^2}{2} }[/math], these excursions become shorter and shorter as [math]\displaystyle{ t\to +\infty }[/math]. In particular, they can be sorted in order of decreasing lengths: we can partition [math]\displaystyle{ \R }[/math] into intervals [math]\displaystyle{ (C_i)_{i\in \N} }[/math] of decreasing lengths such that [math]\displaystyle{ R^\lambda }[/math] restricted to [math]\displaystyle{ C_i }[/math] is a Brownian excursion for any [math]\displaystyle{ i\in \N }[/math].
  • Now, consider an excursion [math]\displaystyle{ (e(s))_{s\in [0,1]} }[/math]. Construct a random graph as follows:
    A Brownian excursion [math]\displaystyle{ (e(t))_{t\in [0,1]} }[/math]. Here, the process [math]\displaystyle{ \Xi }[/math] has a single point, marked with a red dot. The red line corresponds to a single internal node of the associated tree [math]\displaystyle{ T_e }[/math], the green line corresponds to a leaf of [math]\displaystyle{ T_e }[/math]. If one adds an edge between the two nodes, one obtains a graph with a single cycle
    • Construct a real tree [math]\displaystyle{ T_e }[/math] (see Brownian tree).
    • Consider a Poisson point process [math]\displaystyle{ \Xi }[/math] on [math]\displaystyle{ [0,1]\times \R_+ }[/math] with unit intensity. To each point [math]\displaystyle{ (x,s)\in \Xi }[/math] such that [math]\displaystyle{ x\leq e(s) }[/math], corresponds an underlying internal node and a leaf of the tree [math]\displaystyle{ T_e }[/math]. Identifying the two vertices, the tree [math]\displaystyle{ T_e }[/math] becomes a graph [math]\displaystyle{ \Gamma_e }[/math]

Applying this procedure, one obtains a sequence of random infinite graphs of decreasing sizes: [math]\displaystyle{ (\Gamma_i)_{i\in \N} }[/math]. The theorem[11] states that this graph corresponds in a certain sense to the limit object of [math]\displaystyle{ G_n }[/math] as [math]\displaystyle{ n\to+\infty }[/math].

See also

  • Rado graph – Infinite graph containing all countable graphs, the graph formed by extending the G(np) model to graphs with a countably infinite number of vertices. Unlike in the finite case, the result of this infinite process is (with probability 1) the same graph, up to isomorphism.
  • Dual-phase evolution – Process that drives self-organization within complex adaptive systems describes ways in which properties associated with the Erdős–Rényi model contribute to the emergence of order in systems.
  • Exponential random graph models describe a general probability distribution of graphs on "n" nodes given a set of network statistics and various parameters associated with them.
  • Stochastic block model, a generalization of the Erdős–Rényi model for graphs with latent community structure
  • Watts–Strogatz model – Method of generating random small-world graphs
  • Barabási–Albert model – Scale-free network generation algorithm

References

  1. 1.0 1.1 Erdős, P.; Rényi, A. (1959). "On Random Graphs. I". Publicationes Mathematicae 6 (3–4): 290–297. doi:10.5486/PMD.1959.6.3-4.12. http://www.renyi.hu/~p_erdos/1959-11.pdf. Retrieved 2011-02-23. 
  2. 2.0 2.1 Bollobás, B. (2001). Random Graphs (2nd ed.). Cambridge University Press. ISBN 0-521-79722-5. 
  3. 3.0 3.1 Gilbert, E.N. (1959). "Random Graphs". Annals of Mathematical Statistics 30 (4): 1141–1144. doi:10.1214/aoms/1177706098. 
  4. Fienberg, Stephen E. (2012). "A brief history of statistical models for network analysis and open challenges". Journal of Computational and Graphical Statistics 21 (4): 825–839. doi:10.1080/10618600.2012.738106. 
  5. Newman, Mark. E. J.; Strogatz, S. H.; Watts, D. J. (2001). "Random graphs with arbitrary degree distributions and their applications". Physical Review E 64 (2): 026118. doi:10.1103/PhysRevE.64.026118. PMID 11497662. Bibcode2001PhRvE..64b6118N. , Eq. (1)
  6. 6.0 6.1 Erdős, P.; Rényi, A. (1960). "On the evolution of random graphs". Magyar Tudományos Akadémia Matematikai Kutató Intézetének Kőzleményei [Publications of the Mathematical Institute of the Hungarian Academy of Sciences] 5: 17–61. http://www.renyi.hu/~p_erdos/1960-10.pdf. Retrieved 2011-11-18.  The probability p used here refers there to [math]\displaystyle{ N(n) = \tbinom{n}{2} p }[/math]
  7. "The employee party problem". Notices of the American Mathematical Society 19: A-382. February 1972. 
  8. Ramezanpour, A.; Karimipour, V.; Mashaghi, A. (April 2003). "Generating correlated networks from uncorrelated ones". Physical Review E 67 (4): 046107. doi:10.1103/PhysRevE.67.046107. PMID 12786436. Bibcode2003PhRvE..67d6107R. 
  9. Bollobás, B.; Erdős, P. (1976). "Cliques in Random Graphs". Mathematical Proceedings of the Cambridge Philosophical Society 80 (3): 419–427. doi:10.1017/S0305004100053056. Bibcode1976MPCPS..80..419B. 
  10. Saberi, Abbas Ali (March 2015). "Recent advances in percolation theory and its applications". Physics Reports 578: 12. doi:10.1016/j.physrep.2015.03.003. Bibcode2015PhR...578....1S. https://www.sciencedirect.com/science/article/abs/pii/S0370157315002008. Retrieved 30 January 2022. 
  11. 11.0 11.1 Addario-Berry, L.; Broutin, N.; Goldschmidt, C. (2012-04-01). "The continuum limit of critical random graphs" (in en). Probability Theory and Related Fields 152 (3): 367–406. doi:10.1007/s00440-010-0325-4. ISSN 1432-2064. 
  12. Aldous, David (1997-04-01). "Brownian excursions, critical random graphs and the multiplicative coalescent". The Annals of Probability 25 (2). doi:10.1214/aop/1024404421. ISSN 0091-1798. 

Literature

  • West, Douglas B. (2001). Introduction to Graph Theory (2nd ed.). Prentice Hall. ISBN 0-13-014400-2. 
  • Newman, M. E. J. (2010). Networks: An Introduction. Oxford. 

External links