Alon–Boppana bound

From HandWiki

In spectral graph theory, the Alon–Boppana bound provides a lower bound on the second-largest eigenvalue of the adjacency matrix of a [math]\displaystyle{ d }[/math]-regular graph,[1] meaning a graph in which every vertex has degree [math]\displaystyle{ d }[/math]. The reason for the interest in the second-largest eigenvalue is that the largest eigenvalue is guaranteed to be [math]\displaystyle{ d }[/math] due to [math]\displaystyle{ d }[/math]-regularity, with the all-ones vector being the associated eigenvector. The graphs that come close to meeting this bound are Ramanujan graphs, which are examples of the best possible expander graphs.

Its discoverers are Noga Alon and Ravi Boppana.

Theorem statement

Let [math]\displaystyle{ G }[/math] be a [math]\displaystyle{ d }[/math]-regular graph on [math]\displaystyle{ n }[/math] vertices with diameter [math]\displaystyle{ m }[/math], and let [math]\displaystyle{ A }[/math] be its adjacency matrix. Let [math]\displaystyle{ \lambda_1 \ge \lambda_2 \ge \cdots \ge \lambda_n }[/math] be its eigenvalues. Then

[math]\displaystyle{ \lambda_2 \ge 2\sqrt{d-1} - \frac{2\sqrt{d-1} - 1}{\lfloor m/2 \rfloor}. }[/math]

The above statement is the original one proved by Noga Alon. Some slightly weaker variants exist to improve the ease of proof or improve intuition. Two of these are shown in the proofs below.

Intuition

The Cayley graph of the free group on two generators [math]\displaystyle{ a }[/math] and [math]\displaystyle{ b }[/math] is an example of an infinite [math]\displaystyle{ d }[/math]-regular tree for [math]\displaystyle{ d=4. }[/math]

The intuition for the number [math]\displaystyle{ 2\sqrt{d-1} }[/math] comes from considering the infinite [math]\displaystyle{ d }[/math]-regular tree.[2] This graph is a universal cover of [math]\displaystyle{ d }[/math]-regular graphs, and it has spectral radius [math]\displaystyle{ 2\sqrt{d-1}. }[/math]

Saturation

A graph that essentially saturates the Alon–Boppana bound is called a Ramanujan graph. More precisely, a Ramanujan graph is a [math]\displaystyle{ d }[/math]-regular graph such that [math]\displaystyle{ |\lambda_2|, |\lambda_n| \le 2\sqrt{d-1}. }[/math]

A theorem by Friedman[3] shows that, for every [math]\displaystyle{ d }[/math] and [math]\displaystyle{ \epsilon \gt 0 }[/math] and for sufficiently large [math]\displaystyle{ n }[/math], a random [math]\displaystyle{ d }[/math]-regular graph [math]\displaystyle{ G }[/math] on [math]\displaystyle{ n }[/math] vertices satisfies [math]\displaystyle{ \max\{|\lambda_2|, |\lambda_n|\} \lt 2\sqrt{d-1} + \epsilon }[/math] with high probability. This means that a random [math]\displaystyle{ n }[/math]-vertex [math]\displaystyle{ d }[/math]-regular graph is typically "almost Ramanujan."

First proof (slightly weaker statement)

We will prove a slightly weaker statement, namely dropping the specificity on the second term and simply asserting [math]\displaystyle{ \lambda_2 \ge 2\sqrt{d-1} - o(1). }[/math] Here, the [math]\displaystyle{ o(1) }[/math] term refers to the asymptotic behavior as [math]\displaystyle{ n }[/math] grows without bound while [math]\displaystyle{ d }[/math] remains fixed.

Let the vertex set be [math]\displaystyle{ V. }[/math] By the min-max theorem, it suffices to construct a nonzero vector [math]\displaystyle{ z\in\mathbb{R}^{|V|} }[/math] such that [math]\displaystyle{ z^{\text{T}}\mathbf{1} = 0 }[/math] and [math]\displaystyle{ \frac{z^{\text{T}}Az}{z^{\text{T}}z} \ge 2\sqrt{d-1} - o(1). }[/math]

Pick some value [math]\displaystyle{ r\in\mathbb{N}. }[/math] For each vertex in [math]\displaystyle{ V, }[/math] define a vector [math]\displaystyle{ f(v)\in\mathbb{R}^{|V|} }[/math] as follows. Each component will be indexed by a vertex [math]\displaystyle{ u }[/math] in the graph. For each [math]\displaystyle{ u, }[/math] if the distance between [math]\displaystyle{ u }[/math] and [math]\displaystyle{ v }[/math] is [math]\displaystyle{ k, }[/math] then the [math]\displaystyle{ u }[/math]-component of [math]\displaystyle{ f(v) }[/math] is [math]\displaystyle{ f(v)_u = w_k = (d-1)^{-k/2} }[/math] if [math]\displaystyle{ k\le r-1 }[/math] and [math]\displaystyle{ 0 }[/math] if [math]\displaystyle{ k\ge r. }[/math] We claim that any such vector [math]\displaystyle{ x = f(v) }[/math] satisfies

[math]\displaystyle{ \frac{x^{\text{T}}Ax}{x^{\text{T}}x} \ge 2\sqrt{d-1}\left(1 - \frac{1}{2r}\right). }[/math]

To prove this, let [math]\displaystyle{ V_k }[/math] denote the set of all vertices that have a distance of exactly [math]\displaystyle{ k }[/math] from [math]\displaystyle{ v. }[/math] First, note that

[math]\displaystyle{ x^{\text{T}}x = \sum_{k=0}^{r-1}|V_k|w^2_k. }[/math]

Second, note that

[math]\displaystyle{ x^{\text{T}}Ax = \sum_{u\in V}x_u \sum_{u'\in N(u)}x_{u'} \ge \sum_{k=0}^{r-1}|V_k|w_k\left[w_{k-1} + (d-1)w_{k+1}\right] - (d-1)|V_{r-1}|w_{r-1}w_r, }[/math]

where the last term on the right comes from a possible overcounting of terms in the initial expression. The above then implies

[math]\displaystyle{ x^{\text{T}}Ax \ge 2\sqrt{d-1}\left(\sum_{k=0}^{r-1}|V_k|w^2_k - \frac{1}{2}|V_{r-1}|w^2_{r-1}\right), }[/math]

which, when combined with the fact that [math]\displaystyle{ |V_{k+1}| \le (d-1)|V_k| }[/math] for any [math]\displaystyle{ k, }[/math] yields

[math]\displaystyle{ x^{\text{T}}Ax \ge 2\sqrt{d-1}\left(1 - \frac{1}{2r}\right)\sum_{k=0}^{r-1}|V_k|w^2_k. }[/math]

The combination of the above results proves the desired inequality.

For convenience, define the [math]\displaystyle{ (r-1) }[/math]-ball of a vertex [math]\displaystyle{ v }[/math] to be the set of vertices with a distance of at most [math]\displaystyle{ r-1 }[/math] from [math]\displaystyle{ v. }[/math] Notice that the entry of [math]\displaystyle{ f(v) }[/math] corresponding to a vertex [math]\displaystyle{ u }[/math] is nonzero if and only if [math]\displaystyle{ u }[/math] lies in the [math]\displaystyle{ (r-1) }[/math]-ball of [math]\displaystyle{ x. }[/math]

The number of vertices within distance [math]\displaystyle{ k }[/math] of a given vertex is at most [math]\displaystyle{ 1 + d + d(d-1) + d(d-1)^2 + \cdots + d(d-1)^{k-1} = d^k + 1. }[/math] Therefore, if [math]\displaystyle{ n \ge d^{2r-1} + 2, }[/math] then there exist vertices [math]\displaystyle{ u, v }[/math] with distance at least [math]\displaystyle{ 2r. }[/math]

Let [math]\displaystyle{ x = f(v) }[/math] and [math]\displaystyle{ y = f(u). }[/math] It then follows that [math]\displaystyle{ x^{\text{T}}y = 0, }[/math] because there is no vertex that lies in the [math]\displaystyle{ (r-1) }[/math]-balls of both [math]\displaystyle{ x }[/math] and [math]\displaystyle{ y. }[/math] It is also true that [math]\displaystyle{ x^{\text{T}}Ay = 0, }[/math] because no vertex in the [math]\displaystyle{ (r-1) }[/math]-ball of [math]\displaystyle{ x }[/math] can be adjacent to a vertex in the [math]\displaystyle{ (r-1) }[/math]-ball of [math]\displaystyle{ y. }[/math]

Now, there exists some constant [math]\displaystyle{ c }[/math] such that [math]\displaystyle{ z = x - cy }[/math] satisfies [math]\displaystyle{ z^{\text{T}}\mathbf{1} = 0. }[/math] Then, since [math]\displaystyle{ x^{\text{T}}y = x^{\text{T}}Ay = 0, }[/math]

[math]\displaystyle{ z^{\text{T}}Az = x^{\text{T}}Ax + c^2y^{\text{T}}Ay \ge 2\sqrt{d-1}\left(1 - \frac{1}{2r}\right)(x^{\text{T}}x + c^2y^{\text{T}}y) = 2\sqrt{d-1}\left(1 - \frac{1}{2r}\right)z^{\text{T}}z. }[/math]

Finally, letting [math]\displaystyle{ r }[/math] grow without bound while ensuring that [math]\displaystyle{ n \ge d^{2r-1} + 2 }[/math] (this can be done by letting [math]\displaystyle{ r }[/math] grow sublogarithmically as a function of [math]\displaystyle{ n }[/math]) makes the error term [math]\displaystyle{ o(1) }[/math] in [math]\displaystyle{ n. }[/math]

Second proof (slightly modified statement)

This proof will demonstrate a slightly modified result, but it provides better intuition for the source of the number [math]\displaystyle{ 2\sqrt{d-1}. }[/math] Rather than showing that [math]\displaystyle{ \lambda_2 \ge 2\sqrt{d-1} - o(1), }[/math] we will show that [math]\displaystyle{ \lambda = \max(|\lambda_2|, |\lambda_n|) \ge 2\sqrt{d-1} - o(1). }[/math]

First, pick some value [math]\displaystyle{ k\in\mathbb{N}. }[/math] Notice that the number of closed walks of length [math]\displaystyle{ 2k }[/math] is

[math]\displaystyle{ \operatorname{tr}A^{2k} = \sum_{i=1}^n \lambda^{2k}_i\le d^{2k} + n\lambda^{2k}. }[/math]

However, it is also true that the number of closed walks of length [math]\displaystyle{ 2k }[/math] starting at a fixed vertex [math]\displaystyle{ v }[/math] in a [math]\displaystyle{ d }[/math]-regular graph is at least the number of such walks in an infinite [math]\displaystyle{ d }[/math]-regular tree, because an infinite [math]\displaystyle{ d }[/math]-regular tree can be used to cover the graph. By the definition of the Catalan numbers, this number is at least [math]\displaystyle{ C_kd(d-1)^k, }[/math] where [math]\displaystyle{ C_k = \frac{1}{k+1}\binom{2k}{k} }[/math] is the [math]\displaystyle{ k^{\text{th}} }[/math] Catalan number.

It follows that

[math]\displaystyle{ \operatorname{tr}A^{2k} \ge n\frac{1}{k+1}\binom{2k}{k}(d-1)^{k} }[/math]
[math]\displaystyle{ \implies \lambda^{2k} \ge \frac{1}{k+1}\binom{2k}{k}(d-1)^{k} - \frac{d^{2k}}{n}. }[/math]

Letting [math]\displaystyle{ n }[/math] grow without bound and letting [math]\displaystyle{ k }[/math] grow without bound but sublogarithmically in [math]\displaystyle{ n }[/math] yields [math]\displaystyle{ \lambda \ge 2\sqrt{d-1} - o(1). }[/math]

References

  1. "On the second eigenvalue of a graph", Discrete Mathematics 91 (2): 207–210, 1991, doi:10.1016/0012-365X(91)90112-F 
  2. Hoory, S.; Linial, N.; Wigderson, A. (2006), "Expander Graphs and their Applications", Bull. Amer. Math. Soc. (N.S.) 43 (4): 439–561, doi:10.1090/S0273-0979-06-01126-8, https://www.cs.huji.ac.il/~nati/PAPERS/expander_survey.pdf 
  3. Friedman, Joel (2003). "Relative expanders or weakly relatively Ramanujan graphs". Duke Math. J. 118 (1): 19–35. doi:10.1215/S0012-7094-03-11812-8.