Weakly dependent random variables

In probability, weak dependence of random variables is a generalization of independence that is weaker than the concept of a martingale. A (time) sequence of random variables is weakly dependent if distinct portions of the sequence have a covariance that asymptotically decreases to 0 as the blocks are further separated in time. Weak dependence primarily appears as a technical condition in various probabilistic limit theorems.

Formal definition

Fix a set S, a sequence of sets of measurable functions [math]\displaystyle{ \{\mathcal{F}_d\}_{d=1}^{\infty}\in\prod_{d=1}^{\infty}{\left(S^d\to\mathbb{R}\right)} }[/math], a decreasing sequence [math]\displaystyle{ \{\theta_{\delta}\}_{\delta=1}^{\infty}\to0 }[/math], and a function [math]\displaystyle{ \psi\in\mathcal{F}^2\times(\mathbb{Z}^+)^2\to\mathbb{R}^+ }[/math]. A sequence [math]\displaystyle{ \{X_n\}_{n=1}^{\infty} }[/math] of random variables is [math]\displaystyle{ (\{\mathcal{F}_d\}_{d=1}^{\infty},\{\theta_{\delta}\}_{\delta},\psi) }[/math]-weakly dependent iff, for all [math]\displaystyle{ j_1\leq j_2\leq\dots\leq j_d\lt j_d+\delta\leq k_1\leq k_2\leq\dots\leq k_e }[/math], for all [math]\displaystyle{ \phi\in\mathcal{F}_d }[/math], and [math]\displaystyle{ \theta\in\mathcal{F}_e }[/math], we have

[math]\displaystyle{ |\operatorname{Cov}{(\phi(X_{j_1},\dots,X_{j_d}), \theta(X_{k_1},\dots,X_{k_e}))}|\leq\psi(\phi,\theta,d,e)\theta_{\delta} }[/math]

Note that the covariance does not decay to 0 uniformly in d and e.

Common applications

Weak dependence is a sufficient weak condition that many natural instances of stochastic processes exhibit it. In particular, weak dependence is a natural condition for the ergodic theory of random functions.

A sufficient substitute for independence in the Lindeberg–Lévy central limit theorem is weak dependence. For this reason, specializations often appear in the probability literature on limit theorems. These include Withers' condition for strong mixing, Tran's "absolute regularity in the locally transitive sense," and Birkel's "asymptotic quadrant independence."

Weak dependence also functions as a substitute for strong mixing. Again, generalizations of the latter are specializations of the former; an example is Rosenblatt's mixing condition.

Other uses include a generalization of the Marcinkiewicz–Zygmund inequality and Rosenthal inequalities.

Martingales are weakly dependent, so many results about martingales also hold true for weakly dependent sequences. An example is Bernstein's bound on higher moments, which can be relaxed to only require

[math]\displaystyle{ \begin{align} \operatorname{E} \left [ X_i \mid X_1, \dots, X_{i-1} \right ] &= 0, \\ \operatorname{E} \left [ X_i^2 \mid X_1, \dots, X_{i-1} \right ] &\leq R_i \operatorname{E} \left [ X_i^2 \right ], \\ \operatorname{E} \left [ X_i^k \mid X_1, \dots, X_{i-1} \right ] &\leq \tfrac{1}{2} \operatorname{E} \left[ X_i^2 \mid X_1, \dots, X_{i-1} \right ] L^{k-2} k! \end{align} }[/math]

See also

• Central limit theorem
• Independence of random variables
• Martingale (probability theory)

External links

• An example inspiring this idea
• An application
• A paper on an alternative to weak dependence