Donsker classes
A class of functions is considered a Donsker class if it satisfies Donsker's theorem, a functional generalization of the central limit theorem.
Definition
A class of functions [math]\displaystyle{ \mathcal{F} }[/math] is called a Donsker class if the empirical process indexed by [math]\displaystyle{ \mathcal{F} }[/math], [math]\displaystyle{ \{\mathbb{G}_n(f): f \in \mathcal{F}\} }[/math], converges in distribution to a Gaussian process in the space [math]\displaystyle{ l^{\infty}(\mathcal{F}) }[/math]. This means that for every finite set of functions [math]\displaystyle{ f_1, f_2, \dots, f_k \in \mathcal{F} }[/math] and each [math]\displaystyle{ n }[/math], the random vector [math]\displaystyle{ (\mathbb{G}_n(f_1), \mathbb{G}_n(f_2), \dots, \mathbb{G}_n(f_k)) }[/math] converges in distribution to a multivariate normal vector as [math]\displaystyle{ n \rightarrow \infty }[/math].
The empirical process [math]\displaystyle{ \mathbb{G}_n(f) }[/math] is defined by [math]\displaystyle{ \mathbb{G}_n(f) = \sqrt{n}(\mathbb{P}_n - P)(f) }[/math] where [math]\displaystyle{ \mathbb{P}_n }[/math] is the empirical measure based on an iid sample [math]\displaystyle{ X_1, \dots, X_n }[/math] and [math]\displaystyle{ P }[/math] is the probability measure from which the sample is drawn.
Examples and Sufficient Conditions
Classes of functions which have finite Dudley's entropy integral are Donsker classes. This includes empirical distribution functions formed from the class of functions defined by [math]\displaystyle{ \mathbb I_{(-\infty, t]} }[/math] as well as parametric classes over bounded parameter spaces. More generally any VC class is also Donsker class.[1]
Properties
Classes of functions formed by taking infima or suprema of functions in a Donsker class also form a Donsker class.[1]
Donsker's Theorem
Donsker's theorem states that the empirical distribution function, when properly normalized, converges weakly to a Brownian bridge—a continuous Gaussian process. This is significant as it assures that results analogous to the central limit theorem hold for empirical processes, thereby enabling asymptotic inference for a wide range of statistical applications.[2]
The concept of the Donsker class is influential in the field of asymptotic statistics. Knowing whether a function class is a Donsker class helps in understanding the limiting distribution of empirical processes, which in turn facilitates the construction of confidence bands for function estimators and hypothesis testing.[2]
See also
- Empirical process
- Central limit theorem
- Brownian bridge
- Glivenko–Cantelli theorem
- Vapnik–Chervonenkis theory
- Weak convergence (probability)
References
- ↑ 1.0 1.1 Vaart AW van der. Asymptotic Statistics. Cambridge University Press; 1998.
- ↑ 2.0 2.1 van der Vaart, A. W., & Wellner, J. A. (1996). Weak Convergence and Empirical Processes. In Springer Series in Statistics. Springer New York. https://doi.org/10.1007/978-1-4757-2545-2
 |  |
