Isotropic position
In the fields of machine learning, the theory of computation, and random matrix theory, a probability distribution over vectors is said to be in isotropic position if its covariance matrix is equal to the identity matrix.
Formal definitions
Let [math]\displaystyle{ D }[/math] be a distribution over vectors in the vector space [math]\displaystyle{ \mathbb{R}^n }[/math]. Then [math]\displaystyle{ D }[/math] is in isotropic position if, for vector [math]\displaystyle{ v }[/math] sampled from the distribution, [math]\displaystyle{ \mathbb{E}\, vv^\mathsf{T} = \mathrm{Id}. }[/math]
A set of vectors is said to be in isotropic position if the uniform distribution over that set is in isotropic position. In particular, every orthonormal set of vectors is isotropic.
As a related definition, a convex body [math]\displaystyle{ K }[/math] in [math]\displaystyle{ \mathbb{R}^n }[/math] is called isotropic if it has volume [math]\displaystyle{ |K| = 1 }[/math], center of mass at the origin, and there is a constant [math]\displaystyle{ \alpha \gt 0 }[/math] such that [math]\displaystyle{ \int_K \langle x, y \rangle^2 dx = \alpha^2 |y|^2, }[/math] for all vectors [math]\displaystyle{ y }[/math] in [math]\displaystyle{ \mathbb{R}^n }[/math]; here [math]\displaystyle{ |\cdot| }[/math] stands for the standard Euclidean norm.
See also
References
- Rudelson, M. (1999). "Random Vectors in the Isotropic Position". Journal of Functional Analysis 164 (1): 60–72. doi:10.1006/jfan.1998.3384.
Original source: https://en.wikipedia.org/wiki/Isotropic position.
Read more |