Bivariate normal distribution

From HandWiki


If Hepa img34.gif is a constant vector and

Hepa img35.gif

are positive definite symmetric matrices ( Hepa img2.gif Positivity), then

Hepa img36.gif

where Hepa img37n.gif . Hepa img38.gif is the joint probability density of a normal distribution of the variables Hepa img39.gif . The expectation values of the variables are Hepa img40.gif . Their covariance matrix is C. Lines of constant probability density in the Hepa img42.gif -plane correspond to constant values of the exponent. For a constant exponent, one obtains the condition:

Hepa img43n.gif

This is the equation of an ellipse. For Hepa img43n1.gif, the right-hand side of the equation becomes Hepa img43n2.gif and the ellipse is called the covariance ellipse or error ellipse of the bivariate normal distribution. The error ellipse is centred at the point Hepa img34.gif and has as principal (major and minor) axes the (uncorrelated) largest and smallest standard deviation that can be found under any angle. The size and orientation of the error ellipse is discussed below. The probability of observing a point (X1,X2) inside the error ellipse is Hepa img44.gif .

Note that distances from the point Hepa img45.gif to the covariance ellipse do not describe the standard deviation along directions other than along the principal axes. This standard deviation is obtained by error propagation, and is greater than or equal to the distance to the error ellipse, the difference being explained by the non-uniform distribution of the second (angular) variable (see figure).

Hepa img46.gif

For vanishing correlation coefficient ( Hepa img47.gif ) the principal axes of the error ellipse are parallel to the coordinate x1, x2 axes, and the principal semi-diameters of the ellipse p1,p2 are equal to Hepa img48.gif .

For Hepa img49.gif one can find the principal axes and their orientation with respect to the coordinate axes from the relations

Hepa img50.gif

where a is the angle between the x1 axis and the semi-diameter of length p1. Note that a is determined up to multiples of Hepa img51.gif , i.e. for both semi-diameters of both principal axes.

The marginal distributions of the bivariate normal are normal distributions of one variable:

Hepa img56.gif

Only for uncorrelated variables, i.e. for Hepa img47.gif , is the bivariate normal the product of two univariate Gaussians

Hepa img57.gif

Unbiased estimators for the parameters a1,a2, and the elements Cij are constructed from a sample (X1k X2k), Hepa img58.gif as follows:

Estimator of ai:

Hepa img59.gif

Estimator of Cij:

Hepa img60.gif