Location parameter

From HandWiki
Short description: Concept in statistics

In statistics, a location parameter of a probability distribution is a scalar- or vector-valued parameter [math]\displaystyle{ x_0 }[/math], which determines the "location" or shift of the distribution. In the literature of location parameter estimation, the probability distributions with such parameter are found to be formally defined in one of the following equivalent ways:

A direct example of a location parameter is the parameter [math]\displaystyle{ \mu }[/math] of the normal distribution. To see this, note that the probability density function [math]\displaystyle{ f(x | \mu, \sigma) }[/math] of a normal distribution [math]\displaystyle{ \mathcal{N}(\mu,\sigma^2) }[/math] can have the parameter [math]\displaystyle{ \mu }[/math] factored out and be written as:

[math]\displaystyle{ g(y - \mu | \sigma) = \frac{1}{\sigma \sqrt{2\pi} } e^{-\frac{1}{2}\left(\frac{y}{\sigma}\right)^2} }[/math]

thus fulfilling the first of the definitions given above.

The above definition indicates, in the one-dimensional case, that if [math]\displaystyle{ x_0 }[/math] is increased, the probability density or mass function shifts rigidly to the right, maintaining its exact shape.

A location parameter can also be found in families having more than one parameter, such as location–scale families. In this case, the probability density function or probability mass function will be a special case of the more general form

[math]\displaystyle{ f_{x_0,\theta}(x) = f_\theta(x-x_0) }[/math]

where [math]\displaystyle{ x_0 }[/math] is the location parameter, θ represents additional parameters, and [math]\displaystyle{ f_\theta }[/math] is a function parametrized on the additional parameters.

Additive noise

An alternative way of thinking of location families is through the concept of additive noise. If [math]\displaystyle{ x_0 }[/math] is a constant and W is random noise with probability density [math]\displaystyle{ f_W(w), }[/math] then [math]\displaystyle{ X = x_0 + W }[/math] has probability density [math]\displaystyle{ f_{x_0}(x) = f_W(x-x_0) }[/math] and its distribution is therefore part of a location family.

Proofs

For the continuous univariate case, consider a probability density function [math]\displaystyle{ f(x | \theta), x \in [a, b] \subset \mathbb{R} }[/math], where [math]\displaystyle{ \theta }[/math] is a vector of parameters. A location parameter [math]\displaystyle{ x_0 }[/math] can be added by defining:

[math]\displaystyle{ g(x | \theta, x_0) = f(x - x_0 | \theta), \; x \in [a - x_0, b - x_0] }[/math]

it can be proved that [math]\displaystyle{ g }[/math] is a p.d.f. by verifying if it respects the two conditions[4] [math]\displaystyle{ g(x | \theta, x_0) \ge 0 }[/math] and [math]\displaystyle{ \int_{-\infty}^{\infty} g(x | \theta, x_0) dx = 1 }[/math]. [math]\displaystyle{ g }[/math] integrates to 1 because:

[math]\displaystyle{ \int_{-\infty}^{\infty} g(x | \theta, x_0) dx = \int_{a - x_0}^{b - x_0} g(x | \theta, x_0) dx = \int_{a - x_0}^{b - x_0} f(x - x_0 | \theta) dx }[/math]

now making the variable change [math]\displaystyle{ u = x - x_0 }[/math] and updating the integration interval accordingly yields:

[math]\displaystyle{ \int_{a}^{b} f(u | \theta) du = 1 }[/math]

because [math]\displaystyle{ f(x | \theta) }[/math] is a p.d.f. by hypothesis. [math]\displaystyle{ g(x | \theta, x_0) \ge 0 }[/math] follows from [math]\displaystyle{ g }[/math] sharing the same image of [math]\displaystyle{ f }[/math], which is a p.d.f. so its image is contained in [math]\displaystyle{ [0, 1] }[/math].

See also

References

  1. Takeuchi, Kei (1971). "A Uniformly Asymptotically Efficient Estimator of a Location Parameter". Journal of the American Statistical Association 66 (334): 292-301. 
  2. Huber, Peter J. (1992). "Robust estimation of a location parameter". Breakthroughs in statistics (Springer): 492-518. 
  3. Stone, Charles J. (1975). "Adaptive Maximum Likelihood Estimators of a Location Parameter". The Annals of Statistics 3 (2): 267-284. 
  4. Ross, Sheldon (2010). Introduction to probability models. Amsterdam Boston: Academic Press. ISBN 978-0-12-375686-2. OCLC 444116127.