Inverse distribution
In probability theory and statistics, an inverse distribution is the distribution of the reciprocal of a random variable. Inverse distributions arise in particular in the Bayesian context of prior distributions and posterior distributions for scale parameters. In the algebra of random variables, inverse distributions are special cases of the class of ratio distributions, in which the numerator random variable has a degenerate distribution.
Relation to original distribution
In general, given the probability distribution of a random variable X with strictly positive support, it is possible to find the distribution of the reciprocal, Y = 1 / X. If the distribution of X is continuous with density function f(x) and cumulative distribution function F(x), then the cumulative distribution function, G(y), of the reciprocal is found by noting that
- [math]\displaystyle{ G(y) = \Pr(Y \leq y) = \Pr\left(X \geq \frac{1}{y}\right) = 1-\Pr\left(X\lt \frac{1}{y}\right) = 1 - F\left( \frac{ 1 }{ y } \right). }[/math]
Then the density function of Y is found as the derivative of the cumulative distribution function:
- [math]\displaystyle{ g(y) = \frac{ 1 }{ y^2 } f\left( \frac{ 1 }{ y } \right) . }[/math]
Examples
Reciprocal distribution
The reciprocal distribution has a density function of the form[1]
- [math]\displaystyle{ f(x) \propto x^{-1} \quad \text{ for } 0\lt a\lt x\lt b, }[/math]
where [math]\displaystyle{ \propto \!\, }[/math] means "is proportional to". It follows that the inverse distribution in this case is of the form
- [math]\displaystyle{ g(y) \propto y^{-1} \quad \text{ for } 0\le b^{-1}\lt y\lt a^{-1}, }[/math]
which is again a reciprocal distribution.
Inverse uniform distribution
Parameters | [math]\displaystyle{ 0 \lt a \lt b, \quad a, b \in \R }[/math] | ||
---|---|---|---|
Support | [math]\displaystyle{ [ b^{-1} , a^{-1} ] }[/math] | ||
[math]\displaystyle{ y^{-2} \frac{ 1 }{ b-a } }[/math] | |||
CDF | [math]\displaystyle{ \frac{ b - y^{-1} }{ b - a } }[/math] | ||
Mean | [math]\displaystyle{ \frac{ \ln(b) - \ln(a)}{ b - a } }[/math] | ||
Median | [math]\displaystyle{ \frac{ 2}{ a+b } }[/math] | ||
Variance | [math]\displaystyle{ \frac{1}{a \cdot b} - \left( \frac{ \ln(b) - \ln(a)}{ b - a } \right)^2 }[/math] |
If the original random variable X is uniformly distributed on the interval (a,b), where a>0, then the reciprocal variable Y = 1 / X has the reciprocal distribution which takes values in the range (b−1 ,a−1), and the probability density function in this range is
- [math]\displaystyle{ g( y ) = y^{-2} \frac{ 1 }{ b-a } , }[/math]
and is zero elsewhere.
The cumulative distribution function of the reciprocal, within the same range, is
- [math]\displaystyle{ G( y ) = \frac{ b - y^{-1} }{ b - a } . }[/math]
For example, if X is uniformly distributed on the interval (0,1), then Y = 1 / X has density [math]\displaystyle{ g( y ) = y^{-2} }[/math] and cumulative distribution function [math]\displaystyle{ G( y ) = { 1 - y^{-1} } }[/math] when [math]\displaystyle{ y \gt 1 . }[/math]
Inverse t distribution
Let X be a t distributed random variate with k degrees of freedom. Then its density function is
- [math]\displaystyle{ f( x ) = \frac{ 1 }{ \sqrt{ k \pi } } \frac{ \Gamma\left( \frac{ k + 1 }{ 2 } \right) }{ \Gamma\left( \frac{ k }{ 2 } \right) } \frac{ 1 }{ \left( 1 + \frac{ x^2 }{ k } \right)^{ \frac{ 1 + k }{ 2 } } } . }[/math]
The density of Y = 1 / X is
- [math]\displaystyle{ g( y ) = \frac{ 1 }{ \sqrt{ k \pi } } \frac{ \Gamma\left( \frac{ k + 1 }{ 2 } \right) }{ \Gamma\left( \frac{ k }{ 2 } \right) } \frac{ 1 }{ y^2 \left( 1 + \frac{ 1 }{ y^2 k } \right)^{ \frac{ 1 + k }{ 2 } } } . }[/math]
With k = 1, the distributions of X and 1 / X are identical (X is then Cauchy distributed (0,1)). If k > 1 then the distribution of 1 / X is bimodal.[citation needed]
Reciprocal normal distribution
If variable [math]\displaystyle{ X }[/math] follows a normal distribution [math]\displaystyle{ \mathcal{N}(\mu,\sigma^2) }[/math], then the inverse or reciprocal [math]\displaystyle{ Y=\frac{1}{X} }[/math] follows a reciprocal normal distribution:[2]
- [math]\displaystyle{ f(y) = \frac{1}{\sqrt{2\pi} \sigma y^2} e^{-\frac{1}{2}\left(\frac{1/y-\mu}{\sigma}\right)^2} . }[/math]
If variable X follows a standard normal distribution [math]\displaystyle{ \mathcal{N}(0, 1) }[/math], then Y = 1/X follows a reciprocal standard normal distribution, heavy-tailed and bimodal,[2] with modes at [math]\displaystyle{ \pm\tfrac{1}{\sqrt{2}} }[/math] and density
- [math]\displaystyle{ f(y)=\frac{e^{-\frac{1}{2y^2}}}{\sqrt{2\pi}y^2} }[/math]
and the first and higher-order moments do not exist.[2] For such inverse distributions and for ratio distributions, there can still be defined probabilities for intervals, which can be computed either by Monte Carlo simulation or, in some cases, by using the Geary–Hinkley transformation.[3]
However, in the more general case of a shifted reciprocal function [math]\displaystyle{ 1/(p-B) }[/math], for [math]\displaystyle{ B=N(\mu,\sigma) }[/math] following a general normal distribution, then mean and variance statistics do exist in a principal value sense, if the difference between the pole [math]\displaystyle{ p }[/math] and the mean [math]\displaystyle{ \mu }[/math] is real-valued. The mean of this transformed random variable (reciprocal shifted normal distribution) is then indeed the scaled Dawson's function:[4]
- [math]\displaystyle{ \frac{\sqrt{2}}{\sigma} F \left(\frac{p-\mu}{\sqrt{2}\sigma}\right). }[/math]
In contrast, if the shift [math]\displaystyle{ p-\mu }[/math] is purely complex, the mean exists and is a scaled Faddeeva function, whose exact expression depends on the sign of the imaginary part, [math]\displaystyle{ \operatorname{Im}(p-\mu) }[/math]. In both cases, the variance is a simple function of the mean.[5] Therefore, the variance has to be considered in a principal value sense if [math]\displaystyle{ p-\mu }[/math] is real, while it exists if the imaginary part of [math]\displaystyle{ p-\mu }[/math] is non-zero. Note that these means and variances are exact, as they do not recur to linearisation of the ratio. The exact covariance of two ratios with a pair of different poles [math]\displaystyle{ p_1 }[/math] and [math]\displaystyle{ p_2 }[/math] is similarly available.[6] The case of the inverse of a complex normal variable [math]\displaystyle{ B }[/math], shifted or not, exhibits different characteristics.[4]
Inverse exponential distribution
If [math]\displaystyle{ X }[/math] is an exponentially distributed random variable with rate parameter [math]\displaystyle{ \lambda }[/math], then [math]\displaystyle{ Y=1/X }[/math] has the following cumulative distribution function: [math]\displaystyle{ F_Y(y) = e^{-\lambda/y} }[/math]for [math]\displaystyle{ y\gt 0 }[/math]. Note that the expected value of this random variable does not exist. The reciprocal exponential distribution finds use in the analysis of fading wireless communication systems.
Inverse Cauchy distribution
If X is a Cauchy distributed (μ, σ) random variable, then 1 / X is a Cauchy ( μ / C, σ / C ) random variable where C = μ2 + σ2.
Inverse F distribution
If X is an F(ν1, ν2 ) distributed random variable then 1 / X is an F(ν2, ν1 ) random variable.
Reciprocal of binomial distribution
If [math]\displaystyle{ X }[/math] is distributed according to a Binomial distribution with [math]\displaystyle{ n }[/math] number of trials and a probability of success [math]\displaystyle{ p }[/math] then no closed form for the reciprocal distribution is known. However, we can calculate the mean of this distribution.
[math]\displaystyle{ E\left[\frac{1}{(1+X)}\right] = \frac{1}{p(n+1)}\left( 1 - (1-p)^{n+1} \right) }[/math]
An asymptotic approximation for the non-central moments of the reciprocal distribution is known.[7]
[math]\displaystyle{ E[ ( 1 + X )^a ] = O( ( np )^{ -a } ) + o( n^{ -a } ) }[/math]
where O() and o() are the big and little o order functions and [math]\displaystyle{ a }[/math] is a real number.
Reciprocal of triangular distribution
For a triangular distribution with lower limit a, upper limit b and mode c, where a < b and a ≤ c ≤ b, the mean of the reciprocal is given by
[math]\displaystyle{ \mu = \frac{2 \left( \frac{ a\, \mathrm{ln} \left(\frac{a}{c}\right) }{a-c} + \frac{ b\, \mathrm{ln}\left(\frac{c}{b}\right) }{b-c} \right)}{a-b} }[/math]
and the variance by
[math]\displaystyle{ \sigma^2 = \frac{2 \left( \frac{ \mathrm{ln} \left(\frac{c}{a}\right) }{a-c} + \frac{ \mathrm{ln} \left(\frac{b}{c}\right) }{b-c} \right)}{a-b} - \mu^2 }[/math].
Both moments of the reciprocal are only defined when the triangle does not cross zero, i.e. when a, b, and c are either all positive or all negative.
Other inverse distributions
Other inverse distributions include
- inverse-chi-squared distribution
- inverse-gamma distribution
- inverse-Wishart distribution
- inverse matrix gamma distribution
Applications
Inverse distributions are widely used as prior distributions in Bayesian inference for scale parameters.
See also
References
- ↑ Hamming R. W. (1970) "On the distribution of numbers", The Bell System Technical Journal 49(8) 1609–1625
- ↑ 2.0 2.1 2.2 Johnson, Norman L.; Kotz, Samuel; Balakrishnan, Narayanaswamy (1994). Continuous Univariate Distributions, Volume 1. Wiley. pp. 171. ISBN 0-471-58495-9.
- ↑ Hayya, Jack; Armstrong, Donald; Gressis, Nicolas (July 1975). "A Note on the Ratio of Two Normally Distributed Variables". Management Science 21 (11): 1338–1341. doi:10.1287/mnsc.21.11.1338.
- ↑ 4.0 4.1 Lecomte, Christophe (May 2013). "Exact statistics of systems with uncertainties: an analytical theory of rank-one stochastic dynamic systems". Journal of Sound and Vibration 332 (11): 2750–2776. doi:10.1016/j.jsv.2012.12.009.
- ↑ Lecomte, Christophe (May 2013). "Exact statistics of systems with uncertainties: an analytical theory of rank-one stochastic dynamic systems". Journal of Sound and Vibration 332 (11): Section (4.1.1). doi:10.1016/j.jsv.2012.12.009.
- ↑ Lecomte, Christophe (May 2013). "Exact statistics of systems with uncertainties: an analytical theory of rank-one stochastic dynamic systems". Journal of Sound and Vibration 332 (11): Eq.(39)-(40). doi:10.1016/j.jsv.2012.12.009.
- ↑ Cribari-Neto F, Lopes Garcia N, Vasconcellos KLP (2000) A note on inverse moments of binomial variates. Brazilian Review of Econometrics 20 (2)
![]() | Original source: https://en.wikipedia.org/wiki/Inverse distribution.
Read more |