List of convolutions of probability distributions

From HandWiki
Revision as of 14:43, 6 February 2024 by John Marlo (talk | contribs) (update)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Short description: none

In probability theory, the probability distribution of the sum of two or more independent random variables is the convolution of their individual distributions. The term is motivated by the fact that the probability mass function or probability density function of a sum of independent random variables is the convolution of their corresponding probability mass functions or probability density functions respectively. Many well known distributions have simple convolutions. The following is a list of these convolutions. Each statement is of the form

[math]\displaystyle{ \sum_{i=1}^n X_i \sim Y }[/math]

where [math]\displaystyle{ X_1, X_2,\dots, X_n }[/math] are independent random variables, and [math]\displaystyle{ Y }[/math] is the distribution that results from the convolution of [math]\displaystyle{ X_1, X_2,\dots, X_n }[/math]. In place of [math]\displaystyle{ X_i }[/math] and [math]\displaystyle{ Y }[/math] the names of the corresponding distributions and their parameters have been indicated.

Discrete distributions

  • [math]\displaystyle{ \sum_{i=1}^n \mathrm{Bernoulli}(p) \sim \mathrm{Binomial}(n,p) \qquad 0\lt p\lt 1 \quad n=1,2,\dots }[/math]
  • [math]\displaystyle{ \sum_{i=1}^n \mathrm{Binomial}(n_i,p) \sim \mathrm{Binomial}\left(\sum_{i=1}^n n_i,p\right) \qquad 0\lt p\lt 1 \quad n_i=1,2,\dots }[/math]
  • [math]\displaystyle{ \sum_{i=1}^n \mathrm{NegativeBinomial}(n_i,p) \sim \mathrm{NegativeBinomial}\left(\sum_{i=1}^n n_i,p\right) \qquad 0\lt p\lt 1 \quad n_i=1,2,\dots }[/math]
  • [math]\displaystyle{ \sum_{i=1}^n \mathrm{Geometric}(p) \sim \mathrm{NegativeBinomial}(n,p) \qquad 0\lt p\lt 1 \quad n=1,2,\dots }[/math]
  • [math]\displaystyle{ \sum_{i=1}^n \mathrm{Poisson}(\lambda_i) \sim \mathrm{Poisson}\left(\sum_{i=1}^n \lambda_i\right) \qquad \lambda_i\gt 0 }[/math]

Continuous distributions

  • [math]\displaystyle{ \sum_{i=1}^n \operatorname{Stable}\left(\alpha,\beta_i,c_i,\mu_i\right)=\operatorname{Stable}\left(\alpha,\frac{\sum_{i=1}^n \beta_i c_i ^\alpha}{\sum_{i=1}^n c_i^\alpha},\left( \sum_{i=1}^n c_i^\alpha \right)^{1/\alpha},\sum_{i=1}^n\mu_i\right) }[/math]

[math]\displaystyle{ \qquad 0\lt \alpha_i\le 2 \quad -1 \le \beta_i \le 1 \quad c_i\gt 0 \quad \infty\lt \mu_i\lt \infty }[/math]

The following three statements are special cases of the above statement:

  • [math]\displaystyle{ \sum_{i=1}^n \operatorname{Normal}(\mu_i,\sigma_i^2) \sim \operatorname{Normal}\left(\sum_{i=1}^n \mu_i, \sum_{i=1}^n \sigma_i^2\right) \qquad -\infty\lt \mu_i\lt \infty \quad \sigma_i^2\gt 0\quad (\alpha=2, \beta_i=0) }[/math]
  • [math]\displaystyle{ \sum_{i=1}^n \operatorname{Cauchy}(a_i,\gamma_i) \sim \operatorname{Cauchy}\left(\sum_{i=1}^n a_i, \sum_{i=1}^n \gamma_i\right) \qquad -\infty\lt a_i\lt \infty \quad \gamma_i\gt 0 \quad (\alpha=1, \beta_i=0) }[/math]
  • [math]\displaystyle{ \sum_{i=1}^n \operatorname{Levy}(\mu_i,c_i) \sim \operatorname{Levy}\left(\sum_{i=1}^n \mu_i, \left(\sum_{i=1}^n \sqrt{c_i}\right)^2\right) \qquad -\infty\lt \mu_i\lt \infty \quad c_i\gt 0\quad (\alpha=1/2, \beta_i=1) }[/math]


  • [math]\displaystyle{ \sum_{i=1}^n \operatorname{Gamma}(\alpha_i,\beta) \sim \operatorname{Gamma}\left(\sum_{i=1}^n \alpha_i,\beta\right) \qquad \alpha_i\gt 0 \quad \beta\gt 0 }[/math]
  • [math]\displaystyle{ \sum_{i=1}^n \operatorname{Voigt}(\mu_i,\gamma_i,\sigma_i) \sim \operatorname{Voigt}\left(\sum_{i=1}^n \mu_i,\sum_{i=1}^n \gamma_i,\sqrt{\sum_{i=1}^n \sigma_i^2}\right) \qquad -\infty\lt \mu_i\lt \infty \quad \gamma_i\gt 0 \quad \sigma_i\gt 0 }[/math][1]
  • [math]\displaystyle{ \sum_{i=1}^n \operatorname{VarianceGamma}(\mu_i,\alpha,\beta,\lambda_i) \sim \operatorname{VarianceGamma}\left(\sum_{i=1}^n \mu_i, \alpha,\beta, \sum_{i=1}^n \lambda_i\right) \qquad -\infty\lt \mu_i\lt \infty \quad \lambda_i \gt 0 \quad \sqrt{\alpha^2 - \beta^2} \gt 0 }[/math][2]
  • [math]\displaystyle{ \sum_{i=1}^n \operatorname{Exponential}(\theta) \sim \operatorname{Erlang}(n,\theta) \qquad \theta\gt 0 \quad n=1,2,\dots }[/math]
  • [math]\displaystyle{ \sum_{i=1}^n \operatorname{Exponential}(\lambda_i) \sim \operatorname{Hypoexponential}(\lambda_1,\dots,\lambda_n) \qquad \lambda_i\gt 0 }[/math][3]
  • [math]\displaystyle{ \sum_{i=1}^n \chi^2(r_i) \sim \chi^2\left(\sum_{i=1}^n r_i\right) \qquad r_i=1,2,\dots }[/math]
  • [math]\displaystyle{ \sum_{i=1}^r N^2(0,1) \sim \chi^2_r \qquad r=1,2,\dots }[/math]
  • [math]\displaystyle{ \sum_{i=1}^n(X_i - \bar X)^2 \sim \sigma^2 \chi^2_{n-1}, \quad }[/math] where [math]\displaystyle{ X_1,\dots,X_n }[/math] is a random sample from [math]\displaystyle{ N(\mu,\sigma^2) }[/math] and [math]\displaystyle{ \bar X = \frac{1}{n} \sum_{i=1}^n X_i. }[/math]

Mixed distributions:

  • [math]\displaystyle{ \operatorname{Normal}(\mu,\sigma^2)+\operatorname{Cauchy}(x_0,\gamma) \sim \operatorname{Voigt}(\mu+x_0,\sigma,\gamma)\qquad -\infty\lt \mu\lt \infty \quad -\infty\lt x_0\lt \infty \quad \gamma\gt 0 \quad \sigma\gt 0 }[/math]

See also

References

  1. "VoigtDistribution". 2016. https://reference.wolfram.com/language/ref/VoigtDistribution.html. 
  2. "VarianceGammaDistribution". 2012. https://reference.wolfram.com/language/ref/VarianceGammaDistribution.html.en. 
  3. Yanev, George P. (2020-12-15). "Exponential and Hypoexponential Distributions: Some Characterizations". Mathematics 8 (12): 2207. doi:10.3390/math8122207. 

Sources