Generalized integer gamma distribution

From HandWiki

In probability and statistics, the generalized integer gamma distribution (GIG) is the distribution of the sum of independent gamma distributed random variables, all with integer shape parameters and different rate parameters. This is a special case of the generalized chi-squared distribution. A related concept is the generalized near-integer gamma distribution (GNIG).

Definition

The random variable [math]\displaystyle{ X\! }[/math] has a gamma distribution with shape parameter [math]\displaystyle{ r }[/math] and rate parameter [math]\displaystyle{ \lambda }[/math] if its probability density function is

[math]\displaystyle{ f^{}_X(x)=\frac{\lambda^r}{\Gamma(r)}\,e^{-\lambda x} x^{r-1}~~~~~~(x\gt 0;\,\lambda,r\gt 0) }[/math]

and this fact is denoted by [math]\displaystyle{ X\sim\Gamma(r,\lambda)\!. }[/math]

Let [math]\displaystyle{ X_j\sim\Gamma(r_j,\lambda_j)\! }[/math], where [math]\displaystyle{ (j=1,\dots,p), }[/math] be [math]\displaystyle{ p }[/math] independent random variables, with all [math]\displaystyle{ r_j }[/math] being positive integers and all [math]\displaystyle{ \lambda_j\! }[/math] different. In other words, each variable has the Erlang distribution with different shape parameters. The uniqueness of each shape parameter comes without loss of generality, because any case where some of the [math]\displaystyle{ \lambda_j }[/math] are equal would be treated by first adding the corresponding variables: this sum would have a gamma distribution with the same rate parameter and a shape parameter which is equal to the sum of the shape parameters in the original distributions.

Then the random variable Y defined by

[math]\displaystyle{ Y=\sum^p_{j=1} X_j }[/math]

has a GIG (generalized integer gamma) distribution of depth [math]\displaystyle{ p }[/math] with shape parameters [math]\displaystyle{ r_j\! }[/math] and rate parameters [math]\displaystyle{ \lambda_j\! }[/math] [math]\displaystyle{ (j=1,\dots,p) }[/math]. This fact is denoted by

[math]\displaystyle{ Y\sim GIG(r_j,\lambda_j;p)\! . }[/math]

It is also a special case of the generalized chi-squared distribution.

Properties

The probability density function and the cumulative distribution function of Y are respectively given by[1][2][3]

[math]\displaystyle{ f_Y^{\text{GIG}}(y|r_1,\dots,r_p;\lambda_1,\dots,\lambda_p)\,=\,K\sum^p_{j=1}P_j(y)\,e^{-\lambda_j\,y}\,,~~~~(y\gt 0) }[/math]

and

[math]\displaystyle{ F_Y^{\text{GIG}}(y|r_1,\dots,r_j;\lambda_1,\dots,\lambda_p)\,=\,1-K\sum^p_{j=1}P^*_j(y)\,e^{-\lambda_j\,y}\,,~~~~(y\gt 0) }[/math]

where

[math]\displaystyle{ K=\prod^p_{j=1}\lambda_j^{r_j}~,~~~~~P_j(y)=\sum^{r_j}_{k=1} c_{j,k}\,y^{k-1} }[/math]

and

[math]\displaystyle{ P^*_j(y)=\sum^{r_j}_{k=1}c_{j,k}\,(k-1)!\sum^{k-1}_{i=0}\frac{y^i}{i!\,\lambda_j^{k-i}} }[/math]

with

[math]\displaystyle{ c_{j,r_j} =\frac{1}{(r_j-1)!}\,\mathop{\prod^p_{i=1}}_{i\neq j}(\lambda_i-\lambda_j)^{-r_i}~,~~~~~~ j=1,\ldots,p\,, }[/math]

 

 

 

 

(1)

and

[math]\displaystyle{ c_{j,r_j-k}=\frac{1}{k}\sum^k_{i=1}\frac{(r_j-k+i-1)!}{(r_j-k-1)!}\,R(i,j,p)\,c_{j,r_j-(k-i)}\,, ~~~~~~ (k=1,\ldots,r_j-1;\,j=1,\ldots,p) }[/math]

 

 

 

 

(2)

where

[math]\displaystyle{ R(i,j,p)=\mathop{\sum^p_{k=1}}_{k\neq j}r_k\left(\lambda_j-\lambda_k\right)^{-i}~~~(i=1,\ldots,r_j-1)\,. }[/math]

 

 

 

 

(3)

Alternative expressions are available in the literature on generalized chi-squared distribution, which is a field where computer algorithms have been available for some years.[when?]

Generalization

The GNIG (generalized near-integer gamma) distribution of depth [math]\displaystyle{ p+1 }[/math] is the distribution of the random variable[4]

[math]\displaystyle{ Z=Y_1+Y_2\!, }[/math]

where [math]\displaystyle{ Y_1\sim GIG(r_j,\lambda_j;p)\! }[/math] and [math]\displaystyle{ Y_2\sim\Gamma(r,\lambda)\! }[/math] are two independent random variables, where [math]\displaystyle{ r }[/math] is a positive non-integer real and where [math]\displaystyle{ \lambda\neq\lambda_j }[/math] [math]\displaystyle{ (j=1,\dots,p) }[/math].

Properties

The probability density function of [math]\displaystyle{ Z\! }[/math] is given by

[math]\displaystyle{ \begin{array}{l} \displaystyle f_Z^{\text{GNIG}} (z|r_1,\dots,r_p,r;\,\lambda_1,\dots,\lambda_p,\lambda) = \\[5pt] \displaystyle \quad\quad\quad K\lambda ^r \sum\limits_{j = 1}^p {e^{ - \lambda _j z} } \sum\limits_{k = 1}^{r_j } {\left\{ {c_{j,k} \frac{{\Gamma (k)}}{{\Gamma (k+r)}}z^{k + r - 1} {}_1F_1 (r,k+r, - (\lambda-\lambda _j )z)} \right\}} {\rm , } ~~~~(z \gt 0) \end{array} }[/math]

and the cumulative distribution function is given by

[math]\displaystyle{ \begin{array}{l} \displaystyle F_Z^{\text{GNIG}} (z|r_1,\ldots,r_p,r;\,\lambda_1,\ldots,\lambda_p,\lambda) = \frac{\lambda ^r \,{z^r }}{{\Gamma (r+1)}}{}_1F_1 (r,r+1, - \lambda z)\\[12pt] \quad\quad \displaystyle - K\lambda ^r \sum\limits_{j = 1}^p {e^{ - \lambda _j z} } \sum\limits_{k = 1}^{r_j } {c_{j,k}^* } \sum\limits_{i = 0}^{k - 1} {\frac{{z^{r + i} \lambda _j^i }}{{\Gamma (r+1+i)}}} {}_1F_1 (r,r+1+i, - (\lambda - \lambda _j )z) ~~~~ (z\gt 0) \end{array} }[/math]

where

[math]\displaystyle{ c_{j,k}^* = \frac{{c_{j,k} }}{{\lambda _j^k }}\Gamma (k) }[/math]

with [math]\displaystyle{ c_{j,k} }[/math] given by (1)-(3) above. In the above expressions [math]\displaystyle{ _1F_1(a,b;z) }[/math] is the Kummer confluent hypergeometric function. This function has usually very good convergence properties and is nowadays easily handled by a number of software packages.

Applications

The GIG and GNIG distributions are the basis for the exact and near-exact distributions of a large number of likelihood ratio test statistics and related statistics used in multivariate analysis. [5][6][7][8][9] More precisely, this application is usually for the exact and near-exact distributions of the negative logarithm of such statistics. If necessary, it is then easy, through a simple transformation, to obtain the corresponding exact or near-exact distributions for the corresponding likelihood ratio test statistics themselves. [4][10][11]

The GIG distribution is also the basis for a number of wrapped distributions in the wrapped gamma family. [12]

As being a special case of the generalized chi-squared distribution, there are many other applications; for example, in renewal theory[1] and in multi-antenna wireless communications.[13][14][15][16]

References

  1. 1.0 1.1 Amari S.V. and Misra R.B. (1997). Closed-From Expressions for Distribution of Sum of Exponential Random Variables[yes|permanent dead link|dead link}}]. IEEE Transactions on Reliability, vol. 46, no. 4, 519-522.
  2. Coelho, C. A. (1998). The Generalized Integer Gamma distribution – a basis for distributions in Multivariate Statistics. Journal of Multivariate Analysis, 64, 86-102.
  3. Coelho, C. A. (1999). Addendum to the paper ’The Generalized IntegerGamma distribution - a basis for distributions in MultivariateAnalysis’. Journal of Multivariate Analysis, 69, 281-285.
  4. 4.0 4.1 Coelho, C. A. (2004). "The Generalized Near-Integer Gamma distribution – a basis for ’near-exact’ approximations to the distributions of statistics which are the product of an odd number of particular independent Beta random variables". Journal of Multivariate Analysis, 89 (2), 191-218. MR2063631 Zbl 1047.62014 [WOS: 000221483200001]
  5. Bilodeau, M., Brenner, D. (1999) "Theory of Multivariate Statistics". Springer, New York [Ch. 11, sec. 11.4]
  6. Das, S., Dey, D. K. (2010) "On Bayesian inference for generalized multivariate gamma distribution". Statistics and Probability Letters, 80, 1492-1499.
  7. Karagiannidis, K., Sagias, N. C., Tsiftsis, T. A. (2006) "Closed-form statistics for the sum of squared Nakagami-m variates and its applications". Transactions on Communications, 54, 1353-1359.
  8. Paolella, M. S. (2007) "Intermediate Probability - A Computational Approach". J. Wiley & Sons, New York [Ch. 2, sec. 2.2]
  9. Timm, N. H. (2002) "Applied Multivariate Analysis". Springer, New York [Ch. 3, sec. 3.5]
  10. Coelho, C. A. (2006) "The exact and near-exact distributions of the product of independent Beta random variables whose second parameter is rational". Journal of Combinatorics, Information & System Sciences, 31 (1-4), 21-44. MR2351709
  11. Coelho, C. A., Alberto, R. P. and Grilo, L. M. (2006) "A mixture of Generalized Integer Gamma distributions as the exact distribution of the product of an odd number of independent Beta random variables.Applications". Journal of Interdisciplinary Mathematics, 9, 2, 229-248. MR2245158 Zbl 1117.62017
  12. Coelho, C. A. (2007) "The wrapped Gamma distribution and wrapped sums and linear combinations of independent Gamma and Laplace distributions". Journal of Statistical Theory and Practice, 1 (1), 1-29.
  13. E. Björnson, D. Hammarwall, B. Ottersten (2009) "Exploiting Quantized Channel Norm Feedback through Conditional Statistics in Arbitrarily Correlated MIMO Systems", IEEE Transactions on Signal Processing, 57, 4027-4041
  14. Kaiser, T., Zheng, F. (2010) "Ultra Wideband Systems with MIMO". J. Wiley & Sons, Chichester, U.K. [Ch. 6, sec. 6.6]
  15. Suraweera, H. A., Smith, P. J., Surobhi, N. A. (2008) "Exact outage probability of cooperative diversity with opportunistic spectrum access". IEEE International Conference on Communications, 2008, ICC Workshops '08, 79-86 (ISBN:978-1-4244-2052-0 - doi:10.1109/ICCW.2008.20).
  16. Surobhi, N. A. (2010) "Outage performance of cooperative cognitive relay networks". MsC Thesis, School of Engineering and Science, Victoria University, Melbourne, Australia [Ch. 3, sec. 3.4].