Hypoexponential distribution

Short description: Concept in probability theory

Hypoexponential

Parameters	[math]\displaystyle{ \lambda_{1},\dots,\lambda_{k} \gt 0\, }[/math] rates (real)
Support	[math]\displaystyle{ x \in [0; \infty)\! }[/math]
PDF	Expressed as a phase-type distribution [math]\displaystyle{ -\boldsymbol{\alpha}e^{x\Theta}\Theta\boldsymbol{1} }[/math] Has no other simple form; see article for details
CDF	Expressed as a phase-type distribution [math]\displaystyle{ 1-\boldsymbol{\alpha}e^{x\Theta}\boldsymbol{1} }[/math]
Mean	[math]\displaystyle{ \sum^{k}_{i=1}1/\lambda_{i}\, }[/math]
Median	General closed form does not exist
Mode	[math]\displaystyle{ (k-1)/\lambda }[/math] if [math]\displaystyle{ \lambda_{k} = \lambda }[/math], for all k
Variance	[math]\displaystyle{ \sum^{k}_{i=1}1/\lambda^2_{i} }[/math]
Skewness	[math]\displaystyle{ 2(\sum^{k}_{i=1}1/\lambda_{i}^3)/(\sum^{k}_{i=1}1/\lambda_{i}^2)^{3/2} }[/math]
Kurtosis	no simple closed form
MGF	[math]\displaystyle{ \boldsymbol{\alpha}(tI-\Theta)^{-1}\Theta\mathbf{1} }[/math]
CF	[math]\displaystyle{ \boldsymbol{\alpha}(itI-\Theta)^{-1}\Theta\mathbf{1} }[/math]

In probability theory the hypoexponential distribution or the generalized Erlang distribution is a continuous distribution, that has found use in the same fields as the Erlang distribution, such as queueing theory, teletraffic engineering and more generally in stochastic processes. It is called the hypoexponetial distribution as it has a coefficient of variation less than one, compared to the hyper-exponential distribution which has coefficient of variation greater than one and the exponential distribution which has coefficient of variation of one.

Overview

The Erlang distribution is a series of k exponential distributions all with rate [math]\displaystyle{ \lambda }[/math]. The hypoexponential is a series of k exponential distributions each with their own rate [math]\displaystyle{ \lambda_{i} }[/math], the rate of the [math]\displaystyle{ i^{th} }[/math] exponential distribution. If we have k independently distributed exponential random variables [math]\displaystyle{ \boldsymbol{X}_{i} }[/math], then the random variable,

[math]\displaystyle{ \boldsymbol{X}=\sum^{k}_{i=1}\boldsymbol{X}_{i} }[/math]

is hypoexponentially distributed. The hypoexponential has a minimum coefficient of variation of [math]\displaystyle{ 1/k }[/math].

Relation to the phase-type distribution

As a result of the definition it is easier to consider this distribution as a special case of the phase-type distribution. The phase-type distribution is the time to absorption of a finite state Markov process. If we have a k+1 state process, where the first k states are transient and the state k+1 is an absorbing state, then the distribution of time from the start of the process until the absorbing state is reached is phase-type distributed. This becomes the hypoexponential if we start in the first 1 and move skip-free from state i to i+1 with rate [math]\displaystyle{ \lambda_{i} }[/math] until state k transitions with rate [math]\displaystyle{ \lambda_{k} }[/math] to the absorbing state k+1. This can be written in the form of a subgenerator matrix,

[math]\displaystyle{ \left[\begin{matrix}-\lambda_{1}&\lambda_{1}&0&\dots&0&0\\ 0&-\lambda_{2}&\lambda_{2}&\ddots&0&0\\ \vdots&\ddots&\ddots&\ddots&\ddots&\vdots\\ 0&0&\ddots&-\lambda_{k-2}&\lambda_{k-2}&0\\ 0&0&\dots&0&-\lambda_{k-1}&\lambda_{k-1}\\ 0&0&\dots&0&0&-\lambda_{k} \end{matrix}\right]\; . }[/math]

For simplicity denote the above matrix [math]\displaystyle{ \Theta\equiv\Theta(\lambda_{1},\dots,\lambda_{k}) }[/math]. If the probability of starting in each of the k states is

[math]\displaystyle{ \boldsymbol{\alpha}=(1,0,\dots,0) }[/math]

then [math]\displaystyle{ Hypo(\lambda_{1},\dots,\lambda_{k})=PH(\boldsymbol{\alpha},\Theta). }[/math]

Two parameter case

Where the distribution has two parameters ([math]\displaystyle{ \lambda_1 \neq \lambda_2 }[/math]) the explicit forms of the probability functions and the associated statistics are

CDF: [math]\displaystyle{ F(x) = 1 - \frac{\lambda_2}{\lambda_2-\lambda_1}e^{-\lambda_1x} + \frac{\lambda_1}{\lambda_2-\lambda_1}e^{-\lambda_2x} }[/math]

PDF: [math]\displaystyle{ f(x) = \frac{\lambda_1\lambda_2}{\lambda_1-\lambda_2}( e^{-x \lambda_2} - e^{-x \lambda_1} ) }[/math]

Mean: [math]\displaystyle{ \frac{1}{\lambda_1}+\frac{1}{\lambda_2} }[/math]

Variance: [math]\displaystyle{ \frac{1}{\lambda_1^2}+\frac{1}{\lambda_2^2} }[/math]

Coefficient of variation: [math]\displaystyle{ \frac{\sqrt{\lambda_1^2 + \lambda_2^2}}{ \lambda_1 + \lambda_2 } }[/math]

The coefficient of variation is always < 1.

Given the sample mean ([math]\displaystyle{ \bar{x} }[/math]) and sample coefficient of variation ([math]\displaystyle{ c }[/math]), the parameters [math]\displaystyle{ \lambda_1 }[/math] and [math]\displaystyle{ \lambda_2 }[/math] can be estimated as follows:

[math]\displaystyle{ \lambda_1= \frac{ 2}{ \bar{x} } \left[ 1 + \sqrt{ 1 + 2 ( c^2 - 1 ) } \right]^{-1} }[/math]

[math]\displaystyle{ \lambda_2 = \frac{ 2 }{ \bar{x} } \left[ 1 - \sqrt{ 1 + 2 ( c^2 - 1 ) } \right]^{-1} }[/math]

These estimators can be derived from the methods of moments by setting [math]\displaystyle{ \frac{1}{\lambda_1}+\frac{1}{\lambda_2}=\bar x }[/math] and [math]\displaystyle{ \frac{\sqrt{\lambda_1^2+\lambda_2^2}}{\lambda_1+\lambda_2}=c }[/math].

The resulting parameters [math]\displaystyle{ \lambda_1 }[/math] and [math]\displaystyle{ \lambda_2 }[/math] are real values if [math]\displaystyle{ c^2\in[0.5,1] }[/math].

Characterization

A random variable [math]\displaystyle{ \boldsymbol{X}\sim Hypo(\lambda_{1},\dots,\lambda_{k}) }[/math] has cumulative distribution function given by,

[math]\displaystyle{ F(x)=1-\boldsymbol{\alpha}e^{x\Theta}\boldsymbol{1} }[/math]

and density function,

[math]\displaystyle{ f(x)=-\boldsymbol{\alpha}e^{x\Theta}\Theta\boldsymbol{1}\; , }[/math]

where [math]\displaystyle{ \boldsymbol{1} }[/math] is a column vector of ones of the size k and [math]\displaystyle{ e^{A} }[/math] is the matrix exponential of A. When [math]\displaystyle{ \lambda_{i} \ne \lambda_{j} }[/math] for all [math]\displaystyle{ i \ne j }[/math], the density function can be written as

[math]\displaystyle{ f(x) = \sum_{i=1}^k \lambda_i e^{-x \lambda_i} \left(\prod_{j=1, j \ne i}^k \frac{\lambda_j}{\lambda_j - \lambda_i}\right) = \sum_{i=1}^k \ell_i(0) \lambda_i e^{-x \lambda_i} }[/math]

where [math]\displaystyle{ \ell_1(x), \dots, \ell_k(x) }[/math] are the Lagrange basis polynomials associated with the points [math]\displaystyle{ \lambda_1,\dots,\lambda_k }[/math].

The distribution has Laplace transform of

[math]\displaystyle{ \mathcal{L}\{f(x)\}=-\boldsymbol{\alpha}(sI-\Theta)^{-1}\Theta\boldsymbol{1} }[/math]

Which can be used to find moments,

[math]\displaystyle{ E[X^{n}]=(-1)^{n}n!\boldsymbol{\alpha}\Theta^{-n}\boldsymbol{1}\; . }[/math]

General case

In the general case where there are [math]\displaystyle{ a }[/math] distinct sums of exponential distributions with rates [math]\displaystyle{ \lambda_1,\lambda_2,\cdots,\lambda_a }[/math] and a number of terms in each sum equals to [math]\displaystyle{ r_1,r_2,\cdots,r_a }[/math] respectively. The cumulative distribution function for [math]\displaystyle{ t\geq0 }[/math] is given by

[math]\displaystyle{ F(t) = 1 - \left(\prod_{j=1}^a \lambda_j^{r_j} \right) \sum_{k=1}^a \sum_{l=1}^{r_k} \frac{\Psi_{k,l}(-\lambda_k) t^{r_k-l} \exp(-\lambda_k t)} {(r_k-l)!(l-1)!} , }[/math]

with

[math]\displaystyle{ \Psi_{k,l}(x) = -\frac{\partial^{l-1}}{\partial x^{l-1}} \left(\prod_{j=0,j\neq k}^a \left(\lambda_j+x\right)^{-r_j} \right) . }[/math]

with the additional convention [math]\displaystyle{ \lambda_0 = 0, r_0 = 1 }[/math].

Uses

This distribution has been used in population genetics, cell biology, and queuing theory.

See also

• Phase-type distribution
• Coxian distribution

Further reading

• M. F. Neuts. (1981) Matrix-Geometric Solutions in Stochastic Models: an Algorthmic Approach, Chapter 2: Probability Distributions of Phase Type; Dover Publications Inc.
• G. Latouche, V. Ramaswami. (1999) Introduction to Matrix Analytic Methods in Stochastic Modelling, 1st edition. Chapter 2: PH Distributions; ASA SIAM,
• Colm A. O'Cinneide (1999). Phase-type distribution: open problems and a few properties, Communication in Statistic - Stochastic Models, 15(4), 731–757.
• L. Leemis and J. McQueston (2008). Univariate distribution relationships, The American Statistician, 62(1), 45—53.
• S. Ross. (2007) Introduction to Probability Models, 9th edition, New York: Academic Press
• S.V. Amari and R.B. Misra (1997) Closed-form expressions for distribution of sum of exponential random variables, IEEE Trans. Reliab. 46, 519–522
• B. Legros and O. Jouini (2015) A linear algebraic approach for the computation of sums of Erlang random variables, Applied Mathematical Modelling, 39(16), 4971–4977

zh:Erlang分布