Noncentral t-distribution

From HandWiki
Short description: Probability distribution
Noncentral Student's t
Probability density function
Nc student t pdf.svg
Parameters ν > 0 degrees of freedom
[math]\displaystyle{ \mu \in \Re \,\! }[/math] noncentrality parameter
Support [math]\displaystyle{ x \in (-\infty; +\infty)\,\! }[/math]
PDF see text
CDF see text
Mean see text
Mode see text
Variance see text
Skewness see text
Kurtosis see text

The noncentral t-distribution generalizes Student's t-distribution using a noncentrality parameter. Whereas the central probability distribution describes how a test statistic t is distributed when the difference tested is null, the noncentral distribution describes how t is distributed when the null is false. This leads to its use in statistics, especially calculating statistical power. The noncentral t-distribution is also known as the singly noncentral t-distribution, and in addition to its primary use in statistical inference, is also used in robust modeling for data.

Definitions

If Z is a standard normal random variable, and V is a chi-squared distributed random variable with ν degrees of freedom that is independent of Z, then

[math]\displaystyle{ T=\frac{Z+\mu}{\sqrt{V/\nu}} }[/math]

is a noncentral t-distributed random variable with ν degrees of freedom and noncentrality parameter μ ≠ 0. Note that the noncentrality parameter may be negative.

Cumulative distribution function

The cumulative distribution function of noncentral t-distribution with ν degrees of freedom and noncentrality parameter μ can be expressed as[1]

[math]\displaystyle{ F_{\nu,\mu}(x)=\begin{cases} \tilde{F}_{\nu,\mu}(x), & \mbox{if } x\ge 0; \\ 1-\tilde{F}_{\nu, -\mu}(x), &\mbox{if } x \lt 0, \end{cases} }[/math]

where

[math]\displaystyle{ \tilde{F}_{\nu,\mu}(x)=\Phi(-\mu)+\frac{1}{2}\sum_{j=0}^\infty\left[p_jI_y\left(j+\frac{1}{2},\frac{\nu}{2}\right)+q_jI_y\left(j+1,\frac{\nu}{2}\right)\right], }[/math]
[math]\displaystyle{ I_y\,\!(a,b) }[/math] is the regularized incomplete beta function,
[math]\displaystyle{ y=\frac{x^2}{x^2+\nu}, }[/math]
[math]\displaystyle{ p_j=\frac{1}{j!}\exp\left\{-\frac{\mu^2}{2}\right\}\left(\frac{\mu^2}{2}\right)^j, }[/math]
[math]\displaystyle{ q_j=\frac{\mu}{\sqrt{2}\Gamma(j+3/2)}\exp\left\{-\frac{\mu^2}{2}\right\}\left(\frac{\mu^2}{2}\right)^j, }[/math]

and Φ is the cumulative distribution function of the standard normal distribution.

Alternatively, the noncentral t-distribution CDF can be expressed as[citation needed]:

[math]\displaystyle{ F_{v,\mu}(x)=\begin{cases} \frac{1}{2}\sum_{j=0}^\infty\frac{1}{j!}(-\mu\sqrt{2})^je^{\frac{-\mu^2}{2}}\frac{\Gamma(\frac{j+1}{2})}{\sqrt{\pi}}I\left (\frac{v}{v+x^2};\frac{v}{2},\frac{j+1}{2}\right ), & x\ge 0 \\ 1-\frac{1}{2}\sum_{j=0}^\infty\frac{1}{j!}(-\mu\sqrt{2})^je^{\frac{-\mu^2}{2}}\frac{\Gamma(\frac{j+1}{2})}{\sqrt{\pi}}I\left (\frac{v}{v+x^2};\frac{v}{2},\frac{j+1}{2}\right ), & x \lt 0 \end{cases} }[/math]

where Γ is the gamma function and I is the regularized incomplete beta function.

Although there are other forms of the cumulative distribution function, the first form presented above is very easy to evaluate through recursive computing.[1] In statistical software R, the cumulative distribution function is implemented as pt.

Probability density function

The probability density function (pdf) for the noncentral t-distribution with ν > 0 degrees of freedom and noncentrality parameter μ can be expressed in several forms.

The confluent hypergeometric function form of the density function is

[math]\displaystyle{ f(x) = \underbrace{\frac{\Gamma( \frac{\nu+1}{2} ) }{\sqrt{\nu \pi} \Gamma( \frac{\nu}{2} )} \left (1+ \frac{x^{2}}{\nu} \right )^{-\tfrac{\nu+1}{2}}}_{\text{StudentT}(x \, ; \, \mu=0)} \exp \big ( - \tfrac{\mu^{2}}{2} \big ) \Big \{ A_{\nu}(x \, ; \, \mu) + B_{\nu}(x \, ; \, \mu) \Big \}, }[/math]

where

[math]\displaystyle{ \begin{align} A_{\nu}(x \, ; \, \mu) & = {_{1} F}_{1} \left ( \frac{\nu+1}{2} \, ; \, \frac{1}{2} \, ; \, \frac{\mu^{2} x^{2} }{ 2 (x^{2} + \nu ) } \right ), \\ B_{\nu}(x \, ; \, \mu) & = \frac{\sqrt{2} \mu x}{\sqrt{x^{2} + \nu }} \frac{\Gamma ( \frac{\nu}{2} +1)}{\Gamma ( \frac{\nu+1}{2} )} {_{1} F}_{1} \left ( \frac{\nu}{2} +1 \, ; \, \frac{3}{2} \, ; \, \frac{\mu^{2} x^{2} }{ 2 (x^{2} + \nu ) } \right ) , \end{align} }[/math]

and where 1F1 is a confluent hypergeometric function.

An alternative integral form is[2]

[math]\displaystyle{ f(x) =\frac{\nu^{\frac{\nu}{2}} \exp\left (-\frac{\nu\mu^2}{2(x^2+\nu)} \right )}{\sqrt{\pi}\Gamma(\frac{\nu}{2})2^{\frac{\nu-1}{2}}(x^2+\nu)^{\frac{\nu+1}{2}}} \int_0^\infty y^\nu\exp\left (-\frac{1}{2}\left(y-\frac{\mu x}{\sqrt{x^2+\nu}}\right)^2\right ) dy. }[/math]

A third form of the density is obtained using its cumulative distribution functions, as follows.

[math]\displaystyle{ f(x)= \begin{cases} \frac{\nu}{x} \left \{ F_{\nu+2,\mu} \left (x\sqrt{1+\frac{2}{\nu}} \right ) - F_{\nu,\mu}(x)\right \}, &\mbox{if } x\neq 0; \\ \frac{\Gamma(\frac{\nu+1}{2})}{\sqrt{\pi\nu} \Gamma(\frac{\nu}{2})} \exp\left (-\frac{\mu^2}{2}\right), &\mbox{if } x=0. \end{cases} }[/math]

This is the approach implemented by the dt function in R.

Properties

Moments of the noncentral t-distribution

In general, the kth raw moment of the noncentral t-distribution is[3]

[math]\displaystyle{ \mbox{E}\left[T^k\right]= \begin{cases} \left(\frac{\nu}{2}\right)^{\frac{k}{2}}\frac{\Gamma\left(\frac{\nu-k}{2}\right)}{\Gamma\left(\frac{\nu}{2}\right)}\mbox{exp}\left(-\frac{\mu^2}{2}\right)\frac{d^k}{d \mu^k}\mbox{exp}\left(\frac{\mu^2}{2}\right), & \mbox{if }\nu\gt k ; \\ \mbox{Does not exist} , & \mbox{if }\nu\le k .\\ \end{cases} }[/math]

In particular, the mean and variance of the noncentral t-distribution are

[math]\displaystyle{ \begin{align} \mbox{E}\left[T\right] &= \begin{cases} \mu\sqrt{\frac{\nu}{2}}\frac{\Gamma((\nu-1)/2)}{\Gamma(\nu/2)}, &\mbox{if }\nu\gt 1 ;\\ \mbox{Does not exist}, &\mbox{if }\nu\le1 ,\\ \end{cases} \\ \mbox{Var}\left[T\right]&= \begin{cases} \frac{\nu(1+\mu^2)}{\nu-2} -\frac{\mu^2\nu}{2} \left(\frac{\Gamma((\nu-1)/2)}{\Gamma(\nu/2)}\right)^2 , &\mbox{if }\nu\gt 2 ;\\ \mbox{Does not exist}, &\mbox{if }\nu\le2 .\\ \end{cases} \end{align} }[/math]

An excellent approximation to [math]\displaystyle{ \sqrt{\frac{\nu}{2}}\frac{\Gamma((\nu-1)/2)}{\Gamma(\nu/2)} }[/math] is [math]\displaystyle{ \left(1-\frac{3}{4\nu-1}\right)^{-1} }[/math], which can be used in both formulas.[4][5]

Asymmetry

The non-central t-distribution is asymmetric unless μ is zero, i.e., a central t-distribution. In addition, the asymmetry becomes smaller the larger degree of freedom. The right tail will be heavier than the left when μ > 0, and vice versa. However, the usual skewness is not generally a good measure of asymmetry for this distribution, because if the degrees of freedom is not larger than 3, the third moment does not exist at all. Even if the degrees of freedom is greater than 3, the sample estimate of the skewness is still very unstable unless the sample size is very large.


Mode

The noncentral t-distribution is always unimodal and bell shaped, but the mode is not analytically available, although for μ ≠ 0 we have[6]

[math]\displaystyle{ \sqrt{\frac{\nu}{\nu+(5/2)}} \lt \frac{\mathrm{mode}}{\mu} \lt \sqrt{\frac{\nu}{\nu+1}} }[/math]

In particular, the mode always has the same sign as the noncentrality parameter μ. Moreover, the negative of the mode is exactly the mode for a noncentral t-distribution with the same number of degrees of freedom ν but noncentrality parameter −μ.

The mode is strictly increasing with μ (it always moves in the same direction as μ is adjusted in). In the limit, when μ → 0, the mode is approximated by

[math]\displaystyle{ \sqrt{\frac{\nu}{2}}\frac{\Gamma\left(\frac{\nu+2}{2}\right)}{\Gamma\left(\frac{\nu+3}{2}\right)}\mu;\, }[/math]

and when μ → ∞, the mode is approximated by

[math]\displaystyle{ \sqrt{\frac{\nu}{\nu+1}}\mu. }[/math]

Related distributions

  • Central t-distribution: the central t-distribution can be converted into a location/scale family. This family of distributions is used in data modeling to capture various tail behaviors. The location/scale generalization of the central t-distribution is a different distribution from the noncentral t-distribution discussed in this article. In particular, this approximation does not respect the asymmetry of the noncentral t-distribution. However, the central t-distribution can be used as an approximation to the noncentral t-distribution.[7]
  • If T is noncentral t-distributed with ν degrees of freedom and noncentrality parameter μ and F = T2, then F has a noncentral F-distribution with 1 numerator degree of freedom, ν denominator degrees of freedom, and noncentrality parameter μ2.
  • If T is noncentral t-distributed with ν degrees of freedom and noncentrality parameter μ and [math]\displaystyle{ Z=\lim_{\nu\rightarrow\infty} T }[/math], then Z has a normal distribution with mean μ and unit variance.
  • When the denominator noncentrality parameter of a doubly noncentral t-distribution is zero, then it becomes a noncentral t-distribution.

Special cases

Occurrence and applications

Use in power analysis

Suppose we have an independent and identically distributed sample X1, ..., Xn each of which is normally distributed with mean θ and variance σ2, and we are interested in testing the null hypothesis θ = 0 vs. the alternative hypothesis θ ≠ 0. We can perform a one sample t-test using the test statistic

[math]\displaystyle{ T = \frac{\bar{X}}{\hat{\sigma}/ \sqrt{n}} = \frac{\frac{\bar{X}-\theta}{(\sigma / \sqrt{n})} + \frac{\theta}{(\sigma/ \sqrt{n})}}{\sqrt{ \left.\left(\frac{\hat{\sigma}^2}{\sigma^2 / (n-1)} \right) \right/ (n-1) }} }[/math]

where [math]\displaystyle{ \bar{X} }[/math] is the sample mean and [math]\displaystyle{ \hat{\sigma}^2\,\! }[/math] is the unbiased sample variance. Since the right hand side of the second equality exactly matches the characterization of a noncentral t-distribution as described above, T has a noncentral t-distribution with n−1 degrees of freedom and noncentrality parameter [math]\displaystyle{ \sqrt{n}\theta/\sigma\,\! }[/math].

If the test procedure rejects the null hypothesis whenever [math]\displaystyle{ |T|\gt t_{1-\alpha/2}\,\! }[/math], where [math]\displaystyle{ t_{1-\alpha/2}\,\! }[/math] is the upper α/2 quantile of the (central) Student's t-distribution for a pre-specified α ∈ (0, 1), then the power of this test is given by

[math]\displaystyle{ 1-F_{n-1,\sqrt{n}\theta/\sigma}(t_{1-\alpha/2})+F_{n-1,\sqrt{n}\theta/\sigma}(-t_{1-\alpha/2}) . }[/math]

Similar applications of the noncentral t-distribution can be found in the power analysis of the general normal-theory linear models, which includes the above one sample t-test as a special case.

Use in tolerance intervals

One-sided normal tolerance intervals have an exact solution in terms of the sample mean and sample variance based on the noncentral t-distribution.[8] This enables the calculation of a statistical interval within which, with some confidence level, a specified proportion of a sampled population falls.

See also

References

  1. 1.0 1.1 Lenth, Russell V (1989). "Algorithm AS 243: Cumulative Distribution Function of the Non-central t Distribution". Journal of the Royal Statistical Society, Series C 38 (1): 185–189. 
  2. L. Scharf, Statistical Signal Processing, (Massachusetts: Addison-Wesley, 1991), p.177.
  3. Hogben, D; Pinkham, RS; Wilk, MB (1961). "The moments of the non-central t-distribution". Biometrika 48 (3–4): 465–468. doi:10.1093/biomet/48.3-4.465. 
  4. Hedges, Larry V. (June 1981). "Distribution Theory for Glass's Estimator of Effect size and Related Estimators". Journal of Educational Statistics 6 (2): 107–128. doi:10.3102/2F10769986006002107. 
  5. Tothfalusi, Laszlo; Endrenyi, Laszlo (1 March 2016). "An Exact Procedure for the Evaluation of Reference-Scaled Average Bioequivalence". The AAPS Journal 18 (2): 476–489. doi:10.1208/s12248-016-9873-6. 
  6. van Aubel, A; Gawronski, W (2003). "Analytic properties of noncentral distributions". Applied Mathematics and Computation 141: 3–12. doi:10.1016/S0096-3003(02)00316-8. 
  7. Helena Chmura Kraemer; Minja Paik (1979). "A Central t Approximation to the Noncentral t Distribution". Technometrics 21 (3): 357–360. doi:10.1080/00401706.1979.10489781. 
  8. Derek S. Young (August 2010). "tolerance: An R Package for Estimating Tolerance Intervals". Journal of Statistical Software 36 (5): 1–39. ISSN 1548-7660. http://www.jstatsoft.org/v36/i05. Retrieved 19 February 2013. , p.23

External links