Noncentral chi-squared distribution explained

In probability theory and statistics, the noncentral chi-squared distribution (or noncentral chi-square distribution, noncentral

\chi²

distribution) is a noncentral generalization of the chi-squared distribution. It often arises in the power analysis of statistical tests in which the null distribution is (perhaps asymptotically) a chi-squared distribution; important examples of such tests are the likelihood-ratio tests.^[1]

Definitions

Background

Let

(X_1,X_2,\ldots,X_i,\ldots,X_k)

be k independent, normally distributed random variables with means

\mu_i

and unit variances. Then the random variable

	k
\sum
	i=1

	2
X
	i

is distributed according to the noncentral chi-squared distribution. It has two parameters:

which specifies the number of degrees of freedom (i.e. the number of

X_i

), and

which is related to the mean of the random variables

X_i

by:

	k
λ=\sum
	i=1

	2.
\mu
	i

is sometimes called the noncentrality parameter. Note that some references define

in other ways, such as half of the above sum, or its square root.

This distribution arises in multivariate statistics as a derivative of the multivariate normal distribution. While the central chi-squared distribution is the squared norm of a random vector with

N(0_k,I_k)

distribution (i.e., the squared distance from the origin to a point taken at random from that distribution), the non-central

\chi²

is the squared norm of a random vector with

N(\mu,I_k)

distribution. Here

0_k

is a zero vector of length k,

\mu=(\mu_1,\ldots,\mu_k)

and

I_k

is the identity matrix of size k.

Density

The probability density function (pdf) is given by

f_X(x;k,λ)=

	infty
\sum
	i=0

	e^-λ/2(λ/2)ⁱ
	i!

f
	Y_k+2i

(x),

where

Y_q

is distributed as chi-squared with

degrees of freedom.

From this representation, the noncentral chi-squared distribution is seen to be a Poisson-weighted mixture of central chi-squared distributions. Suppose that a random variable J has a Poisson distribution with mean

λ/2

, and the conditional distribution of Z given J = i is chi-squared with k + 2i degrees of freedom. Then the unconditional distribution of Z is non-central chi-squared with k degrees of freedom, and non-centrality parameter

Alternatively, the pdf can be written as

X(x;k,λ)=	1
	2

e^-(x+λ)/2\left(

	x
	λ

\right)^k/4-1/2I_k/2-1(\sqrt{λx})

where

I_\nu(y)

is a modified Bessel function of the first kind given by

I_\nu(y)=(y/2)^\nu

	infty
\sum
	j=0

	(y^2/4)^j
	j!\Gamma(\nu+j+1)

Using the relation between Bessel functions and hypergeometric functions, the pdf can also be written as:^[2]

f_{X(x;k,λ)={{\rm}e}^-λ/2

} _0F_1(;k/2;\lambda x/4)\frac 1 ^ x^.

The case k = 0 (zero degrees of freedom), in which case the distribution has a discrete component at zero, is discussed by Torgersen (1972) and further by Siegel (1979).^[3] ^[4]

Derivation of the pdf

The derivation of the probability density function is most easily done by performing the following steps:

Since

X_1,\ldots,X_k

have unit variances, their joint distribution is spherically symmetric, up to a location shift.

The spherical symmetry then implies that the distribution of

	2
X=X
	k

depends on the means only through the squared length,

	2
λ=\mu
	k

. Without loss of generality, we can therefore take

\mu_1=\sqrt{λ}

and

\mu_{2= … =\mu}_k=0

Now derive the density of

	2
X=X
	1

(i.e. the k = 1 case). Simple transformation of random variables shows that

\begin{align}f_X(x,1,λ)&=

	1
	2\sqrt{x

}\left(\phi(\sqrt-\sqrt) + \phi(\sqrt+\sqrt) \right)\\ &= \frac e^ \cosh(\sqrt), \end

where

\phi( ⋅ )

is the standard normal density.

Expand the cosh term in a Taylor series. This gives the Poisson-weighted mixture representation of the density, still for k = 1. The indices on the chi-squared random variables in the series above are 1 + 2i in this case.
Finally, for the general case. We've assumed, without loss of generality, that

X_2,\ldots,X_k

are standard normal, and so

	2
X
	k

has a central chi-squared distribution with (k − 1) degrees of freedom, independent of

	2
X
	1

. Using the poisson-weighted mixture representation for

	2
X
	1

, and the fact that the sum of chi-squared random variables is also a chi-square, completes the result. The indices in the series are (1 + 2i) + (k − 1) = k + 2i as required.

Properties

Moment generating function

The moment-generating function is given by

M(t;k,λ)=

\exp\left(	λt	\right)
	1-2t

(1-2t)^k/2

Moments

The first few raw moments are:

\mu'_1=k+λ

	2
\mu'
	2=(k+λ)

+2(k+2λ)

	3
\mu'
	3=(k+λ)

+6(k+λ)(k+2λ)+8(k+3λ)

	4+12(k+λ)
\mu'
	4=(k+λ)

^{2(k+2λ)+4(11k}^2+44kλ+36λ^{2)+48(k+4λ).}

The first few central moments are:

\mu_2=2(k+2λ)

\mu_3=8(k+3λ)

	2+48(k+4λ)
\mu
	4=12(k+2λ)

The nth cumulant is

	n-1
\kappa
	n=2

(n-1)!(k+nλ).

Hence

\mu'_n=2^n-1

	n-1
(n-1)!(k+nλ)+\sum
	j=1

	(n-1)!2^j-1
	(n-j)!

(k+jλ)\mu'_n-j.

Cumulative distribution function

Again using the relation between the central and noncentral chi-squared distributions, the cumulative distribution function (cdf) can be written as

P(x;k,λ)=e^-λ/2

	infty
\sum
	j=0

	(λ/2)^j
	j!

Q(x;k+2j)

where

Q(x;k)

is the cumulative distribution function of the central chi-squared distribution with k degrees of freedom which is given by

Q(x;k)=	\gamma(k/2,x/2)
	\Gamma(k/2)

and where

\gamma(k,z)

is the lower incomplete gamma function.

Q_M(a,b)

can also be used to represent the cdf.^[5]

P(x;k,λ)=1-

	k
	2

\left(\sqrt{λ},\sqrt{x}\right)

When the degrees of freedom k is positive odd integer, we have a closed form expression for the complementary cumulative distribution function given by^[6]

\begin{align} P(x;2n+1,λ)&=1-Q_n+1/2(\sqrt{λ},\sqrt{x})\\ &=1-\left[Q(\sqrt{x}-\sqrt{λ})+Q(\sqrt{x}+\sqrt{λ})+e^-(x

	n
\sum		\left(
	m=1

	x
	λ

\right)^m/2-1/4I_m-1/2(\sqrt{λx})\right], \end{align}

where n is non-negative integer, Q is the Gaussian Q-function, and I is the modified Bessel function of first kind with half-integer order. The modified Bessel function of first kind with half-integer order in itself can be represented as a finite sum in terms of hyperbolic functions.

In particular, for k = 1, we have

P(x;1,λ)=1-\left[Q(\sqrt{x}-\sqrt{λ})+Q(\sqrt{x}+\sqrt{λ})\right].

Also, for k = 3, we have

P(x;3,λ)=1-\left[Q(\sqrt{x}-\sqrt{λ})+Q(\sqrt{x}+\sqrt{λ})+\sqrt{

	2
	\pi

} \frac e^ \right].

Approximation (including for quantiles)

Abdel-Aty derives (as "first approx.") a non-central Wilson–Hilferty transformation:^[7]

\left(	\chi'²
	k+λ

	1
	3

\right)

is approximately normally distributed,

\sim

l{N}\left(1-	2
	9f

	2
	9f

\right),

i.e.,

P(x;k,λ) ≈ \Phi\left\{

\left(

\right)^1/3-\left(1-

	2
	9f

\right)

k+λ

\sqrt{	2
	9f

}\right\},where f:=

	(k+λ)²
	k+2λ

=k+

	λ²
	k+2λ

which is quite accurate and well adapting to the noncentrality. Also,

f=f(k,λ)

becomes

f=k

for

λ=0

, the (central) chi-squared case.

Sankaran discusses a number of closed form approximations for the cumulative distribution function.^[8] In an earlier paper, he derived and states the following approximation:^[9]

P(x;k,λ) ≈ \Phi\left\{

(	x	)^h-(1+hp(h-1-0.5(2-h)mp))
	k+λ

h\sqrt{2p

(1+0.5mp)}\right\}

where

\Phi\lbrace ⋅ \rbrace

denotes the cumulative distribution function of the standard normal distribution;

h=1-

	2
	3

	(k+λ)(k+3λ)
	(k+2λ)²

;

	k+2λ
	(k+λ)²

;

m=(h-1)(1-3h).

This and other approximations are discussed in a later text book.^[10]

More recently, since the CDF of non-central chi-squared distribution with odd degree of freedom can be exactly computed, the CDF for even degree of freedom can be approximated by exploiting the monotonicity and log-concavity properties of Marcum-Q function as

P(x;2n,λ) ≈

	1
	2

\left[P(x;2n-1,λ)+P(x;2n+1,λ)\right].

Another approximation that also serves as an upper bound is given by

P(x;2n,λ) ≈ 1-\left[(1-P(x;2n-1,λ))(1-P(x;2n+1,λ))\right]^1/2.

For a given probability, these formulas are easily inverted to provide the corresponding approximation for

, to compute approximate quantiles.

Related distributions

is chi-square distributed

V\sim

	2
\chi
	k

then

is also non-central chi-square distributed:

V\sim

	2
{\chi'}
	k(0)

A linear combination of independent noncentral chi-squared variables

\xi=\sum_iλ_iY_i+c, Y_i\sim

	2(m
\chi'
	i,\delta

	2)

	i

, is generalized chi-square distributed.

V₁\sim

	2(λ)
{\chi'}
	k₁

and

V₂\sim

	2(0)
{\chi'}
	k₂

and

V₁

is independent of

V₂

then a noncentral F-distributed variable is developed as

	V_1/k₁
	V_2/k₂

\sim

F'
	k_1,k₂

(λ)

J\simPoisson\left({

	1
	2

λ}\right)

, then

	2
\chi
	k+2J

\sim

	2(λ)
{\chi'}
	k

	2
V\sim{\chi'}
	2(λ)

, then

\sqrt{V}

takes the Rice distribution with parameter

\sqrt{λ}

Normal approximation:^[11] if

V\sim

	2
{\chi'}
	k(λ)

, then

	V-(k+λ)
	\sqrt{2(k+2λ)

}\to N(0,1) in distribution as either

k\toinfty

λ\toinfty

V₁\sim

	2
{\chi'}
	k₁

(λ₁₎

and

V₂\sim

	2
{\chi'}
	k₂

(λ₂₎

, where

V_1,V₂

are independent, then

W=(V_1+V₂₎\sim

	2
{\chi'}
	k(λ

_1+λ₂₎

where

k=k_1+k₂

In general, for a finite set of

V_i\sim

	2
{\chi'}
	k_i

(λ_i),i\in\left\{1..N\right\}

, the sum of these non-central chi-square distributed random variables

	N
\sum
	i=1

V_i

has the distribution

Y\sim

	2
{\chi'}
	k_y

(λ_y)

where

k_y=\sum

	N

	i=1

k_i,λ_y=\sum

	Nλ

	i

. This can be seen using moment generating functions as follows:

M_Y(t)=

	N
\sum		V_i
	i=1

(t)=

	N
\prod
	i=1

M
	V_i

(t)

by the independence of the

V_i

random variables. It remains to plug in the MGF for the non-central chi square distributions into the product and compute the new MGF – this is left as an exercise. Alternatively it can be seen via the interpretation in the background section above as sums of squares of independent normally distributed random variables with variances of 1 and the specified means.

The complex noncentral chi-squared distribution has applications in radio communication and radar systems. Let

(z_1,\ldots,z_k)

be independent scalar complex random variables with noncentral circular symmetry, means of

\mu_i

and unit variances:

\operatorname{E}\left|z_i-\mu_i\right|²=1

. Then the real random variable

	k
\sum
	i=1

\left|z_i\right|²

is distributed according to the complex noncentral chi-squared distribution, which is effectively a scaled (by 1/2) non-central

{\chi'}²

with twice the degree of freedom and twice the noncentrality parameter:

f_S(S)=\left(

	S
	λ

\right)^(k-1)/2eI_k-1(2\sqrt{Sλ})

where

	k
λ=\sum
	i=1

\left|\mu_i\right|^2.

Transformations

Sankaran (1963) discusses the transformations of the form

z=[(X-b)/(k+λ)]^1/2

. He analyzes the expansions of the cumulants of

up to the term

O((k+λ)^-4)

and shows that the following choices of

produce reasonable results:

b=(k-1)/2

makes the second cumulant of

approximately independent of

b=(k-1)/3

makes the third cumulant of

approximately independent of

b=(k-1)/4

makes the fourth cumulant of

approximately independent of

Also, a simpler transformation

z₁=(X-(k-1)/2)^1/2

can be used as a variance stabilizing transformation that produces a random variable with mean

(λ+(k-1)/2)^1/2

and variance

O((k+λ)^-2)

Usability of these transformations may be hampered by the need to take the square roots of negative numbers.

Various chi and chi-squared distributions

Name

Statistic

	k
\sum		\left(
	i=1

	X_i-\mu_i
	\sigma_i

\right)²

noncentral chi-squared distribution

	k
\sum		\left(
	i=1

	X_i
	\sigma_i

\right)²

	k
\sqrt{\sum		\left(
	i=1

	X_i-\mu_i
	\sigma_i

\right)^2}

	k
\sqrt{\sum		\left(
	i=1

	X_i
	\sigma_i

\right)^2}

Occurrence and applications

Use in tolerance intervals

Two-sided normal regression tolerance intervals can be obtained based on the noncentral chi-squared distribution.^[12] This enables the calculation of a statistical interval within which, with some confidence level, a specified proportion of a sampled population falls.

Notes

Patnaik . P. B. . 1949 . The Non-Central χ2- and F-Distribution and their Applications . Biometrika . 36 . 1/2 . 202–232 . 10.2307/2332542 . 0006-3444.
Muirhead (2005) Theorem 1.3.4
Torgersen, E. N. (1972), "Supplementary notes on linear models", Preprint series: Statistical Memoirs, Dept. of Mathematics, University of Oslo, http://urn.nb.no/URN:NBN:no-58681
Siegel, A. F. (1979), "The noncentral chi-squared distribution with zero degrees of freedom and testing for uniformity", Biometrika, 66, 381–386
Nuttall, Albert H. (1975): Some Integrals Involving the Q_M Function, IEEE Transactions on Information Theory, 21(1), 95–96,
A. Annamalai, C. Tellambura and John Matyjas (2009). "A New Twist on the Generalized Marcum Q-Function Q_M(a, b) with Fractional-Order M and its Applications". 2009 6th IEEE Consumer Communications and Networking Conference, 1–5,
Abdel-Aty . S. . 1954 . 2332731 . Approximate Formulae for the Percentage Points and the Probability Integral of the Non-Central χ² Distribution . . 41 . 538–540 .
Sankaran . M. . 1963 . 10.1093/biomet/50.1-2.199 . Approximations to the non-central chi-squared distribution . . 50 . 1–2 . 199–204 .
Sankaran . M. . 1959 . On the non-central chi-squared distribution . . 46 . 1–2 . 235–237 . 10.1093/biomet/46.1-2.235 .
Johnson et al. (1995) Continuous Univariate Distributions Section 29.8
Muirhead (2005) pages 22–24 and problem 1.18.
Derek S. Young. tolerance: An R Package for Estimating Tolerance Intervals. Journal of Statistical Software. August 2010. 36. 5. 1–39. 1548-7660. 19 February 2013., p. 32

References

Abramowitz, M. and Stegun, I. A. (1972), Handbook of Mathematical Functions, Dover.
Johnson, N. L., Kotz, S., Balakrishnan, N. (1995), Continuous Univariate Distributions, Volume 2 (2nd Edition), Wiley.
Muirhead, R. (2005) Aspects of Multivariate Statistical Theory (2nd Edition). Wiley.