Conway–Maxwell–Poisson distribution explained

Conway–Maxwell–Poisson

Type:

mass

Parameters:

λ>0,\nu\geq0

Support:

x\in\{0,1,2,...\}

Pdf:

	λ^x
	(x!)^\nu

	1
	Z(λ,\nu)

Cdf:

	x
\sum
	i=0

\Pr(X=i)

Mean:

	infty
\sum
	j=0

	jλ^j
	(j!)^\nuZ(λ,\nu)

Median:

No closed form

Mode:

See text

Variance:

	infty
\sum
	j=0

	j^2λ^j
	(j!)^\nuZ(λ,\nu)

-\operatorname{mean}²

Skewness:

Not listed

Kurtosis:

Not listed

Entropy:

Not listed

Mgf:

	Z(e^tλ,\nu)
	Z(λ,\nu)

Char:

	Z(e^itλ,\nu)
	Z(λ,\nu)

Pgf:

	Z(tλ,\nu)
	Z(λ,\nu)

In probability theory and statistics, the Conway–Maxwell–Poisson (CMP or COM–Poisson) distribution is a discrete probability distribution named after Richard W. Conway, William L. Maxwell, and Siméon Denis Poisson that generalizes the Poisson distribution by adding a parameter to model overdispersion and underdispersion. It is a member of the exponential family,^[1] has the Poisson distribution and geometric distribution as special cases and the Bernoulli distribution as a limiting case.

Background

The CMP distribution was originally proposed by Conway and Maxwell in 1962 as a solution to handling queueing systems with state-dependent service rates. The CMP distribution was introduced into the statistics literature by Boatwright et al. 2003 ^[2] and Shmueli et al. (2005).^[3] The first detailed investigation into theprobabilistic and statistical properties of the distribution was published by Shmueli et al. (2005).^[3] Some theoretical probability results of COM-Poisson distribution is studied and reviewed by Li et al. (2019),^[4] especially the characterizations of COM-Poisson distribution.

Probability mass function and basic properties

The CMP distribution is defined to be the distribution with probability mass function

P(X=x)=f(x;λ,\nu)=

	λ^x
	(x!)^\nu

	1
	Z(λ,\nu)

where :

Z(λ,\nu)=

	infty
\sum
	j=0

	λ^j
	(j!)^\nu

The function

Z(λ,\nu)

serves as a normalization constant so the probability mass function sums to one. Note that

Z(λ,\nu)

does not have a closed form.

The domain of admissible parameters is

λ,\nu>0

, and

0<λ<1

\nu=0

The additional parameter

\nu

which does not appear in the Poisson distribution allows for adjustment of the rate of decay. This rate of decay is a non-linear decrease in ratios of successive probabilities, specifically

	P(X=x-1)
	P(X=x)

	x^\nu
	λ

When

\nu=1

, the CMP distribution becomes the standard Poisson distribution and as

\nu\toinfty

, the distribution approaches a Bernoulli distribution with parameter

λ/(1+λ)

. When

\nu=0

the CMP distribution reduces to a geometric distribution with probability of success

1-λ

provided

λ<1

.^[3]

For the CMP distribution, moments can be found through the recursive formula ^[3]

\operatorname{E}[X^r+1]=\begin{cases} λ\operatorname{E}[X+1]^1-\nu&ifr=0\\ λ

	d
	dλ

\operatorname{E}[X^r]+\operatorname{E}[X]\operatorname{E}[X^r]&ifr>0.\\ \end{cases}

Cumulative distribution function

For general

\nu

, there does not exist a closed form formula for the cumulative distribution function of

X\simCMP(λ,\nu)

. If

\nu\geq1

is an integer, we can, however, obtain the following formula in terms of the generalized hypergeometric function:^[5]

F(n)=P(X\leqn)=1-

	_1F_\nu-1(;n+2,\ldots,n+2;λ)
	{\{(n+1)!\

^\nu-1

} _0F_(;1,\ldots,1;\lambda)}.

The normalizing constant

Many important summary statistics, such as moments and cumulants, of the CMP distribution can be expressed in terms of the normalizing constant

Z(λ,\nu)

.^[3] Indeed, The probability generating function is

\operatorname{E}s^{X=Z(sλ,\nu)/Z(λ,\nu)}

, and the mean and variance are given by

\operatorname{E}X=λ	d
	dλ

\{ln(Z(λ,\nu))\},

\operatorname{var}(X)=λ	d
	dλ

\operatorname{E}X.

The cumulant generating function is

g(t)=ln(\operatorname{E}[e^tX])=ln(Z(λe^t,\nu))-ln(Z(λ,\nu)),

and the cumulants are given by

	(n)
\kappa		(0)=
	n=g

	\partialⁿ
	\partialtⁿ

ln(Z(λe^t,\nu))|_t=0, n\geq1.

Whilst the normalizing constant

infty	λⁱ
	(i!)^\nu

Z(λ,\nu)=\sum

i=0

does not in general have a closed form, there are some noteworthy special cases:

Z(λ,1)=e^λ

Z(λ,0)=(1-λ)^-1

\lim_{\nu → infty}Z(λ,\nu)=1+λ

Z(λ,2)=I_{0(2\sqrt{λ})}

, where

I_0(x)=\sum

infty	1
	(k!)²

(

k=0

	x
	2

)^2k

is a modified Bessel function of the first kind.

For integer

\nu

, the normalizing constant can expressed ^[5] as a generalized hypergeometric function:

Z(λ,\nu)=_0F_\nu-1(;1,\ldots,1;λ)

Because the normalizing constant does not in general have a closed form, the following asymptotic expansion is of interest. Fix

\nu>0

. Then, as

λ → infty

,^[6]

Z(λ,\nu)=	\exp\left\{\nuλ^1/\nu\right\

}\sum_^\infty c_k\big(\nu\lambda^\big)^,

where the

c_j

are uniquely determined by the expansion

\left(\Gamma(t+1)\right)^-\nu=

	\nu^\nu
	\left(2\pi\right)^(\nu-1)/2

infty	c_j
	\Gamma(\nut+(1+\nu)/2+j)

\sum

j=0

In particular,

c₀₌₁

1=	\nu^2-1
	24

2=	\nu^2-1
	1152

\left(\nu^2+23\right)

. Further coefficients are given in.^[6]

Moments, cumulants and related results

For general values of

\nu

, there does not exist closed form formulas for the mean, variance and moments of the CMP distribution. We do, however, have the following neat formula. Let

(j)_{r=j(j-1) … (j-r+1)}

denote the falling factorial. Let

X\simCMP(λ,\nu)

λ,\nu>0

. Then

	\nu]=λ
\operatorname{E}[((X)
	r)

^r,

for

r\inN

Since in general closed form formulas are not available for moments and cumulants of the CMP distribution, the following asymptotic formulas are of interest. Let

X\simCMP(λ,\nu)

, where

\nu>0

. Denote the skewness

\gamma

1=	\kappa₃
	\sigma³

and excess kurtosis

\gamma

2=	\kappa₄
	\sigma⁴

, where

\sigma^2=Var(X)

. Then, as

λ → infty

,^[6]

\operatorname{E}X=λ^1/\nu\left(1-

	\nu-1
	2\nu

λ^-1/\nu-

	\nu^2-1
	24\nu²

λ^-2/\nu-

	\nu^2-1
	24\nu³

λ^-3/\nu+l{O}(λ^-4/\nu)\right),

Var(X)=

	λ^1/\nu	(1+
	\nu

	\nu^2-1
	24\nu²

λ^-2/\nu+

	\nu^2-1
	12\nu³

λ^-3/\nu+l{O}(λ^-4/\nu)),

\kappa_n=

	λ^1/\nu	(1+
	\nu^n-1

	(-1)^n(\nu^2-1)
	24\nu²

λ^-2/\nu+

	(-2)^n(\nu^2-1)
	48\nu³

λ^-3/\nu+l{O}(λ^-4/\nu)),

\gamma₁₌

	λ^-1/2\nu
	\sqrt{\nu

}\bigg(1-\frac\lambda^-\frac\lambda^+\mathcal(\lambda^)\bigg),

\gamma₂₌

	λ^-1/\nu	(1-
	\nu

	(\nu^2-1)
	24\nu²

λ^-2/\nu+

	(\nu^2-1)
	6\nu³

λ^-3/\nu+l{O}(λ^-4/\nu)),

\operatorname{E}[X^n]=λ^n/\nu(1+

	n(n-\nu)
	2\nu

λ^-1/\nu

	-2/\nu
+a
	2λ

+l{O}(λ^-3/\nu)),

where

2=-	n(\nu-1)(6n\nu^{2-3n\nu-15n+4\nu+10)}
	24\nu²

	1
	\nu²

\{\binom{n}{3}+3\binom{n}{4}\}.

The asymptotic series for

\kappa_n

holds for all

n\geq2

, and

\kappa_{1=\operatorname{E}X}

Moments for the case of integer

\nu

When

\nu

is an integer explicit formulas for moments can be obtained. The case

\nu=1

corresponds to the Poisson distribution. Suppose now that

\nu=2

. For

m\inN

\operatorname{E}[(X)

m]=	λ^m/2I_m(2\sqrt{λ
	)}{I

_{0(2\sqrt{λ})},}

where

I_r(x)

is the modified Bessel function of the first kind.

Using the connecting formula for moments and factorial moments gives

	m\left\{
\operatorname{E}X
	k=1

{m\atopk}\right\}

	λ^k/2I_k(2\sqrt{λ
	)}{I

_{0(2\sqrt{λ})}.}

In particular, the mean of

is given by

\operatorname{E}X=	\sqrt{λ
	I

_{1(2\sqrt{λ})}{I}_{0(2\sqrt{λ})}.}

Also, since

\operatorname{E}X^2=λ

, the variance is given by

Var(X)=λ\left(1-	I_1(2\sqrt{λ
	)

	2}\right).

	0(2\sqrt{λ})

Suppose now that

\nu\geq1

is an integer. Then ^[5]

\operatorname{E}[(X)

m]=	{λ^m

} \frac.

In particular,

\operatorname{E}[X]=λ

	_0F_\nu-1(;2,\ldots,2;λ)
	_0F_\nu-1(;1,\ldots,1;λ)

and

Var(X)=	{λ²

} \frac+\operatorname[X]-(\operatorname[X])^2.

Median, mode and mean deviation

Let

X\simCMP(λ,\nu)

. Then the mode of

\lfloorλ^1/\nu\rfloor

λ^1/\nu<m

is not an integer. Otherwise, the modes of

are

λ^1/\nu

and

λ^1/\nu-1

The mean deviation of

X^\nu

about its mean

is given by ^[7]

\operatorname{E}|X^\nu-λ|=2Z(λ,\nu)^-1

	\lfloorλ^1/\nu\rfloor+1
λ

\lfloorλ^1/\nu\rfloor!

No explicit formula is known for the median of

, but the following asymptotic result is available.^[7] Let

be the median of

X\simCMP(λ,\nu)

. Then

m=λ^1/\nu+l{O}\left(λ^1/2\nu\right),

λ → infty

Stein characterisation

Let

X\simCMP(λ,\nu)

, and suppose that

f:Z^+\mapstoR

is such that

\operatorname{E}|f(X+1)|<infty

and

\operatorname{E}|X^\nuf(X)|<infty

. Then

\operatorname{E}[λf(X+1)-X^\nuf(X)]=0.

Conversely, suppose now that

is a real-valued random variable supported on

Z⁺

such that

\operatorname{E}[λf(W+1)-W^\nuf(W)]=0

for all bounded

f:Z^+\mapstoR

. Then

W\simCMP(λ,\nu)

.^[7]

Use as a limiting distribution

Let

Y_n

have the Conway–Maxwell–binomial distribution with parameters

p=λ/n^\nu

and

\nu

. Fix

λ>0

and

\nu>0

. Then,

Y_n

converges in distribution to the

CMP(λ,\nu)

distribution as

n → infty

.^[7] This result generalises the classical Poisson approximation of the binomial distribution. More generally, the CMP distribution arises as a limiting distribution of Conway–Maxwell–Poisson binomial distribution.^[7] Apart from the fact that COM-binomial approximates to COM-Poisson, Zhang et al. (2018)^[8] illustrates that COM-negative binomial distribution with probability mass function

P(X=k)=

{{{(	{\Gamma(r+k)

{k!\Gamma(r)

})}^\nu }}} =\frac,\quad (k = 0,1,2, \ldots),convergents to a limiting distribution which is the COM-Poisson, as

{r\to+infty}

Related distributions

X\sim\operatorname{CMP}(λ,1)

, then

follows the Poisson distribution with parameter

Suppose

λ<1

. Then if

X\simCMP(λ,0)

, we have that

follows the geometric distribution with probability mass function

P(X=k)=λ^k(1-λ)

k\geq0

The sequence of random variable

X_{\nu\simCMP(λ,\nu)}

converges in distribution as

\nu → infty

to the Bernoulli distribution with mean

λ(1+λ)^-1

Parameter estimation

There are a few methods of estimating the parameters of the CMP distribution from the data. Two methods will be discussed: weighted least squares and maximum likelihood. The weighted least squares approach is simple and efficient but lacks precision. Maximum likelihood, on the other hand, is precise, but is more complex and computationally intensive.

Weighted least squares

The weighted least squares provides a simple, efficient method to derive rough estimates of the parameters of the CMP distribution and determine if the distribution would be an appropriate model. Following the use of this method, an alternative method should be employed to compute more accurate estimates of the parameters if the model is deemed appropriate.

This method uses the relationship of successive probabilities as discussed above. By taking logarithms of both sides of this equation, the following linear relationship arises

log

	p_x-1
	p_x

=-logλ+\nulogx

where

p_x

denotes

\Pr(X=x)

. When estimating the parameters, the probabilities can be replaced by the relative frequencies of

and

x-1

. To determine if the CMP distribution is an appropriate model, these values should be plotted against

logx

for all ratios without zero counts. If the data appear to be linear, then the model is likely to be a good fit.

Once the appropriateness of the model is determined, the parameters can be estimated by fitting a regression of

log(\hatp_x-1/\hatp_x)

logx

. However, the basic assumption of homoscedasticity is violated, so a weighted least squares regression must be used. The inverse weight matrix will have the variances of each ratio on the diagonal with the one-step covariances on the first off-diagonal, both given below.

\operatorname{var}\left[log

	\hatp_x-1
	\hatp_x

\right] ≈

	1
	np_x

	1
	np_x-1

cov\left(log

	\hatp_x-1
	\hatp_x

,log

	\hatp_x
	\hatp_x+1

\right) ≈ -

	1
	np_x

Maximum likelihood

The CMP likelihood function is

l{L}(λ,\nu\midx_1,...,x_n)=

	S₁
λ

\exp(-\nuS₂₎Z^-n(λ,\nu)

where

S₁=

	n
\sum
	i=1

x_i

and

S₂=

	n
\sum
	i=1

logx_i!

. Maximizing the likelihood yields the following two equations

\operatorname{E}[X]=\barX

\operatorname{E}[logX!]=\overline{logX!}

which do not have an analytic solution.

Instead, the maximum likelihood estimates are approximated numerically by the Newton–Raphson method. In each iteration, the expectations, variances, and covariance of

and

logX!

are approximated by using the estimates for

and

\nu

from the previous iteration in the expression

\operatorname{E}[f(x)]=

	infty
\sum
	j=0

f(j)

	λ^j
	(j!)^\nuZ(λ,\nu)

This is continued until convergence of

\hatλ

and

\hat\nu

Generalized linear model

The basic CMP distribution discussed above has also been used as the basis for a generalized linear model (GLM) using a Bayesian formulation. A dual-link GLM based on the CMP distribution has been developed,^[9] and this model has been used to evaluate traffic accident data.^[10] ^[11] The CMP GLM developed by Guikema and Coffelt (2008) is based on a reformulation of the CMP distribution above, replacing

with

\mu=λ^1/\nu

. The integral part of

\mu

is then the mode of the distribution. A full Bayesian estimation approach has been used with MCMC sampling implemented in WinBugs with non-informative priors for the regression parameters.^[9] ^[10] This approach is computationally expensive, but it yields the full posterior distributions for the regression parameters and allows expert knowledge to be incorporated through the use of informative priors.

A classical GLM formulation for a CMP regression has been developed which generalizes Poisson regression and logistic regression.^[12] This takes advantage of the exponential family properties of the CMP distribution to obtain elegant model estimation (via maximum likelihood), inference, diagnostics, and interpretation. This approach requires substantially less computational time than the Bayesian approach, at the cost of not allowing expert knowledge to be incorporated into the model.^[12] In addition it yields standard errors for the regression parameters (via the Fisher Information matrix) compared to the full posterior distributions obtainable via the Bayesian formulation. It also provides a statistical test for the level of dispersion compared to a Poisson model. Code for fitting a CMP regression, testing for dispersion, and evaluating fit is available.^[13]

The two GLM frameworks developed for the CMP distribution significantly extend the usefulness of this distribution for data analysis problems.

References

Web site: Conway–Maxwell–Poisson Regression. SAS Support . SAS Institute, Inc.. 2 March 2015.
Boatwright, P., Borle, S. and Kadane, J.B. "A model of the joint distribution of purchase quantity and timing." Journal of the American Statistical Association 98 (2003): 564–572.
Shmueli G., Minka T., Kadane J.B., Borle S., and Boatwright, P.B. "A useful distribution for fitting discrete data: revival of the Conway–Maxwell–Poisson distribution." Journal of the Royal Statistical Society: Series C (Applied Statistics) 54.1 (2005): 127–142.https://dx.doi.org/10.1111/j.1467-9876.2005.00474.x
Li B., Zhang H., Jiao H. "Some Characterizations and Properties of COM-Poisson Random Variables." Communications in Statistics - Theory and Methods, (2019).https://doi.org/10.1080/03610926.2018.1563164
Nadarajah, S. "Useful moment and CDF formulations for the COM–Poisson distribution." Statistical Papers 50 (2009): 617–622.
Gaunt, R.E., Iyengar, S., Olde Daalhuis, A.B. and Simsek, B. "An asymptotic expansion for the normalizing constant of the Conway–Maxwell–Poisson distribution." To appear in Annals of the Institute of Statistical Mathematics (2017+) DOI 10.1007/s10463-017-0629-6
Daly, F. and Gaunt, R.E. " The Conway–Maxwell–Poisson distribution: distributional theory and approximation." ALEA Latin American Journal of Probability and Mathematical Statistics 13 (2016): 635–658.
Zhang H., Tan K., Li B. "COM-negative binomial distribution: modeling overdispersion and ultrahigh zero-inflated count data." Frontiers of Mathematics in China, 2018, 13(4): 967–998.https://doi.org/10.1007/s11464-018-0714-z
Guikema, S.D. and J.P. Coffelt (2008) "A Flexible Count Data Regression Model for Risk Analysis", Risk Analysis, 28 (1), 213–223.
Lord, D., S.D. Guikema, and S.R. Geedipally (2008) "Application of the Conway–Maxwell–Poisson Generalized Linear Model for Analyzing Motor Vehicle Crashes," Accident Analysis & Prevention, 40 (3), 1123–1134.
Lord, D., S.R. Geedipally, and S.D. Guikema (2010) "Extension of the Application of Conway–Maxwell–Poisson Models: Analyzing Traffic Crash Data Exhibiting Under-Dispersion," Risk Analysis, 30 (8), 1268–1276.
[Kimberly Sellers|Sellers, K. S.]
http://www9.georgetown.edu/faculty/kfs7/research.html Code for COM_Poisson modelling

Conway–Maxwell–Poisson distribution explained

Background

Probability mass function and basic properties

Cumulative distribution function

The normalizing constant

Moments, cumulants and related results

Moments for the case of integer

Median, mode and mean deviation

Stein characterisation

Use as a limiting distribution

Related distributions

Parameter estimation

Weighted least squares

Maximum likelihood

Generalized linear model

References

External links