Fourier amplitude sensitivity testing explained

Fourier amplitude sensitivity testing (FAST) is a variance-based global sensitivity analysis method. The sensitivity value is defined based on conditional variances which indicate the individual or joint effects of the uncertain inputs on the output.

FAST first represents conditional variances via coefficients from the multiple Fourier series expansion of the output function. Then the ergodic theorem is applied to transform the multi-dimensional integral to a one-dimensional integral in evaluation of the Fourier coefficients. A set of incommensurate frequencies is required to perform the transform and most frequencies are irrational. To facilitate computation a set of integer frequencies is selected instead of the irrational frequencies. The integer frequencies are not strictly incommensurate, resulting in an error between the multi-dimensional integral and the transformed one-dimensional integral. However, the integer frequencies can be selected to be incommensurate to any order so that the error can be controlled meeting any precision requirement in theory. Using integer frequencies in the integral transform, the resulted function in the one-dimensional integral is periodic and the integral only needs to evaluate in a single period. Next, since the continuous integral function can be recovered from a set of finite sampling points if the Nyquist–Shannon sampling theorem is satisfied, the one-dimensional integral is evaluated from the summation of function values at the generated sampling points.

FAST is more efficient to calculate sensitivities than other variance-based global sensitivity analysis methods via Monte Carlo integration. However the calculation by FAST is usually limited to sensitivities referred to as “main effects” or “first-order effects” due to the computational complexity in computing higher-order effects.

History

The FAST method originated in study of coupled chemical reaction systems in 1973^[1] ^[2] and the detailed analysis of the computational error was presented latter in 1975.^[3] Only the first order sensitivity indices referring to “main effect” were calculated in the original method. A FORTRAN computer program capable of analyzing either algebraic or differential equation systems was published in 1982.^[4] In 1990s, the relationship between FAST sensitivity indices and Sobol’s ones calculated from Monte-Carlo simulation was revealed in the general framework of ANOVA-like decomposition ^[5] and an extended FAST method able to calculate sensitivity indices referring to “total effect” was developed.^[6]

Foundation

Variance-based sensitivity

See main article: Variance-based sensitivity analysis.

Sensitivity indices of a variance-based method are calculated via ANOVA-like decomposition of the function for analysis. Suppose the function is

Y=f\left(X\right)=f\left(X_1,X_2,...,X_n\right)

where

0\leqX_j\leq1,j=1,...,n

. The ANOVA-like decomposition is

f\left(X_1,X_2,\ldots,X_n\right)=f_0+\sum

	nf

	j\left(X

_{j\right)+\sum}

	n-1

	j=1

	n
\sum
	k=j+1

f_jk\left(X_j,X_k\right)+ … +f₁₂

provided that

f₀

is a constant and the integral of each term in the sums is zero, i.e.

	1
\int
	0

f
	j₁j₂...j_r

\left(X
	j₁

,X
	j₂

,...,X
	j_r

\right)dX
	j_k

=0,1\leqk\leqr.

The conditional variance which characterizes the contribution of each term to the total variance of

f\left(X\right)

V
	j₁j₂...j_r

	1
=\int
	0

…

	1
\int
	0

	2\left(X
f
	j₁

,X
	j₂

,...,X
	j_r

\right)dX
	j₁

dX
	j₂

...

dX
	j_r

The total variance is the sum of all conditional variances

	n
\sum
	j=1

V_j+

	n-1
\sum
	j=1

	n
\sum
	k=j+1

V_jk+ … +V_12....

The sensitivity index is defined as the normalized conditional variance as

S
	j₁j₂...j_r

V
	j₁j₂...j_r

especially the first order sensitivity

j=	V_j
	V

which indicates the main effect of the input

X_j

Multiple Fourier series

One way to calculate the ANOVA-like decomposition is based on multiple Fourier series. The function

f\left(X\right)

in the unit hyper-cube can be extended to a multiply periodic function and the multiple Fourier series expansion is

f\left(X_1,X_2,...,X_n\right)=

	infty
\sum
	m_1=-infty

	infty
\sum
	m_2=-infty

…

	infty
\sum
	m_n=-infty

C
	m_1m_2...m_n

\expl[2\pii\left(m_1X₁+m_2X₂+ … +m_nX_n\right)r],forintegersm_1,m_2,...,m_n

where the Fourier coefficient is

C
	m_1m_2...m_n

	1
\int
	0

…

	1
\int
	0

f\left(X_1,X_2,...,X_n\right)\expl[-2\pii\left(m_1X_1+m_2X_2+...+m_nX_n\right)r].

The ANOVA-like decomposition is

\begin{align} f₀&=C₀₀\\ f_j&=

\sum
	m_j ≠ 0

C
	0...m_j...0

\expl[2\piim_jX_jr]\\ f_jk&=

\sum
	m_j ≠ 0

\sum
	m_k ≠ 0

C
	0...m_j...m_k...0

\expl[2\pii\left(m_jX_j+m_kX_k\right)r]\\ f₁₂&=

\sum
	m₁ ≠ 0

\sum
	m₂ ≠ 0

…

\sum
	m_n ≠ 0

C
	m₁m₂...m_n

\expl[2\pii\left(m_1X_1+m_2X_{2+ … +m}_nX_n\right)r]. \end{align}

The first order conditional variance is

\begin{align} V_j&=

	1
\int
	0

	2\left(X
f
	j\right)dX

_j\\
&=

\sum
	m_j ≠ 0

\left|

C
	0...m_j...0

\right|^2\\
&=

	infty
2\sum
	m_j=1

\left(

	2
A
	m_j

\right) \end{align}

where

A
	m_j

and

B
	m_j

are the real and imaginary part of

C
	0...m_j...0

respectively

A
	m_j

	1
\int
	0

…

	1
\int
	0

f\left(X_1,X_2,...,X_n\right)\cos\left(2\pim_jX_j\right)dX_1dX₂...dX_n

B
	m_j

	1
\int
	0

…

	1
\int
	0

f\left(X_1,X_2,...,X_n\right)\sin\left(2\pim_jX_j\right)dX_1dX₂...dX_n

Ergodic theorem

A multi-dimensional integral must be evaluated in order to calculate the Fourier coefficients. One way to evaluate this multi-dimensional integral is to transform it into a one-dimensional integral by expressing every input as a function of a new independent variable

, as follows

X_j\left(s\right)=

	1
	2\pi

\left(\omega_jsmod2\pi\right),j=1,2,...,n

where

\left\{\omega_j\right\}

is a set of incommensurate frequencies, i.e.

	n
\sum
	j=1

\gamma_j\omega_j=0

for an integer set of

\left\{\gamma_j\right\}

if and only if

\gamma_j=0

for every

.Then the Fourier coefficients can be calculated by a one-dimensional integral according to the ergodic theorem ^[7]

A
	m_j

=\lim_T

	1
	2T

	T
\int
	-T

fl(X_{1\left(s\right),X}_{2\left(s\right),...,X}_{n\left(s\right)r)\cosl(2\pi}m_jX_{j\left(s\right)r)ds}

B
	m_j

=\lim_T

	1
	2T

	T
\int
	-T

fl(X_{1\left(s\right),X}_{2\left(s\right),...,X}_{n\left(s\right)r)\sinl(2\pi}m_jX_{j\left(s\right)r)ds}

Implementation

Integer frequencies

At most one of the incommensurate frequencies

\left\{\omega_j\right\}

can be rational with all others being irrational. Since the numerical value of an irrational number cannot be stored exactly in a computer, an approximation of the incommensurate frequencies by all rational numbers is required in implementation. Without loss of any generality the frequencies can be set as integers instead of any rational numbers. A set of integers

\left\{\omega_j\right\}

is approximately incommensurate to the order of

	n
\sum
	j=1

\gamma_j\omega_j ≠ 0

for

	n
\sum
	j=1

\left|\gamma_j\right|\leqM+1

where

is an integer. The exact incommensurate condition is an extreme case when

M\toinfty

Using the integer frequencies the function in the transformed one-dimensional integral is periodic so only the integration over a period of

2\pi

is required. The Fourier coefficients can be approximately calculated as

\begin{align} A
	m_j

& ≈

	1
	2\pi

	\pi
\int
	-\pi

fl(X_{1\left(s\right),X}_{2\left(s\right),...,X}_{n\left(s\right)r)\cos\left(m}_j\omega_js\right)ds:=

\hat{A}
	m_j

\\ B
	m_j

& ≈

	1
	2\pi

	\pi
\int
	-\pi

fl(X_{1\left(s\right),X}_{2\left(s\right),...,X}_{n\left(s\right)r)\sin\left(m}_j\omega_js\right)ds:=

\hat{B}
	m_j

\end{align}

The approximation of the incommensurate frequencies for a finite

results in a discrepancy error between the true Fourier coefficients

A
	m_j

B
	m_j

and their estimates

\hat{A}
	m_j

\hat{B}
	m_j

. The larger the order

is the smaller the error is but the more computational efforts are required to calculate the estimates in the following procedure. In practice

is frequently set to 4 and a table of resulted frequency sets which have up to 50 frequencies is available. (McRae et al., 1982)

Search curve

The transform,

X_j\left(s\right)=

	1
	2\pi

\left(\omega_jsmod2\pi\right)

, defines a search curve in the input space. If the frequencies,

\omega_j,j=1,...,n

, are incommensurate, the search curve can pass through every point in the input space as

varies from 0 to

infty

so the multi-dimensional integral over the input space can be accurately transformed to a one-dimensional integral along the search curve. However, if the frequencies are approximately incommensurate integers, the search curve cannot pass through every point in the input space. If fact the search is repeated since the transform function is periodic, with a period of

2\pi

. The one-dimensional integral can be evaluated over a single period instead of the infinite interval for incommensurate frequencies; However, a computational error arises due to the approximation of the incommensuracy.

Sampling

The approximated Fourier can be further expressed as

\hat{A}
	m_j

= \begin{cases} 0&m_jodd\\

	1
	\pi

	\pi/2
\int
	-\pi/2

fl(X(s)r)\cos\left(m_j\omega_js\right)ds&m_jeven \end{cases}

and

\hat{B}		= \begin{cases}
	m_j

	1
	\pi

	\pi/2
\int
	-\pi/2

fl(X(s)r)\sin\left(m_j\omega_js\right)ds&m_jodd\\ 0&m_jeven \end{cases}

The non-zero integrals can be calculated from sampling points

\begin{align} \hat{A}
	m_j

	1
	2q+1

	q
\sum
	k=-q

fl(X(s_{k)r)\cos\left(}m_j\omega_js_k\right),m_j

even\\ \hat{B}
	m_j

	1
	2q+1

	q
\sum
	k=-q

fl(X(s_{k)r)\sin\left(}m_j\omega_js_k\right),m_jodd \end{align}

where the uniform sampling point in

\left[-\pi/2,\pi/2\right]

s_k=

	\pik
	2q+1

,k=-q,...,-1,0,1,...,q.

The total number of sampling points is

2q+1

which should satisfy the Nyquist sampling criterion, i.e.

2q+1\geqN\omega_max+1

where

\omega_max

is the largest frequency in

\left\{\omega_k\right\}

and

is the maximum order of the calculated Fourier coefficients.

Partial sum

After calculating the estimated Fourier coefficients, the first order conditional variance can be approximated by

\begin{align} V_j&=

	infty
2\sum
	m_j=1

\left(

	2
A
	m_j

\right)\\ & ≈

	infty
2\sum
	m_j=1

\left(

	2
\hat{A}
	m_j

\right)\\ & ≈

	2
2\sum
	m_j=1

\left(

	2
\hat{A}
	m_j

\right)\\ &=2\left(

	2
\hat{A}
	m_j=2

	2
\hat{B}
	m_j=1

\right) \end{align}

where only the partial sum of the first two terms is calculated and

N=2

for determining the number of sampling points. Using the partial sum can usually return an adequately good approximation of the total sum since the terms corresponding to the fundamental frequency and low order frequencies usually contribute most to the total sum. Additionally, the Fourier coefficient in the summation are just an estimate of the true value and adding more higher order terms will not help improve the computational accuracy significantly. Since the integer frequencies are not exactly incommensurate there are two integers

m_j

and

m_k

such that

m_j\omega_j=m_k\omega_k.

Interference between the two frequencies can occur if higher order terms are included in the summation.

Similarly the total variance of

f\left(X\right)

can be calculated as

V ≈ \hat{A}_0\left[f²\right]-\hat{A}_0\left[f\right]²

where

\hat{A}_0\left[f²\right]

denotes the estimated Fourier coefficient of the function of

f²

inside the bracket and

\hat{A}_0\left[f\right]²

is the squared Fourier coefficient of the function

. Finally the sensitivity referring to the main effect of an input can be calculated by dividing the conditional variance by the total variance.

References

Cukier, R.I., C.M. Fortuin, K.E. Shuler, A.G. Petschek and J.H. Schaibly (1973). Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. I Theory. Journal of Chemical Physics, 59, 3873–3878.
Schaibly, J.H. and K.E. Shuler (1973). Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. II Applications. Journal of Chemical Physics, 59, 3879–3888.
Cukier, R.I., J.H. Schaibly, and K.E. Shuler (1975). Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. III. Analysis of the approximations. Journal of Chemical Physics, 63, 1140–1149.
McRae, G.J., J.W. Tilden and J.H. Seinfeld (1982). Global sensitivity analysis—a computational implementation of the Fourier Amplitude Sensitivity Test (FAST). Computers & Chemical Engineering, 6, 15–25.
Archer G.E.B., A. Saltelli and I.M. Sobol (1997). Sensitivity measures, ANOVA-like techniques and the use of bootstrap. Journal of Statistical Computation and Simulation, 58, 99–120.
Saltelli A., S. Tarantola and K.P.S. Chan (1999). A quantitative model-independent method for global sensitivity analysis of model output. Technometrics, 41, 39–56.
Weyl, H. (1938). Mean motion. American Journal of Mathematics, 60, 889–896.