For some observed time series, a very high-order AR or MA model is needed to model the underlying process well. In this case, a combined autoregressive moving average (ARMA) model can sometimes be a more parsimonious choice.
An ARMA model expresses the conditional mean of yt as a function of both past observations, , and past innovations, The number of past observations that yt depends on, p, is the AR degree. The number of past innovations that yt depends on, q, is the MA degree. In general, these models are denoted by ARMA(p,q).
The form of the ARMA(p,q) model in Econometrics Toolbox™ is
where is an uncorrelated innovation process with mean zero.
In lag operator polynomial notation, . Define the degree p AR lag operator polynomial . Define the degree q MA lag operator polynomial . You can write the ARMA(p,q) model as
The signs of the coefficients in the AR lag operator polynomial, , are opposite to the right side of Equation 5-10. When specifying and interpreting AR coefficients in Econometrics Toolbox, use the form in Equation 5-10.
Consider the ARMA(p,q) model in lag operator notation,
From this expression, you can see that
is the unconditional mean of the process, and is a rational, infinite-degree lag operator polynomial, .
By Wold's decomposition , Equation 5-12 corresponds to a stationary stochastic process provided the coefficients are absolutely summable. This is the case when the AR polynomial, , is stable, meaning all its roots lie outside the unit circle. Additionally, the process is causal provided the MA polynomial is invertible, meaning all its roots lie outside the unit circle.
Econometrics Toolbox enforces stability and invertibility
of ARMA processes. When you specify an ARMA model using
you get an error if you enter coefficients that do not correspond
to a stable AR polynomial or invertible MA polynomial. Similarly,
stationarity and invertibility constraints during estimation.
 Wold, H. A Study in the Analysis of Stationary Time Series. Uppsala, Sweden: Almqvist & Wiksell, 1938.