Vector autoregression

Short description: Statistical model to calculate the value of multiple quantities as they change over time

Vector autoregression (VAR) is a statistical model used to capture the relationship between multiple quantities as they change over time. VAR is a type of stochastic process model. VAR models generalize the single-variable (univariate) autoregressive model by allowing for multivariate time series. VAR models are often used in economics and the natural sciences.

Like the autoregressive model, each variable has an equation modelling its evolution over time. This equation includes the variable's lagged (past) values, the lagged values of the other variables in the model, and an error term. VAR models do not require as much knowledge about the forces influencing a variable as do structural models with simultaneous equations. The only prior knowledge required is a list of variables which can be hypothesized to affect each other over time.

Specification

Definition

A VAR model describes the evolution of a set of k variables, called endogenous variables, over time. Each period of time is numbered, t = 1, ..., T. The variables are collected in a vector, y_t, which is of length k. (Equivalently, this vector might be described as a (k × 1)-matrix.) The vector is modelled as a linear function of its previous value. The vector's components are referred to as y_i,t, meaning the observation at time t of the i th variable. For example, if the first variable in the model measures the price of wheat over time, then y_1,1998 would indicate the price of wheat in the year 1998.

VAR models are characterized by their order, which refers to the number of earlier time periods the model will use. Continuing the above example, a 5th-order VAR would model each year's wheat price as a linear combination of the last five years of wheat prices. A lag is the value of a variable in a previous time period. So in general a pth-order VAR refers to a VAR model which includes lags for the last p time periods. A pth-order VAR is denoted "VAR(p)" and sometimes called "a VAR with p lags". A pth-order VAR model is written as

[math]\displaystyle{ y_t = c + A_1 y_{t-1} + A_2 y_{t-2} + \cdots + A_p y_{t-p} + e_t, \, }[/math]

The variables of the form y_t−i indicate that variable's value i time periods earlier and are called the "ith lag" of y_t. The variable c is a k-vector of constants serving as the intercept of the model. A_i is a time-invariant (k × k)-matrix and e_t is a k-vector of error terms. The error terms must satisfy three conditions:

[math]\displaystyle{ \mathrm{E}(e_t) = 0\, }[/math]. Every error term has a mean of zero.
[math]\displaystyle{ \mathrm{E}(e_t e_t') = \Omega\, }[/math]. The contemporaneous covariance matrix of error terms is a k × k positive-semidefinite matrix denoted Ω.
[math]\displaystyle{ \mathrm{E}(e_t e_{t-k}') = 0\, }[/math] for any non-zero k. There is no correlation across time. In particular, there is no serial correlation in individual error terms.^[1]

The process of choosing the maximum lag p in the VAR model requires special attention because inference is dependent on correctness of the selected lag order.^[2]^[3]

Order of integration of the variables

Note that all variables have to be of the same order of integration. The following cases are distinct:

All the variables are I(0) (stationary): this is in the standard case, i.e. a VAR in level
All the variables are I(d) (non-stationary) with d > 0:^{[citation needed]}
- The variables are cointegrated: the error correction term has to be included in the VAR. The model becomes a Vector error correction model (VECM) which can be seen as a restricted VAR.
- The variables are not cointegrated: first, the variables have to be differenced d times and one has a VAR in difference.

Concise matrix notation

One can stack the vectors in order to write a VAR(p) as a stochastic matrix difference equation, with a concise matrix notation:

[math]\displaystyle{ Y=BZ +U \, }[/math]

Details of the matrices are in a separate page.

Example

For a general example of a VAR(p) with k variables, see General matrix notation of a VAR(p).

A VAR(1) in two variables can be written in matrix form (more compact notation) as

[math]\displaystyle{ \begin{bmatrix}y_{1,t} \\ y_{2,t}\end{bmatrix} = \begin{bmatrix}c_{1} \\ c_{2}\end{bmatrix} + \begin{bmatrix}a_{1,1}&a_{1,2} \\ a_{2,1}&a_{2,2}\end{bmatrix}\begin{bmatrix}y_{1,t-1} \\ y_{2,t-1}\end{bmatrix} + \begin{bmatrix}e_{1,t} \\ e_{2,t}\end{bmatrix}, }[/math]

(in which only a single A matrix appears because this example has a maximum lag p equal to 1), or, equivalently, as the following system of two equations

[math]\displaystyle{ y_{1,t} = c_{1} + a_{1,1}y_{1,t-1} + a_{1,2}y_{2,t-1} + e_{1,t}\, }[/math]

[math]\displaystyle{ y_{2,t} = c_{2} + a_{2,1}y_{1,t-1} + a_{2,2}y_{2,t-1} + e_{2,t}.\, }[/math]

Each variable in the model has one equation. The current (time t) observation of each variable depends on its own lagged values as well as on the lagged values of each other variable in the VAR.

Writing VAR(p) as VAR(1)

A VAR with p lags can always be equivalently rewritten as a VAR with only one lag by appropriately redefining the dependent variable. The transformation amounts to stacking the lags of the VAR(p) variable in the new VAR(1) dependent variable and appending identities to complete the number of equations.

For example, the VAR(2) model

[math]\displaystyle{ y_t = c + A_1 y_{t-1} + A_2 y_{t-2} + e_t }[/math]

can be recast as the VAR(1) model

[math]\displaystyle{ \begin{bmatrix}y_{t} \\ y_{t-1}\end{bmatrix} = \begin{bmatrix}c \\ 0\end{bmatrix} + \begin{bmatrix}A_{1}&A_{2} \\ I&0\end{bmatrix}\begin{bmatrix}y_{t-1} \\ y_{t-2}\end{bmatrix} + \begin{bmatrix}e_{t} \\ 0\end{bmatrix}, }[/math]

where I is the identity matrix.

The equivalent VAR(1) form is more convenient for analytical derivations and allows more compact statements.

Structural vs. reduced form

Structural VAR

A structural VAR with p lags (sometimes abbreviated SVAR) is

[math]\displaystyle{ B_0 y_t = c_0 + B_1 y_{t-1} + B_2 y_{t-2} + \cdots + B_p y_{t-p} + \epsilon_t, }[/math]

where c₀ is a k × 1 vector of constants, B_i is a k × k matrix (for every i = 0, ..., p) and ε_t is a k × 1 vector of error terms. The main diagonal terms of the B₀ matrix (the coefficients on the i^th variable in the i^th equation) are scaled to 1.

The error terms ε_t (structural shocks) satisfy the conditions (1) - (3) in the definition above, with the particularity that all the elements in the off diagonal of the covariance matrix [math]\displaystyle{ \mathrm{E}(\epsilon_t\epsilon_t') = \Sigma }[/math] are zero. That is, the structural shocks are uncorrelated.

For example, a two variable structural VAR(1) is:

[math]\displaystyle{ \begin{bmatrix}1&B_{0;1,2} \\ B_{0;2,1}&1\end{bmatrix}\begin{bmatrix}y_{1,t} \\ y_{2,t}\end{bmatrix} = \begin{bmatrix}c_{0;1} \\ c_{0;2}\end{bmatrix} + \begin{bmatrix}B_{1;1,1}&B_{1;1,2} \\ B_{1;2,1}&B_{1;2,2}\end{bmatrix}\begin{bmatrix}y_{1,t-1} \\ y_{2,t-1}\end{bmatrix} + \begin{bmatrix}\epsilon_{1,t} \\ \epsilon_{2,t}\end{bmatrix}, }[/math]

where

[math]\displaystyle{ \Sigma = \mathrm{E}(\epsilon_t \epsilon_t') = \begin{bmatrix}\sigma_{1}^2&0 \\ 0&\sigma_{2}^2\end{bmatrix}; }[/math]

that is, the variances of the structural shocks are denoted [math]\displaystyle{ \mathrm{var}(\epsilon_i) = \sigma_i^2 }[/math] (i = 1, 2) and the covariance is [math]\displaystyle{ \mathrm{cov}(\epsilon_1,\epsilon_2) = 0 }[/math].

Writing the first equation explicitly and passing y_2,t to the right hand side one obtains

[math]\displaystyle{ y_{1,t} = c_{0;1} - B_{0;1,2}y_{2,t} + B_{1;1,1}y_{1,t-1} + B_{1;1,2}y_{2,t-1} + \epsilon_{1,t}\, }[/math]

Note that y_2,t can have a contemporaneous effect on y_1,t if B_0;1,2 is not zero. This is different from the case when B₀ is the identity matrix (all off-diagonal elements are zero — the case in the initial definition), when y_2,t can impact directly y_1,t+1 and subsequent future values, but not y_1,t.

Because of the parameter identification problem, ordinary least squares estimation of the structural VAR would yield inconsistent parameter estimates. This problem can be overcome by rewriting the VAR in reduced form.

From an economic point of view, if the joint dynamics of a set of variables can be represented by a VAR model, then the structural form is a depiction of the underlying, "structural", economic relationships. Two features of the structural form make it the preferred candidate to represent the underlying relations:

1. Error terms are not correlated. The structural, economic shocks which drive the dynamics of the economic variables are assumed to be independent, which implies zero correlation between error terms as a desired property. This is helpful for separating out the effects of economically unrelated influences in the VAR. For instance, there is no reason why an oil price shock (as an example of a supply shock) should be related to a shift in consumers' preferences towards a style of clothing (as an example of a demand shock); therefore one would expect these factors to be statistically independent.

2. Variables can have a contemporaneous impact on other variables. This is a desirable feature especially when using low frequency data. For example, an indirect tax rate increase would not affect tax revenues the day the decision is announced, but one could find an effect in that quarter's data.

Reduced-form VAR

By premultiplying the structural VAR with the inverse of B₀

[math]\displaystyle{ y_t = B_0^{-1}c_0 + B_0^{-1} B_1 y_{t-1} + B_0^{-1} B_2 y_{t-2} + \cdots + B_0^{-1} B_p y_{t-p} + B_0^{-1}\epsilon_t, }[/math]

and denoting

[math]\displaystyle{ B_{0}^{-1} c_0 = c,\quad B_{0}^{-1}B_i = A_{i}\text{ for }i = 1, \dots, p\text{ and }B_{0}^{-1}\epsilon_t = e_t }[/math]

one obtains the pth order reduced VAR

[math]\displaystyle{ y_t = c + A_1 y_{t-1} + A_2 y_{t-2} + \cdots + A_p y_{t-p} + e_t }[/math]

Note that in the reduced form all right hand side variables are predetermined at time t. As there are no time t endogenous variables on the right hand side, no variable has a direct contemporaneous effect on other variables in the model.

However, the error terms in the reduced VAR are composites of the structural shocks e_t = B₀⁻¹ε_t. Thus, the occurrence of one structural shock ε_i,t can potentially lead to the occurrence of shocks in all error terms e_j,t, thus creating contemporaneous movement in all endogenous variables. Consequently, the covariance matrix of the reduced VAR

[math]\displaystyle{ \Omega = \mathrm{E}(e_t e_t') = \mathrm{E} (B_0^{-1} \epsilon_t \epsilon_t' (B_0^{-1})') = B_0^{-1}\Sigma(B_0^{-1})'\, }[/math]

can have non-zero off-diagonal elements, thus allowing non-zero correlation between error terms.

Estimation

Estimation of the regression parameters

Starting from the concise matrix notation (for details see this annex):

[math]\displaystyle{ Y=BZ +U \, }[/math]

The multivariate least squares (MLS) approach for estimating B yields:

[math]\displaystyle{ \hat B= YZ'(ZZ')^{-1}. }[/math]

This can be written alternatively as:

[math]\displaystyle{ \operatorname{Vec}(\hat B) = ((ZZ')^{-1} Z \otimes I_{k})\ \operatorname{Vec}(Y), }[/math]

where [math]\displaystyle{ \otimes }[/math] denotes the Kronecker product and Vec the vectorization of the indicated matrix.

This estimator is consistent and asymptotically efficient. It is furthermore equal to the conditional maximum likelihood estimator.^[4]

As the explanatory variables are the same in each equation, the multivariate least squares estimator is equivalent to the ordinary least squares estimator applied to each equation separately.^[5]

Estimation of the covariance matrix of the errors

As in the standard case, the maximum likelihood estimator (MLE) of the covariance matrix differs from the ordinary least squares (OLS) estimator.

MLE estimator: [math]\displaystyle{ \hat \Sigma = \frac{1}{T} \sum_{t=1}^T \hat \epsilon_t\hat \epsilon_t' }[/math]

OLS estimator: [math]\displaystyle{ \hat \Sigma = \frac{1}{T-kp-1} \sum_{t=1}^T \hat \epsilon_t\hat \epsilon_t' }[/math] for a model with a constant, k variables and p lags.

In a matrix notation, this gives:

[math]\displaystyle{ \hat \Sigma = \frac{1}{T-kp-1} (Y-\hat{B}Z)(Y-\hat{B}Z)'. }[/math]

Estimation of the estimator's covariance matrix

The covariance matrix of the parameters can be estimated as^{[citation needed]}

[math]\displaystyle{ \widehat \mbox{Cov} (\mbox{Vec}(\hat B)) =({ZZ'})^{-1} \otimes\hat \Sigma.\, }[/math]

Degrees of freedom

Vector autoregression models often involve the estimation of many parameters. For example, with seven variables and four lags, each matrix of coefficients for a given lag length is 7 by 7, and the vector of constants has 7 elements, so a total of 49×4 + 7 = 203 parameters are estimated, substantially lowering the degrees of freedom of the regression (the number of data points minus the number of parameters to be estimated). This can hurt the accuracy of the parameter estimates and hence of the forecasts given by the model.

Interpretation of estimated model

Properties of the VAR model are usually summarized using structural analysis using Granger causality, impulse responses, and forecast error variance decompositions.

Impulse response

Consider the first-order case (i.e., with only one lag), with equation of evolution

[math]\displaystyle{ y_t=Ay_{t-1}+e_t, }[/math]

for evolving (state) vector [math]\displaystyle{ y }[/math] and vector [math]\displaystyle{ e }[/math] of shocks. To find, say, the effect of the j-th element of the vector of shocks upon the i-th element of the state vector 2 periods later, which is a particular impulse response, first write the above equation of evolution one period lagged:

[math]\displaystyle{ y_{t-1}=Ay_{t-2}+e_{t-1}. }[/math]

Use this in the original equation of evolution to obtain

[math]\displaystyle{ y_t=A^2y_{t-2}+Ae_{t-1}+e_t; }[/math]

then repeat using the twice lagged equation of evolution, to obtain

[math]\displaystyle{ y_t=A^3y_{t-3}+A^2e_{t-2}+Ae_{t-1}+e_t. }[/math]

From this, the effect of the j-th component of [math]\displaystyle{ e_{t-2} }[/math] upon the i-th component of [math]\displaystyle{ y_t }[/math] is the i, j element of the matrix [math]\displaystyle{ A^2. }[/math]

It can be seen from this induction process that any shock will have an effect on the elements of y infinitely far forward in time, although the effect will become smaller and smaller over time assuming that the AR process is stable — that is, that all the eigenvalues of the matrix A are less than 1 in absolute value.

Forecasting using an estimated VAR model

An estimated VAR model can be used for forecasting, and the quality of the forecasts can be judged, in ways that are completely analogous to the methods used in univariate autoregressive modelling.

Applications

Christopher Sims has advocated VAR models, criticizing the claims and performance of earlier modeling in macroeconomic econometrics.^[6] He recommended VAR models, which had previously appeared in time series statistics and in system identification, a statistical specialty in control theory. Sims advocated VAR models as providing a theory-free method to estimate economic relationships, thus being an alternative to the "incredible identification restrictions" in structural models.^[6] VAR models are also increasingly used in health research for automatic analyses of diary data^[7] or sensor data.

Software

R: The package vars includes functions for VAR models.^[8]^[9] Other R packages are listed in the CRAN Task View: Time Series Analysis.
Python: The statsmodels package's tsa (time series analysis) module supports VARs. PyFlux has support for VARs and Bayesian VARs.
SAS: VARMAX
Stata: "var"
EViews: "VAR"
Gretl: "var"
Matlab: "varm"
Regression analysis of time series: "SYSTEM"
LDT

Notes

↑ For multivariate tests for autocorrelation in the VAR models, see Hatemi-J, A. (2004). "Multivariate tests for autocorrelation in the stable and unstable VAR models". Economic Modelling 21 (4): 661–683. doi:10.1016/j.econmod.2003.09.005. https://ideas.repec.org/a/eee/ecmode/v21y2004i4p661-683.html.
↑ Hacker, R. S.; Hatemi-J, A. (2008). "Optimal lag-length choice in stable and unstable VAR models under situations of homoscedasticity and ARCH". Journal of Applied Statistics 35 (6): 601–615. doi:10.1080/02664760801920473. https://ideas.repec.org/a/taf/japsta/v35y2008i6p601-615.html.
↑ Hatemi-J, A.; Hacker, R. S. (2009). "Can the LR test be helpful in choosing the optimal lag order in the VAR model when information criteria suggest different lag orders?". Applied Economics 41 (9): 1489–1500. https://ideas.repec.org/a/taf/applec/v41y2009i9p1121-1125.html.
↑ Hamilton, James D. (1994). Time Series Analysis. Princeton University Press. p. 293.
↑ Zellner, Arnold (1962). "An Efficient Method of Estimating Seemingly Unrelated Regressions and Tests for Aggregation Bias". Journal of the American Statistical Association 57 (298): 348–368. doi:10.1080/01621459.1962.10480664.
↑ ^6.0 ^6.1 Sims, Christopher (1980). "Macroeconomics and Reality". Econometrica 48 (1): 1–48. doi:10.2307/1912017.
↑ van der Krieke (2016). "Temporal Dynamics of Health and Well-Being: A Crowdsourcing Approach to Momentary Assessments and Automated Generation of Personalized Feedback (2016)". Psychosomatic Medicine: 1. doi:10.1097/PSY.0000000000000378. PMID 27551988.
↑ Bernhard Pfaff VAR, SVAR and SVEC Models: Implementation Within R Package vars
↑ Hyndman, Rob J; Athanasopoulos, George (2018). "11.2: Vector Autoregressions". Forecasting: Principles and Practice. OTexts. pp. 333–335. ISBN 978-0-9875071-1-2. https://otexts.com/fpp2/VAR.html.
↑ Holtz-Eakin, D., Newey, W., and Rosen, H. S. (1988). Estimating Vector Autoregressions with Panel Data. Econometrica, 56(6):1371–1395.

v t e Economics
Economic theory Political economy Applied economics
Methodology	Economic model Economic systems Microfoundations Mathematical economics Econometrics Computational economics Experimental economics Publications
Microeconomics	Aggregation problem Budget set Consumer choice Convexity Cost Average Marginal Opportunity Social Sunk Transaction Cost–benefit analysis Deadweight loss Distribution Economies of scale Economies of scope Elasticity Equilibrium General Externality Firm Goods and services Goods Service Indifference curve Interest Intertemporal choice Market Market failure Market structure Competition Monopolistic Perfect Monopoly Bilateral Monopsony Oligopoly Oligopsony Non-convexity Pareto efficiency Preference Price Production set Profit Public good Rate of profit Rationing Rent Returns to scale Risk aversion Scarcity Shortage Surplus Social choice Supply and demand Trade Uncertainty Utility Expected Marginal Value Wage Publications
Macroeconomics	Aggregate demand Balance of payments Business cycle Capacity utilization Capital flight Central bank Consumer confidence Currency Deflation Demand shock Depression Great Disinflation DSGE Effective demand Expectations Adaptive Rational Fiscal policy General Theory of Keynes Growth Indicators Inflation Hyperinflation Interest rate Investment IS–LM model Measures of national income and output Models Money Creation Demand Supply Monetary policy NAIRU National accounts Price level PPP Recession Saving Shrinkflation Stagflation Supply shock Unemployment Publications
Mathematical economics	Contract theory Decision theory Econometrics Game theory Input–output model Mathematical finance Mechanism design Operations research
Applied fields	Agricultural Business Demographic Development Economic geography Economic history Education Industrial Engineering Civil Engineering Environmental Financial Health Industrial organization International Knowledge Labour Law and economics Monetary Natural resource Economic planning Economic policy Public economics Public choice Regional Service Socioeconomics Economic sociology Economic statistics Transportation Urban Welfare
Schools (history) of economic thought	American (National) Ancient thought Anarchist Mutualism Austrian Behavioral Buddhist Chartalism Modern Monetary Theory Chicago Classical Disequilibrium Ecological Evolutionary Feminist Georgism Heterodox Historical Institutional Keynesian Neo- (neoclassical–Keynesian synthesis) New Post- Circuitism Mainstream Malthusianism Marginalism Marxian Neo Mercantilism Neoclassical Lausanne New classical Real business-cycle theory New institutional Physiocracy Socialist Stockholm Supply-side Thermoeconomics
Notable economists and thinkers within economics	François Quesnay Adam Smith David Ricardo Thomas Robert Malthus Johann Heinrich von Thünen Friedrich List Hermann Heinrich Gossen Jules Dupuit Antoine Augustin Cournot John Stuart Mill Karl Marx William Stanley Jevons Henry George Léon Walras Alfred Marshall Georg Friedrich Knapp Francis Ysidro Edgeworth Vilfredo Pareto Friedrich von Wieser John Bates Clark Thorstein Veblen John R. Commons Irving Fisher Wesley Clair Mitchell John Maynard Keynes Joseph Schumpeter Arthur Cecil Pigou Frank Knight John von Neumann Alvin Hansen Jacob Viner Edward Chamberlin Ragnar Frisch Harold Hotelling Michał Kalecki Oskar R. Lange Jacob Marschak Gunnar Myrdal Abba P. Lerner Roy Harrod Piero Sraffa Simon Kuznets Joan Robinson E. F. Schumacher Friedrich Hayek John Hicks Tjalling Koopmans Nicholas Georgescu-Roegen Wassily Leontief John Kenneth Galbraith Hyman Minsky Herbert A. Simon Milton Friedman Paul Samuelson Kenneth Arrow William Baumol Gary Becker Elinor Ostrom Robert Solow Amartya Sen Robert Lucas Jr. Joseph Stiglitz Richard Thaler Paul Krugman Thomas Piketty more
International organizations	Asia-Pacific Economic Cooperation Economic Cooperation Organization European Free Trade Association International Monetary Fund Organisation for Economic Co-operation and Development World Bank World Trade Organization
Category Index Lists Outline Publications Business and economics portal

Anonymous

Search

Vector autoregression

Namespaces

More

Page actions

Contents

Specification

Definition

Order of integration of the variables

Concise matrix notation

Example

Writing VAR(p) as VAR(1)

Structural vs. reduced form

Structural VAR

Reduced-form VAR

Estimation

Estimation of the regression parameters

Estimation of the covariance matrix of the errors

Estimation of the estimator's covariance matrix

Degrees of freedom

Interpretation of estimated model

Impulse response

Forecasting using an estimated VAR model

Applications

Software

See also

Notes

Further reading

Navigation

Navigation

Help

Translate

Wiki tools

Wiki tools

Anonymous

Search

Vector autoregression

Specification

Definition

Order of integration of the variables

Concise matrix notation

Example

Writing VAR(p) as VAR(1)

Structural vs. reduced form

Structural VAR

Reduced-form VAR

Estimation

Estimation of the regression parameters

Estimation of the covariance matrix of the errors

Estimation of the estimator's covariance matrix

Degrees of freedom

Interpretation of estimated model

Impulse response

Forecasting using an estimated VAR model

Applications

Software

See also

Notes

Further reading

Navigation

Wiki tools

Page tools

Other projects

Categories