Arellano–Bond estimator

In econometrics, the Arellano–Bond estimator is a generalized method of moments estimator used to estimate dynamic models of panel data. It was proposed in 1991 by Manuel Arellano and Stephen Bond, based on the earlier work by Alok Bhargava and John Denis Sargan in 1983, for addressing certain endogeneity problems. The GMM-SYS estimator is a system that contains both the levels and the first difference equations. It provides an alternative to the standard first difference GMM estimator.

Qualitative description

Unlike static panel data models, dynamic panel data models include lagged levels of the dependent variable as regressors. Including a lagged dependent variable as a regressor violates strict exogeneity, because the lagged dependent variable is likely to be correlated with the random effects and/or the general errors. The Bhargava-Sargan article developed optimal linear combinations of predetermined variables from different time periods, provided sufficient conditions for identification of model parameters using restrictions across time periods, and developed tests for exogeneity for a subset of the variables. When the exogeneity assumptions are violated and correlation pattern between time varying variables and errors may be complicated, commonly used static panel data techniques such as fixed effects estimators are likely to produce inconsistent estimators because they require certain strict exogeneity assumptions.

Anderson and Hsiao (1981) first proposed a solution by utilising instrumental variables (IV) estimation. However, the Anderson–Hsiao estimator is asymptotically inefficient, as its asymptotic variance is higher than the Arellano–Bond estimator, which uses a similar set of instruments, but uses generalized method of moments estimation rather than instrumental variables estimation.

In the Arellano–Bond method, first difference of the regression equation are taken to eliminate the individual effects. Then, deeper lags of the dependent variable are used as instruments for differenced lags of the dependent variable (which are endogenous).

In traditional panel data techniques, adding deeper lags of the dependent variable reduces the number of observations available. For example, if observations are available at T time periods, then after first differencing, only T-1 lags are usable. Then, if K lags of the dependent variable are used as instruments, only T-K-1 observations are usable in the regression. This creates a trade-off: adding more lags provides more instruments, but reduces the sample size. The Arellano–Bond method circumvents this problem.

Formal description

Consider the static linear unobserved effects model for [math]\displaystyle{ N }[/math] observations and [math]\displaystyle{ T }[/math] time periods:

[math]\displaystyle{ y_{it} = X_{it}\mathbf{\beta}+\alpha_i+u_{it} }[/math] for [math]\displaystyle{ t=1,\ldots,T }[/math] and [math]\displaystyle{ i=1,\ldots,N }[/math]

where [math]\displaystyle{ y_{it} }[/math] is the dependent variable observed for individual [math]\displaystyle{ i }[/math] at time [math]\displaystyle{ t, }[/math] [math]\displaystyle{ X_{it} }[/math] is the time-variant [math]\displaystyle{ 1\times k }[/math] regressor matrix, [math]\displaystyle{ \alpha_i }[/math] is the unobserved time-invariant individual effect and [math]\displaystyle{ u_{it} }[/math] is the error term. Unlike [math]\displaystyle{ X_{it} }[/math], [math]\displaystyle{ \alpha_i }[/math] cannot be observed by the econometrician. Common examples for time-invariant effects [math]\displaystyle{ \alpha_i }[/math] are innate ability for individuals or historical and institutional factors for countries.

Unlike a static panel data model, a dynamic panel model also contains lags of the dependent variable as regressors, accounting for concepts such as momentum and inertia. In addition to the regressors outlined above, consider a case where one lag of the dependent variable is included as a regressor, [math]\displaystyle{ y_{it-1} }[/math].

[math]\displaystyle{ y_{it} = X_{it}\mathbf{\beta}+\rho y_{it-1}+\alpha_{i}+u_{it} \text{ for } t=2,\ldots,T \text{ and } i=1,\ldots,N }[/math]

Taking the first difference of this equation to eliminate the individual effect,

[math]\displaystyle{ \Delta y_{it}=y_{it}-y_{it-1}=\Delta X_{it}\beta + \rho\Delta\ y_{it-1} + \Delta u_{it} \text{ for } t=3,\ldots,T \text{ and } i=1,\ldots,N. }[/math]

Note that if [math]\displaystyle{ \alpha_i }[/math] had a time varying coefficient, then differencing the equation will not remove the individual effect. This equation can be re-written as,

[math]\displaystyle{ \Delta y=\Delta R \pi +\Delta u. }[/math]

Applying the formula for the Efficient Generalized Method of Moments Estimator, which is,

[math]\displaystyle{ \pi_\text{EGMM} = [\Delta R'Z(Z'\Omega Z)^{-1}Z'\,\Delta R]^{-1}\,\Delta R'Z(Z'\Omega Z)^{-1}Z'\Delta y }[/math]

where [math]\displaystyle{ Z }[/math] is the instrument matrix for [math]\displaystyle{ \Delta R }[/math].

The matrix [math]\displaystyle{ \Omega }[/math] can be calculated from the variance of the error terms, [math]\displaystyle{ u_{it} }[/math] for the one-step Arellano–Bond estimator or using the residual vectors of the one-step Arellano–Bond estimator for the two-step Arellano–Bond estimator, which is consistent and asymptotically efficient in the presence of heteroskedasticity.

Instrument matrix

The original Anderson and Hsiao (1981) IV estimator uses the following moment conditions:

[math]\displaystyle{ E(y_{it-I} \, \Delta u_{it}) = 0 \text{ with } I\ge 2 \text{ for each } t\ge 3. }[/math]

Using the single instrument [math]\displaystyle{ y_{it-2} }[/math], these moment conditions form the basis for the instrument matrix [math]\displaystyle{ Z_{di} }[/math]:

[math]\displaystyle{ Z_{di} = \begin{bmatrix}NA & (t=2) \\y_{i1} & (t=3) \\y_{i2} & (t=4) \\\vdots & \vdots \\y_{T-2} & (t=T) \end{bmatrix} }[/math]

Note: The first possible observation is t = 2 due to the first difference transformation

The instrument [math]\displaystyle{ y_{it-2} }[/math] enters as a single column. Since [math]\displaystyle{ y_{it-2} }[/math] is unavailable at [math]\displaystyle{ t=2 }[/math], all observations from [math]\displaystyle{ t=2 }[/math] must be dropped.

Using an additional instrument [math]\displaystyle{ y_{it-3} }[/math] would mean adding an additional column to [math]\displaystyle{ Z_{di} }[/math]. Thus, all observations from [math]\displaystyle{ t=3 }[/math] would have to be dropped.

While adding additional instruments increases the efficiency of the IV estimator, the smaller sample size decreases efficiency. This is the efficiency - sample size trade-off.

The Arellano-bond estimator addresses this trade-off by using time-specific instruments.

The Arellano–Bond estimator uses the following moment conditions

[math]\displaystyle{ E(y_{it-I} \, \Delta u_{it}) = 0 \text{ for } t\ge 3,\,I\ge 2. }[/math]

Using these moment conditions, the instrument matrix [math]\displaystyle{ Z_{di} }[/math] now becomes:

[math]\displaystyle{ Z_{di} = \begin{bmatrix}y_{i1} & 0 & 0 & 0 & 0 & 0 & \cdots \\0 & y_{i2} & y_{i1} & 0 & 0 & 0 & \cdots \\0 & 0 & 0 & y_{i3} & y_{i2} & y_{i1} & \cdots \\ \vdots & \vdots & \vdots & \vdots & \vdots & \vdots & \ddots \end{bmatrix} }[/math]

Note that the number of moments is increasing in the time period: this is how the efficiency - sample size tradeoff is avoided. Time periods further in the future have more lags available to use as instruments.

Then if one defines:

[math]\displaystyle{ \Delta u_i = \begin{bmatrix} \Delta u_{i3} \\ \Delta u_{i4}\\ \Delta u_{i5} \\ \vdots \end{bmatrix} }[/math]

The moment conditions can be summarized as:

[math]\displaystyle{ E(Z_{di}^T \, \Delta u_i) = 0 }[/math]

These moment conditions are only valid when the error term [math]\displaystyle{ u_{it} }[/math] has no serial correlation. If serial correlation is present, then the Arellano–Bond estimator can still be used under some circumstances, but deeper lags will be required. For example, if the error term [math]\displaystyle{ u_{it} }[/math] is correlated with all terms [math]\displaystyle{ u_{it-s} }[/math] for s[math]\displaystyle{ \leq }[/math]S (as would be the case if [math]\displaystyle{ u_{it} }[/math] were a MA(S) process), it would be necessary to use only lags of [math]\displaystyle{ y_{it} }[/math] of depth S + 1 or greater as instruments.

System GMM

When the variance of the individual effect term across individual observations is high, or when the stochastic process [math]\displaystyle{ y_{it} }[/math] is close to being a random walk, then the Arellano–Bond estimator may perform very poorly in finite samples. This is because the lagged dependent variables will be weak instruments in these circumstances.

Blundell and Bond (1998) derived a condition under which it is possible to use an additional set of moment conditions. These additional moment conditions can be used to improve the small sample performance of the Arellano–Bond estimator. Specifically, they advocated using the moment conditions:

[math]\displaystyle{ \operatorname{E}(\Delta y_{it-1}(\alpha_i + u_{it}))=0 \text{ for } t\geq3 }[/math] (1)

These additional moment conditions are valid under conditions provided in their paper. In this case, the full set of moment conditions can be written:

[math]\displaystyle{ \operatorname{E}(Z_{SYS,i}^T P_{i})=0 }[/math]

where

[math]\displaystyle{ P_i = \begin{pmatrix} \Delta u_{i} \\ u_{i3} \\ u_{i4} \\ u_{i5} \\ \vdots \end{pmatrix} }[/math]

and

[math]\displaystyle{ Z_{SYS,i}=\begin{pmatrix} Z_{di} & 0 & 0 & 0 \\ 0 & \Delta y_{i2} & 0 & 0 \\ 0 & 0 & \Delta y_{i3} & 0 \\ 0 & 0 & 0 & \ddots \end{pmatrix}. }[/math]

This method is known as system GMM. Note that the consistency and efficiency of the estimator depends on validity of the assumption that the errors can be decomposed as in equation (1). This assumption can be tested in empirical applications and likelihood ratio test often reject the simple random effects decomposition.

Implementations in statistics packages

• R: the Arellano–Bond estimator is available as part of the plm package.
• Stata: the commands xtabond and xtabond2 return Arellano–Bond estimators.

See also

• Random effects model
• Mixed model

Further reading

• Baltagi, Badi H. (2008). "Dynamic Panel Data Models". Econometric Analysis of Panel Data (4th ed.). John Wiley & Sons. pp. 147–180. ISBN 978-0-470-51886-1. https://books.google.com/books?id=oQdx_70Xmy0C&pg=PA147. 
• Cameron, A. Colin; Trivedi, Pravin K. (2005). "Dynamic Models". Microeconometrics: Methods and Applications. New York: Cambridge University Press. pp. 763–768. ISBN 0-521-84805-9. https://books.google.com/books?id=Zf0gCwxC9ocC&pg=PA763. 
• Hsiao, Cheng (2014). "Dynamic Simultaneous Equations Models". Analysis of Panel Data (3rd ed.). New York: Cambridge University Press. pp. 397–402. ISBN 978-1-107-65763-2. https://books.google.com/books?id=7LIkBQAAQBAJ&pg=PA397.