Breusch–Pagan test

Short description: Statistical test

In statistics, the Breusch–Pagan test, developed in 1979 by Trevor Breusch and Adrian Pagan, is used to test for heteroskedasticity in a linear regression model. It was independently suggested with some extension by R. Dennis Cook and Sanford Weisberg in 1983 (Cook–Weisberg test). Derived from the Lagrange multiplier test principle, it tests whether the variance of the errors from a regression is dependent on the values of the independent variables. In that case, heteroskedasticity is present.

Suppose that we estimate the regression model

[math]\displaystyle{ y = \beta_0 + \beta_1 x + u, \, }[/math]

and obtain from this fitted model a set of values for [math]\displaystyle{ \widehat{u} }[/math], the residuals. Ordinary least squares constrains these so that their mean is 0 and so, given the assumption that their variance does not depend on the independent variables, an estimate of this variance can be obtained from the average of the squared values of the residuals. If the assumption is not held to be true, a simple model might be that the variance is linearly related to independent variables. Such a model can be examined by regressing the squared residuals on the independent variables, using an auxiliary regression equation of the form

[math]\displaystyle{ \widehat{u}^2 = \gamma_0 + \gamma_1 x + v.\, }[/math]

This is the basis of the Breusch–Pagan test. It is a chi-squared test: the test statistic is distributed nχ² with k degrees of freedom. If the test statistic has a p-value below an appropriate threshold (e.g. p < 0.05) then the null hypothesis of homoskedasticity is rejected and heteroskedasticity assumed.

If the Breusch–Pagan test shows that there is conditional heteroskedasticity, one could either use weighted least squares (if the source of heteroskedasticity is known) or use heteroscedasticity-consistent standard errors.

Procedure

Under the classical assumptions, ordinary least squares is the best linear unbiased estimator (BLUE), i.e., it is unbiased and efficient. It remains unbiased under heteroskedasticity, but efficiency is lost. Before deciding upon an estimation method, one may conduct the Breusch–Pagan test to examine the presence of heteroskedasticity. The Breusch–Pagan test is based on models of the type [math]\displaystyle{ \sigma_i^2 = h(z_i'\gamma) }[/math] for the variances of the observations where [math]\displaystyle{ z_i = (1, z_{2i}, \ldots, z_{pi}) }[/math] explain the difference in the variances. The null hypothesis is equivalent to the [math]\displaystyle{ (p - 1)\, }[/math] parameter restrictions:

[math]\displaystyle{ \gamma_2 = \cdots = \gamma_p = 0. }[/math]

The following Lagrange multiplier (LM) yields the test statistic for the Breusch–Pagan test:

[math]\displaystyle{ \text{LM}=\left (\frac{\partial\ell}{\partial\theta} \right )^{\mathsf{T}} \left (-E\left [\frac{\partial^2\ell}{\partial\theta\, \partial\theta'} \right ] \right )^{-1} \left(\frac{\partial\ell}{\partial\theta} \right ). }[/math]

This test can be implemented via the following three-step procedure:

• Step 1: Apply OLS in the model

[math]\displaystyle{ y_i = X_i\beta+\varepsilon_i, \quad i=1,\dots{},n }[/math]

• Step 2: Compute the regression residuals, [math]\displaystyle{ \hat{\varepsilon}_i }[/math], square them, and divide by the Maximum Likelihood estimate of the error variance from the Step 1 regression, to obtain what Breusch and Pagan call [math]\displaystyle{ g_i }[/math]:

[math]\displaystyle{ g_i = \hat{\varepsilon}_i^2 / \hat{\sigma}^2, \quad \hat{\sigma}^2 = \sum{\hat{\varepsilon}_i^2}/n }[/math]

• Step 2: Estimate the auxiliary regression

[math]\displaystyle{ g_i=\gamma_1+\gamma_2z_{2i}+\cdots+\gamma_pz_{pi}+\eta_i. }[/math]

where the z terms will typically but not necessarily be the same as the original covariates x.

• Step 3: The LM test statistic is then half of the explained sum of squares from the auxiliary regression in Step 2:

[math]\displaystyle{ \text{LM}=\frac{1}{2}\left(\text{TSS} - \text{SSR}\right). }[/math]

where TSS is the sum of squared deviations of the [math]\displaystyle{ g_i }[/math] from their mean of 1, and SSR is the sum of squared residuals from the auxiliary regression. The test statistic is asymptotically distributed as [math]\displaystyle{ \chi^2_{p - 1} }[/math] under the null hypothesis of homoskedasticity and normally distributed [math]\displaystyle{ \varepsilon_i }[/math], as proved by Breusch and Pagan in their 1979 paper.

Robust variant

A variant of this test, robust in the case of a non-Gaussian error term, was proposed by Roger Koenker. In this variant, the dependent variable in the auxiliary regression is just the squared residual from the Step 1 regression, [math]\displaystyle{ \hat{\varepsilon}_i^2 }[/math], and the test statistic is [math]\displaystyle{ nR^2 }[/math] from the auxiliary regression. As Koenker notes (1981, page 111), while the revised statistic has correct asymptotic size its power "may be quite poor except under idealized Gaussian conditions."

Software

In R, this test is performed by the function ncvTest available in the car package, the function bptest available in the lmtest package, the function plmtest available in the plm package, or the function breusch_pagan available in the skedastic package.

In Stata, one specifies the full regression, and then enters the command estat hettest followed by all independent variables.

In SAS, Breusch–Pagan can be obtained using the Proc Model option.

In Python, there is a method het_breuschpagan in statsmodels.stats.diagnostic (the statsmodels package) for Breusch–Pagan test.

In gretl, the command modtest --breusch-pagan can be applied following an OLS regression.

See also

• Glejser test
• Goldfeld–Quandt test
• Park test
• White test

Further reading

• Gujarati, Damodar N.; Porter, Dawn C. (2009). Basic Econometrics (Fifth ed.). New York: McGraw-Hill Irwin. pp. 385–86. ISBN 978-0-07-337577-9. https://books.google.com/books?id=zJlDPgAACAAJ&pg=PA385. 
• Kmenta, Jan (1986). Elements of Econometrics (Second ed.). New York: Macmillan. pp. 292–298. ISBN 0-02-365070-2. https://archive.org/details/elementsofeconom0003kmen/page/292. 
• Krämer, W.; Sonnberger, H. (1986). The Linear Regression Model under Test. Heidelberg: Physica. pp. 32–39. ISBN 9783642958762. https://books.google.com/books?id=NSvqCAAAQBAJ&pg=PA32. 
• Maddala, G. S.; Lahiri, Kajal (2009). Introduction to Econometrics (Fourth ed.). Chichester: Wiley. pp. 216–218. ISBN 978-0-470-01512-4. https://books.google.com/books?id=vkQvQgAACAAJ&pg=PA216.