Heckman correction

Short description: Statistical technique correcting sampling bias

The Heckman correction is a statistical technique to correct bias from non-randomly selected samples or otherwise incidentally truncated dependent variables, a pervasive issue in quantitative social sciences when using observational data. Conceptually, this is achieved by explicitly modelling the individual sampling probability of each observation (the so-called selection equation) together with the conditional expectation of the dependent variable (the so-called outcome equation). The resulting likelihood function is mathematically similar to the tobit model for censored dependent variables, a connection first drawn by James Heckman in 1974. Heckman also developed a two-step control function approach to estimate this model, which avoids the computational burden of having to estimate both equations jointly, albeit at the cost of inefficiency. Heckman received the Nobel Memorial Prize in Economic Sciences in 2000 for his work in this field.

Method

Statistical analyses based on non-randomly selected samples can lead to erroneous conclusions. The Heckman correction, a two-step statistical approach, offers a means of correcting for non-randomly selected samples.

Heckman discussed bias from using nonrandom selected samples to estimate behavioral relationships as a specification error. He suggests a two-stage estimation method to correct the bias. The correction uses a control function idea and is easy to implement. Heckman's correction involves a normality assumption, provides a test for sample selection bias and formula for bias corrected model.

Suppose that a researcher wants to estimate the determinants of wage offers, but has access to wage observations for only those who work. Since people who work are selected non-randomly from the population, estimating the determinants of wages from the subpopulation who work may introduce bias. The Heckman correction takes place in two stages.

In the first stage, the researcher formulates a model, based on economic theory, for the probability of working. The canonical specification for this relationship is a probit regression of the form

[math]\displaystyle{ \operatorname{Prob}( D = 1 | Z ) = \Phi(Z\gamma), }[/math]

where D indicates employment (D = 1 if the respondent is employed and D = 0 otherwise), Z is a vector of explanatory variables, [math]\displaystyle{ \gamma }[/math] is a vector of unknown parameters, and Φ is the cumulative distribution function of the standard normal distribution. Estimation of the model yields results that can be used to predict this employment probability for each individual.

In the second stage, the researcher corrects for self-selection by incorporating a transformation of these predicted individual probabilities as an additional explanatory variable. The wage equation may be specified,

[math]\displaystyle{ w^* = X\beta + u }[/math]

where [math]\displaystyle{ w^* }[/math] denotes an underlying wage offer, which is not observed if the respondent does not work. The conditional expectation of wages given the person works is then

[math]\displaystyle{ E [ w | X, D=1 ] = X\beta + E [ u | X, D=1 ]. }[/math]

Under the assumption that the error terms are jointly normal, we have

[math]\displaystyle{ E [ w | X, D=1 ] = X\beta + \rho\sigma_u \lambda(Z\gamma), }[/math]

where ρ is the correlation between unobserved determinants of propensity to work [math]\displaystyle{ \varepsilon }[/math] and unobserved determinants of wage offers u, σ _u is the standard deviation of [math]\displaystyle{ u }[/math], and [math]\displaystyle{ \lambda }[/math] is the inverse Mills ratio evaluated at [math]\displaystyle{ Z\gamma }[/math]. This equation demonstrates Heckman's insight that sample selection can be viewed as a form of omitted-variables bias, as conditional on both X and on [math]\displaystyle{ \lambda }[/math] it is as if the sample is randomly selected. The wage equation can be estimated by replacing [math]\displaystyle{ \gamma }[/math] with Probit estimates from the first stage, constructing the [math]\displaystyle{ \lambda }[/math] term, and including it as an additional explanatory variable in linear regression estimation of the wage equation. Since [math]\displaystyle{ \sigma_u \gt 0 }[/math], the coefficient on [math]\displaystyle{ \lambda }[/math] can only be zero if [math]\displaystyle{ \rho=0 }[/math], so testing the null that the coefficient on [math]\displaystyle{ \lambda }[/math] is zero is equivalent to testing for sample selectivity.

Heckman's achievements have generated a large number of empirical applications in economics as well as in other social sciences. The original method has subsequently been generalized, by Heckman and by others.

Statistical inference

The Heckman correction is a two-step M-estimator where the covariance matrix generated by OLS estimation of the second stage is inconsistent. Correct standard errors and other statistics can be generated from an asymptotic approximation or by resampling, such as through a bootstrap.

Disadvantages

• The two-step estimator discussed above is a limited information maximum likelihood (LIML) estimator. In asymptotic theory and in finite samples as demonstrated by Monte Carlo simulations, the full information (FIML) estimator exhibits better statistical properties. However, the FIML estimator is more computationally difficult to implement.
• The canonical model assumes the errors are jointly normal. If that assumption fails, the estimator is generally inconsistent and can provide misleading inference in small samples. Semiparametric and other robust alternatives can be used in such cases.
• The model obtains formal identification from the normality assumption when the same covariates appear in the selection equation and the equation of interest, but identification will be tenuous unless there are many observations in the tails where there is substantial nonlinearity in the inverse Mills ratio. Generally, an exclusion restriction is required to generate credible estimates: there must be at least one variable which appears with a non-zero coefficient in the selection equation but does not appear in the equation of interest, essentially an instrument. If no such variable is available, it may be difficult to correct for sampling selectivity. The reason for this is two-fold: Without an instrument, identification relies on the functional form assumption that is typically considered very weak. Furthermore, even if the assumption holds, the chosen function can be very close to a linear functional form in the area under investigation, causing a multicollinearity problem in the second stage.

Implementations in statistics packages

• R: Heckman-type procedures are available as part of the sampleSelection package.
• Stata: the command heckman provides the Heckman selection model.

See also

• Propensity score matching – Statistical matching technique
• Finance:Roy model – Model for self-selection in economics

Further reading

• Achen, Christopher H. (1986). "Estimating Treatment Effects in Quasi-Experiments : The Case of Censored Data". The Statistical Analysis of Quasi-Experiments. Berkeley: University of California Press. pp. 97–137. ISBN 0-520-04723-0. https://books.google.com/books?id=Qbk8XgU57aQC&pg=PA97. 
• Breen, Richard (1996). Regression Models : Censored, Sample Selected, or Truncated Data. Thousand Oaks: Sage. pp. 33–48. ISBN 0-8039-5710-6. https://books.google.com/books?id=btrvKnZSqIIC&pg=PA33. 
• Fu, Vincent Kang; Winship, Christopher; Mare, Robert D. (2004). "Sample Selection Bias Models". in Hardy, Melissa; Bryman, Alan. Handbook of Data Analysis. London: Sage. pp. 409–430. doi:10.4135/9781848608184.n18. ISBN 0-7619-6652-8. 
• Greene, William H. (2012). "Incidental Truncation and Sample Selection". Econometric Analysis (Seventh ed.). Boston: Pearson. pp. 912–27. ISBN 978-0-273-75356-8. 
• Vella, Francis (1998). "Estimating Models with Sample Selection Bias: A Survey". Journal of Human Resources 33 (1): 127–169. doi:10.2307/146317. 

External links

• Nobel prize Heckman facts.