Chemistry:Bland–Altman plot

Short description: Data visualization

Bland–Altman plot example

A Bland–Altman plot (difference plot) in analytical chemistry or biomedicine is a method of data plotting used in analyzing the agreement between two different assays. It is identical to a Tukey mean-difference plot, the name by which it is known in other fields, but was popularised in medical statistics by J. Martin Bland and Douglas G. Altman.

Agreement versus correlation

Bland and Altman drive the point that any two methods that are designed to measure the same parameter (or property) should have good correlation when a set of samples are chosen such that the property to be determined varies considerably. A high correlation for any two methods designed to measure the same property could thus in itself just be a sign that one has chosen a widespread sample. A high correlation does not necessarily imply that there is good agreement between the two methods.

Construction

Consider a sample consisting of [math]\displaystyle{ n }[/math] observations (for example, objects of unknown volume). Both assays (for example, different methods of volume measurement) are performed on each sample, resulting in [math]\displaystyle{ 2n }[/math] data points. Each of the [math]\displaystyle{ n }[/math] samples is then represented on the graph by assigning the mean of the two measurements as the [math]\displaystyle{ x }[/math]-value, and the difference between the two values as the [math]\displaystyle{ y }[/math]-value.

The Cartesian coordinates of a given sample [math]\displaystyle{ S }[/math] with values of [math]\displaystyle{ S_1 }[/math] and [math]\displaystyle{ S_2 }[/math] determined by the two assays is

[math]\displaystyle{ S(x,y)=\left( \frac{S_1+S_2}{2}, S_1-S_2 \right). }[/math]

For comparing the dissimilarities between the two sets of samples independently from their mean values, it is more appropriate to look at the ratio of the pairs of measurements. Log transformation (base 2) of the measurements before the analysis will enable the standard approach to be used; so the plot will be given by the following equation:

[math]\displaystyle{ S(x,y)=\left( \frac{\log_2 S_1 +\log_2 S_2}{2}, \log_2 S_1 -\log_2 S_2 \right). }[/math]

This version of the plot is used in MA plot.

Application

One primary application of the Bland–Altman plot is to compare two clinical measurements each of which produced some error in their measures. It can also be used to compare a new measurement technique or method with a gold standard, as even a gold standard does not—and should not—imply it to be without error. See Analyse-it, MedCalc, NCSS, GraphPad Prism, R, StatsDirect, or JASP for software providing Bland–Altman plots.

Bland–Altman plots are extensively used to evaluate the agreement among two different instruments or two measurements techniques. Bland–Altman plots allow identification of any systematic difference between the measurements (i.e., fixed bias) or possible outliers. The mean difference is the estimated bias, and the SD of the differences measures the random fluctuations around this mean. If the mean value of the difference differs significantly from 0 on the basis of a 1-sample t-test, this indicates the presence of fixed bias. If there is a consistent bias, it can be adjusted for by subtracting the mean difference from the new method. It is common to compute 95% limits of agreement for each comparison (average difference ± 1.96 standard deviation of the difference), which tells us how far apart measurements by two methods were more likely to be for most individuals. If the differences within mean ± 1.96 SD are not clinically important, the two methods may be used interchangeably. The 95% limits of agreement can be unreliable estimates of the population parameters especially for small sample sizes so, when comparing methods or assessing repeatability, it is important to calculate confidence intervals for 95% limits of agreement. This can be done by Bland and Altman's approximate method or by more precise methods.

Bland–Altman plot showing likely proportional bias

Bland–Altman plots were also used to investigate any possible relationship of the discrepancies between the measurements and the true value (i.e., proportional bias). The existence of proportional bias indicates that the methods do not agree equally through the range of measurements (i.e., the limits of agreement will depend on the actual measurement). To evaluate this relationship formally, the difference between the methods should be regressed on the average of the 2 methods. When a relationship between the differences and the true value was identified (i.e., a significant slope of the regression line), regression-based 95% limits of agreement should be provided.

See also

• MA plot
• Gardner–Altman plot

Notes

A similar method was proposed in 1981 by Eksborg. This method was based on Deming regression—a method introduced by Adcock in 1878.

Bland and Altman's Lancet paper was number 29 in a list of the top 100 most-cited papers of all time with over 23,000 citations.