Total sum of squares

From HandWiki
Revision as of 20:00, 6 March 2023 by John Marlo (talk | contribs) (update)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Short description: Statistical quantity

In statistical data analysis the total sum of squares (TSS or SST) is a quantity that appears as part of a standard way of presenting results of such analyses. For a set of observations, [math]\displaystyle{ y_i, i\leq n }[/math], it is defined as the sum over all squared differences between the observations and their overall mean [math]\displaystyle{ \bar{y} }[/math].:[1]

[math]\displaystyle{ \mathrm{TSS}=\sum_{i=1}^{n}\left(y_{i}-\bar{y}\right)^2 }[/math]

For wide classes of linear models, the total sum of squares equals the explained sum of squares plus the residual sum of squares. For proof of this in the multivariate OLS case, see partitioning in the general OLS model.

In analysis of variance (ANOVA) the total sum of squares is the sum of the so-called "within-samples" sum of squares and "between-samples" sum of squares, i.e., partitioning of the sum of squares. In multivariate analysis of variance (MANOVA) the following equation applies[2]

[math]\displaystyle{ \mathbf{T} = \mathbf{W} + \mathbf{B}, }[/math]

where T is the total sum of squares and products (SSP) matrix, W is the within-samples SSP matrix and B is the between-samples SSP matrix. Similar terminology may also be used in linear discriminant analysis, where W and B are respectively referred to as the within-groups and between-groups SSP matrices.[2]

See also

References

  1. Everitt, B.S. (2002) The Cambridge Dictionary of Statistics, CUP, ISBN:0-521-81099-X
  2. 2.0 2.1 K. V. Mardia, J. T. Kent and J. M. Bibby (1979). Multivariate Analysis. Academic Press. ISBN 0-12-471252-5.  Especially chapters 11 and 12.