Relative change and difference
In any quantitative science, the terms relative change and relative difference are used to compare two quantities while taking into account the "sizes" of the things being compared, i.e. dividing by a standard or reference or starting value. The comparison is expressed as a ratio and is a unitless number. By multiplying these ratios by 100 they can be expressed as percentages so the terms percentage change, percent(age) difference, or relative percentage difference are also commonly used. The terms "change" and "difference" are used interchangeably.[1] Relative change is often used as a quantitative indicator of quality assurance and quality control for repeated measurements where the outcomes are expected to be the same. A special case of percent change (relative change expressed as a percentage) called percent error occurs in measuring situations where the reference value is the accepted or actual value (perhaps theoretically determined) and the value being compared to it is experimentally determined (by measurement).
The relative change formula is not well-behaved under many conditions and various alternative formulas, called indicators of relative difference or change, have been proposed in the literature. Several authors have found log change and log points to be satisfactory indicators, but these have not seen widespread use.
Definition
Given two numerical quantities, vref and v, with vref a reference value (a theoretical/actual/correct/accepted/optimal/starting/base, etc. value), their actual change, actual difference, or absolute change is Δv = v − vref. The term absolute difference is sometimes also used even though the absolute value is not taken; the sign of Δ typically is uniform, e.g. across an increasing data series. If the relationship of the value with respect to the reference value (that is, larger or smaller) does not matter in a particular application, the absolute value may be used in place of the actual change in the above formula to produce a value for the relative change which is always non-negative. The actual difference is not usually a good way to compare the numbers, in particular because it depends on the unit of measurement. For instance, 1 meter is the same as 100 centimeters, but the absolute difference between 2 m and 1 m is 1 while the absolute difference between 200 cm and 100 cm is 100, giving the impression of a larger difference.[2] But even with constant units, the relative change helps judge the importance of the respective change. For example, an increase in price of $100 of a valuable is considered big if changing from $50 to $150 but rather small when changing from $10000 to $10100.
We can adjust the comparison to take into account the "size" of the quantities involved, by defining, for positive values of vref:
[math]\displaystyle{ \text{Relative change}(v_\text{ref}, v) = \frac{\text{Actual change}}{v_\text{ref}} = \frac{v - v_\text{ref}}{v_\text{ref}}. }[/math]
The relative change is independent of the unit of measurement employed; for example, the relative change from 2 meters to 1 meter is -50%, the same as for 200 cm to 100 cm. The relative change is not defined if the reference value (vref) is zero, and gives negative values for positive increases if vref is negative, hence it is not usually defined for negative reference values either. For example, we might want to calculate the relative change of −10 to −6. The above formula gives ((−6) − (−10)) / (−10) = 4 / −10 = −0.4, indicating a decrease, yet in fact the reading increased.
Measures of relative difference are unitless numbers expressed as a fraction. Corresponding values of percent difference would be obtained by multiplying these values by 100 (and appending the % sign to indicate that the value is a percentage).
Domain
The domain restriction of relative change to positive numbers often poses a constraint. To avoid this problem it is common to take the absolute value, so that the relative change formula works correctly for all nonzero values of vref:
[math]\displaystyle{ \text{Relative change}(v_\text{ref}, v) = \frac{v - v_\text{ref}}{|v_\text{ref}|}. }[/math]
This still does not solve the issue when the reference is zero. It is common to instead use an indicator of relative difference, and take the absolute values of both [math]\displaystyle{ v }[/math] and [math]\displaystyle{ v_\text{reference} }[/math]. Then the only problematic case is [math]\displaystyle{ v=v_\text{reference}=0 }[/math], which can usually be addressed by appropriately extending the indicator. For example, for arithmetic mean this formula may be used:[citation needed] [math]\displaystyle{ d_r=\frac{\big||x|-|y|\big|}{\left(\frac{|x|+|y|}{2}\right)}, d_r(0,0)=0 }[/math]
Percent error
The percent error is a special case of the percentage form of relative change calculated from the absolute change between the experimental (measured) and theoretical (accepted) values, and dividing by the theoretical (accepted) value.
[math]\displaystyle{ \%\text{ Error} = \frac{|\text{Experimental}-\text{Theoretical}|}{|\text{Theoretical}|}\times 100. }[/math]
The terms "Experimental" and "Theoretical" used in the equation above are commonly replaced with similar terms. Other terms used for experimental could be "measured," "calculated," or "actual" and another term used for theoretical could be "accepted." Experimental value is what has been derived by use of calculation and/or measurement and is having its accuracy tested against the theoretical value, a value that is accepted by the scientific community or a value that could be seen as a goal for a successful result.
Although it is common practice to use the absolute value version of relative change when discussing percent error, in some situations, it can be beneficial to remove the absolute values to provide more information about the result. Thus, if an experimental value is less than the theoretical value, the percent error will be negative. This negative result provides additional information about the experimental result. For example, experimentally calculating the speed of light and coming up with a negative percent error says that the experimental value is a velocity that is less than the speed of light. This is a big difference from getting a positive percent error, which means the experimental value is a velocity that is greater than the speed of light (violating the theory of relativity) and is a newsworthy result.
The percent error equation, when rewritten by removing the absolute values, becomes: [math]\displaystyle{ \%\text{ Error} = \frac{\text{Experimental}-\text{Theoretical}}{|\text{Theoretical}|}\times100. }[/math]
It is important to note that the two values in the numerator do not commute. Therefore, it is vital to preserve the order as above: subtract the theoretical value from the experimental value and not vice versa.
Percentage change
A percentage change is a way to express a change in a variable. It represents the relative change between the old value and the new one.[3]
For example, if a house is worth $100,000 today and the year after its value goes up to $110,000, the percentage change of its value can be expressed as [math]\displaystyle{ \frac{110000-100000}{100000} = 0.1 = 10\%. }[/math]
It can then be said that the worth of the house went up by 10%.
More generally, if V1 represents the old value and V2 the new one, [math]\displaystyle{ \text{Percentage change} = \frac{\Delta V}{V_1} = \frac{V_2 - V_1}{V_1} \times100\% . }[/math]
Some calculators directly support this via a %CH or Δ% function.
When the variable in question is a percentage itself, it is better to talk about its change by using percentage points, to avoid confusion between relative difference and absolute difference.
Example of percentages of percentages
If a bank were to raise the interest rate on a savings account from 3% to 4%, the statement that "the interest rate was increased by 1%" would be ambiguous. The absolute change in this situation is 1 percentage point (4% − 3%), but the relative change in the interest rate is: [math]\displaystyle{ \frac{4\% - 3\%}{3\%} = 0.333\ldots = 33\frac{1}{3}\%. }[/math]
In general, the term "percentage point(s)" indicates an absolute change or difference of percentages, while the percent sign or the word "percentage" refers to the relative change or difference.[4]
Examples
Comparisons
Car M costs $50,000 and car L costs $40,000. We wish to compare these costs.[5] With respect to car L, the absolute difference is $10,000 = $50,000 − $40,000. That is, car M costs $10,000 more than car L. The relative difference is, [math]\displaystyle{ \frac{\$10,000}{\$40,000} = 0.25 = 25\%, }[/math] and we say that car M costs 25% more than car L. It is also common to express the comparison as a ratio, which in this example is, [math]\displaystyle{ \frac{\$50,000}{\$40,000} = 1.25 = 125\%, }[/math] and we say that car M costs 125% of the cost of car L.
In this example the cost of car L was considered the reference value, but we could have made the choice the other way and considered the cost of car M as the reference value. The absolute difference is now −$10,000 = $40,000 − $50,000 since car L costs $10,000 less than car M. The relative difference, [math]\displaystyle{ \frac{-\$10,000}{\$50,000} = -0.20 = -20\% }[/math] is also negative since car L costs 20% less than car M. The ratio form of the comparison, [math]\displaystyle{ \frac{\$40,000}{\$50,000} = 0.8 = 80\% }[/math] says that car L costs 80% of what car M costs.
It is the use of the words "of" and "less/more than" that distinguish between ratios and relative differences.[6]
Indicators of relative change
The (classical) relative change above is but one of the possible measures/indicators of relative change or difference. An indicator of relative change from x (initial or reference value) to y (new value) [math]\displaystyle{ R(x,y) }[/math] is a binary real-valued function defined for the domain of interest which satisfies the following properties:[7]
- Appropriate sign: [math]\displaystyle{ R(x,y)\gt 0 }[/math] iff [math]\displaystyle{ y\gt x }[/math], [math]\displaystyle{ R(x,y)= 0 }[/math] iff [math]\displaystyle{ y=x }[/math], [math]\displaystyle{ R(x,y)\lt 0 }[/math] iff [math]\displaystyle{ y\lt x }[/math].
- [math]\displaystyle{ R }[/math] is an increasing function of [math]\displaystyle{ y }[/math] when [math]\displaystyle{ x }[/math] is fixed.
- [math]\displaystyle{ R }[/math] is continuous.
- Independent of the unit of measurement: for all [math]\displaystyle{ a\gt 0 }[/math], [math]\displaystyle{ R(ax,ay)=R(x,y) }[/math].
Due to the independence condition, every such function [math]\displaystyle{ R }[/math] can be written as a single argument function [math]\displaystyle{ H }[/math] of the ratio [math]\displaystyle{ y/x }[/math].[8] It is also clear that if [math]\displaystyle{ H(y/x) }[/math] satisfies the other conditions then [math]\displaystyle{ c H(y/x) }[/math] will as well, for every [math]\displaystyle{ c\gt 0 }[/math]. We thus further restrict indicators to be normalized such that [math]\displaystyle{ H'(1) = 1 }[/math]. It can be shown that this implies all such indicators behave like the classical one when [math]\displaystyle{ y/x }[/math] is close to [math]\displaystyle{ 1 }[/math].
Usually the indicator of relative difference is presented as the actual difference Δ scaled by some function of the values x and y, say f(x, y).[1]
[math]\displaystyle{ \text{Relative change}(x, y) = \frac{\text{Actual change}\,\Delta}{f(x,y)} = \frac{y - x}{f(x,y)}. }[/math]
As with classical relative change, the general relative change is undefined if f(x, y) is zero. Various choices for the function f(x, y) have been proposed:[9]
| Name | [math]\displaystyle{ f(x,y) }[/math] where the indicator's value is [math]\displaystyle{ (y-x)/f(x,y) }[/math] | [math]\displaystyle{ H(y/x) }[/math] |
|---|---|---|
| (Classical) Relative change | [math]\displaystyle{ x }[/math] | [math]\displaystyle{ (y/x) - 1 }[/math] |
| Reversed relative change | [math]\displaystyle{ y }[/math] | [math]\displaystyle{ 1-(x/y) }[/math] |
| Arithmetic mean change | [math]\displaystyle{ \frac{1}{2}(x + y) }[/math] | [math]\displaystyle{ ((y/x) - 1)/\frac{1}{2}(1 + (y/x)) }[/math] |
| Geometric mean change | [math]\displaystyle{ \sqrt{xy} }[/math] | [math]\displaystyle{ ((y/x) - 1)/\sqrt{y/x} }[/math] |
| Harmonic mean change | [math]\displaystyle{ 2/(1/x+1/y) }[/math] | [math]\displaystyle{ ((y/x) - 1)(1+(x/y))/2 }[/math] |
| Moment mean change of order [math]\displaystyle{ k }[/math] | [math]\displaystyle{ (\frac{1}{2}(x^k+y^k))^{1/k} }[/math] | [math]\displaystyle{ ((y/x) - 1)/[\frac{1}{2}(1+(y/x)^k))]^{1/k} }[/math] |
| Maximum mean change | [math]\displaystyle{ \max(x,y) }[/math] | [math]\displaystyle{ ((y/x) - 1)/\max(1,y/x) }[/math] |
| Minimum mean change | [math]\displaystyle{ \min(x,y) }[/math] | [math]\displaystyle{ ((y/x) - 1)/\min(1,y/x) }[/math] |
| Logarithmic (mean) change | [math]\displaystyle{ \begin{cases} (y-x)/\ln(y/x) & x \neq y \\ x & x = y \end{cases} }[/math] | [math]\displaystyle{ \ln(y/x) }[/math] |
As can be seen in the table, all but the first two indicators have, as denominator a mean. One of the properties of a mean function [math]\displaystyle{ m(x,y) }[/math] is:[9] [math]\displaystyle{ m(x,y)=m(y,x) }[/math], which means that all such indicators have a "symmetry" property that the classical relative change lacks: [math]\displaystyle{ R(x,y)=-R(y,x) }[/math]. This agrees with intuition that a relative change from x to y should have the same magnitude as a relative change in the opposite direction, y to x, just like the relation [math]\displaystyle{ y/x = 1/(x/y) }[/math] suggests.
Maximum mean change has been recommended when comparing floating point values in programming languages for equality with a certain tolerance.[10] Another application is in the computation of approximation errors when the relative error of a measurement is required.[citation needed] Minimum mean change has been recommended for use in econometrics.[11][12] Logarithmic change has been recommended as a general-purpose replacement for relative change and is discussed more below.
Tenhunen defines a general relative difference function from L (reference value) to K:[13] [math]\displaystyle{ H(K,L) = \begin{cases} \int_1^{K/L} t^{c-1} dt & \text{when } K\gt L \\ -\int_{K/L}^1 t^{c-1} dt & \text{when } K\lt L \end{cases} }[/math]
which leads to
[math]\displaystyle{ H(K,L) = \begin{cases} \frac{1}{c} \cdot ((K/L)^c-1) & c \neq 0 \\ \ln(K/L) & c = 0, K \gt 0, L \gt 0 \end{cases} }[/math]
In particular for the special cases [math]\displaystyle{ c=\pm 1 }[/math],
[math]\displaystyle{ H(K,L) = \begin{cases} (K-L)/K & c=-1 \\ (K-L)/L & c=1 \end{cases} }[/math]
Logarithmic change
Of these indicators of relative change, the most natural arguably is the natural logarithm (ln) of the ratio of the two numbers (final and initial), called log change.[1] Indeed, when [math]\displaystyle{ \left | \frac{V_1 - V_0}{V_0} \right | \ll 1 }[/math], the following approximation holds: [math]\displaystyle{ \ln\frac{V_1}{V_0} = \int_{V_0}^{V_1}\frac{{\mathrm d}V}{V} \approx \int_{V_0}^{V_1}\frac{{\mathrm d}V}{V_0} = \frac{V_1 - V_0}{V_0} = \text{classical relative change} }[/math]
In the same way that relative change is scaled by 100 to get percentages, [math]\displaystyle{ \ln\frac{V_1}{V_0} }[/math] can be scaled by 100 to get what is commonly called log points.[14] Log points are equivalent to the unit centinepers (cNp) when measured for root-power quantities.[15][16] This quantity has also been referred to as a log percentage and denoted L%.[1] Since the derivative of the natural log at 1 is 1, log points are approximately equal to percentage difference for small differences – for example an increase of 1% equals an increase of 0.995 cNp, and a 5% increase gives a 4.88 cNp increase. This approximation property does not hold for other choices of logarithm base, which introduce a scaling factor due to the derivative not being 1. Log points can thus be used as a replacement for percentage differences.[17][15]
Additivity
Using log change has the advantages of additivity compared to relative change.[1][15] Specifically, when using log change, the total change after a series of changes equals the sum of the changes. With percent, summing the changes is only an approximation, with larger error for larger changes.[15] For example:
| Log change 0 (cNp) | Log change 1 (cNp) | Total log change (cNp) | Relative change 0 (%) | Relative change 1 (%) | Total relative change (%) |
|---|---|---|---|---|---|
| 10 | 5 | 15 | 10 | 5 | 15.5 |
| 10 | −5 | 5 | 10 | −5 | 4.5 |
| 10 | 10 | 20 | 10 | 10 | 21 |
| 10 | −10 | 0 | 10 | −10 | −1 |
| 50 | 50 | 100 | 50 | 50 | 125 |
| 50 | −50 | 0 | 50 | −50 | −25 |
Note that in the above table, since relative change 0 (respectively relative change 1) has the same numerical value as log change 0 (respectively log change 1), it does not correspond to the same variation. The conversion between relative and log changes may be computed as [math]\displaystyle{ \text{log change} = \ln(1 + \text{relative change}) }[/math].
By additivity, [math]\displaystyle{ \ln\frac{V_1}{V_0} + \ln\frac{V_0}{V_1} = 0 }[/math], and therefore additivity implies a sort of symmetry property, namely [math]\displaystyle{ \ln\frac{V_1}{V_0} = - \ln\frac{V_0}{V_1} }[/math] and thus the magnitude of a change expressed in log change is the same whether V0 or V1 is chosen as the reference.[15] In contrast, for relative change, [math]\displaystyle{ \frac{V_1 - V_0}{V_0} \neq - \frac{V_0 - V_1}{V_1} }[/math], with the difference [math]\displaystyle{ \frac{(V_1 - V_0)^2}{V_0 V_1} }[/math] becoming larger as V1 or V0 approaches 0 while the other remains fixed. For example:
| V0 | V1 | Log change (cNp) | Relative change (%) |
|---|---|---|---|
| 10 | 9 | −10.5 | −10.0 |
| 9 | 10 | +10.5 | +11.1 |
| 10 | 1 | −230 | −90 |
| 1 | 10 | +230 | +900 |
| 10 | 0+ | −∞ | −100 |
| 0+ | 10 | +∞ | +∞ |
Here 0+ means taking the limit from above towards 0.
Uniqueness and extensions
The log change is the unique two-variable function that is additive, and whose linearization matches relative change. There is a family of additive difference functions [math]\displaystyle{ F_\lambda(x,y) }[/math] for any [math]\displaystyle{ \lambda\in\mathbb{R} }[/math], such that absolute change is [math]\displaystyle{ F_0 }[/math] and log change is [math]\displaystyle{ F_1 }[/math].[18]
See also
- Approximation error
- Errors and residuals in statistics
- Relative standard deviation
- Logarithmic scale
Notes
- ↑ 1.0 1.1 1.2 1.3 1.4 Törnqvist, Vartia & Vartia 1985.
- ↑ Vartia 1976, p. 9.
- ↑ Kazmi, Kumail (March 26, 2021). "Percentage Increase Calculator". Smadent Publishing. https://www.smadent.com/percentage-increase-calculator/.
- ↑ Bennett & Briggs 2005, p. 141
- ↑ Bennett & Briggs 2005, pp. 137–139
- ↑ Bennett & Briggs 2005, p.140
- ↑ Vartia 1976, p. 10.
- ↑ Vartia 1976, p. 14.
- ↑ 9.0 9.1 9.2 Törnqvist, Vartia & Vartia 1985, p. 5.
- ↑ What's a good way to check for close enough floating-point equality
- ↑ Rao, Potluri; Miller, Roger LeRoy (1971). Applied econometrics. Belmont, Calif., Wadsworth Pub. Co. p. 17. ISBN 978-0-534-00031-8. https://archive.org/details/appliedeconometr0000raop/page/16/mode/2up.
- ↑ Vartia 1976, pp. 17-18.
- ↑ Tenhunen 1990, p. 20.
- ↑ Békés, Gábor; Kézdi, Gábor (6 May 2021) (in en). Data Analysis for Business, Economics, and Policy. Cambridge University Press. p. 203. ISBN 978-1-108-48301-8. https://books.google.com/books?id=1TorEAAAQBAJ&pg=PA203.
- ↑ 15.0 15.1 15.2 15.3 15.4 Karjus, Andres; Blythe, Richard A.; Kirby, Simon; Smith, Kenny (10 February 2020). "Quantifying the dynamics of topical fluctuations in language". Language Dynamics and Change 10 (1): Section A.3.1. doi:10.1163/22105832-01001200. https://brill.com/view/journals/ldc/10/1/article-p86_5.xml#d55925245e1287.
- ↑ Roe, John; deForest, Russ; Jamshidi, Sara (26 April 2018) (in en). Mathematics for Sustainability. Springer. p. 190. doi:10.1007/978-3-319-76660-7_4. ISBN 978-3-319-76660-7. https://books.google.com/books?id=3ppYDwAAQBAJ&dq=centinepers&pg=PA190.
- ↑ Doyle, Patrick (2016-08-24). "The Case for a Logarithmic Performance Metric". https://engineering.vena.io/2016/08/24/the-case-for-a-logarithmic-performance-metric/.
- ↑ Brauen, Silvan; Erpf, Philipp; Wasem, Micha (2020). "On Absolute and Relative Change". SSRN Electronic Journal. doi:10.2139/ssrn.3739890.
References
- Bennett, Jeffrey; Briggs, William (2005), Using and Understanding Mathematics: A Quantitative Reasoning Approach (3rd ed.), Boston: Pearson, ISBN 0-321-22773-5
- "Understanding Measurement and Graphing". North Carolina State University. 2008-08-20. http://www.physics.ncsu.edu/courses/pylabs/205N_208N_MeasurementandErrors.pdf.
- "Percent Difference – Percent Error". Illinois State University, Dept of Physics. 2004-07-20. http://www.phy.ilstu.edu/slh/Percent%20Difference%20Error.pdf.
- Törnqvist, Leo; Vartia, Pentti; Vartia, Yrjö (1985), "How Should Relative Changes Be Measured?", The American Statistician 39 (1): 43–46, doi:10.2307/2683905, https://www.etla.fi/wp-content/uploads/dp681.pdf
- Tenhunen, Lauri (1990). The CES and par production techniques, income distribution and the neoclassical theory of production (PhD). A. 290. University of Tampere.
- Vartia, Yrjö O. (1976) (in en). Relative changes and index numbers. ETLA A 4. Helsinki: Research Institute of the Finnish Economy. ISBN 951-9205-24-1. https://www.etla.fi/wp-content/uploads/A4.pdf. Retrieved 20 November 2022.
 |
