Linearity of differentiation

From HandWiki
Short description: Calculus property

In calculus, the derivative of any linear combination of functions equals the same linear combination of the derivatives of the functions;[1] this property is known as linearity of differentiation, the rule of linearity,[2] or the superposition rule for differentiation.[3] It is a fundamental property of the derivative that encapsulates in a single rule two simpler rules of differentiation, the sum rule (the derivative of the sum of two functions is the sum of the derivatives) and the constant factor rule (the derivative of a constant multiple of a function is the same constant multiple of the derivative).[4][5] Thus it can be said that differentiation is linear, or the differential operator is a linear operator.[6]

Statement and derivation

Let f and g be functions, with α and β constants. Now consider

[math]\displaystyle{ \frac{\mbox{d}}{\mbox{d} x} ( \alpha \cdot f(x) + \beta \cdot g(x) ). }[/math]

By the sum rule in differentiation, this is

[math]\displaystyle{ \frac{\mbox{d}}{\mbox{d} x} ( \alpha \cdot f(x) ) + \frac{\mbox{d}}{\mbox{d} x} (\beta \cdot g(x)), }[/math]

and by the constant factor rule in differentiation, this reduces to

[math]\displaystyle{ \alpha \cdot f'(x) + \beta \cdot g'(x). }[/math]

Therefore,

[math]\displaystyle{ \frac{\mbox{d}}{\mbox{d} x}(\alpha \cdot f(x) + \beta \cdot g(x)) = \alpha \cdot f'(x) + \beta \cdot g'(x). }[/math]

Omitting the brackets, this is often written as:

[math]\displaystyle{ (\alpha \cdot f + \beta \cdot g)' = \alpha \cdot f'+ \beta \cdot g'. }[/math]

Detailed proofs/derivations from definition

We can prove the entire linearity principle at once, or, we can prove the individual steps (of constant factor and adding) individually. Here, both will be shown.

Proving linearity directly also proves the constant factor rule, the sum rule, and the difference rule as special cases. The sum rule is obtained by setting both constant coefficients to [math]\displaystyle{ 1 }[/math]. The difference rule is obtained by setting the first constant coefficient to [math]\displaystyle{ 1 }[/math] and the second constant coefficient to [math]\displaystyle{ -1 }[/math]. The constant factor rule is obtained by setting either the second constant coefficient or the second function to [math]\displaystyle{ 0 }[/math]. (From a technical standpoint, the domain of the second function must also be considered - one way to avoid issues is setting the second function equal to the first function and the second constant coefficient equal to [math]\displaystyle{ 0 }[/math]. One could also define both the second constant coefficient and the second function to be 0, where the domain of the second function is a superset of the first function, among other possibilities.)

On the contrary, if we first prove the constant factor rule and the sum rule, we can prove linearity and the difference rule. Proving linearity is done by defining the first and second functions as being two other functions being multiplied by constant coefficients. Then, as shown in the derivation from the previous section, we can first use the sum law while differentiation, and then use the constant factor rule, which will reach our conclusion for linearity. In order to prove the difference rule, the second function can be redefined as another function multiplied by the constant coefficient of [math]\displaystyle{ -1 }[/math]. This would, when simplified, give us the difference rule for differentiation.

In the proofs/derivations below,[7][8] the coefficients [math]\displaystyle{ a, b }[/math] are used; they correspond to the coefficients [math]\displaystyle{ \alpha, \beta }[/math] above.

Linearity (directly)

Let [math]\displaystyle{ a, b \in \mathbb{R} }[/math]. Let [math]\displaystyle{ f, g }[/math] be functions. Let [math]\displaystyle{ j }[/math] be a function, where [math]\displaystyle{ j }[/math] is defined only where [math]\displaystyle{ f }[/math] and [math]\displaystyle{ g }[/math] are both defined. (In other words, the domain of [math]\displaystyle{ j }[/math] is the intersection of the domains of [math]\displaystyle{ f }[/math] and [math]\displaystyle{ g }[/math].) Let [math]\displaystyle{ x }[/math] be in the domain of [math]\displaystyle{ j }[/math]. Let [math]\displaystyle{ j(x) = af(x) + bg(x) }[/math].

We want to prove that [math]\displaystyle{ j^{\prime}(x) = af^{\prime}(x) + bg^{\prime}(x) }[/math].

By definition, we can see that

[math]\displaystyle{ \begin{align} j^{\prime}(x) &= \lim_{h \rightarrow 0} \frac{j(x + h) - j(x)}{h} \\ &= \lim_{h \rightarrow 0} \frac{\left( af(x + h) + bg(x + h) \right) - \left( af(x) + bg(x) \right)}{h} \\ &= \lim_{h \rightarrow 0} \frac{af(x + h) + bg(x + h) - af(x) - bg(x)}{h} \\ &= \lim_{h \rightarrow 0} \frac{af(x + h) - af(x) + bg(x + h) - bg(x)}{h} \\ &= \lim_{h \rightarrow 0} \frac{(af(x + h) - af(x)) + (bg(x + h) - bg(x))}{h} \\ &= \lim_{h \rightarrow 0} \left( \frac{af(x + h) - af(x)}{h} + \frac{bg(x + h) - bg(x)}{h} \right) \\ &= \lim_{h \rightarrow 0} \left( \frac{a(f(x + h) - f(x))}{h} + \frac{b(g(x + h) - g(x))}{h} \right) \\ &= \lim_{h \rightarrow 0} \left( a\frac{f(x + h) - f(x)}{h} + b\frac{g(x + h) - g(x)}{h} \right) \\ \end{align} }[/math]


In order to use the limits law for the sum of limits, we need to know that [math]\displaystyle{ \lim_{h \to 0} a\frac{f(x + h) - f(x)}{h} }[/math] and [math]\displaystyle{ \lim_{h \to 0} b\frac{g(x + h) - g(x)}{h} }[/math] both individually exist. For these smaller limits, we need to know that [math]\displaystyle{ \lim_{h \to 0} \frac{f(x + h) - f(x)}{h} }[/math] and [math]\displaystyle{ \lim_{h \to 0} \frac{g(x + h) - g(x)}{h} }[/math] both individually exist to use the coefficient law for limits. By definition, [math]\displaystyle{ f^{\prime}(x) = \lim_{h \to 0} \frac{f(x + h) - f(x)}{h} }[/math] and [math]\displaystyle{ g^{\prime}(x) = \lim_{h \to 0} \frac{g(x + h) - g(x)}{h} }[/math]. So, if we know that [math]\displaystyle{ f^{\prime}(x) }[/math] and [math]\displaystyle{ g^{\prime}(x) }[/math] both exist, we will know that [math]\displaystyle{ \lim_{h \to 0} \frac{f(x + h) - f(x)}{h} }[/math] and [math]\displaystyle{ \lim_{h \to 0} \frac{g(x + h) - g(x)}{h} }[/math] both individually exist. This allows us to use the coefficient law for limits to write

[math]\displaystyle{ \lim_{h \to 0} a\frac{f(x + h) - f(x)}{h} = a\lim_{h \to 0}\frac{f(x + h) - f(x)}{h} }[/math]

and

[math]\displaystyle{ \lim_{h \to 0} b\frac{g(x + h) - g(x)}{h} = b\lim_{h \to 0}\frac{g(x + h) - g(x)}{h}. }[/math]

With this, we can go back to apply the limit law for the sum of limits, since we know that [math]\displaystyle{ \lim_{h \rightarrow 0} a\frac{f(x + h) - f(x)}{h} }[/math] and [math]\displaystyle{ \lim_{h \rightarrow 0} b\frac{g(x + h) - g(x)}{h} }[/math] both individually exist. From here, we can directly go back to the derivative we were working on.[math]\displaystyle{ \begin{align} j^{\prime}(x) &= \lim_{h \rightarrow 0} \frac{j(x + h) - j(x)}{h} \\ &\;\;\vdots \\ &= \lim_{h \rightarrow 0} \left( a\frac{f(x + h) - f(x)}{h} + b\frac{g(x + h) - g(x)}{h} \right) \\ &= \lim_{h \rightarrow 0} \left( a\frac{f(x + h) - f(x)}{h}\right) + \lim_{h \rightarrow 0} \left(b\frac{g(x + h) - g(x)}{h} \right) \\ &= a\lim_{h \rightarrow 0} \left( \frac{f(x + h) - f(x)}{h}\right) + b\lim_{h \rightarrow 0} \left(\frac{g(x + h) - g(x)}{h} \right) \\ &= af^{\prime}(x) + bg^{\prime}(x) \end{align} }[/math]Finally, we have shown what we claimed in the beginning: [math]\displaystyle{ j^{\prime}(x) = af^{\prime}(x) + bg^{\prime}(x) }[/math].

Sum

Let [math]\displaystyle{ f, g }[/math] be functions. Let [math]\displaystyle{ j }[/math] be a function, where [math]\displaystyle{ j }[/math] is defined only where [math]\displaystyle{ f }[/math] and [math]\displaystyle{ g }[/math] are both defined. (In other words, the domain of [math]\displaystyle{ j }[/math] is the intersection of the domains of [math]\displaystyle{ f }[/math] and [math]\displaystyle{ g }[/math].) Let [math]\displaystyle{ x }[/math] be in the domain of [math]\displaystyle{ j }[/math]. Let [math]\displaystyle{ j(x) = f(x) + g(x) }[/math].

We want to prove that [math]\displaystyle{ j^{\prime}(x) = f^{\prime}(x) + g^{\prime}(x) }[/math].

By definition, we can see that

[math]\displaystyle{ \begin{align} j^{\prime}(x) &= \lim_{h \rightarrow 0} \frac{j(x + h) - j(x)}{h} \\ &= \lim_{h \rightarrow 0} \frac{\left( f(x + h) + g(x + h) \right) - \left( f(x) + g(x) \right)}{h} \\ &= \lim_{h \rightarrow 0} \frac{f(x + h) + g(x + h) - f(x) - g(x)}{h} \\ &= \lim_{h \rightarrow 0} \frac{f(x + h) - f(x) + g(x + h) - g(x)}{h} \\ &= \lim_{h \rightarrow 0} \frac{(f(x + h) - f(x)) + (g(x + h) - g(x))}{h} \\ &= \lim_{h \rightarrow 0} \left( \frac{f(x + h) - f(x)}{h} + \frac{g(x + h) - g(x)}{h} \right) \\ \end{align} }[/math]In order to use the law for the sum of limits here, we need to show that the individual limits, [math]\displaystyle{ \lim_{h \rightarrow 0} \frac{f(x + h) - f(x)}{h} }[/math] and [math]\displaystyle{ \lim_{h \rightarrow 0} \frac{g(x + h) - g(x)}{h} }[/math] both exist. By definition, [math]\displaystyle{ f^{\prime}(x) = \lim_{h \rightarrow 0} \frac{f(x + h) - f(x)}{h} }[/math]and [math]\displaystyle{ g^{\prime}(x) = \lim_{h \rightarrow 0} \frac{g(x + h) - g(x)}{h} }[/math], so the limits exist whenever the derivatives [math]\displaystyle{ f^{\prime}(x) }[/math] and [math]\displaystyle{ g^{\prime}(x) }[/math] exist. So, assuming that the derivatives exist, we can continue the above derivation

[math]\displaystyle{ \begin{align} j^{\prime}(x) &= \lim_{h \rightarrow 0} \frac{j(x + h) - j(x)}{h} \\ &\;\;\vdots \\ &= \lim_{h \rightarrow 0} \left( \frac{f(x + h) - f(x)}{h} + \frac{g(x + h) - g(x)}{h} \right) \\ &= \lim_{h \rightarrow 0} \frac{f(x + h) - f(x)}{h} + \lim_{h \rightarrow 0} \frac{g(x + h) - g(x)}{h} \\ &= f^{\prime}(x) + g^{\prime}(x) \end{align} }[/math]


Thus, we have shown what we wanted to show, that: [math]\displaystyle{ j^{\prime}(x) = f^{\prime}(x) + g^{\prime}(x) }[/math].

Difference

Let [math]\displaystyle{ f, g }[/math] be functions. Let [math]\displaystyle{ j }[/math] be a function, where [math]\displaystyle{ j }[/math] is defined only where [math]\displaystyle{ f }[/math] and [math]\displaystyle{ g }[/math] are both defined. (In other words, the domain of [math]\displaystyle{ j }[/math] is the intersection of the domains of [math]\displaystyle{ f }[/math] and [math]\displaystyle{ g }[/math].) Let [math]\displaystyle{ x }[/math] be in the domain of [math]\displaystyle{ j }[/math]. Let [math]\displaystyle{ j(x) = f(x) - g(x) }[/math].

We want to prove that [math]\displaystyle{ j^{\prime}(x) = f^{\prime}(x) - g^{\prime}(x) }[/math].

By definition, we can see that: [math]\displaystyle{ \begin{align} j^{\prime}(x) &= \lim_{h \rightarrow 0} \frac{j(x + h) - j(x)}{h} \\ &= \lim_{h \rightarrow 0} \frac{\left( f(x + h) - (g(x + h) \right) - \left( f(x) - g(x) \right)}{h} \\ &= \lim_{h \rightarrow 0} \frac{f(x + h) - g(x + h) - f(x) + g(x)}{h} \\ &= \lim_{h \rightarrow 0} \frac{f(x + h) - f(x) - g(x + h) + g(x)}{h} \\ &= \lim_{h \rightarrow 0} \frac{(f(x + h) - f(x)) + (-g(x + h) + g(x))}{h} \\ &= \lim_{h \rightarrow 0} \frac{(f(x + h) - f(x)) - (g(x + h) - g(x))}{h} \\ &= \lim_{h \rightarrow 0} \left( \frac{f(x + h) - f(x)}{h} - \frac{g(x + h) - g(x)}{h} \right) \\ \end{align} }[/math]

In order to use the law for the difference of limits here, we need to show that the individual limits, [math]\displaystyle{ \lim_{h \rightarrow 0} \frac{f(x + h) - f(x)}{h} }[/math] and [math]\displaystyle{ \lim_{h \rightarrow 0} \frac{g(x + h) - g(x)}{h} }[/math] both exist. By definition, [math]\displaystyle{ f^{\prime}(x) = \lim_{h \rightarrow 0} \frac{f(x + h) - f(x)}{h} }[/math] and that [math]\displaystyle{ g^{\prime}(x) = \lim_{h \rightarrow 0} \frac{g(x + h) - g(x)}{h} }[/math], so these limits exist whenever the derivatives [math]\displaystyle{ f^{\prime}(x) }[/math] and [math]\displaystyle{ g^{\prime}(x) }[/math] exist. So, assuming that the derivatives exist, we can continue the above derivation

[math]\displaystyle{ \begin{align} j^{\prime}(x) &= \lim_{h \rightarrow 0} \frac{j(x + h) - j(x)}{h} \\ &\;\;\vdots \\ &= \lim_{h \rightarrow 0} \left( \frac{f(x + h) - f(x)}{h} - \frac{g(x + h) - g(x)}{h} \right) \\ &= \lim_{h \rightarrow 0} \frac{f(x + h) - f(x)}{h} - \lim_{h \rightarrow 0} \frac{g(x + h) - g(x)}{h} \\ &= f^{\prime}(x) - g^{\prime}(x) \end{align} }[/math]

Thus, we have shown what we wanted to show, that: [math]\displaystyle{ j^{\prime}(x) = f^{\prime}(x) - g^{\prime}(x) }[/math].

Constant coefficient

Let [math]\displaystyle{ f }[/math] be a function. Let [math]\displaystyle{ a \in \mathbb{R} }[/math]; [math]\displaystyle{ a }[/math] will be the constant coefficient. Let [math]\displaystyle{ j }[/math] be a function, where j is defined only where [math]\displaystyle{ f }[/math] is defined. (In other words, the domain of [math]\displaystyle{ j }[/math] is equal to the domain of [math]\displaystyle{ f }[/math].) Let [math]\displaystyle{ x }[/math] be in the domain of [math]\displaystyle{ j }[/math]. Let [math]\displaystyle{ j(x) = af(x) }[/math].

We want to prove that [math]\displaystyle{ j^{\prime}(x) = af^{\prime}(x) }[/math].

By definition, we can see that:

[math]\displaystyle{ \begin{align} j^{\prime}(x) &= \lim_{h \rightarrow 0} \frac{j(x + h) - j(x)}{h} \\ &= \lim_{h \rightarrow 0} \frac{af(x + h) - af(x)}{h} \\ &= \lim_{h \rightarrow 0} \frac{a\left( f(x + h) - f(x) \right)}{h} \\ &= \lim_{h \rightarrow 0} a\frac{f(x + h) - f(x)}{h} \\ \end{align} }[/math]

Now, in order to use a limit law for constant coefficients to show that

[math]\displaystyle{ \lim_{h \rightarrow 0} a\frac{f(x + h) - f(x)}{h} = a\lim_{h \rightarrow 0} \frac{f(x + h) - f(x)}{h} }[/math] we need to show that [math]\displaystyle{ \lim_{h \rightarrow 0} \frac{f(x + h) - f(x)}{h} }[/math] exists. However, [math]\displaystyle{ f^{\prime}(x) = \lim_{h \rightarrow 0} \frac{f(x + h) - f(x)}{h} }[/math], by the definition of the derivative. So, if [math]\displaystyle{ f^{\prime}(x) }[/math] exists, then [math]\displaystyle{ \lim_{h \rightarrow 0} \frac{f(x + h) - f(x)}{h} }[/math] exists.

Thus, if we assume that [math]\displaystyle{ f^{\prime}(x) }[/math] exists, we can use the limit law and continue our proof.

[math]\displaystyle{ \begin{align} j^{\prime}(x) &= \lim_{h \rightarrow 0} \frac{j(x + h) - j(x)}{h} \\ &\;\;\vdots \\ &= \lim_{h \rightarrow 0} a\frac{f(x + h) - f(x)}{h} \\ &= a\lim_{h \rightarrow 0} \frac{f(x + h) - f(x)}{h} \\ &= af^{\prime}(x) \\ \end{align} }[/math]

Thus, we have proven that when [math]\displaystyle{ j(x) = af(x) }[/math], we have [math]\displaystyle{ j^{\prime}(x) = af^{\prime}(x) }[/math].

See also

References

  1. ↑ Blank, Brian E.; Krantz, Steven George (2006), Calculus: Single Variable, Volume 1, Springer, p. 177, ISBN 9781931914598, https://books.google.com/books?id=hMY8lbX87Y8C&pg=PA177 .
  2. ↑ Strang, Gilbert (1991), Calculus, Volume 1, SIAM, pp. 71–72, ISBN 9780961408824, https://books.google.com/books?id=OisInC1zvEMC&pg=PA71 .
  3. ↑ Stroyan, K. D. (2014), Calculus Using Mathematica, Academic Press, p. 89, ISBN 9781483267975, https://books.google.com/books?id=C8DiBQAAQBAJ&pg=PA89 .
  4. ↑ Estep, Donald (2002), "20.1 Linear Combinations of Functions", Practical Analysis in One Variable, Undergraduate Texts in Mathematics, Springer, pp. 259–260, ISBN 9780387954844, https://books.google.com/books?id=trC-jTRffesC&pg=PA259 .
  5. ↑ Zorn, Paul (2010), Understanding Real Analysis, CRC Press, p. 184, ISBN 9781439894323, https://books.google.com/books?id=1WLNBQAAQBAJ&pg=PA184 .
  6. ↑ Gockenbach, Mark S. (2011), Finite-Dimensional Linear Algebra, Discrete Mathematics and Its Applications, CRC Press, p. 103, ISBN 9781439815649, https://books.google.com/books?id=xP0RFUHWQI0C&pg=PA103 .
  7. ↑ "Differentiation Rules". https://courseware.cemc.uwaterloo.ca/11/assignments/47/6. 
  8. ↑ Dawkins, Paul. "Proof Of Various Derivative Properties". https://tutorial.math.lamar.edu/Classes/CalcI/DerivativeProofs.aspx. 



Retrieved from "https://handwiki.org/wiki/index.php?title=Linearity_of_differentiation&oldid=3387852"