Taylor series

Short description: Mathematical approximation of a function

As the degree of the Taylor polynomial rises, it approaches the correct function. This image shows sin x and its Taylor approximations by polynomials of degree 1, 3, 5, 7, 9, 11, and 13 at x = 0.

In mathematics, the Taylor series or Taylor expansion of a function is an infinite sum of terms that are expressed in terms of the function's derivatives at a single point. For most common functions, the function and the sum of its Taylor series are equal near this point. Taylor series are named after Brook Taylor, who introduced them in 1715. A Taylor series is also called a Maclaurin series when 0 is the point where the derivatives are considered, after Colin Maclaurin, who made extensive use of this special case of Taylor series in the mid-18th century.

The partial sum formed by the first n + 1 terms of a Taylor series is a polynomial of degree n that is called the nth Taylor polynomial of the function. Taylor polynomials are approximations of a function, which become generally more accurate as n increases. Taylor's theorem gives quantitative estimates on the error introduced by the use of such approximations. If the Taylor series of a function is convergent, its sum is the limit of the infinite sequence of the Taylor polynomials. A function may differ from the sum of its Taylor series, even if its Taylor series is convergent. A function is analytic at a point x if it is equal to the sum of its Taylor series in some open interval (or open disk in the complex plane) containing x. This implies that the function is analytic at every point of the interval (or disk).

Definition

The Taylor series of a real or complex-valued function f (x), that is infinitely differentiable at a real or complex number a, is the power series [math]\displaystyle{ f(a) + \frac {f'(a)}{1!}(x-a) + \frac{f''(a)}{2!} (x-a)^2+\frac{f'''(a)}{3!}(x-a)^3+ \cdots = \sum_{n=0} ^ {\infty} \frac {f^{(n)}(a)}{n!} (x-a)^{n}. }[/math] Here, n! denotes the factorial of n. The function f⁽ⁿ⁾(a) denotes the nth derivative of f evaluated at the point a. The derivative of order zero of f is defined to be f itself and (x − a)⁰ and 0! are both defined to be 1. This series can be written by using sigma notation, as in the right side formula. With a = 0, the Maclaurin series takes the form: [math]\displaystyle{ f(0)+\frac {f'(0)}{1!} x+ \frac{f''(0)}{2!} x^2+\frac{f'''(0)}{3!}x^3+ \cdots = \sum_{n=0} ^ {\infty} \frac {f^{(n)}(0)}{n!} x^{n}. }[/math]

Examples

The Taylor series of any polynomial is the polynomial itself.

The Maclaurin series of 1/1 − x is the geometric series

[math]\displaystyle{ 1 + x + x^2 + x^3 + \cdots. }[/math]

So, by substituting x for 1 − x, the Taylor series of 1/x at a = 1 is

[math]\displaystyle{ 1 - (x-1) + (x-1)^2 - (x-1)^3 + \cdots. }[/math]

By integrating the above Maclaurin series, we find the Maclaurin series of ln(1 − x), where ln denotes the natural logarithm:

[math]\displaystyle{ -x - \tfrac{1}{2}x^2 - \tfrac{1}{3}x^3 - \tfrac{1}{4}x^4 - \cdots. }[/math]

The corresponding Taylor series of ln x at a = 1 is

[math]\displaystyle{ (x-1) - \tfrac{1}{2}(x-1)^2 + \tfrac{1}{3}(x-1)^3 - \tfrac{1}{4}(x-1)^4 + \cdots, }[/math]

and more generally, the corresponding Taylor series of ln x at an arbitrary nonzero point a is:

[math]\displaystyle{ \ln a + \frac{1}{a} (x - a) - \frac{1}{a^2}\frac{\left(x - a\right)^2}{2} + \cdots. }[/math]

The Maclaurin series of the exponential function e^x is

[math]\displaystyle{ \begin{align} \sum_{n=0}^\infty \frac{x^n}{n!} &= \frac{x^0}{0!} + \frac{x^1}{1!} + \frac{x^2}{2!} + \frac{x^3}{3!} + \frac{x^4}{4!} + \frac{x^5}{5!}+ \cdots \\ &= 1 + x + \frac{x^2}{2} + \frac{x^3}{6} + \frac{x^4}{24} + \frac{x^5}{120} + \cdots. \end{align} }[/math]

The above expansion holds because the derivative of e^x with respect to x is also e^x, and e⁰ equals 1. This leaves the terms (x − 0)ⁿ in the numerator and n! in the denominator of each term in the infinite sum.

History

The ancient Greek philosopher Zeno of Elea considered the problem of summing an infinite series to achieve a finite result, but rejected it as an impossibility; the result was Zeno's paradox. Later, Aristotle proposed a philosophical resolution of the paradox, but the mathematical content was apparently unresolved until taken up by Archimedes, as it had been prior to Aristotle by the Presocratic Atomist Democritus. It was through Archimedes's method of exhaustion that an infinite number of progressive subdivisions could be performed to achieve a finite result. Liu Hui independently employed a similar method a few centuries later.

In the 14th century, the earliest examples of specific Taylor series (but not the general method) were given by Madhava of Sangamagrama. Though no record of his work survives, writings of his followers in the Kerala school of astronomy and mathematics suggest that he found the Taylor series for the trigonometric functions of sine, cosine, and arctangent (see Madhava series). During the following two centuries his followers developed further series expansions and rational approximations.

In late 1670, James Gregory was shown in a letter from John Collins several Maclaurin series ([math]\displaystyle{ \sin x, }[/math] [math]\displaystyle{ \cos x, }[/math] [math]\displaystyle{ \arcsin x, }[/math] and [math]\displaystyle{ x \cot x }[/math]) derived by Isaac Newton, and told that Newton had developed a general method for expanding functions in series. Newton had in fact used a cumbersome method involving long division of series and term-by-term integration, but Gregory did not know it and set out to discover a general method for himself. In early 1671 Gregory discovered something like the general Maclaurin series and sent a letter to Collins including series for [math]\displaystyle{ \arctan x, }[/math] [math]\displaystyle{ \tan x, }[/math] [math]\displaystyle{ \sec x, }[/math] [math]\displaystyle{ \ln\, \sec x }[/math] (the integral of [math]\displaystyle{ \tan }[/math]), [math]\displaystyle{ \ln\, \tan\tfrac12{\bigl(\tfrac12\pi + x\bigr)} }[/math] (the integral of sec, the inverse Gudermannian function), [math]\displaystyle{ \arcsec \bigl(\sqrt2 e^x\bigr), }[/math] and [math]\displaystyle{ 2 \arctan e^x - \tfrac12\pi }[/math] (the Gudermannian function). However, thinking that he had merely redeveloped a method by Newton, Gregory never described how he obtained these series, and it can only be inferred that he understood the general method by examining scratch work he had scribbled on the back of another letter from 1671.

In 1691–1692, Isaac Newton wrote down an explicit statement of the Taylor and Maclaurin series in an unpublished version of his work De Quadratura Curvarum. However, this work was never completed and the relevant sections were omitted from the portions published in 1704 under the title Tractatus de Quadratura Curvarum.

It was not until 1715 that a general method for constructing these series for all functions for which they exist was finally published by Brook Taylor, after whom the series are now named.

The Maclaurin series was named after Colin Maclaurin, a professor in Edinburgh, who published the special case of the Taylor result in the mid-18th century.

Analytic functions

The function e^(−1/x2) is not analytic at x = 0: the Taylor series is identically 0, although the function is not.

If f (x) is given by a convergent power series in an open disk centred at b in the complex plane (or an interval in the real line), it is said to be analytic in this region. Thus for x in this region, f is given by a convergent power series

[math]\displaystyle{ f(x) = \sum_{n=0}^\infty a_n(x-b)^n. }[/math]

Differentiating by x the above formula n times, then setting x = b gives:

[math]\displaystyle{ \frac{f^{(n)}(b)}{n!} = a_n }[/math]

and so the power series expansion agrees with the Taylor series. Thus a function is analytic in an open disk centered at b if and only if its Taylor series converges to the value of the function at each point of the disk.

If f (x) is equal to the sum of its Taylor series for all x in the complex plane, it is called entire. The polynomials, exponential function e^x, and the trigonometric functions sine and cosine, are examples of entire functions. Examples of functions that are not entire include the square root, the logarithm, the trigonometric function tangent, and its inverse, arctan. For these functions the Taylor series do not converge if x is far from b. That is, the Taylor series diverges at x if the distance between x and b is larger than the radius of convergence. The Taylor series can be used to calculate the value of an entire function at every point, if the value of the function, and of all of its derivatives, are known at a single point.

Uses of the Taylor series for analytic functions include:

1. The partial sums (the Taylor polynomials) of the series can be used as approximations of the function. These approximations are good if sufficiently many terms are included.
2. Differentiation and integration of power series can be performed term by term and is hence particularly easy.
3. An analytic function is uniquely extended to a holomorphic function on an open disk in the complex plane. This makes the machinery of complex analysis available.
4. The (truncated) series can be used to compute function values numerically, (often by recasting the polynomial into the Chebyshev form and evaluating it with the Clenshaw algorithm).
5. Algebraic operations can be done readily on the power series representation; for instance, Euler's formula follows from Taylor series expansions for trigonometric and exponential functions. This result is of fundamental importance in such fields as harmonic analysis.
6. Approximations using the first few terms of a Taylor series can make otherwise unsolvable problems possible for a restricted domain; this approach is often used in physics.

Approximation error and convergence

The sine function (blue) is closely approximated by its Taylor polynomial of degree 7 (pink) for a full period centered at the origin.

The Taylor polynomials for ln(1 + x) only provide accurate approximations in the range −1 < x ≤ 1. For x > 1, Taylor polynomials of higher degree provide worse approximations.

The Taylor approximations for ln(1 + x) (black). For x > 1, the approximations diverge.

Pictured is an accurate approximation of sin x around the point x = 0. The pink curve is a polynomial of degree seven:

[math]\displaystyle{ \sin{x} \approx x - \frac{x^3}{3!} + \frac{x^5}{5!} - \frac{x^7}{7!}.\! }[/math]

The error in this approximation is no more than |x|⁹ / 9!. For a full cycle centered at the origin (−π < x < π) the error is less than 0.08215. In particular, for −1 < x < 1, the error is less than 0.000003.

In contrast, also shown is a picture of the natural logarithm function ln(1 + x) and some of its Taylor polynomials around a = 0. These approximations converge to the function only in the region −1 < x ≤ 1; outside of this region the higher-degree Taylor polynomials are worse approximations for the function.

The error incurred in approximating a function by its nth-degree Taylor polynomial is called the remainder or residual and is denoted by the function R_n(x). Taylor's theorem can be used to obtain a bound on the size of the remainder.

In general, Taylor series need not be convergent at all. And in fact the set of functions with a convergent Taylor series is a meager set in the Fréchet space of smooth functions. And even if the Taylor series of a function f does converge, its limit need not in general be equal to the value of the function f (x). For example, the function

[math]\displaystyle{ f(x) = \begin{cases} e^{-1/x^2} & \text{if } x \neq 0 \\[3mu] 0 & \text{if } x = 0 \end{cases} }[/math]

is infinitely differentiable at x = 0, and has all derivatives zero there. Consequently, the Taylor series of f (x) about x = 0 is identically zero. However, f (x) is not the zero function, so does not equal its Taylor series around the origin. Thus, f (x) is an example of a non-analytic smooth function.

In real analysis, this example shows that there are infinitely differentiable functions f (x) whose Taylor series are not equal to f (x) even if they converge. By contrast, the holomorphic functions studied in complex analysis always possess a convergent Taylor series, and even the Taylor series of meromorphic functions, which might have singularities, never converge to a value different from the function itself. The complex function e^−1/z2, however, does not approach 0 when z approaches 0 along the imaginary axis, so it is not continuous in the complex plane and its Taylor series is undefined at 0.

More generally, every sequence of real or complex numbers can appear as coefficients in the Taylor series of an infinitely differentiable function defined on the real line, a consequence of Borel's lemma. As a result, the radius of convergence of a Taylor series can be zero. There are even infinitely differentiable functions defined on the real line whose Taylor series have a radius of convergence 0 everywhere.

A function cannot be written as a Taylor series centred at a singularity; in these cases, one can often still achieve a series expansion if one allows also negative powers of the variable x; see Laurent series. For example, f (x) = e^−1/x2 can be written as a Laurent series.

Generalization

The generalization of the Taylor series does converge to the value of the function itself for any bounded continuous function on (0,∞), and this can be done by using the calculus of finite differences. Specifically, the following theorem, due to Einar Hille, that for any t > 0, [math]\displaystyle{ \lim_{h\to 0^+}\sum_{n=0}^\infty \frac{t^n}{n!}\frac{\Delta_h^nf(a)}{h^n} = f(a+t). }[/math] Here Δnh is the nth finite difference operator with step size h. The series is precisely the Taylor series, except that divided differences appear in place of differentiation: the series is formally similar to the Newton series. When the function f is analytic at a, the terms in the series converge to the terms of the Taylor series, and in this sense generalizes the usual Taylor series.

In general, for any infinite sequence a_i, the following power series identity holds:

[math]\displaystyle{ \sum_{n=0}^\infty\frac{u^n}{n!}\Delta^na_i = e^{-u}\sum_{j=0}^\infty\frac{u^j}{j!}a_{i+j}. }[/math]

So in particular,

[math]\displaystyle{ f(a+t) = \lim_{h\to 0^+} e^{-t/h}\sum_{j=0}^\infty f(a+jh) \frac{(t/h)^j}{j!}. }[/math]

The series on the right is the expected value of f (a + X), where X is a Poisson-distributed random variable that takes the value jh with probability e^−t/h·(t/h)^j/j!. Hence,

[math]\displaystyle{ f(a+t) = \lim_{h\to 0^+} \int_{-\infty}^\infty f(a+x)dP_{t/h,h}(x). }[/math]

The law of large numbers implies that the identity holds.

List of Maclaurin series of some common functions

Several important Maclaurin series expansions follow. All these expansions are valid for complex arguments x.

Exponential function

The exponential function e^x (in blue), and the sum of the first n + 1 terms of its Taylor series at 0 (in red).

The exponential function [math]\displaystyle{ e^x }[/math] (with base e) has Maclaurin series [math]\displaystyle{ e^{x} = \sum^{\infty}_{n=0} \frac{x^n}{n!} = 1 + x + \frac{x^2}{2!} + \frac{x^3}{3!} + \cdots. }[/math] It converges for all x.

The exponential generating function of the Bell numbers is the exponential function of the predecessor of the exponential function: [math]\displaystyle{ \exp(\exp{x}-1) = \sum_{n=0}^{\infty} \frac{B_n}{n!}x^{n} }[/math]

Natural logarithm

The natural logarithm (with base e) has Maclaurin series [math]\displaystyle{ \begin{align} \ln(1-x) &= - \sum^{\infty}_{n=1} \frac{x^n}n = -x - \frac{x^2}2 - \frac{x^3}3 - \cdots , \\ \ln(1+x) &= \sum^\infty_{n=1} (-1)^{n+1}\frac{x^n}n = x - \frac{x^2}2 + \frac{x^3}3 - \cdots . \end{align} }[/math] The last series is known as Mercator series, named after Nicholas Mercator in his Logarithmotechnia. Both of these series converge for [math]\displaystyle{ |x| \lt 1 }[/math]. (In addition, the series for ln(1 − x) converges for x = −1, and the series for ln(1 + x) converges for x = 1.)

Geometric series

The geometric series and its derivatives have Maclaurin series

[math]\displaystyle{ \begin{align} \frac{1}{1-x} &= \sum^\infty_{n=0} x^n \\ \frac{1}{(1-x)^2} &= \sum^\infty_{n=1} nx^{n-1}\\ \frac{1}{(1-x)^3} &= \sum^\infty_{n=2} \frac{(n-1)n}{2} x^{n-2}. \end{align} }[/math]

All are convergent for [math]\displaystyle{ |x| \lt 1 }[/math]. These are special cases of the binomial series given in the next section.

Binomial series

The binomial series is the power series [math]\displaystyle{ (1+x)^\alpha = \sum_{n=0}^\infty \binom{\alpha}{n} x^n }[/math] whose coefficients are the generalized binomial coefficients [math]\displaystyle{ \binom{\alpha}{n} = \prod_{k=1}^n \frac{\alpha-k+1}k = \frac{\alpha(\alpha-1)\cdots(\alpha-n+1)}{n!}. }[/math]

(If n = 0, this product is an empty product and has value 1.) It converges for [math]\displaystyle{ |x| \lt 1 }[/math] for any real or complex number α.

When α = −1, this is essentially the infinite geometric series mentioned in the previous section. The special cases α = 1/2 and α = −1/2 give the square root function and its inverse: [math]\displaystyle{ \begin{align} (1+x)^\frac{1}{2} = 1 + \frac{1}{2}x - \frac{1}{8}x^2 + \frac{1}{16}x^3 - \frac{5}{128}x^4 + \frac{7}{256}x^5 - \cdots &= \sum^{\infty}_{n=0} \frac{(-1)^{n-1}(2n)!}{4^n (n!)^2 (2n-1)} x^n, \\ (1+x)^{-\frac{1}{2}} = 1 -\frac{1}{2}x + \frac{3}{8}x^2 - \frac{5}{16}x^3 + \frac{35}{128}x^4 - \frac{63}{256}x^5 + \cdots &= \sum^{\infty}_{n=0} \frac{(-1)^n(2n)!}{4^n (n!)^2} x^n. \end{align} }[/math]

When only the linear term is retained, this simplifies to the binomial approximation.

Trigonometric functions

The usual trigonometric functions and their inverses have the following Maclaurin series:

[math]\displaystyle{ \begin{align} \sin x &= \sum^{\infty}_{n=0} \frac{(-1)^n}{(2n+1)!} x^{2n+1} &&= x - \frac{x^3}{3!} + \frac{x^5}{5!} - \cdots && \text{for all } x\\[6pt] \cos x &= \sum^{\infty}_{n=0} \frac{(-1)^n}{(2n)!} x^{2n} &&= 1 - \frac{x^2}{2!} + \frac{x^4}{4!} - \cdots && \text{for all } x\\[6pt] \tan x &= \sum^{\infty}_{n=1} \frac{B_{2n} (-4)^n \left(1-4^n\right)}{(2n)!} x^{2n-1} &&= x + \frac{x^3}{3} + \frac{2 x^5}{15} + \cdots && \text{for }|x| \lt \frac{\pi}{2}\\[6pt] \sec x &= \sum^{\infty}_{n=0} \frac{(-1)^n E_{2n}}{(2n)!} x^{2n} &&=1+\frac{x^2}{2}+\frac{5x^4}{24}+\cdots && \text{for }|x| \lt \frac{\pi}{2}\\[6pt] \arcsin x &= \sum^{\infty}_{n=0} \frac{(2n)!}{4^n (n!)^2 (2n+1)} x^{2n+1} &&=x+\frac{x^3}{6}+\frac{3x^5}{40}+\cdots && \text{for }|x| \le 1\\[6pt] \arccos x &=\frac{\pi}{2}-\arcsin x\\&=\frac{\pi}{2}- \sum^{\infty}_{n=0} \frac{(2n)!}{4^n (n!)^2 (2n+1)} x^{2n+1}&&=\frac{\pi}{2}-x-\frac{x^3}{6}-\frac{3x^5}{40}-\cdots&& \text{for }|x| \le 1\\[6pt] \arctan x &= \sum^{\infty}_{n=0} \frac{(-1)^n}{2n+1} x^{2n+1} &&=x-\frac{x^3}{3} + \frac{x^5}{5}-\cdots && \text{for }|x| \le 1,\ x\neq\pm i \end{align} }[/math]

All angles are expressed in radians. The numbers B_k appearing in the expansions of tan x are the Bernoulli numbers. The E_k in the expansion of sec x are Euler numbers.

Hyperbolic functions

The hyperbolic functions have Maclaurin series closely related to the series for the corresponding trigonometric functions:

[math]\displaystyle{ \begin{align} \sinh x &= \sum^{\infty}_{n=0} \frac{x^{2n+1}}{(2n+1)!} &&= x + \frac{x^3}{3!} + \frac{x^5}{5!} + \cdots && \text{for all } x\\[6pt] \cosh x &= \sum^{\infty}_{n=0} \frac{x^{2n}}{(2n)!} &&= 1 + \frac{x^2}{2!} + \frac{x^4}{4!} + \cdots && \text{for all } x\\[6pt] \tanh x &= \sum^{\infty}_{n=1} \frac{B_{2n} 4^n \left(4^n-1\right)}{(2n)!} x^{2n-1} &&= x-\frac{x^3}{3}+\frac{2x^5}{15}-\frac{17x^7}{315}+\cdots && \text{for }|x| \lt \frac{\pi}{2}\\[6pt] \operatorname{arsinh} x &= \sum^{\infty}_{n=0} \frac{(-1)^n (2n)!}{4^n (n!)^2 (2n+1)} x^{2n+1} &&=x - \frac{x^3}{6} + \frac{3x^5}{40} - \cdots && \text{for }|x| \le 1\\[6pt] \operatorname{artanh} x &= \sum^{\infty}_{n=0} \frac{x^{2n+1}}{2n+1} &&=x + \frac{x^3}{3} + \frac{x^5}{5} +\cdots && \text{for }|x| \le 1,\ x\neq\pm 1 \end{align} }[/math]

The numbers B_k appearing in the series for tanh x are the Bernoulli numbers.

Polylogarithmic functions

The polylogarithms have these defining identities:

[math]\displaystyle{ \text{Li}_{2}(x) = \sum_{n = 1}^{\infty} \frac{1}{n^2} x^{n} }[/math]

[math]\displaystyle{ \text{Li}_{3}(x) = \sum_{n = 1}^{\infty} \frac{1}{n^3} x^{n} }[/math]

The Legendre chi functions are defined as follows:

[math]\displaystyle{ \chi_{2}(x) = \sum_{n = 0}^{\infty} \frac{1}{(2n + 1)^2} x^{2n + 1} }[/math]

[math]\displaystyle{ \chi_{3}(x) = \sum_{n = 0}^{\infty} \frac{1}{(2n + 1)^3} x^{2n + 1} }[/math]

And the formulas presented below are called inverse tangent integrals:

[math]\displaystyle{ \text{Ti}_{2}(x) = \sum_{n = 0}^{\infty} \frac{(-1)^{n}}{(2n + 1)^2} x^{2n + 1} }[/math]

[math]\displaystyle{ \text{Ti}_{3}(x) = \sum_{n = 0}^{\infty} \frac{(-1)^{n}}{(2n + 1)^3} x^{2n + 1} }[/math]

In statistical thermodynamics these formulas are of great importance.

Elliptic functions

The complete elliptic integrals of first kind K and of second kind E can be defined as follows:

[math]\displaystyle{ \frac{2}{\pi}K(x) = \sum_{n = 0}^{\infty} \frac{[(2n)!]^2}{16^{n}(n!)^4}x^{2n} }[/math]

[math]\displaystyle{ \frac{2}{\pi}E(x) = \sum_{n = 0}^{\infty} \frac{[(2n)!]^2}{(1 - 2n)16^{n}(n!)^4}x^{2n} }[/math]

The Jacobi theta functions describe the world of the elliptic modular functions and they have these Taylor series:

[math]\displaystyle{ \vartheta_{00}(x) = 1 + 2\sum_{n = 1}^{\infty} x^{n^2} }[/math]

[math]\displaystyle{ \vartheta_{01}(x) = 1 + 2\sum_{n = 1}^{\infty} (-1)^{n} x^{n^2} }[/math]

The regular partition number sequence P(n) has this generating function:

[math]\displaystyle{ \vartheta_{00}(x)^{-1/6}\vartheta_{01}(x)^{-2/3}\biggl[\frac{\vartheta_{00}(x)^4 - \vartheta_{01}(x)^4}{16\,x}\biggr]^{-1/24} = \sum_{n=0}^{\infty} P(n)x^n = \prod_{k = 1}^{\infty} \frac{1}{1 - x^{k}} }[/math]

The strict partition number sequence Q(n) has that generating function:

[math]\displaystyle{ \vartheta_{00}(x)^{1/6}\vartheta_{01}(x)^{-1/3}\biggl[\frac{\vartheta_{00}(x)^4 - \vartheta_{01}(x)^4}{16\,x}\biggr]^{1/24} = \sum_{n=0}^{\infty} Q(n)x^n = \prod_{k = 1}^{\infty} \frac{1}{1 - x^{2k - 1}} }[/math]

Calculation of Taylor series

Several methods exist for the calculation of Taylor series of a large number of functions. One can attempt to use the definition of the Taylor series, though this often requires generalizing the form of the coefficients according to a readily apparent pattern. Alternatively, one can use manipulations such as substitution, multiplication or division, addition or subtraction of standard Taylor series to construct the Taylor series of a function, by virtue of Taylor series being power series. In some cases, one can also derive the Taylor series by repeatedly applying integration by parts. Particularly convenient is the use of computer algebra systems to calculate Taylor series.

First example

In order to compute the 7th degree Maclaurin polynomial for the function

[math]\displaystyle{ f(x)=\ln(\cos x),\quad x\in\bigl({-\tfrac\pi2}, \tfrac\pi2\bigr), }[/math]

one may first rewrite the function as

[math]\displaystyle{ f(x)={\ln}\bigl(1+(\cos x-1)\bigr), }[/math]

the composition of two functions [math]\displaystyle{ x \mapsto \ln(1 + x) }[/math] and [math]\displaystyle{ x \mapsto \cos x - 1. }[/math] The Taylor series for the natural logarithm is (using big O notation)

[math]\displaystyle{ \ln(1+x) = x - \frac{x^2}2 + \frac{x^3}3 + O{\left(x^4\right)} }[/math]

and for the cosine function

[math]\displaystyle{ \cos x - 1 = -\frac{x^2}2 + \frac{x^4}{24} - \frac{x^6}{720} + O{\left(x^8\right)}. }[/math]

The first several terms from the second series can be substituted into each term of the first series. Because the first term in the second series has degree 2, three terms of the first series suffice to give a 7th-degree polynomial:

[math]\displaystyle{ \begin{align}f(x)&=\ln\bigl(1+(\cos x-1)\bigr)\\ &=(\cos x-1) - \tfrac12(\cos x-1)^2 + \tfrac13(\cos x-1)^3+ O{\left((\cos x-1)^4\right)}\\ &=- \frac{x^2}2 - \frac{x^4}{12} - \frac{x^6}{45}+O{\left(x^8\right)}. \end{align}\! }[/math]

Since the cosine is an even function, the coefficients for all the odd powers are zero.

Second example

Suppose we want the Taylor series at 0 of the function

[math]\displaystyle{ g(x)=\frac{e^x}{\cos x}.\! }[/math]

The Taylor series for the exponential function is

[math]\displaystyle{ e^x =1 + x + \frac{x^2}{2!} + \frac{x^3}{3!} + \frac{x^4}{4!}+\cdots, }[/math]

and the series for cosine is

[math]\displaystyle{ \cos x = 1 - \frac{x^2}{2!} + \frac{x^4}{4!} - \cdots. }[/math]

Assume the series for their quotient is

[math]\displaystyle{ \frac{e^x}{\cos x} = c_0 + c_1 x + c_2 x^2 + c_3 x^3 + c_4x^4 + \cdots }[/math]

Multiplying both sides by the denominator [math]\displaystyle{ \cos x }[/math] and then expanding it as a series yields

[math]\displaystyle{ \begin{align} e^x &=\left(c_0 + c_1 x + c_2 x^2 + c_3 x^3 + c_4x^4 + \cdots\right)\left(1 - \frac{x^2}{2!} + \frac{x^4}{4!} - \cdots\right)\\[5mu] &=c_0 + c_1x + \left(c_2 - \frac{c_0}{2}\right)x^2 + \left(c_3 - \frac{c_1}{2}\right)x^3+\left(c_4-\frac{c_2}{2}+\frac{c_0}{4!}\right)x^4 + \cdots \end{align} }[/math]

Comparing the coefficients of [math]\displaystyle{ g(x)\cos x }[/math] with the coefficients of [math]\displaystyle{ e^x, }[/math]

[math]\displaystyle{ c_0 = 1,\ \ c_1 = 1,\ \ c_2 - \tfrac12 c_0 = \tfrac12,\ \ c_3 - \tfrac12 c_1 = \tfrac16,\ \ c_4 - \tfrac12 c_2 + \tfrac1{24} c_0 = \tfrac1{24},\ \ldots. }[/math]

The coefficients [math]\displaystyle{ c_i }[/math] of the series for [math]\displaystyle{ g(x) }[/math] can thus be computed one at a time, amounting to long division of the series for [math]\displaystyle{ e^x }[/math] and [math]\displaystyle{ \cos x }[/math]:

[math]\displaystyle{ \frac{e^x}{\cos x}=1 + x + x^2 + \tfrac23 x^3 + \tfrac12 x^4 + \cdots. }[/math]

Third example

Here we employ a method called "indirect expansion" to expand the given function. This method uses the known Taylor expansion of the exponential function. In order to expand (1 + x)e^x as a Taylor series in x, we use the known Taylor series of function e^x:

[math]\displaystyle{ e^x = \sum^\infty_{n=0} \frac{x^n}{n!} =1 + x + \frac{x^2}{2!} + \frac{x^3}{3!} + \frac{x^4}{4!}+\cdots. }[/math]

Thus,

[math]\displaystyle{ \begin{align}(1+x)e^x &= e^x + xe^x = \sum^\infty_{n=0} \frac{x^n}{n!} + \sum^\infty_{n=0} \frac{x^{n+1}}{n!} = 1 + \sum^\infty_{n=1} \frac{x^n}{n!} + \sum^\infty_{n=0} \frac{x^{n+1}}{n!} \\ &= 1 + \sum^\infty_{n=1} \frac{x^n}{n!} + \sum^\infty_{n=1} \frac{x^n}{(n-1)!} =1 + \sum^\infty_{n=1}\left(\frac{1}{n!} + \frac{1}{(n-1)!}\right)x^n \\ &= 1 + \sum^\infty_{n=1}\frac{n+1}{n!}x^n\\ &= \sum^\infty_{n=0}\frac{n+1}{n!}x^n.\end{align} }[/math]

Taylor series as definitions

Classically, algebraic functions are defined by an algebraic equation, and transcendental functions (including those discussed above) are defined by some property that holds for them, such as a differential equation. For example, the exponential function is the function which is equal to its own derivative everywhere, and assumes the value 1 at the origin. However, one may equally well define an analytic function by its Taylor series.

Taylor series are used to define functions and "operators" in diverse areas of mathematics. In particular, this is true in areas where the classical definitions of functions break down. For example, using Taylor series, one may extend analytic functions to sets of matrices and operators, such as the matrix exponential or matrix logarithm.

In other areas, such as formal analysis, it is more convenient to work directly with the power series themselves. Thus one may define a solution of a differential equation as a power series which, one hopes to prove, is the Taylor series of the desired solution.

Taylor series in several variables

The Taylor series may also be generalized to functions of more than one variable with

[math]\displaystyle{ \begin{align} T(x_1,\ldots,x_d) &= \sum_{n_1=0}^\infty \cdots \sum_{n_d = 0}^\infty \frac{(x_1-a_1)^{n_1}\cdots (x_d-a_d)^{n_d}}{n_1!\cdots n_d!}\,\left(\frac{\partial^{n_1 + \cdots + n_d}f}{\partial x_1^{n_1}\cdots \partial x_d^{n_d}}\right)(a_1,\ldots,a_d) \\ &= f(a_1, \ldots,a_d) + \sum_{j=1}^d \frac{\partial f(a_1, \ldots,a_d)}{\partial x_j} (x_j - a_j) + \frac{1}{2!} \sum_{j=1}^d \sum_{k=1}^d \frac{\partial^2 f(a_1, \ldots,a_d)}{\partial x_j \partial x_k} (x_j - a_j)(x_k - a_k) \\ & \qquad \qquad + \frac{1}{3!} \sum_{j=1}^d\sum_{k=1}^d\sum_{l=1}^d \frac{\partial^3 f(a_1, \ldots,a_d)}{\partial x_j \partial x_k \partial x_l} (x_j - a_j)(x_k - a_k)(x_l - a_l) + \cdots \end{align} }[/math]

For example, for a function [math]\displaystyle{ f(x,y) }[/math] that depends on two variables, x and y, the Taylor series to second order about the point (a, b) is

[math]\displaystyle{ f(a,b) +(x-a) f_x(a,b) +(y-b) f_y(a,b) + \frac{1}{2!}\Big( (x-a)^2 f_{xx}(a,b) + 2(x-a)(y-b) f_{xy}(a,b) +(y-b)^2 f_{yy}(a,b) \Big) }[/math]

where the subscripts denote the respective partial derivatives.

Second-order Taylor series in several variables

A second-order Taylor series expansion of a scalar-valued function of more than one variable can be written compactly as

[math]\displaystyle{ T(\mathbf{x}) = f(\mathbf{a}) + (\mathbf{x} - \mathbf{a})^\mathsf{T} D f(\mathbf{a}) + \frac{1}{2!} (\mathbf{x} - \mathbf{a})^\mathsf{T} \left \{D^2 f(\mathbf{a}) \right \} (\mathbf{x} - \mathbf{a}) + \cdots, }[/math]

where D f (a) is the gradient of f evaluated at x = a and D² f (a) is the Hessian matrix. Applying the multi-index notation the Taylor series for several variables becomes

[math]\displaystyle{ T(\mathbf{x}) = \sum_{|\alpha| \geq 0}\frac{(\mathbf{x}-\mathbf{a})^\alpha}{\alpha !} \left({\mathrm{\partial}^{\alpha}}f\right)(\mathbf{a}), }[/math]

which is to be understood as a still more abbreviated multi-index version of the first equation of this paragraph, with a full analogy to the single variable case.

Example

Second-order Taylor series approximation (in orange) of a function f (x,y) = e^x ln(1 + y) around the origin.

In order to compute a second-order Taylor series expansion around point (a, b) = (0, 0) of the function

[math]\displaystyle{ f(x,y)=e^x\ln(1+y), }[/math]

one first computes all the necessary partial derivatives:

[math]\displaystyle{ \begin{align} f_x &= e^x\ln(1+y) \\[6pt] f_y &= \frac{e^x}{1+y} \\[6pt] f_{xx} &= e^x\ln(1+y) \\[6pt] f_{yy} &= - \frac{e^x}{(1+y)^2} \\[6pt] f_{xy} &=f_{yx} = \frac{e^x}{1+y} . \end{align} }[/math]

Evaluating these derivatives at the origin gives the Taylor coefficients

[math]\displaystyle{ \begin{align} f_x(0,0) &= 0 \\ f_y(0,0) &=1 \\ f_{xx}(0,0) &=0 \\ f_{yy}(0,0) &=-1 \\ f_{xy}(0,0) &=f_{yx}(0,0)=1. \end{align} }[/math]

Substituting these values in to the general formula

[math]\displaystyle{ \begin{align} T(x,y) = &f(a,b) +(x-a) f_x(a,b) +(y-b) f_y(a,b) \\ &{}+\frac{1}{2!}\left( (x-a)^2f_{xx}(a,b) + 2(x-a)(y-b)f_{xy}(a,b) +(y-b)^2 f_{yy}(a,b) \right)+ \cdots \end{align} }[/math]

produces

[math]\displaystyle{ \begin{align} T(x,y) &= 0 + 0(x-0) + 1(y-0) + \frac{1}{2}\big( 0(x-0)^2 + 2(x-0)(y-0) + (-1)(y-0)^2 \big) + \cdots \\ &= y + xy - \tfrac12 y^2 + \cdots \end{align} }[/math]

Since ln(1 + y) is analytic in |y| < 1, we have

[math]\displaystyle{ e^x\ln(1+y)= y + xy - \tfrac12 y^2 + \cdots, \qquad |y| \lt 1. }[/math]

Comparison with Fourier series

The trigonometric Fourier series enables one to express a periodic function (or a function defined on a closed interval [a,b]) as an infinite sum of trigonometric functions (sines and cosines). In this sense, the Fourier series is analogous to Taylor series, since the latter allows one to express a function as an infinite sum of powers. Nevertheless, the two series differ from each other in several relevant issues:

• The finite truncations of the Taylor series of f (x) about the point x = a are all exactly equal to f at a. In contrast, the Fourier series is computed by integrating over an entire interval, so there is generally no such point where all the finite truncations of the series are exact.
• The computation of Taylor series requires the knowledge of the function on an arbitrary small neighbourhood of a point, whereas the computation of the Fourier series requires knowing the function on its whole domain interval. In a certain sense one could say that the Taylor series is "local" and the Fourier series is "global".
• The Taylor series is defined for a function which has infinitely many derivatives at a single point, whereas the Fourier series is defined for any integrable function. In particular, the function could be nowhere differentiable. (For example, f (x) could be a Weierstrass function.)
• The convergence of both series has very different properties. Even if the Taylor series has positive convergence radius, the resulting series may not coincide with the function; but if the function is analytic then the series converges pointwise to the function, and uniformly on every compact subset of the convergence interval. Concerning the Fourier series, if the function is square-integrable then the series converges in quadratic mean, but additional requirements are needed to ensure the pointwise or uniform convergence (for instance, if the function is periodic and of class C¹ then the convergence is uniform).
• Finally, in practice one wants to approximate the function with a finite number of terms, say with a Taylor polynomial or a partial sum of the trigonometric series, respectively. In the case of the Taylor series the error is very small in a neighbourhood of the point where it is computed, while it may be very large at a distant point. In the case of the Fourier series the error is distributed along the domain of the function.

See also

• Asymptotic expansion
• Generating function
• Laurent series
• Madhava series
• Newton's divided difference interpolation
• Padé approximant
• Puiseux series
• Shift operator

References

• Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables. New York: Dover Publications. 1970. Ninth printing. 
• Banner, Adrian (2007). The Calculus Lifesaver: All the Tools You Need to Excel at Calculus. Princeton University Press. ISBN 978-0-691-13088-0. https://books.google.com/books?id=OrumDwAAQBAJ. 
• Bilodeau, Gerald; Thie, Paul; Keough, G. E. (2010). An Introduction to Analysis. Jones & Bartlett Publisher. ISBN 978-0-7637-7492-9. 
• Boyer, C. (1991). A History of Mathematics (2nd ed.). John Wiley and Sons. ISBN 0-471-09763-2. https://archive.org/details/historyofmathema00boye. 
• Bruce, Ian (2007). "Methodus Incrementorum Directa & Inversa"]. http://17centurymaths.com/contents/taylorscontents.html. 
• Dani, S. G. (2012). "Ancient Indian Mathematics – A Conspectus". Resonance 17 (3): 236–246. doi:10.1007/s12045-012-0022-y. 
• Feigenbaum, L. (1985). "Brook Taylor and the method of increments". Archive for History of Exact Sciences 34 (1–2): 1–140. doi:10.1007/bf00329903. 
• An introduction to probability theory and its applications. 2 (3rd ed.). Wiley. 2003. ISBN 9789971512989. OCLC 818811840. 
• Greenberg, Michael (1998). Advanced Engineering Mathematics (2nd ed.). Prentice Hall. ISBN 0-13-321431-1. https://archive.org/details/advancedengineer0000gree. 
• Functional analysis and semi-groups. AMS Colloquium Publications. 31. American Mathematical Society. 1957. 
• Hofmann, Josef Ehrenfried (1939). "On the Discovery of the Logarithmic Series and Its Development in England up to Cotes". National Mathematics Magazine 14 (1): 33–45. doi:10.2307/3028095. 
• "1. Test Functions §1.1. A review of Differential Calculus". The analysis of partial differential operators. 1 (2nd ed.). Springer. 2002. doi:10.1007/978-3-642-61497-2_2. ISBN 978-3-642-61497-2. https://link.springer.com/chapter/10.1007/978-3-642-61497-2_2. 
• Kline, M. (1990). Mathematical Thought from Ancient to Modern Times. New York: Oxford University Press. ISBN 0-19-506135-7. https://archive.org/details/mathematicalthou00klin. 
• Kolk, Johan A.C.; Duistermaat, J.J. (2010). "Taylor Expansion in Several Variables". Distributions: Theory and applications. Birkhauser. doi:10.1007/978-0-8176-4675-2_6. ISBN 978-0-8176-4672-1. https://link.springer.com/chapter/10.1007/978-0-8176-4675-2_6. 
• Lindberg, David (2007). The Beginnings of Western Science (2nd ed.). University of Chicago Press. ISBN 978-0-226-48205-7. 
• Malet, Antoni (1993). "James Gregorie on Tangents and the "Taylor" Rule for Series Expansions". Archive for History of Exact Sciences 46 (2): 97–137. doi:10.1007/BF00375656. 
• Roy, Ranjan (1990). "The Discovery of the Series Formula for π by Leibniz, Gregory and Nilakantha". Mathematics Magazine 63 (5): 291–306. doi:10.1080/0025570X.1990.11977541. https://www.maa.org/sites/default/files/images/upload_library/22/Allendoerfer/1991/0025570x.di021167.02p0073q.pdf. 
•    (2021). Series and Products in the Development of Mathematics. 1 (2nd ed.). Cambridge University Press. 
• Real and Complex Analysis. New Delhi: McGraw-Hill. 1980. ISBN 0-07-099557-5. 
• Struik, D. J. (1969). A Source Book in Mathematics 1200–1800. Harvard University Press. ISBN 978-0-674-82355-6. https://books.google.com/books?id=XmRsZhJZGhEC&pg=PR11. 
• Taylor, Brook (1715) (in la). Methodus Incrementorum Directa et Inversa. London. https://archive.org/details/UFIE003454_TO0324_PNI-2529_000000. 
• Thomas, George B. Jr.; Finney, Ross L. (1996). Calculus and Analytic Geometry (9th ed.). Addison Wesley. ISBN 0-201-53174-7. 
• Turnbull, Herbert Westren, ed (1939). James Gregory; Tercentenary Memorial Volume. G. Bell & Sons. 

External links

• Hazewinkel, Michiel, ed. (2001), "Taylor series", Encyclopedia of Mathematics, Springer Science+Business Media B.V. / Kluwer Academic Publishers, ISBN 978-1-55608-010-4, https://www.encyclopediaofmath.org/index.php?title=p/t092320 
• Weisstein, Eric W.. "Taylor Series". http://mathworld.wolfram.com/TaylorSeries.html.